2023-10-19T08:25:38.693 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-19T08:25:38.694 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} --archive /home/teuthworker/archive/dparmar-2023-10-19_08:18:21-fs:functional-wip-63105-distro-default-smithi/7432255 --owner scheduled_dparmar@teuthology --verbose --name dparmar-2023-10-19_08:18:21-fs:functional-wip-63105-distro-default-smithi -- /home/teuthworker/archive/dparmar-2023-10-19_08:18:21-fs:functional-wip-63105-distro-default-smithi/7432255/orig.config.yaml 2023-10-19T08:25:38.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T08:25:38.848 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dparmar-2023-10-19_08:18:21-fs:functional-wip-63105-distro-default-smithi/7432255 branch: wip-63105 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} email: null first_in_suite: false job_id: '7432255' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: dparmar-2023-10-19_08:18:21-fs:functional-wip-63105-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-63105 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - but it is still running - slow request - MDS_CLIENT_LATE_RELEASE - t responding to mclientcaps - file system flag refuse_client_session is set - Degraded data redundancy - MDS_CLIENTS_LAGGY - Reduced data availability sha1: 6f3e6b48891b9b50415c0822b6b870797fcda16d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6f3e6b48891b9b50415c0822b6b870797fcda16d selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-63105 sha1: 3183a022e354f76c22fd51e4469422a5f509200d owner: scheduled_dparmar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7791 sha1: 6f3e6b48891b9b50415c0822b6b870797fcda16d sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-63105 suite_path: /home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa suite_relpath: qa suite_repo: https://github.com/dparmar18/ceph suite_sha1: 3183a022e354f76c22fd51e4469422a5f509200d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_client_recovery teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 202b180cb047e798fb131047314a862593f45403 timestamp: 2023-10-19_08:18:21 tube: smithi user: dparmar verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-19T08:25:38.849 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa; will attempt to use it 2023-10-19T08:25:38.850 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks 2023-10-19T08:25:38.851 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-19T08:25:38.865 INFO:teuthology.task.internal:Checking packages... 2023-10-19T08:25:38.897 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '6f3e6b48891b9b50415c0822b6b870797fcda16d' 2023-10-19T08:25:38.898 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-19T08:25:38.898 INFO:teuthology.packaging:ref: None 2023-10-19T08:25:38.899 INFO:teuthology.packaging:tag: None 2023-10-19T08:25:38.899 INFO:teuthology.packaging:branch: wip-63105 2023-10-19T08:25:38.899 INFO:teuthology.packaging:sha1: 6f3e6b48891b9b50415c0822b6b870797fcda16d 2023-10-19T08:25:38.900 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-63105 2023-10-19T08:25:39.068 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5610.g6f3e6b48 2023-10-19T08:25:39.069 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-19T08:25:39.076 INFO:teuthology.task.internal:no buildpackages task found 2023-10-19T08:25:39.076 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-19T08:25:39.149 INFO:teuthology.task.internal:Saving configuration 2023-10-19T08:25:39.167 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-19T08:25:39.198 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-19T08:25:39.224 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-19_08:18:21-fs:functional-wip-63105-distro-default-smithi/7432255', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 08:20:33.976341', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-19T08:25:39.248 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-19_08:18:21-fs:functional-wip-63105-distro-default-smithi/7432255', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 08:20:33.974783', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-19T08:25:39.249 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-19T08:25:39.264 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-19T08:25:39.265 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-19T08:25:39.265 INFO:teuthology.run_tasks:Running task console_log... 2023-10-19T08:25:39.350 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff0b30cdaf0>, signals=[15]) 2023-10-19T08:25:39.352 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-19T08:25:39.495 INFO:teuthology.task.internal:Opening connections... 2023-10-19T08:25:39.495 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2023-10-19T08:25:39.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:25:39.582 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2023-10-19T08:25:39.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:25:39.696 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-19T08:25:39.773 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2023-10-19T08:25:39.795 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2023-10-19T08:25:39.795 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-10-19T08:25:39.861 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux" 2023-10-19T08:25:39.861 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)" 2023-10-19T08:25:39.862 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel" 2023-10-19T08:25:39.862 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora" 2023-10-19T08:25:39.862 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6" 2023-10-19T08:25:39.862 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-10-19T08:25:39.862 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-19T08:25:39.863 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-10-19T08:25:39.863 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-19T08:25:39.863 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/" 2023-10-19T08:25:39.863 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-19T08:25:39.863 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T08:25:39.864 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:25:39.864 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T08:25:39.864 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-19T08:25:39.864 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-19T08:25:39.864 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-19T08:25:39.865 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-10-19T08:25:39.890 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-10-19T08:25:39.910 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-10-19T08:25:39.911 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-10-19T08:25:39.969 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Red Hat Enterprise Linux" 2023-10-19T08:25:39.970 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8.6 (Ootpa)" 2023-10-19T08:25:39.970 INFO:teuthology.orchestra.run.smithi089.stdout:ID="rhel" 2023-10-19T08:25:39.970 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="fedora" 2023-10-19T08:25:39.970 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8.6" 2023-10-19T08:25:39.970 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8" 2023-10-19T08:25:39.971 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-19T08:25:39.971 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2023-10-19T08:25:39.971 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-19T08:25:39.971 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.redhat.com/" 2023-10-19T08:25:39.971 INFO:teuthology.orchestra.run.smithi089.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-19T08:25:39.972 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-19T08:25:39.972 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:25:39.972 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-19T08:25:39.972 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-19T08:25:39.972 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-19T08:25:39.973 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-19T08:25:39.973 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-10-19T08:25:39.989 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-19T08:25:39.999 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-19T08:25:40.005 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-19T08:25:40.005 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2023-10-19T08:25:40.008 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2023-10-19T08:25:40.027 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-19T08:25:40.034 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-19T08:25:40.034 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2023-10-19T08:25:40.071 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2023-10-19T08:25:40.101 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-19T08:25:40.155 INFO:teuthology.run_tasks:Running task kernel... 2023-10-19T08:25:40.169 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-19T08:25:40.170 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-19T08:25:40.171 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-19T08:25:40.171 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-19T08:25:40.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T08:25:40.191 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2023-10-19T08:25:40.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T08:25:40.192 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2023-10-19T08:25:40.249 INFO:teuthology.orchestra.run.smithi089.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-19T08:25:40.250 INFO:teuthology.task.kernel:Running kernel on smithi089: 4.18.0-372.9.1.el8.x86_64 2023-10-19T08:25:40.250 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum install -y kernel 2023-10-19T08:25:40.254 INFO:teuthology.orchestra.run.smithi079.stdout:4.18.0-372.9.1.el8.x86_64 2023-10-19T08:25:40.255 INFO:teuthology.task.kernel:Running kernel on smithi079: 4.18.0-372.9.1.el8.x86_64 2023-10-19T08:25:40.255 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum install -y kernel 2023-10-19T08:25:41.449 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-10-19T08:25:41.450 INFO:teuthology.orchestra.run.smithi089.stdout:Unable to read consumer identity 2023-10-19T08:25:41.456 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2023-10-19T08:25:41.457 INFO:teuthology.orchestra.run.smithi079.stdout:Unable to read consumer identity 2023-10-19T08:25:42.904 INFO:teuthology.orchestra.run.smithi089.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-10-19T08:25:42.917 INFO:teuthology.orchestra.run.smithi079.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-10-19T08:25:43.668 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-10-19T08:25:43.697 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-10-19T08:25:47.134 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 379 kB/s | 24 kB 00:00 2023-10-19T08:25:47.214 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 360 kB/s | 24 kB 00:00 2023-10-19T08:25:47.812 INFO:teuthology.orchestra.run.smithi079.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-19T08:25:47.862 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2023-10-19T08:25:47.863 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do. 2023-10-19T08:25:47.863 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2023-10-19T08:25:47.924 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-10-19T08:25:47.973 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-10-19T08:25:47.974 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2023-10-19T08:25:47.974 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-10-19T08:25:47.983 DEBUG:teuthology.orchestra.run.smithi079:> echo no | sudo yum reinstall kernel || true 2023-10-19T08:25:48.097 DEBUG:teuthology.orchestra.run.smithi089:> echo no | sudo yum reinstall kernel || true 2023-10-19T08:25:48.311 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2023-10-19T08:25:48.311 INFO:teuthology.orchestra.run.smithi079.stdout:Unable to read consumer identity 2023-10-19T08:25:48.426 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-10-19T08:25:48.427 INFO:teuthology.orchestra.run.smithi089.stdout:Unable to read consumer identity 2023-10-19T08:25:48.573 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:01 ago on Thu 19 Oct 2023 08:25:47 AM UTC. 2023-10-19T08:25:48.618 INFO:teuthology.orchestra.run.smithi079.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-19T08:25:48.653 INFO:teuthology.orchestra.run.smithi079.stderr:Error: No packages marked for reinstall. 2023-10-19T08:25:48.690 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:01 ago on Thu 19 Oct 2023 08:25:47 AM UTC. 2023-10-19T08:25:48.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum reinstall -y kernel || true 2023-10-19T08:25:48.730 INFO:teuthology.orchestra.run.smithi089.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-19T08:25:48.763 INFO:teuthology.orchestra.run.smithi089.stderr:Error: No packages marked for reinstall. 2023-10-19T08:25:48.809 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum reinstall -y kernel || true 2023-10-19T08:25:49.027 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2023-10-19T08:25:49.027 INFO:teuthology.orchestra.run.smithi079.stdout:Unable to read consumer identity 2023-10-19T08:25:49.138 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-10-19T08:25:49.139 INFO:teuthology.orchestra.run.smithi089.stdout:Unable to read consumer identity 2023-10-19T08:25:49.281 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:00:02 ago on Thu 19 Oct 2023 08:25:47 AM UTC. 2023-10-19T08:25:49.321 INFO:teuthology.orchestra.run.smithi079.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-19T08:25:49.355 INFO:teuthology.orchestra.run.smithi079.stderr:Error: No packages marked for reinstall. 2023-10-19T08:25:49.393 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:02 ago on Thu 19 Oct 2023 08:25:47 AM UTC. 2023-10-19T08:25:49.402 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q kernel | sort -rV | head -n 1 2023-10-19T08:25:49.433 INFO:teuthology.orchestra.run.smithi089.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-10-19T08:25:49.453 INFO:teuthology.orchestra.run.smithi089.stderr:Error: No packages marked for reinstall. 2023-10-19T08:25:49.482 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-19T08:25:49.483 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-19T08:25:49.483 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-19T08:25:49.483 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-19T08:25:49.484 DEBUG:teuthology.orchestra.run.smithi079:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-19T08:25:49.504 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2023-10-19T08:25:49.516 INFO:teuthology.orchestra.run.smithi079.stdout:ttyS1 2023-10-19T08:25:49.535 DEBUG:teuthology.parallel:result is None 2023-10-19T08:25:49.585 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-10-19T08:25:49.585 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-10-19T08:25:49.585 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-10-19T08:25:49.586 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-19T08:25:49.587 DEBUG:teuthology.orchestra.run.smithi089:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-19T08:25:49.617 INFO:teuthology.orchestra.run.smithi089.stdout:ttyS1 2023-10-19T08:25:49.631 DEBUG:teuthology.parallel:result is None 2023-10-19T08:25:49.632 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-19T08:25:49.642 INFO:teuthology.task.internal:Creating test directory... 2023-10-19T08:25:49.643 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-19T08:25:49.646 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-19T08:25:49.688 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-19T08:25:49.695 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-19T08:25:49.702 INFO:teuthology.task.internal:Creating archive directory... 2023-10-19T08:25:49.703 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-19T08:25:49.706 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-19T08:25:49.751 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-19T08:25:49.761 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-19T08:25:49.762 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-19T08:25:49.768 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-19T08:25:49.812 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-19T08:25:49.815 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-19T08:25:49.822 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-19T08:25:49.825 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-19T08:25:49.827 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-19T08:25:49.834 INFO:teuthology.task.internal:Configuring sudo... 2023-10-19T08:25:49.835 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-19T08:25:49.837 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-19T08:25:49.893 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-19T08:25:49.904 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-19T08:25:49.905 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-19T08:25:49.908 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-19T08:25:49.949 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-19T08:25:50.004 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-19T08:25:50.058 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-19T08:25:50.143 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-19T08:25:50.183 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:25:50.183 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-19T08:25:50.250 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-19T08:25:50.293 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-19T08:25:50.343 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-19T08:25:50.427 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-19T08:25:50.467 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:25:50.467 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-19T08:25:50.536 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2023-10-19T08:25:50.538 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2023-10-19T08:25:50.595 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-19T08:25:50.627 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-19T08:25:50.995 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-19T08:25:51.003 INFO:teuthology.task.internal:Starting timer... 2023-10-19T08:25:51.003 INFO:teuthology.run_tasks:Running task pcp... 2023-10-19T08:25:51.015 INFO:teuthology.run_tasks:Running task selinux... 2023-10-19T08:25:51.024 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-19T08:25:51.025 DEBUG:teuthology.orchestra.run.smithi079:> sudo service auditd rotate 2023-10-19T08:25:51.089 INFO:teuthology.orchestra.run.smithi079.stdout:Rotating logs: 2023-10-19T08:25:51.091 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2023-10-19T08:25:51.149 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2023-10-19T08:25:51.151 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-19T08:25:51.151 DEBUG:teuthology.orchestra.run.smithi079:> /usr/sbin/getenforce 2023-10-19T08:25:51.174 INFO:teuthology.orchestra.run.smithi079.stdout:Permissive 2023-10-19T08:25:51.175 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2023-10-19T08:25:51.199 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2023-10-19T08:25:51.199 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi079.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi089.front.sepia.ceph.com': 'permissive'} 2023-10-19T08:25:51.200 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-19T08:25:51.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T08:25:51.241 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-19T08:25:51.267 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T08:25:51.268 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-19T08:25:51.268 DEBUG:teuthology.orchestra.run.smithi079:> sudo /usr/sbin/setenforce permissive 2023-10-19T08:25:51.308 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2023-10-19T08:25:51.334 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-19T08:25:51.345 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-19T08:25:51.345 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-19T08:25:51.361 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-19T08:25:51.362 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi079.front.sepia.ceph.com,smithi089.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-19T08:34:43.285 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi089.front.sepia.ceph.com')] 2023-10-19T08:34:43.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:34:43.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:34:43.357 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-10-19T08:34:43.424 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:34:43.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-19T08:34:43.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:34:43.492 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-10-19T08:34:43.559 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-19T08:34:43.560 INFO:teuthology.run_tasks:Running task clock... 2023-10-19T08:34:43.572 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-19T08:34:43.572 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-19T08:34:43.573 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-19T08:34:43.575 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-19T08:34:43.576 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-19T08:34:43.606 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-19T08:34:43.622 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-19T08:34:43.632 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-19T08:34:43.647 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-19T08:34:43.696 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: ntpd: command not found 2023-10-19T08:34:43.707 INFO:teuthology.orchestra.run.smithi079.stdout:506 Cannot talk to daemon 2023-10-19T08:34:43.719 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2023-10-19T08:34:43.721 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-19T08:34:43.731 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2023-10-19T08:34:43.735 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-19T08:34:43.745 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-19T08:34:43.758 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-19T08:34:43.814 INFO:teuthology.orchestra.run.smithi079.stderr:bash: ntpq: command not found 2023-10-19T08:34:43.818 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-19T08:34:43.818 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2023-10-19T08:34:43.818 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T08:34:43.818 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T08:34:43.819 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T08:34:43.819 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T08:34:43.840 INFO:teuthology.orchestra.run.smithi089.stderr:bash: ntpq: command not found 2023-10-19T08:34:43.844 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-19T08:34:43.844 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2023-10-19T08:34:43.844 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T08:34:43.844 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T08:34:43.845 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T08:34:43.845 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-19T08:34:43.846 INFO:teuthology.run_tasks:Running task install... 2023-10-19T08:34:43.854 DEBUG:teuthology.task.install:project ceph 2023-10-19T08:34:43.855 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d'}} 2023-10-19T08:34:43.855 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d'} 2023-10-19T08:34:43.856 INFO:teuthology.task.install:Using flavor: default 2023-10-19T08:34:43.893 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-19T08:34:43.894 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-19T08:34:43.894 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d', 'tag': None, 'wait_for_package': False} 2023-10-19T08:34:43.895 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=6f3e6b48891b9b50415c0822b6b870797fcda16d 2023-10-19T08:34:43.897 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d', 'tag': None, 'wait_for_package': False} 2023-10-19T08:34:43.897 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=6f3e6b48891b9b50415c0822b6b870797fcda16d 2023-10-19T08:34:44.041 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/centos/8/flavors/default/ 2023-10-19T08:34:44.041 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5610.g6f3e6b48 2023-10-19T08:34:44.112 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/centos/8/flavors/default/ 2023-10-19T08:34:44.113 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5610.g6f3e6b48 2023-10-19T08:34:44.230 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-19T08:34:44.231 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:34:44.231 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-19T08:34:44.234 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-63105/6f3e6b48891b9b50415c0822b6b870797fcda16d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-19T08:34:44.234 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:34:44.234 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-19T08:34:44.261 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-19T08:34:44.262 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6f3e6b48891b9b50415c0822b6b870797fcda16d/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-19T08:34:44.263 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-19T08:34:44.263 DEBUG:teuthology.orchestra.run.smithi079:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6f3e6b48891b9b50415c0822b6b870797fcda16d/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-19T08:34:44.329 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-19T08:34:44.331 DEBUG:teuthology.orchestra.run.smithi079:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-19T08:34:44.405 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-19T08:34:44.408 DEBUG:teuthology.orchestra.run.smithi079:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-19T08:34:44.470 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2023-10-19T08:34:44.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2023-10-19T08:34:44.473 INFO:teuthology.orchestra.run.smithi079.stdout:check_obsoletes = 1 2023-10-19T08:34:44.475 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum clean all 2023-10-19T08:34:44.841 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-10-19T08:34:44.846 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2023-10-19T08:34:45.214 INFO:teuthology.orchestra.run.smithi089.stdout:44 files removed 2023-10-19T08:34:45.232 INFO:teuthology.orchestra.run.smithi079.stdout:44 files removed 2023-10-19T08:34:45.261 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-19T08:34:45.279 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-19T08:34:45.589 INFO:teuthology.orchestra.run.smithi089.stdout:Updating Subscription Management repositories. 2023-10-19T08:34:45.609 INFO:teuthology.orchestra.run.smithi079.stdout:Updating Subscription Management repositories. 2023-10-19T08:34:46.373 INFO:teuthology.orchestra.run.smithi079.stdout:ceph packages for x86_64 251 kB/s | 81 kB 00:00 2023-10-19T08:34:46.394 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 240 kB/s | 81 kB 00:00 2023-10-19T08:34:46.674 INFO:teuthology.orchestra.run.smithi079.stdout:ceph noarch packages 35 kB/s | 9.4 kB 00:00 2023-10-19T08:34:46.703 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 34 kB/s | 9.4 kB 00:00 2023-10-19T08:34:46.970 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 6.1 kB/s | 1.5 kB 00:00 2023-10-19T08:34:46.974 INFO:teuthology.orchestra.run.smithi079.stdout:ceph source packages 5.3 kB/s | 1.5 kB 00:00 2023-10-19T08:34:47.121 INFO:teuthology.orchestra.run.smithi089.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-10-19T08:34:47.125 INFO:teuthology.orchestra.run.smithi079.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-10-19T08:34:47.772 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 25 MB/s | 16 MB 00:00 2023-10-19T08:34:48.093 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-10-19T08:34:51.273 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 540 kB/s | 24 kB 00:00 2023-10-19T08:34:51.651 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 377 kB/s | 24 kB 00:00 2023-10-19T08:34:52.157 INFO:teuthology.orchestra.run.smithi089.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 58 MB/s | 47 MB 00:00 2023-10-19T08:34:52.586 INFO:teuthology.orchestra.run.smithi079.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 55 MB/s | 47 MB 00:00 2023-10-19T08:35:00.033 INFO:teuthology.orchestra.run.smithi089.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 MB/s | 53 MB 00:00 2023-10-19T08:35:00.653 INFO:teuthology.orchestra.run.smithi079.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 MB/s | 53 MB 00:00 2023-10-19T08:35:11.108 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-19T08:35:11.109 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-19T08:35:11.123 INFO:teuthology.orchestra.run.smithi089.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-19T08:35:11.124 INFO:teuthology.orchestra.run.smithi089.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-19T08:35:11.125 INFO:teuthology.orchestra.run.smithi089.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-19T08:35:11.126 INFO:teuthology.orchestra.run.smithi089.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-19T08:35:11.128 INFO:teuthology.orchestra.run.smithi089.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-19T08:35:11.131 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-19T08:35:11.132 INFO:teuthology.orchestra.run.smithi089.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-19T08:35:11.262 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2023-10-19T08:35:11.274 INFO:teuthology.orchestra.run.smithi089.stdout:=========================================================================================================================== 2023-10-19T08:35:11.274 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2023-10-19T08:35:11.275 INFO:teuthology.orchestra.run.smithi089.stdout:=========================================================================================================================== 2023-10-19T08:35:11.275 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2023-10-19T08:35:11.275 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-19T08:35:11.275 INFO:teuthology.orchestra.run.smithi089.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-19T08:35:11.276 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 6.4 k 2023-10-19T08:35:11.276 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 5.4 M 2023-10-19T08:35:11.276 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 862 k 2023-10-19T08:35:11.276 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 167 k 2023-10-19T08:35:11.276 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 1.6 M 2023-10-19T08:35:11.277 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 131 k 2023-10-19T08:35:11.277 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 1.7 M 2023-10-19T08:35:11.277 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 7.4 M 2023-10-19T08:35:11.277 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 47 k 2023-10-19T08:35:11.277 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 14 M 2023-10-19T08:35:11.278 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 48 M 2023-10-19T08:35:11.278 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 261 k 2023-10-19T08:35:11.278 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 173 k 2023-10-19T08:35:11.278 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 260 k 2023-10-19T08:35:11.279 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 18 k 2023-10-19T08:35:11.281 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-19T08:35:11.281 INFO:teuthology.orchestra.run.smithi089.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-19T08:35:11.281 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-19T08:35:11.282 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 31 k 2023-10-19T08:35:11.282 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 783 k 2023-10-19T08:35:11.283 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 139 k 2023-10-19T08:35:11.283 INFO:teuthology.orchestra.run.smithi089.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-19T08:35:11.283 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-19T08:35:11.283 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-19T08:35:11.283 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-19T08:35:11.284 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-19T08:35:11.284 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-19T08:35:11.284 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 197 k 2023-10-19T08:35:11.284 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 370 k 2023-10-19T08:35:11.285 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 364 k 2023-10-19T08:35:11.285 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 107 k 2023-10-19T08:35:11.285 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 93 k 2023-10-19T08:35:11.285 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 3.5 M 2023-10-19T08:35:11.285 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 179 k 2023-10-19T08:35:11.286 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-19T08:35:11.286 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2023-10-19T08:35:11.286 INFO:teuthology.orchestra.run.smithi089.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-19T08:35:11.286 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 3.7 M 2023-10-19T08:35:11.287 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 3.6 M 2023-10-19T08:35:11.287 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2023-10-19T08:35:11.287 INFO:teuthology.orchestra.run.smithi089.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-19T08:35:11.287 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 22 M 2023-10-19T08:35:11.287 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 23 k 2023-10-19T08:35:11.288 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 2.3 M 2023-10-19T08:35:11.288 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 242 k 2023-10-19T08:35:11.288 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 4.6 M 2023-10-19T08:35:11.288 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 18 M 2023-10-19T08:35:11.288 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 15 k 2023-10-19T08:35:11.289 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 24 k 2023-10-19T08:35:11.289 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-19T08:35:11.289 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-19T08:35:11.289 INFO:teuthology.orchestra.run.smithi089.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-19T08:35:11.289 INFO:teuthology.orchestra.run.smithi089.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-19T08:35:11.290 INFO:teuthology.orchestra.run.smithi089.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-19T08:35:11.290 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 139 k 2023-10-19T08:35:11.290 INFO:teuthology.orchestra.run.smithi089.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-19T08:35:11.290 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-19T08:35:11.291 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-19T08:35:11.291 INFO:teuthology.orchestra.run.smithi089.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-19T08:35:11.291 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-19T08:35:11.292 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-19T08:35:11.292 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 474 k 2023-10-19T08:35:11.293 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-19T08:35:11.293 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 6.8 M 2023-10-19T08:35:11.293 INFO:teuthology.orchestra.run.smithi089.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-19T08:35:11.294 INFO:teuthology.orchestra.run.smithi089.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-19T08:35:11.294 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-19T08:35:11.294 INFO:teuthology.orchestra.run.smithi089.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-19T08:35:11.295 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-19T08:35:11.295 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-19T08:35:11.295 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-19T08:35:11.296 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-19T08:35:11.296 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-19T08:35:11.297 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-19T08:35:11.297 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-19T08:35:11.297 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-19T08:35:11.298 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-19T08:35:11.298 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-19T08:35:11.298 INFO:teuthology.orchestra.run.smithi089.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-19T08:35:11.299 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-19T08:35:11.299 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 45 k 2023-10-19T08:35:11.300 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 125 k 2023-10-19T08:35:11.300 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-19T08:35:11.300 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-19T08:35:11.301 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-19T08:35:11.301 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-19T08:35:11.301 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-19T08:35:11.302 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-19T08:35:11.302 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-19T08:35:11.303 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-19T08:35:11.303 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-19T08:35:11.303 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-19T08:35:11.304 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-19T08:35:11.304 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-19T08:35:11.305 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-19T08:35:11.305 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-19T08:35:11.305 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-19T08:35:11.306 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-19T08:35:11.306 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-19T08:35:11.307 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-19T08:35:11.307 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-19T08:35:11.307 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-19T08:35:11.308 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-19T08:35:11.308 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-19T08:35:11.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-19T08:35:11.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-19T08:35:11.309 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-19T08:35:11.310 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-19T08:35:11.310 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-19T08:35:11.311 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-19T08:35:11.311 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-19T08:35:11.311 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-19T08:35:11.312 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-19T08:35:11.312 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-19T08:35:11.313 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-19T08:35:11.313 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-19T08:35:11.313 INFO:teuthology.orchestra.run.smithi089.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-19T08:35:11.314 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-19T08:35:11.314 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-19T08:35:11.314 INFO:teuthology.orchestra.run.smithi089.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-19T08:35:11.315 INFO:teuthology.orchestra.run.smithi089.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-19T08:35:11.315 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-19T08:35:11.316 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-19T08:35:11.316 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-19T08:35:11.316 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-19T08:35:11.317 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-19T08:35:11.317 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-19T08:35:11.318 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-19T08:35:11.318 INFO:teuthology.orchestra.run.smithi089.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-19T08:35:11.318 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-19T08:35:11.319 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-19T08:35:11.319 INFO:teuthology.orchestra.run.smithi089.stdout:Enabling module streams: 2023-10-19T08:35:11.319 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql 10 2023-10-19T08:35:11.320 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:35:11.320 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2023-10-19T08:35:11.321 INFO:teuthology.orchestra.run.smithi089.stdout:=========================================================================================================================== 2023-10-19T08:35:11.321 INFO:teuthology.orchestra.run.smithi089.stdout:Install 128 Packages 2023-10-19T08:35:11.321 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 3 Packages 2023-10-19T08:35:11.322 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:35:11.323 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 206 M 2023-10-19T08:35:11.323 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2023-10-19T08:35:11.670 INFO:teuthology.orchestra.run.smithi079.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-19T08:35:11.671 INFO:teuthology.orchestra.run.smithi079.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-19T08:35:11.684 INFO:teuthology.orchestra.run.smithi079.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-10-19T08:35:11.685 INFO:teuthology.orchestra.run.smithi079.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-10-19T08:35:11.686 INFO:teuthology.orchestra.run.smithi079.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-10-19T08:35:11.688 INFO:teuthology.orchestra.run.smithi079.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-19T08:35:11.690 INFO:teuthology.orchestra.run.smithi079.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-19T08:35:11.693 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-19T08:35:11.694 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-19T08:35:11.767 INFO:teuthology.orchestra.run.smithi089.stdout:(1/131): ceph-18.0.0-5610.g6f3e6b48.el8.x86_64. 20 kB/s | 6.4 kB 00:00 2023-10-19T08:35:11.823 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2023-10-19T08:35:11.835 INFO:teuthology.orchestra.run.smithi079.stdout:=========================================================================================================================== 2023-10-19T08:35:11.835 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2023-10-19T08:35:11.836 INFO:teuthology.orchestra.run.smithi079.stdout:=========================================================================================================================== 2023-10-19T08:35:11.836 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2023-10-19T08:35:11.836 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-10-19T08:35:11.836 INFO:teuthology.orchestra.run.smithi079.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-19T08:35:11.836 INFO:teuthology.orchestra.run.smithi079.stdout: ceph x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 6.4 k 2023-10-19T08:35:11.837 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 5.4 M 2023-10-19T08:35:11.837 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 862 k 2023-10-19T08:35:11.837 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 167 k 2023-10-19T08:35:11.837 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 1.6 M 2023-10-19T08:35:11.837 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 131 k 2023-10-19T08:35:11.838 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 1.7 M 2023-10-19T08:35:11.838 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 7.4 M 2023-10-19T08:35:11.838 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 47 k 2023-10-19T08:35:11.838 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 14 M 2023-10-19T08:35:11.838 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 48 M 2023-10-19T08:35:11.839 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 261 k 2023-10-19T08:35:11.839 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 173 k 2023-10-19T08:35:11.839 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 260 k 2023-10-19T08:35:11.839 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 18 k 2023-10-19T08:35:11.839 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-10-19T08:35:11.840 INFO:teuthology.orchestra.run.smithi079.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-19T08:35:11.840 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-19T08:35:11.840 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 31 k 2023-10-19T08:35:11.840 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2 x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 783 k 2023-10-19T08:35:11.840 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 139 k 2023-10-19T08:35:11.841 INFO:teuthology.orchestra.run.smithi079.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-19T08:35:11.841 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-10-19T08:35:11.841 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-19T08:35:11.841 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-10-19T08:35:11.841 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-10-19T08:35:11.842 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-10-19T08:35:11.842 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 197 k 2023-10-19T08:35:11.842 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 370 k 2023-10-19T08:35:11.842 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 364 k 2023-10-19T08:35:11.842 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 107 k 2023-10-19T08:35:11.843 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 93 k 2023-10-19T08:35:11.843 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 3.5 M 2023-10-19T08:35:11.843 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 179 k 2023-10-19T08:35:11.843 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-10-19T08:35:11.843 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrading: 2023-10-19T08:35:11.844 INFO:teuthology.orchestra.run.smithi079.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-10-19T08:35:11.844 INFO:teuthology.orchestra.run.smithi079.stdout: librados2 x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 3.7 M 2023-10-19T08:35:11.844 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1 x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 3.6 M 2023-10-19T08:35:11.844 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2023-10-19T08:35:11.845 INFO:teuthology.orchestra.run.smithi079.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-19T08:35:11.845 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 22 M 2023-10-19T08:35:11.845 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 23 k 2023-10-19T08:35:11.845 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 2.3 M 2023-10-19T08:35:11.845 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 242 k 2023-10-19T08:35:11.846 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 4.6 M 2023-10-19T08:35:11.846 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 18 M 2023-10-19T08:35:11.846 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5610.g6f3e6b48.el8 ceph-noarch 15 k 2023-10-19T08:35:11.846 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 24 k 2023-10-19T08:35:11.847 INFO:teuthology.orchestra.run.smithi079.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-19T08:35:11.847 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-19T08:35:11.847 INFO:teuthology.orchestra.run.smithi079.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-10-19T08:35:11.847 INFO:teuthology.orchestra.run.smithi079.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-19T08:35:11.847 INFO:teuthology.orchestra.run.smithi079.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-10-19T08:35:11.848 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 139 k 2023-10-19T08:35:11.848 INFO:teuthology.orchestra.run.smithi079.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-10-19T08:35:11.848 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-10-19T08:35:11.848 INFO:teuthology.orchestra.run.smithi079.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-19T08:35:11.849 INFO:teuthology.orchestra.run.smithi079.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-10-19T08:35:11.849 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-10-19T08:35:11.849 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-19T08:35:11.849 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1 x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 474 k 2023-10-19T08:35:11.850 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-10-19T08:35:11.850 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2 x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 6.8 M 2023-10-19T08:35:11.850 INFO:teuthology.orchestra.run.smithi079.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-19T08:35:11.850 INFO:teuthology.orchestra.run.smithi079.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-10-19T08:35:11.851 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-19T08:35:11.851 INFO:teuthology.orchestra.run.smithi079.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-19T08:35:11.851 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-19T08:35:11.851 INFO:teuthology.orchestra.run.smithi079.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-19T08:35:11.852 INFO:teuthology.orchestra.run.smithi079.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-19T08:35:11.852 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-10-19T08:35:11.852 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-19T08:35:11.852 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-19T08:35:11.853 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-19T08:35:11.853 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-19T08:35:11.853 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-19T08:35:11.853 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-19T08:35:11.854 INFO:teuthology.orchestra.run.smithi079.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-19T08:35:11.854 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-19T08:35:11.854 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 45 k 2023-10-19T08:35:11.854 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common x86_64 2:18.0.0-5610.g6f3e6b48.el8 ceph 125 k 2023-10-19T08:35:11.854 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-19T08:35:11.855 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-10-19T08:35:11.855 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-19T08:35:11.855 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-19T08:35:11.855 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-19T08:35:11.856 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-19T08:35:11.856 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-19T08:35:11.856 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-19T08:35:11.856 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-19T08:35:11.857 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-19T08:35:11.857 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-19T08:35:11.857 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-19T08:35:11.857 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-19T08:35:11.857 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-19T08:35:11.858 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-19T08:35:11.858 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-19T08:35:11.858 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-19T08:35:11.858 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-19T08:35:11.858 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-19T08:35:11.859 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-19T08:35:11.859 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-19T08:35:11.859 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-19T08:35:11.859 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-19T08:35:11.859 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-19T08:35:11.860 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-10-19T08:35:11.860 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-19T08:35:11.860 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-19T08:35:11.860 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-10-19T08:35:11.861 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-19T08:35:11.861 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-19T08:35:11.861 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-19T08:35:11.861 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-19T08:35:11.861 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-19T08:35:11.862 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-10-19T08:35:11.862 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-19T08:35:11.862 INFO:teuthology.orchestra.run.smithi079.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-19T08:35:11.862 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-19T08:35:11.862 INFO:teuthology.orchestra.run.smithi079.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-19T08:35:11.863 INFO:teuthology.orchestra.run.smithi079.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-19T08:35:11.863 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-19T08:35:11.863 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-19T08:35:11.863 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-19T08:35:11.863 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-19T08:35:11.864 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-19T08:35:11.864 INFO:teuthology.orchestra.run.smithi079.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-10-19T08:35:11.864 INFO:teuthology.orchestra.run.smithi079.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-19T08:35:11.864 INFO:teuthology.orchestra.run.smithi079.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-10-19T08:35:11.864 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-19T08:35:11.865 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-19T08:35:11.865 INFO:teuthology.orchestra.run.smithi079.stdout:Enabling module streams: 2023-10-19T08:35:11.865 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql 10 2023-10-19T08:35:11.865 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:35:11.865 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2023-10-19T08:35:11.866 INFO:teuthology.orchestra.run.smithi079.stdout:=========================================================================================================================== 2023-10-19T08:35:11.866 INFO:teuthology.orchestra.run.smithi079.stdout:Install 128 Packages 2023-10-19T08:35:11.866 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrade 3 Packages 2023-10-19T08:35:11.866 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:35:11.867 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 206 M 2023-10-19T08:35:11.867 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2023-10-19T08:35:12.569 INFO:teuthology.orchestra.run.smithi079.stdout:(1/131): ceph-18.0.0-5610.g6f3e6b48.el8.x86_64. 17 kB/s | 6.4 kB 00:00 2023-10-19T08:35:12.784 INFO:teuthology.orchestra.run.smithi089.stdout:(2/131): ceph-fuse-18.0.0-5610.g6f3e6b48.el8.x8 848 kB/s | 862 kB 00:01 2023-10-19T08:35:13.034 INFO:teuthology.orchestra.run.smithi089.stdout:(3/131): ceph-immutable-object-cache-18.0.0-561 669 kB/s | 167 kB 00:00 2023-10-19T08:35:14.028 INFO:teuthology.orchestra.run.smithi079.stdout:(2/131): ceph-fuse-18.0.0-5610.g6f3e6b48.el8.x8 591 kB/s | 862 kB 00:01 2023-10-19T08:35:14.336 INFO:teuthology.orchestra.run.smithi079.stdout:(3/131): ceph-immutable-object-cache-18.0.0-561 542 kB/s | 167 kB 00:00 2023-10-19T08:35:14.942 INFO:teuthology.orchestra.run.smithi089.stdout:(4/131): ceph-base-18.0.0-5610.g6f3e6b48.el8.x8 1.5 MB/s | 5.4 MB 00:03 2023-10-19T08:35:15.417 INFO:teuthology.orchestra.run.smithi089.stdout:(5/131): ceph-mds-18.0.0-5610.g6f3e6b48.el8.x86 984 kB/s | 2.3 MB 00:02 2023-10-19T08:35:15.826 INFO:teuthology.orchestra.run.smithi089.stdout:(6/131): ceph-mgr-18.0.0-5610.g6f3e6b48.el8.x86 1.8 MB/s | 1.6 MB 00:00 2023-10-19T08:35:17.128 INFO:teuthology.orchestra.run.smithi079.stdout:(4/131): ceph-base-18.0.0-5610.g6f3e6b48.el8.x8 1.1 MB/s | 5.4 MB 00:04 2023-10-19T08:35:17.178 INFO:teuthology.orchestra.run.smithi079.stdout:(5/131): ceph-mds-18.0.0-5610.g6f3e6b48.el8.x86 825 kB/s | 2.3 MB 00:02 2023-10-19T08:35:17.811 INFO:teuthology.orchestra.run.smithi079.stdout:(6/131): ceph-common-18.0.0-5610.g6f3e6b48.el8. 4.0 MB/s | 22 MB 00:05 2023-10-19T08:35:17.976 INFO:teuthology.orchestra.run.smithi089.stdout:(7/131): ceph-common-18.0.0-5610.g6f3e6b48.el8. 3.4 MB/s | 22 MB 00:06 2023-10-19T08:35:18.029 INFO:teuthology.orchestra.run.smithi079.stdout:(7/131): ceph-mgr-18.0.0-5610.g6f3e6b48.el8.x86 1.7 MB/s | 1.6 MB 00:00 2023-10-19T08:35:18.043 INFO:teuthology.orchestra.run.smithi089.stdout:(8/131): ceph-mon-18.0.0-5610.g6f3e6b48.el8.x86 1.8 MB/s | 4.6 MB 00:02 2023-10-19T08:35:18.093 INFO:teuthology.orchestra.run.smithi089.stdout:(9/131): ceph-selinux-18.0.0-5610.g6f3e6b48.el8 489 kB/s | 24 kB 00:00 2023-10-19T08:35:20.353 INFO:teuthology.orchestra.run.smithi079.stdout:(8/131): ceph-mon-18.0.0-5610.g6f3e6b48.el8.x86 1.5 MB/s | 4.6 MB 00:03 2023-10-19T08:35:20.462 INFO:teuthology.orchestra.run.smithi079.stdout:(9/131): ceph-selinux-18.0.0-5610.g6f3e6b48.el8 225 kB/s | 24 kB 00:00 2023-10-19T08:35:20.644 INFO:teuthology.orchestra.run.smithi089.stdout:(10/131): ceph-radosgw-18.0.0-5610.g6f3e6b48.el 5.1 MB/s | 14 MB 00:02 2023-10-19T08:35:20.694 INFO:teuthology.orchestra.run.smithi089.stdout:(11/131): cephfs-mirror-18.0.0-5610.g6f3e6b48.e 5.1 MB/s | 260 kB 00:00 2023-10-19T08:35:20.744 INFO:teuthology.orchestra.run.smithi089.stdout:(12/131): libcephfs-devel-18.0.0-5610.g6f3e6b48 621 kB/s | 31 kB 00:00 2023-10-19T08:35:20.779 INFO:teuthology.orchestra.run.smithi079.stdout:(10/131): ceph-osd-18.0.0-5610.g6f3e6b48.el8.x8 6.0 MB/s | 18 MB 00:02 2023-10-19T08:35:20.854 INFO:teuthology.orchestra.run.smithi079.stdout:(11/131): cephfs-mirror-18.0.0-5610.g6f3e6b48.e 3.4 MB/s | 260 kB 00:00 2023-10-19T08:35:20.895 INFO:teuthology.orchestra.run.smithi089.stdout:(13/131): libcephfs2-18.0.0-5610.g6f3e6b48.el8. 5.1 MB/s | 783 kB 00:00 2023-10-19T08:35:20.904 INFO:teuthology.orchestra.run.smithi079.stdout:(12/131): libcephfs-devel-18.0.0-5610.g6f3e6b48 622 kB/s | 31 kB 00:00 2023-10-19T08:35:20.945 INFO:teuthology.orchestra.run.smithi089.stdout:(14/131): libcephsqlite-18.0.0-5610.g6f3e6b48.e 2.7 MB/s | 139 kB 00:00 2023-10-19T08:35:21.003 INFO:teuthology.orchestra.run.smithi089.stdout:(15/131): librados-devel-18.0.0-5610.g6f3e6b48. 2.3 MB/s | 139 kB 00:00 2023-10-19T08:35:21.021 INFO:teuthology.orchestra.run.smithi079.stdout:(13/131): libcephfs2-18.0.0-5610.g6f3e6b48.el8. 6.6 MB/s | 783 kB 00:00 2023-10-19T08:35:21.071 INFO:teuthology.orchestra.run.smithi079.stdout:(14/131): libcephsqlite-18.0.0-5610.g6f3e6b48.e 2.7 MB/s | 139 kB 00:00 2023-10-19T08:35:21.087 INFO:teuthology.orchestra.run.smithi089.stdout:(16/131): libradosstriper1-18.0.0-5610.g6f3e6b4 5.6 MB/s | 474 kB 00:00 2023-10-19T08:35:21.122 INFO:teuthology.orchestra.run.smithi079.stdout:(15/131): librados-devel-18.0.0-5610.g6f3e6b48. 2.7 MB/s | 139 kB 00:00 2023-10-19T08:35:21.222 INFO:teuthology.orchestra.run.smithi079.stdout:(16/131): libradosstriper1-18.0.0-5610.g6f3e6b4 4.6 MB/s | 474 kB 00:00 2023-10-19T08:35:21.879 INFO:teuthology.orchestra.run.smithi089.stdout:(17/131): ceph-osd-18.0.0-5610.g6f3e6b48.el8.x8 2.9 MB/s | 18 MB 00:06 2023-10-19T08:35:21.954 INFO:teuthology.orchestra.run.smithi089.stdout:(18/131): python3-ceph-argparse-18.0.0-5610.g6f 595 kB/s | 45 kB 00:00 2023-10-19T08:35:22.039 INFO:teuthology.orchestra.run.smithi079.stdout:(17/131): librgw2-18.0.0-5610.g6f3e6b48.el8.x86 8.3 MB/s | 6.8 MB 00:00 2023-10-19T08:35:22.063 INFO:teuthology.orchestra.run.smithi089.stdout:(19/131): librgw2-18.0.0-5610.g6f3e6b48.el8.x86 7.0 MB/s | 6.8 MB 00:00 2023-10-19T08:35:22.089 INFO:teuthology.orchestra.run.smithi079.stdout:(18/131): python3-ceph-argparse-18.0.0-5610.g6f 900 kB/s | 45 kB 00:00 2023-10-19T08:35:22.096 INFO:teuthology.orchestra.run.smithi089.stdout:(20/131): python3-ceph-common-18.0.0-5610.g6f3e 885 kB/s | 125 kB 00:00 2023-10-19T08:35:22.122 INFO:teuthology.orchestra.run.smithi089.stdout:(21/131): python3-cephfs-18.0.0-5610.g6f3e6b48. 3.3 MB/s | 197 kB 00:00 2023-10-19T08:35:22.131 INFO:teuthology.orchestra.run.smithi079.stdout:(19/131): python3-ceph-common-18.0.0-5610.g6f3e 2.9 MB/s | 125 kB 00:00 2023-10-19T08:35:22.190 INFO:teuthology.orchestra.run.smithi079.stdout:(20/131): python3-cephfs-18.0.0-5610.g6f3e6b48. 3.3 MB/s | 197 kB 00:00 2023-10-19T08:35:22.205 INFO:teuthology.orchestra.run.smithi089.stdout:(22/131): python3-rbd-18.0.0-5610.g6f3e6b48.el8 4.3 MB/s | 364 kB 00:00 2023-10-19T08:35:22.231 INFO:teuthology.orchestra.run.smithi089.stdout:(23/131): python3-rados-18.0.0-5610.g6f3e6b48.e 2.7 MB/s | 370 kB 00:00 2023-10-19T08:35:22.256 INFO:teuthology.orchestra.run.smithi089.stdout:(24/131): python3-rgw-18.0.0-5610.g6f3e6b48.el8 2.1 MB/s | 107 kB 00:00 2023-10-19T08:35:22.256 INFO:teuthology.orchestra.run.smithi079.stdout:(21/131): python3-rados-18.0.0-5610.g6f3e6b48.e 5.4 MB/s | 370 kB 00:00 2023-10-19T08:35:22.298 INFO:teuthology.orchestra.run.smithi089.stdout:(25/131): rbd-fuse-18.0.0-5610.g6f3e6b48.el8.x8 1.4 MB/s | 93 kB 00:00 2023-10-19T08:35:22.332 INFO:teuthology.orchestra.run.smithi079.stdout:(22/131): python3-rbd-18.0.0-5610.g6f3e6b48.el8 4.7 MB/s | 364 kB 00:00 2023-10-19T08:35:22.365 INFO:teuthology.orchestra.run.smithi089.stdout:(26/131): rbd-nbd-18.0.0-5610.g6f3e6b48.el8.x86 2.6 MB/s | 179 kB 00:00 2023-10-19T08:35:22.391 INFO:teuthology.orchestra.run.smithi079.stdout:(23/131): python3-rgw-18.0.0-5610.g6f3e6b48.el8 1.8 MB/s | 107 kB 00:00 2023-10-19T08:35:22.424 INFO:teuthology.orchestra.run.smithi089.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5610.g 395 kB/s | 23 kB 00:00 2023-10-19T08:35:22.441 INFO:teuthology.orchestra.run.smithi079.stdout:(24/131): rbd-fuse-18.0.0-5610.g6f3e6b48.el8.x8 1.8 MB/s | 93 kB 00:00 2023-10-19T08:35:22.491 INFO:teuthology.orchestra.run.smithi089.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5610.g6f3e6b4 1.9 MB/s | 131 kB 00:00 2023-10-19T08:35:22.724 INFO:teuthology.orchestra.run.smithi089.stdout:(29/131): rbd-mirror-18.0.0-5610.g6f3e6b48.el8. 7.5 MB/s | 3.5 MB 00:00 2023-10-19T08:35:22.892 INFO:teuthology.orchestra.run.smithi079.stdout:(25/131): rbd-mirror-18.0.0-5610.g6f3e6b48.el8. 7.8 MB/s | 3.5 MB 00:00 2023-10-19T08:35:22.958 INFO:teuthology.orchestra.run.smithi079.stdout:(26/131): rbd-nbd-18.0.0-5610.g6f3e6b48.el8.x86 2.6 MB/s | 179 kB 00:00 2023-10-19T08:35:22.994 INFO:teuthology.orchestra.run.smithi089.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5610.g6f3e6 3.5 MB/s | 1.7 MB 00:00 2023-10-19T08:35:23.009 INFO:teuthology.orchestra.run.smithi079.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5610.g 462 kB/s | 23 kB 00:00 2023-10-19T08:35:23.067 INFO:teuthology.orchestra.run.smithi079.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5610.g6f3e6b4 2.2 MB/s | 131 kB 00:00 2023-10-19T08:35:23.108 INFO:teuthology.orchestra.run.smithi089.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5610.g6f 2.0 MB/s | 242 kB 00:00 2023-10-19T08:35:23.184 INFO:teuthology.orchestra.run.smithi089.stdout:(32/131): ceph-mgr-rook-18.0.0-5610.g6f3e6b48.e 632 kB/s | 47 kB 00:00 2023-10-19T08:35:23.259 INFO:teuthology.orchestra.run.smithi089.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5610.g6 194 kB/s | 15 kB 00:00 2023-10-19T08:35:23.284 INFO:teuthology.orchestra.run.smithi079.stdout:(29/131): ceph-radosgw-18.0.0-5610.g6f3e6b48.el 2.6 MB/s | 14 MB 00:05 2023-10-19T08:35:23.351 INFO:teuthology.orchestra.run.smithi079.stdout:(30/131): ceph-mgr-dashboard-18.0.0-5610.g6f3e6 6.2 MB/s | 1.7 MB 00:00 2023-10-19T08:35:23.393 INFO:teuthology.orchestra.run.smithi089.stdout:(34/131): ceph-volume-18.0.0-5610.g6f3e6b48.el8 1.9 MB/s | 261 kB 00:00 2023-10-19T08:35:23.476 INFO:teuthology.orchestra.run.smithi089.stdout:(35/131): cephadm-18.0.0-5610.g6f3e6b48.el8.noa 2.0 MB/s | 173 kB 00:00 2023-10-19T08:35:23.534 INFO:teuthology.orchestra.run.smithi089.stdout:(36/131): cephfs-top-18.0.0-5610.g6f3e6b48.el8. 308 kB/s | 18 kB 00:00 2023-10-19T08:35:23.593 INFO:teuthology.orchestra.run.smithi079.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5610.g6f 1.0 MB/s | 242 kB 00:00 2023-10-19T08:35:23.635 INFO:teuthology.orchestra.run.smithi079.stdout:(32/131): ceph-mgr-rook-18.0.0-5610.g6f3e6b48.e 1.1 MB/s | 47 kB 00:00 2023-10-19T08:35:23.643 INFO:teuthology.orchestra.run.smithi089.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 8.0 MB/s | 7.4 MB 00:00 2023-10-19T08:35:23.677 INFO:teuthology.orchestra.run.smithi079.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5610.g6 350 kB/s | 15 kB 00:00 2023-10-19T08:35:23.727 INFO:teuthology.orchestra.run.smithi079.stdout:(34/131): ceph-volume-18.0.0-5610.g6f3e6b48.el8 5.1 MB/s | 261 kB 00:00 2023-10-19T08:35:23.786 INFO:teuthology.orchestra.run.smithi079.stdout:(35/131): cephadm-18.0.0-5610.g6f3e6b48.el8.noa 2.9 MB/s | 173 kB 00:00 2023-10-19T08:35:23.861 INFO:teuthology.orchestra.run.smithi079.stdout:(36/131): cephfs-top-18.0.0-5610.g6f3e6b48.el8. 239 kB/s | 18 kB 00:00 2023-10-19T08:35:23.877 INFO:teuthology.orchestra.run.smithi089.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 252 kB/s | 59 kB 00:00 2023-10-19T08:35:23.919 INFO:teuthology.orchestra.run.smithi089.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 798 kB/s | 306 kB 00:00 2023-10-19T08:35:24.236 INFO:teuthology.orchestra.run.smithi089.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 209 kB/s | 75 kB 00:00 2023-10-19T08:35:24.261 INFO:teuthology.orchestra.run.smithi089.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.4 MB/s | 476 kB 00:00 2023-10-19T08:35:24.303 INFO:teuthology.orchestra.run.smithi089.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 652 kB/s | 44 kB 00:00 2023-10-19T08:35:24.337 INFO:teuthology.orchestra.run.smithi089.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.4 MB/s | 185 kB 00:00 2023-10-19T08:35:24.396 INFO:teuthology.orchestra.run.smithi089.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 357 kB/s | 33 kB 00:00 2023-10-19T08:35:24.421 INFO:teuthology.orchestra.run.smithi089.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 194 kB/s | 16 kB 00:00 2023-10-19T08:35:24.486 INFO:teuthology.orchestra.run.smithi079.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 490 kB/s | 306 kB 00:00 2023-10-19T08:35:24.513 INFO:teuthology.orchestra.run.smithi089.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 4.1 MB/s | 384 kB 00:00 2023-10-19T08:35:24.538 INFO:teuthology.orchestra.run.smithi089.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.2 MB/s | 173 kB 00:00 2023-10-19T08:35:24.597 INFO:teuthology.orchestra.run.smithi089.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 972 kB/s | 81 kB 00:00 2023-10-19T08:35:24.611 INFO:teuthology.orchestra.run.smithi079.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 471 kB/s | 59 kB 00:00 2023-10-19T08:35:24.622 INFO:teuthology.orchestra.run.smithi089.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-10-19T08:35:24.672 INFO:teuthology.orchestra.run.smithi089.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 233 kB/s | 18 kB 00:00 2023-10-19T08:35:24.737 INFO:teuthology.orchestra.run.smithi079.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 600 kB/s | 75 kB 00:00 2023-10-19T08:35:24.748 INFO:teuthology.orchestra.run.smithi089.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 650 kB/s | 49 kB 00:00 2023-10-19T08:35:24.823 INFO:teuthology.orchestra.run.smithi089.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 785 kB/s | 59 kB 00:00 2023-10-19T08:35:24.829 INFO:teuthology.orchestra.run.smithi079.stdout:(40/131): ceph-mgr-diskprediction-local-18.0.0- 4.8 MB/s | 7.4 MB 00:01 2023-10-19T08:35:24.857 INFO:teuthology.orchestra.run.smithi089.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 5.0 MB/s | 1.2 MB 00:00 2023-10-19T08:35:24.924 INFO:teuthology.orchestra.run.smithi089.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 600 kB/s | 60 kB 00:00 2023-10-19T08:35:24.949 INFO:teuthology.orchestra.run.smithi089.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-10-19T08:35:24.962 INFO:teuthology.orchestra.run.smithi079.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-10-19T08:35:25.024 INFO:teuthology.orchestra.run.smithi089.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2023-10-19T08:35:25.058 INFO:teuthology.orchestra.run.smithi089.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 310 kB/s | 34 kB 00:00 2023-10-19T08:35:25.079 INFO:teuthology.orchestra.run.smithi079.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.6 MB/s | 185 kB 00:00 2023-10-19T08:35:25.125 INFO:teuthology.orchestra.run.smithi089.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2023-10-19T08:35:25.142 INFO:teuthology.orchestra.run.smithi089.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 768 kB/s | 64 kB 00:00 2023-10-19T08:35:25.188 INFO:teuthology.orchestra.run.smithi079.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 304 kB/s | 33 kB 00:00 2023-10-19T08:35:25.192 INFO:teuthology.orchestra.run.smithi089.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 280 kB/s | 19 kB 00:00 2023-10-19T08:35:25.217 INFO:teuthology.orchestra.run.smithi089.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 318 kB/s | 24 kB 00:00 2023-10-19T08:35:25.247 INFO:teuthology.orchestra.run.smithi079.stdout:(44/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 104 kB/s | 44 kB 00:00 2023-10-19T08:35:25.259 INFO:teuthology.orchestra.run.smithi089.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 437 kB/s | 29 kB 00:00 2023-10-19T08:35:25.285 INFO:teuthology.orchestra.run.smithi089.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 411 kB/s | 27 kB 00:00 2023-10-19T08:35:25.288 INFO:teuthology.orchestra.run.smithi079.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 163 kB/s | 16 kB 00:00 2023-10-19T08:35:25.369 INFO:teuthology.orchestra.run.smithi089.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.3 MB/s | 255 kB 00:00 2023-10-19T08:35:25.402 INFO:teuthology.orchestra.run.smithi089.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.1 MB/s | 251 kB 00:00 2023-10-19T08:35:25.430 INFO:teuthology.orchestra.run.smithi079.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.7 MB/s | 384 kB 00:00 2023-10-19T08:35:25.461 INFO:teuthology.orchestra.run.smithi089.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 668 kB/s | 61 kB 00:00 2023-10-19T08:35:25.478 INFO:teuthology.orchestra.run.smithi089.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-10-19T08:35:25.528 INFO:teuthology.orchestra.run.smithi089.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 344 kB/s | 23 kB 00:00 2023-10-19T08:35:25.539 INFO:teuthology.orchestra.run.smithi079.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 591 kB/s | 173 kB 00:00 2023-10-19T08:35:25.553 INFO:teuthology.orchestra.run.smithi089.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-10-19T08:35:25.564 INFO:teuthology.orchestra.run.smithi079.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 608 kB/s | 81 kB 00:00 2023-10-19T08:35:25.648 INFO:teuthology.orchestra.run.smithi079.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2023-10-19T08:35:25.670 INFO:teuthology.orchestra.run.smithi089.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 9.0 MB/s | 1.7 MB 00:00 2023-10-19T08:35:25.673 INFO:teuthology.orchestra.run.smithi079.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 162 kB/s | 18 kB 00:00 2023-10-19T08:35:25.729 INFO:teuthology.orchestra.run.smithi089.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.9 MB/s | 110 kB 00:00 2023-10-19T08:35:25.763 INFO:teuthology.orchestra.run.smithi089.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-10-19T08:35:25.782 INFO:teuthology.orchestra.run.smithi079.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 451 kB/s | 49 kB 00:00 2023-10-19T08:35:25.805 INFO:teuthology.orchestra.run.smithi089.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-10-19T08:35:25.847 INFO:teuthology.orchestra.run.smithi089.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-10-19T08:35:25.872 INFO:teuthology.orchestra.run.smithi089.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 1.5 MB/s | 39 kB 00:00 2023-10-19T08:35:25.890 INFO:teuthology.orchestra.run.smithi079.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 542 kB/s | 59 kB 00:00 2023-10-19T08:35:26.007 INFO:teuthology.orchestra.run.smithi079.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 3.2 MB/s | 1.2 MB 00:00 2023-10-19T08:35:26.022 INFO:teuthology.orchestra.run.smithi089.stdout:(76/131): python3-scipy-1.0.0-21.module+el8.5.0 29 MB/s | 14 MB 00:00 2023-10-19T08:35:26.033 INFO:teuthology.orchestra.run.smithi079.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 425 kB/s | 60 kB 00:00 2023-10-19T08:35:26.081 INFO:teuthology.orchestra.run.smithi089.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 3.2 MB/s | 688 kB 00:00 2023-10-19T08:35:26.123 INFO:teuthology.orchestra.run.smithi089.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 5.3 MB/s | 538 kB 00:00 2023-10-19T08:35:26.125 INFO:teuthology.orchestra.run.smithi079.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-10-19T08:35:26.148 INFO:teuthology.orchestra.run.smithi089.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-10-19T08:35:26.150 INFO:teuthology.orchestra.run.smithi079.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2023-10-19T08:35:26.173 INFO:teuthology.orchestra.run.smithi089.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-10-19T08:35:26.207 INFO:teuthology.orchestra.run.smithi089.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-10-19T08:35:26.234 INFO:teuthology.orchestra.run.smithi079.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 310 kB/s | 34 kB 00:00 2023-10-19T08:35:26.240 INFO:teuthology.orchestra.run.smithi089.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 795 kB/s | 27 kB 00:00 2023-10-19T08:35:26.259 INFO:teuthology.orchestra.run.smithi079.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-10-19T08:35:26.282 INFO:teuthology.orchestra.run.smithi089.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-10-19T08:35:26.316 INFO:teuthology.orchestra.run.smithi089.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-10-19T08:35:26.334 INFO:teuthology.orchestra.run.smithi079.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 643 kB/s | 64 kB 00:00 2023-10-19T08:35:26.360 INFO:teuthology.orchestra.run.smithi079.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 186 kB/s | 19 kB 00:00 2023-10-19T08:35:26.383 INFO:teuthology.orchestra.run.smithi089.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 23 MB/s | 4.8 MB 00:00 2023-10-19T08:35:26.425 INFO:teuthology.orchestra.run.smithi089.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-10-19T08:35:26.443 INFO:teuthology.orchestra.run.smithi079.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 220 kB/s | 24 kB 00:00 2023-10-19T08:35:26.467 INFO:teuthology.orchestra.run.smithi089.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-10-19T08:35:26.468 INFO:teuthology.orchestra.run.smithi079.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 269 kB/s | 29 kB 00:00 2023-10-19T08:35:26.526 INFO:teuthology.orchestra.run.smithi089.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 18 MB/s | 3.7 MB 00:00 2023-10-19T08:35:26.544 INFO:teuthology.orchestra.run.smithi079.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 274 kB/s | 27 kB 00:00 2023-10-19T08:35:26.586 INFO:teuthology.orchestra.run.smithi079.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.1 MB/s | 255 kB 00:00 2023-10-19T08:35:26.669 INFO:teuthology.orchestra.run.smithi079.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.0 MB/s | 251 kB 00:00 2023-10-19T08:35:26.695 INFO:teuthology.orchestra.run.smithi079.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 564 kB/s | 61 kB 00:00 2023-10-19T08:35:26.778 INFO:teuthology.orchestra.run.smithi079.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 787 kB/s | 85 kB 00:00 2023-10-19T08:35:26.795 INFO:teuthology.orchestra.run.smithi079.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 229 kB/s | 23 kB 00:00 2023-10-19T08:35:26.829 INFO:teuthology.orchestra.run.smithi079.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.0 MB/s | 70 kB 00:00 2023-10-19T08:35:26.993 INFO:teuthology.orchestra.run.smithi089.stdout:(89/131): ceph-test-18.0.0-5610.g6f3e6b48.el8.x 5.4 MB/s | 48 MB 00:08 2023-10-19T08:35:27.018 INFO:teuthology.orchestra.run.smithi089.stdout:(90/131): uuid-1.6.2-43.el8.x86_64.rpm 116 kB/s | 64 kB 00:00 2023-10-19T08:35:27.051 INFO:teuthology.orchestra.run.smithi089.stdout:(91/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 240 kB/s | 126 kB 00:00 2023-10-19T08:35:27.077 INFO:teuthology.orchestra.run.smithi089.stdout:(92/131): python3-jsonpointer-1.10-11.el8.noarc 240 kB/s | 20 kB 00:00 2023-10-19T08:35:27.102 INFO:teuthology.orchestra.run.smithi089.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.3 MB/s | 103 kB 00:00 2023-10-19T08:35:27.135 INFO:teuthology.orchestra.run.smithi089.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 8.3 MB/s | 709 kB 00:00 2023-10-19T08:35:27.146 INFO:teuthology.orchestra.run.smithi079.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 43 MB/s | 14 MB 00:00 2023-10-19T08:35:27.161 INFO:teuthology.orchestra.run.smithi089.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2023-10-19T08:35:27.188 INFO:teuthology.orchestra.run.smithi079.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 4.2 MB/s | 1.7 MB 00:00 2023-10-19T08:35:27.203 INFO:teuthology.orchestra.run.smithi089.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-19T08:35:27.213 INFO:teuthology.orchestra.run.smithi079.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-10-19T08:35:27.245 INFO:teuthology.orchestra.run.smithi089.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-10-19T08:35:27.247 INFO:teuthology.orchestra.run.smithi079.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 922 kB/s | 54 kB 00:00 2023-10-19T08:35:27.272 INFO:teuthology.orchestra.run.smithi079.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.8 MB/s | 259 kB 00:00 2023-10-19T08:35:27.297 INFO:teuthology.orchestra.run.smithi079.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-10-19T08:35:27.322 INFO:teuthology.orchestra.run.smithi079.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 774 kB/s | 39 kB 00:00 2023-10-19T08:35:27.328 INFO:teuthology.orchestra.run.smithi089.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 19 MB/s | 4.9 MB 00:00 2023-10-19T08:35:27.356 INFO:teuthology.orchestra.run.smithi079.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-10-19T08:35:27.390 INFO:teuthology.orchestra.run.smithi079.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.8 MB/s | 538 kB 00:00 2023-10-19T08:35:27.404 INFO:teuthology.orchestra.run.smithi089.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-10-19T08:35:27.415 INFO:teuthology.orchestra.run.smithi079.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-10-19T08:35:27.440 INFO:teuthology.orchestra.run.smithi079.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-10-19T08:35:27.446 INFO:teuthology.orchestra.run.smithi089.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-10-19T08:35:27.480 INFO:teuthology.orchestra.run.smithi089.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-10-19T08:35:27.482 INFO:teuthology.orchestra.run.smithi079.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-10-19T08:35:27.521 INFO:teuthology.orchestra.run.smithi089.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 13 MB/s | 1.5 MB 00:00 2023-10-19T08:35:27.524 INFO:teuthology.orchestra.run.smithi079.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 637 kB/s | 27 kB 00:00 2023-10-19T08:35:27.546 INFO:teuthology.orchestra.run.smithi089.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-10-19T08:35:27.572 INFO:teuthology.orchestra.run.smithi089.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 847 kB/s | 43 kB 00:00 2023-10-19T08:35:27.574 INFO:teuthology.orchestra.run.smithi079.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-10-19T08:35:27.597 INFO:teuthology.orchestra.run.smithi089.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-10-19T08:35:27.614 INFO:teuthology.orchestra.run.smithi089.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 1.1 MB/s | 48 kB 00:00 2023-10-19T08:35:27.660 INFO:teuthology.orchestra.run.smithi089.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.4 MB/s | 87 kB 00:00 2023-10-19T08:35:27.675 INFO:teuthology.orchestra.run.smithi079.stdout:(84/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-10-19T08:35:27.682 INFO:teuthology.orchestra.run.smithi089.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 638 kB/s | 43 kB 00:00 2023-10-19T08:35:27.700 INFO:teuthology.orchestra.run.smithi079.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 351 kB/s | 44 kB 00:00 2023-10-19T08:35:27.707 INFO:teuthology.orchestra.run.smithi089.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.3 MB/s | 109 kB 00:00 2023-10-19T08:35:27.732 INFO:teuthology.orchestra.run.smithi089.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-10-19T08:35:27.742 INFO:teuthology.orchestra.run.smithi079.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-10-19T08:35:27.784 INFO:teuthology.orchestra.run.smithi079.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-10-19T08:35:27.799 INFO:teuthology.orchestra.run.smithi089.stdout:(111/131): postgresql-server-10.21-2.module+el8 9.1 MB/s | 5.1 MB 00:00 2023-10-19T08:35:27.816 INFO:teuthology.orchestra.run.smithi089.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 224 kB/s | 19 kB 00:00 2023-10-19T08:35:27.841 INFO:teuthology.orchestra.run.smithi089.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.6 MB/s | 155 kB 00:00 2023-10-19T08:35:27.851 INFO:teuthology.orchestra.run.smithi079.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 21 MB/s | 3.7 MB 00:00 2023-10-19T08:35:27.875 INFO:teuthology.orchestra.run.smithi089.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.3 MB/s | 560 kB 00:00 2023-10-19T08:35:27.876 INFO:teuthology.orchestra.run.smithi079.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 696 kB/s | 64 kB 00:00 2023-10-19T08:35:27.900 INFO:teuthology.orchestra.run.smithi089.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 306 kB/s | 18 kB 00:00 2023-10-19T08:35:27.901 INFO:teuthology.orchestra.run.smithi079.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-10-19T08:35:27.926 INFO:teuthology.orchestra.run.smithi089.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 5.0 MB/s | 559 kB 00:00 2023-10-19T08:35:27.926 INFO:teuthology.orchestra.run.smithi079.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 399 kB/s | 20 kB 00:00 2023-10-19T08:35:27.951 INFO:teuthology.orchestra.run.smithi089.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.6 MB/s | 238 kB 00:00 2023-10-19T08:35:27.952 INFO:teuthology.orchestra.run.smithi079.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-10-19T08:35:27.984 INFO:teuthology.orchestra.run.smithi089.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2023-10-19T08:35:27.986 INFO:teuthology.orchestra.run.smithi079.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-10-19T08:35:28.009 INFO:teuthology.orchestra.run.smithi089.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.2 MB/s | 72 kB 00:00 2023-10-19T08:35:28.027 INFO:teuthology.orchestra.run.smithi079.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-10-19T08:35:28.035 INFO:teuthology.orchestra.run.smithi089.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-10-19T08:35:28.060 INFO:teuthology.orchestra.run.smithi089.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-10-19T08:35:28.085 INFO:teuthology.orchestra.run.smithi089.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-10-19T08:35:28.111 INFO:teuthology.orchestra.run.smithi089.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-10-19T08:35:28.128 INFO:teuthology.orchestra.run.smithi079.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 28 MB/s | 4.9 MB 00:00 2023-10-19T08:35:28.136 INFO:teuthology.orchestra.run.smithi089.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 769 kB/s | 39 kB 00:00 2023-10-19T08:35:28.170 INFO:teuthology.orchestra.run.smithi089.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-10-19T08:35:28.171 INFO:teuthology.orchestra.run.smithi079.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-10-19T08:35:28.195 INFO:teuthology.orchestra.run.smithi089.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-10-19T08:35:28.220 INFO:teuthology.orchestra.run.smithi089.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-10-19T08:35:28.245 INFO:teuthology.orchestra.run.smithi079.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 22 MB/s | 4.7 MB 00:00 2023-10-19T08:35:28.279 INFO:teuthology.orchestra.run.smithi079.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.2 MB/s | 354 kB 00:00 2023-10-19T08:35:28.279 INFO:teuthology.orchestra.run.smithi089.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.6 MB/s | 2.3 MB 00:00 2023-10-19T08:35:28.330 INFO:teuthology.orchestra.run.smithi089.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-10-19T08:35:28.346 INFO:teuthology.orchestra.run.smithi079.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 12 MB/s | 808 kB 00:00 2023-10-19T08:35:28.563 INFO:teuthology.orchestra.run.smithi089.stdout:(130/131): librados2-18.0.0-5610.g6f3e6b48.el8. 10 MB/s | 3.7 MB 00:00 2023-10-19T08:35:28.796 INFO:teuthology.orchestra.run.smithi079.stdout:(100/131): ceph-test-18.0.0-5610.g6f3e6b48.el8. 5.8 MB/s | 48 MB 00:08 2023-10-19T08:35:28.863 INFO:teuthology.orchestra.run.smithi079.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 2.9 MB/s | 1.5 MB 00:00 2023-10-19T08:35:28.880 INFO:teuthology.orchestra.run.smithi079.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 567 kB/s | 47 kB 00:00 2023-10-19T08:35:28.905 INFO:teuthology.orchestra.run.smithi079.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 4.7 MB/s | 200 kB 00:00 2023-10-19T08:35:28.922 INFO:teuthology.orchestra.run.smithi079.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-10-19T08:35:28.973 INFO:teuthology.orchestra.run.smithi079.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2023-10-19T08:35:29.005 INFO:teuthology.orchestra.run.smithi089.stdout:(131/131): librbd1-18.0.0-5610.g6f3e6b48.el8.x8 4.6 MB/s | 3.6 MB 00:00 2023-10-19T08:35:29.007 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2023-10-19T08:35:29.008 INFO:teuthology.orchestra.run.smithi089.stdout:Total 12 MB/s | 206 MB 00:17 2023-10-19T08:35:29.056 INFO:teuthology.orchestra.run.smithi079.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 360 kB/s | 48 kB 00:00 2023-10-19T08:35:29.290 INFO:teuthology.orchestra.run.smithi079.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 274 kB/s | 87 kB 00:00 2023-10-19T08:35:29.307 INFO:teuthology.orchestra.run.smithi079.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 170 kB/s | 43 kB 00:00 2023-10-19T08:35:29.341 INFO:teuthology.orchestra.run.smithi079.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-10-19T08:35:29.365 INFO:teuthology.orchestra.run.smithi079.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2023-10-19T08:35:29.433 INFO:teuthology.orchestra.run.smithi079.stdout:(111/131): postgresql-server-10.21-2.module+el8 4.3 MB/s | 5.1 MB 00:01 2023-10-19T08:35:29.449 INFO:teuthology.orchestra.run.smithi079.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 224 kB/s | 19 kB 00:00 2023-10-19T08:35:29.475 INFO:teuthology.orchestra.run.smithi079.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.6 MB/s | 155 kB 00:00 2023-10-19T08:35:29.509 INFO:teuthology.orchestra.run.smithi079.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.3 MB/s | 560 kB 00:00 2023-10-19T08:35:29.525 INFO:teuthology.orchestra.run.smithi079.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 357 kB/s | 18 kB 00:00 2023-10-19T08:35:29.567 INFO:teuthology.orchestra.run.smithi079.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 4.7 MB/s | 559 kB 00:00 2023-10-19T08:35:29.609 INFO:teuthology.orchestra.run.smithi079.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.8 MB/s | 238 kB 00:00 2023-10-19T08:35:29.634 INFO:teuthology.orchestra.run.smithi079.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2023-10-19T08:35:29.660 INFO:teuthology.orchestra.run.smithi079.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-10-19T08:35:29.677 INFO:teuthology.orchestra.run.smithi079.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-10-19T08:35:29.702 INFO:teuthology.orchestra.run.smithi079.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.4 MB/s | 60 kB 00:00 2023-10-19T08:35:29.719 INFO:teuthology.orchestra.run.smithi079.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 2.3 MB/s | 98 kB 00:00 2023-10-19T08:35:29.745 INFO:teuthology.orchestra.run.smithi079.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.3 MB/s | 58 kB 00:00 2023-10-19T08:35:29.770 INFO:teuthology.orchestra.run.smithi079.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 767 kB/s | 39 kB 00:00 2023-10-19T08:35:29.803 INFO:teuthology.orchestra.run.smithi079.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-10-19T08:35:29.829 INFO:teuthology.orchestra.run.smithi079.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-10-19T08:35:29.835 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2023-10-19T08:35:29.862 INFO:teuthology.orchestra.run.smithi079.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.3 MB/s | 138 kB 00:00 2023-10-19T08:35:29.913 INFO:teuthology.orchestra.run.smithi079.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.7 MB/s | 2.3 MB 00:00 2023-10-19T08:35:29.954 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2023-10-19T08:35:29.954 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2023-10-19T08:35:29.963 INFO:teuthology.orchestra.run.smithi079.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-10-19T08:35:30.305 INFO:teuthology.orchestra.run.smithi079.stdout:(130/131): librados2-18.0.0-5610.g6f3e6b48.el8. 7.8 MB/s | 3.7 MB 00:00 2023-10-19T08:35:30.572 INFO:teuthology.orchestra.run.smithi079.stdout:(131/131): librbd1-18.0.0-5610.g6f3e6b48.el8.x8 5.1 MB/s | 3.6 MB 00:00 2023-10-19T08:35:30.575 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2023-10-19T08:35:30.575 INFO:teuthology.orchestra.run.smithi079.stdout:Total 11 MB/s | 206 MB 00:18 2023-10-19T08:35:31.075 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2023-10-19T08:35:31.079 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2023-10-19T08:35:31.397 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2023-10-19T08:35:31.515 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2023-10-19T08:35:31.516 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2023-10-19T08:35:32.635 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2023-10-19T08:35:32.639 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2023-10-19T08:35:35.924 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2023-10-19T08:35:36.087 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-19T08:35:36.285 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-19T08:35:36.471 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-19T08:35:36.640 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-19T08:35:36.770 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-19T08:35:37.031 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-19T08:35:37.417 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-19T08:35:37.629 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2023-10-19T08:35:37.682 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 6/134 2023-10-19T08:35:37.821 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-10-19T08:35:38.015 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-10-19T08:35:38.066 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 6/134 2023-10-19T08:35:38.238 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-10-19T08:35:38.298 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:18.0.0-5610.g6f3e6b48.el8.x86_64 7/134 2023-10-19T08:35:38.422 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-19T08:35:38.424 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:18.0.0-5610.g6f3e6b48.el8.x86_64 7/134 2023-10-19T08:35:38.526 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-10-19T08:35:38.598 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 8/134 2023-10-19T08:35:38.699 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 8/134 2023-10-19T08:35:38.761 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-19T08:35:38.889 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:18.0.0-5610.g6f3e6b48.el8.x86_64 9/134 2023-10-19T08:35:39.134 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-19T08:35:39.160 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-10-19T08:35:39.350 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-19T08:35:39.394 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librados2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 6/134 2023-10-19T08:35:39.756 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-19T08:35:39.790 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 6/134 2023-10-19T08:35:39.984 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-19T08:35:40.155 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:18.0.0-5610.g6f3e6b48.el8.x86_64 14/134 2023-10-19T08:35:40.160 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librbd1-2:18.0.0-5610.g6f3e6b48.el8.x86_64 7/134 2023-10-19T08:35:40.242 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5610.g6f3e6b48.el8.x86_64 14/134 2023-10-19T08:35:40.289 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:18.0.0-5610.g6f3e6b48.el8.x86_64 7/134 2023-10-19T08:35:40.527 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 8/134 2023-10-19T08:35:40.610 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephfs2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 8/134 2023-10-19T08:35:40.647 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:18.0.0-5610.g6f3e6b48.el8.x86 15/134 2023-10-19T08:35:40.731 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5610.g6f3e6b48.el8.x86 15/134 2023-10-19T08:35:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rados-2:18.0.0-5610.g6f3e6b48.el8.x86_64 9/134 2023-10-19T08:35:40.864 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-19T08:35:41.003 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-19T08:35:41.080 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-10-19T08:35:41.156 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-19T08:35:41.346 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-10-19T08:35:41.740 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-10-19T08:35:41.774 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-19T08:35:41.964 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-19T08:35:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-10-19T08:35:42.151 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephsqlite-2:18.0.0-5610.g6f3e6b48.el8.x86_64 14/134 2023-10-19T08:35:42.257 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5610.g6f3e6b48.el8.x86_64 14/134 2023-10-19T08:35:42.468 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libradosstriper1-2:18.0.0-5610.g6f3e6b48.el8.x86 15/134 2023-10-19T08:35:42.556 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5610.g6f3e6b48.el8.x86 15/134 2023-10-19T08:35:42.562 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-19T08:35:42.685 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-19T08:35:42.747 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-19T08:35:42.808 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-10-19T08:35:42.968 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-19T08:35:43.468 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-19T08:35:43.622 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-10-19T08:35:43.732 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-19T08:35:43.801 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-19T08:35:43.948 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-19T08:35:44.176 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-19T08:35:44.353 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-19T08:35:44.379 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-10-19T08:35:44.551 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-10-19T08:35:44.561 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-19T08:35:44.823 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-19T08:35:45.020 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:18.0.0-5610.g6f3e6b48.el8. 26/134 2023-10-19T08:35:45.157 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:18.0.0-5610.g6f3e6b48.el 27/134 2023-10-19T08:35:45.237 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-10-19T08:35:45.497 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-10-19T08:35:45.708 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-10-19T08:35:45.921 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-10-19T08:35:46.082 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:18.0.0-5610.g6f3e6b48.el8.x86_6 28/134 2023-10-19T08:35:46.098 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-10-19T08:35:46.297 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-10-19T08:35:46.411 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-19T08:35:46.510 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-10-19T08:35:46.665 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-19T08:35:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-common-2:18.0.0-5610.g6f3e6b48.el8. 26/134 2023-10-19T08:35:46.786 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-argparse-2:18.0.0-5610.g6f3e6b48.el 27/134 2023-10-19T08:35:46.948 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-19T08:35:47.146 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-19T08:35:47.727 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cephfs-2:18.0.0-5610.g6f3e6b48.el8.x86_6 28/134 2023-10-19T08:35:48.038 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-10-19T08:35:48.327 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-10-19T08:35:48.557 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-10-19T08:35:48.742 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-19T08:35:48.911 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-19T08:35:49.213 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-19T08:35:49.421 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-19T08:35:49.623 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-19T08:35:49.811 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 36/134 2023-10-19T08:35:49.974 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:18.0.0-5610.g6f3e6b48.el8.x86_6 37/134 2023-10-19T08:35:50.127 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-19T08:35:50.339 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-19T08:35:50.501 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-10-19T08:35:50.565 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-19T08:35:50.724 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-19T08:35:50.850 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-10-19T08:35:50.952 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-19T08:35:51.061 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-10-19T08:35:51.144 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-19T08:35:51.268 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-10-19T08:35:51.505 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rbd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 36/134 2023-10-19T08:35:51.518 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-19T08:35:51.680 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librados-devel-2:18.0.0-5610.g6f3e6b48.el8.x86_6 37/134 2023-10-19T08:35:51.807 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-19T08:35:51.843 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-10-19T08:35:51.989 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-19T08:35:52.026 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-10-19T08:35:52.199 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-19T08:35:52.243 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-10-19T08:35:52.378 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-10-19T08:35:52.450 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-19T08:35:52.581 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-10-19T08:35:52.752 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-19T08:35:52.821 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-10-19T08:35:53.003 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-19T08:35:53.184 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-10-19T08:35:53.212 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-19T08:35:53.429 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-19T08:35:53.494 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-10-19T08:35:53.611 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-19T08:35:53.709 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-10-19T08:35:53.796 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-19T08:35:53.935 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-10-19T08:35:54.120 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-19T08:35:54.203 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-10-19T08:35:54.358 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-19T08:35:54.523 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-10-19T08:35:54.633 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-19T08:35:54.782 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-10-19T08:35:54.868 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-19T08:35:54.975 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-10-19T08:35:55.052 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-19T08:35:55.202 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-10-19T08:35:55.238 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-19T08:35:55.412 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-19T08:35:55.420 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-10-19T08:35:55.464 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-19T08:35:55.602 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-10-19T08:35:55.689 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-19T08:35:55.900 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-10-19T08:35:55.915 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-19T08:35:56.078 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-19T08:35:56.159 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-19T08:35:56.170 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-10-19T08:35:56.374 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-19T08:35:56.394 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-10-19T08:35:56.537 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-19T08:35:56.647 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-10-19T08:35:56.736 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-19T08:35:56.814 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-10-19T08:35:56.897 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-19T08:35:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-10-19T08:35:57.181 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-10-19T08:35:57.196 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-19T08:35:57.255 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-10-19T08:35:57.443 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-19T08:35:57.494 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-10-19T08:35:57.599 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-19T08:35:57.685 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-10-19T08:35:57.739 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-19T08:35:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-19T08:35:57.913 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-19T08:35:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-10-19T08:35:58.152 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-10-19T08:35:58.158 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-19T08:35:58.307 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-10-19T08:35:58.341 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-19T08:35:58.489 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-19T08:35:58.498 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-10-19T08:35:58.626 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-19T08:35:58.677 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-10-19T08:35:58.850 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-19T08:35:58.962 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-10-19T08:35:59.074 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-19T08:35:59.214 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-10-19T08:35:59.259 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-19T08:35:59.377 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-10-19T08:35:59.509 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-19T08:35:59.543 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-10-19T08:35:59.741 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-10-19T08:35:59.743 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-19T08:35:59.919 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-19T08:35:59.953 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-10-19T08:36:00.128 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-19T08:36:00.135 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-10-19T08:36:00.284 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-10-19T08:36:00.437 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-10-19T08:36:00.644 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-10-19T08:36:00.869 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-10-19T08:36:01.103 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-10-19T08:36:01.225 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-19T08:36:01.369 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-10-19T08:36:01.472 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-19T08:36:01.614 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-10-19T08:36:01.735 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-19T08:36:01.814 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-10-19T08:36:02.028 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-19T08:36:02.030 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-10-19T08:36:02.330 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-19T08:36:02.520 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-19T08:36:03.103 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-10-19T08:36:03.336 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-19T08:36:03.350 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-10-19T08:36:03.510 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 92/134 2023-10-19T08:36:03.586 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 92/134 2023-10-19T08:36:03.629 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-10-19T08:36:03.803 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:18.0.0-5610.g6f3e6b48.el8.x86_64 93/134 2023-10-19T08:36:03.921 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-10-19T08:36:04.275 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-10-19T08:36:04.486 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-10-19T08:36:05.300 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-10-19T08:36:05.455 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librgw2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 92/134 2023-10-19T08:36:05.543 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librgw2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 92/134 2023-10-19T08:36:05.722 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rgw-2:18.0.0-5610.g6f3e6b48.el8.x86_64 93/134 2023-10-19T08:36:07.459 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.0.0-5610.g6f3e6b48.el8.x86_64 94/134 2023-10-19T08:36:07.686 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:18.0.0-5610.g6f3e6b48.el8.x86_64 94/134 2023-10-19T08:36:08.263 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:18.0.0-5610.g6f3e6b48.el8.x86_64 94/134 2023-10-19T08:36:08.533 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:18.0.0-5610.g6f3e6b48.el8.x86_64 95/134 2023-10-19T08:36:08.606 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:18.0.0-5610.g6f3e6b48.el8.x86_64 95/134 2023-10-19T08:36:08.785 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:18.0.0-5610.g6f3e6b48.el8.x86_64 96/134 2023-10-19T08:36:09.377 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:18.0.0-5610.g6f3e6b48.el8.x86_64 94/134 2023-10-19T08:36:09.604 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-common-2:18.0.0-5610.g6f3e6b48.el8.x86_64 94/134 2023-10-19T08:36:10.179 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:18.0.0-5610.g6f3e6b48.el8.x86_64 94/134 2023-10-19T08:36:10.467 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-base-2:18.0.0-5610.g6f3e6b48.el8.x86_64 95/134 2023-10-19T08:36:10.552 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-base-2:18.0.0-5610.g6f3e6b48.el8.x86_64 95/134 2023-10-19T08:36:10.729 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-selinux-2:18.0.0-5610.g6f3e6b48.el8.x86_64 96/134 2023-10-19T08:36:27.296 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5610.g6f3e6b48.el8.x86_64 96/134 2023-10-19T08:36:27.296 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2023-10-19T08:36:27.297 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2023-10-19T08:36:27.297 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /dev 2023-10-19T08:36:27.297 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /run 2023-10-19T08:36:27.297 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2023-10-19T08:36:27.297 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2023-10-19T08:36:27.298 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2023-10-19T08:36:27.298 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2023-10-19T08:36:27.298 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /dev 2023-10-19T08:36:27.299 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:36:27.624 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-volume-2:18.0.0-5610.g6f3e6b48.el8.noarch 97/134 2023-10-19T08:36:29.212 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-volume-2:18.0.0-5610.g6f3e6b48.el8.noarch 97/134 2023-10-19T08:36:29.371 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 98/134 2023-10-19T08:36:29.424 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5610.g6f3e6b48.el8.x86_64 96/134 2023-10-19T08:36:29.425 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /sys 2023-10-19T08:36:29.425 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /proc 2023-10-19T08:36:29.425 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /dev 2023-10-19T08:36:29.425 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /run 2023-10-19T08:36:29.426 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /mnt 2023-10-19T08:36:29.426 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /var/tmp 2023-10-19T08:36:29.426 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /home 2023-10-19T08:36:29.426 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /tmp 2023-10-19T08:36:29.426 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /dev 2023-10-19T08:36:29.427 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:36:29.590 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 98/134 2023-10-19T08:36:29.748 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:18.0.0-5610.g6f3e6b48.el8.x86_64 99/134 2023-10-19T08:36:29.783 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-volume-2:18.0.0-5610.g6f3e6b48.el8.noarch 97/134 2023-10-19T08:36:30.204 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:18.0.0-5610.g6f3e6b48.el8.x86_64 99/134 2023-10-19T08:36:30.382 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:18.0.0-5610.g6f3e6b48.el8.x86_64 100/134 2023-10-19T08:36:30.398 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:18.0.0-5610.g6f3e6b48.el8.x86_64 100/134 2023-10-19T08:36:31.363 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-volume-2:18.0.0-5610.g6f3e6b48.el8.noarch 97/134 2023-10-19T08:36:31.512 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-osd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 98/134 2023-10-19T08:36:31.730 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-osd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 98/134 2023-10-19T08:36:31.882 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mds-2:18.0.0-5610.g6f3e6b48.el8.x86_64 99/134 2023-10-19T08:36:32.132 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:18.0.0-5610.g6f3e6b48.el8.noarch 101/134 2023-10-19T08:36:32.335 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mds-2:18.0.0-5610.g6f3e6b48.el8.x86_64 99/134 2023-10-19T08:36:32.348 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:18.0.0-5610.g6f3e6b48.el8.noarch 101/134 2023-10-19T08:36:32.470 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5610.g6f3e6b48.e 102/134 2023-10-19T08:36:32.516 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mon-2:18.0.0-5610.g6f3e6b48.el8.x86_64 100/134 2023-10-19T08:36:32.533 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mon-2:18.0.0-5610.g6f3e6b48.el8.x86_64 100/134 2023-10-19T08:36:32.696 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5610.g6f3e6b48. 103/134 2023-10-19T08:36:32.889 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5610.g6f3e6b48.el8.noa 104/134 2023-10-19T08:36:33.108 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5610.g6f3e6b48.el8.noa 104/134 2023-10-19T08:36:33.470 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5610.g6f3e6b48.el8.n 105/134 2023-10-19T08:36:34.218 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephadm-2:18.0.0-5610.g6f3e6b48.el8.noarch 101/134 2023-10-19T08:36:34.422 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephadm-2:18.0.0-5610.g6f3e6b48.el8.noarch 101/134 2023-10-19T08:36:34.428 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5610.g6f3e6b48.el8.n 105/134 2023-10-19T08:36:34.529 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5610.g6f3e6b48.e 102/134 2023-10-19T08:36:34.606 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5610.g6f3 106/134 2023-10-19T08:36:34.695 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5610.g6f3 106/134 2023-10-19T08:36:34.714 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5610.g6f3e6b48. 103/134 2023-10-19T08:36:34.923 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5610.g6f3e6b48.el8.noa 104/134 2023-10-19T08:36:35.075 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5610.g6f3e6b48.el 107/134 2023-10-19T08:36:35.140 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5610.g6f3e6b48.el8.noa 104/134 2023-10-19T08:36:35.279 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:18.0.0-5610.g6f3e6b48.el8.x86_64 108/134 2023-10-19T08:36:35.314 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5610.g6f3e6b48.el8.x86_64 108/134 2023-10-19T08:36:35.519 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5610.g6f3e6b48.el8.n 105/134 2023-10-19T08:36:35.522 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:18.0.0-5610.g6f3e6b48.el8.noarch 109/134 2023-10-19T08:36:35.533 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5610.g6f3e6b48.el8.noarch 109/134 2023-10-19T08:36:36.475 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5610.g6f3e6b48.el8.n 105/134 2023-10-19T08:36:36.631 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5610.g6f3 106/134 2023-10-19T08:36:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5610.g6f3 106/134 2023-10-19T08:36:36.840 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:18.0.0-5610.g6f3e6b48.el8.x86_64 110/134 2023-10-19T08:36:37.086 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:18.0.0-5610.g6f3e6b48.el8.x86_64 111/134 2023-10-19T08:36:37.115 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5610.g6f3e6b48.el 107/134 2023-10-19T08:36:37.120 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5610.g6f3e6b48.el8.x86_64 111/134 2023-10-19T08:36:37.297 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5610.g6f3e6 112/134 2023-10-19T08:36:37.302 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-2:18.0.0-5610.g6f3e6b48.el8.x86_64 108/134 2023-10-19T08:36:37.337 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5610.g6f3e6b48.el8.x86_64 108/134 2023-10-19T08:36:37.340 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5610.g6f3e6 112/134 2023-10-19T08:36:37.489 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-mirror-2:18.0.0-5610.g6f3e6b48.el8.x86_64 113/134 2023-10-19T08:36:37.564 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-rook-2:18.0.0-5610.g6f3e6b48.el8.noarch 109/134 2023-10-19T08:36:37.578 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5610.g6f3e6b48.el8.noarch 109/134 2023-10-19T08:36:37.842 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5610.g6f3e6b48.el8.x86_64 113/134 2023-10-19T08:36:37.997 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:18.0.0-5610.g6f3e6b48.el8.x86_64 114/134 2023-10-19T08:36:38.875 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-2:18.0.0-5610.g6f3e6b48.el8.x86_64 110/134 2023-10-19T08:36:39.105 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-radosgw-2:18.0.0-5610.g6f3e6b48.el8.x86_64 111/134 2023-10-19T08:36:39.138 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5610.g6f3e6b48.el8.x86_64 111/134 2023-10-19T08:36:39.273 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5610.g6f3e6 112/134 2023-10-19T08:36:39.314 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5610.g6f3e6 112/134 2023-10-19T08:36:39.473 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-mirror-2:18.0.0-5610.g6f3e6b48.el8.x86_64 113/134 2023-10-19T08:36:39.824 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5610.g6f3e6b48.el8.x86_64 113/134 2023-10-19T08:36:40.006 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-mirror-2:18.0.0-5610.g6f3e6b48.el8.x86_64 114/134 2023-10-19T08:36:42.559 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5610.g6f3e6b48.el8.x86_64 114/134 2023-10-19T08:36:42.910 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:18.0.0-5610.g6f3e6b48.el8.x86_64 115/134 2023-10-19T08:36:43.079 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-19T08:36:43.267 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-19T08:36:44.134 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-19T08:36:44.429 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-19T08:36:44.564 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5610.g6f3e6b48.el8.x86_64 114/134 2023-10-19T08:36:44.609 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:18.0.0-5610.g6f3e6b48.el8.x86_64 119/134 2023-10-19T08:36:44.825 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-19T08:36:44.856 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-test-2:18.0.0-5610.g6f3e6b48.el8.x86_64 115/134 2023-10-19T08:36:44.983 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:18.0.0-5610.g6f3e6b48.el8.x86_ 121/134 2023-10-19T08:36:45.046 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-10-19T08:36:45.155 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-19T08:36:45.235 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-10-19T08:36:46.116 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-10-19T08:36:46.476 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-10-19T08:36:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-fuse-2:18.0.0-5610.g6f3e6b48.el8.x86_64 119/134 2023-10-19T08:36:46.850 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-19T08:36:47.058 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs-devel-2:18.0.0-5610.g6f3e6b48.el8.x86_ 121/134 2023-10-19T08:36:47.214 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-19T08:36:47.409 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-19T08:36:47.679 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-19T08:36:47.697 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-19T08:36:47.854 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephfs-top-2:18.0.0-5610.g6f3e6b48.el8.noarch 124/134 2023-10-19T08:36:48.153 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:18.0.0-5610.g6f3e6b48.el8.x86_64 125/134 2023-10-19T08:36:48.436 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 126/134 2023-10-19T08:36:48.730 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-19T08:36:48.887 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-19T08:36:48.895 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-19T08:36:49.079 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-19T08:36:49.237 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-19T08:36:49.321 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-19T08:36:49.373 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-19T08:36:49.512 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-19T08:36:49.525 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-19T08:36:49.525 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-19T08:36:49.654 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-19T08:36:49.670 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-10-19T08:36:49.756 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-19T08:36:49.757 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-19T08:36:49.829 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-top-2:18.0.0-5610.g6f3e6b48.el8.noarch 124/134 2023-10-19T08:36:50.016 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-19T08:36:50.111 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-fuse-2:18.0.0-5610.g6f3e6b48.el8.x86_64 125/134 2023-10-19T08:36:50.219 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-19T08:36:50.440 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-nbd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 126/134 2023-10-19T08:36:50.747 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-10-19T08:36:50.755 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-19T08:36:50.755 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:18.0.0-5610.g6f3e6b48.el8.x86_64 1/134 2023-10-19T08:36:50.756 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2/134 2023-10-19T08:36:50.756 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:18.0.0-5610.g6f3e6b48.el8.x86_64 3/134 2023-10-19T08:36:50.756 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:18.0.0-5610.g6f3e6b48.el8.x86_64 4/134 2023-10-19T08:36:50.756 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5610.g6f3e6 5/134 2023-10-19T08:36:50.756 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:18.0.0-5610.g6f3e6b48.el8.x86_64 6/134 2023-10-19T08:36:50.757 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:18.0.0-5610.g6f3e6b48.el8.x86_64 7/134 2023-10-19T08:36:50.757 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:18.0.0-5610.g6f3e6b48.el8.x86_64 8/134 2023-10-19T08:36:50.757 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 9/134 2023-10-19T08:36:50.757 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:18.0.0-5610.g6f3e6b48.el8.x86_64 10/134 2023-10-19T08:36:50.757 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:18.0.0-5610.g6f3e6b48.el8.x86_64 11/134 2023-10-19T08:36:50.758 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:18.0.0-5610.g6f3e6b48.el8.x86_64 12/134 2023-10-19T08:36:50.758 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-mirror-2:18.0.0-5610.g6f3e6b48.el8.x86_64 13/134 2023-10-19T08:36:50.758 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:18.0.0-5610.g6f3e6b48.el8.x86_ 14/134 2023-10-19T08:36:50.758 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 15/134 2023-10-19T08:36:50.759 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:18.0.0-5610.g6f3e6b48.el8.x86_64 16/134 2023-10-19T08:36:50.759 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:18.0.0-5610.g6f3e6b48.el8.x86_6 17/134 2023-10-19T08:36:50.759 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:18.0.0-5610.g6f3e6b48.el8.x86 18/134 2023-10-19T08:36:50.759 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 19/134 2023-10-19T08:36:50.760 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5610.g6f3e6b48.el 20/134 2023-10-19T08:36:50.760 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:18.0.0-5610.g6f3e6b48.el8. 21/134 2023-10-19T08:36:50.760 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:18.0.0-5610.g6f3e6b48.el8.x86_6 22/134 2023-10-19T08:36:50.760 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:18.0.0-5610.g6f3e6b48.el8.x86_64 23/134 2023-10-19T08:36:50.760 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 24/134 2023-10-19T08:36:50.760 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:18.0.0-5610.g6f3e6b48.el8.x86_64 25/134 2023-10-19T08:36:50.761 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:18.0.0-5610.g6f3e6b48.el8.x86_64 26/134 2023-10-19T08:36:50.761 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:18.0.0-5610.g6f3e6b48.el8.x86_64 27/134 2023-10-19T08:36:50.770 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 28/134 2023-10-19T08:36:50.770 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5610.g6f3e6b48. 29/134 2023-10-19T08:36:50.770 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5610.g6f3e6b48.el8.noa 30/134 2023-10-19T08:36:50.771 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5610.g6f3e6b48.el8.n 31/134 2023-10-19T08:36:50.771 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5610.g6f3 32/134 2023-10-19T08:36:50.771 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5610.g6f3e6b48.el 33/134 2023-10-19T08:36:50.771 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5610.g6f3e6b48.el8.noarch 34/134 2023-10-19T08:36:50.771 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5610.g6f3e6b48.e 35/134 2023-10-19T08:36:50.771 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-volume-2:18.0.0-5610.g6f3e6b48.el8.noarch 36/134 2023-10-19T08:36:50.772 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:18.0.0-5610.g6f3e6b48.el8.noarch 37/134 2023-10-19T08:36:50.772 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephfs-top-2:18.0.0-5610.g6f3e6b48.el8.noarch 38/134 2023-10-19T08:36:50.772 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-19T08:36:50.772 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-19T08:36:50.772 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-19T08:36:50.773 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-19T08:36:50.773 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-19T08:36:50.773 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-19T08:36:50.773 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-19T08:36:50.773 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-19T08:36:50.774 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-19T08:36:50.774 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-19T08:36:50.774 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-19T08:36:50.774 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-19T08:36:50.774 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-19T08:36:50.775 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-19T08:36:50.775 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-19T08:36:50.775 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-19T08:36:50.775 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-19T08:36:50.775 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-19T08:36:50.776 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-19T08:36:50.776 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-19T08:36:50.776 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-19T08:36:50.776 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-19T08:36:50.776 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-19T08:36:50.777 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-19T08:36:50.777 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-19T08:36:50.777 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-19T08:36:50.777 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-19T08:36:50.777 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-19T08:36:50.777 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-19T08:36:50.778 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-19T08:36:50.778 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-19T08:36:50.778 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-19T08:36:50.778 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-19T08:36:50.778 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-19T08:36:50.779 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-19T08:36:50.779 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-19T08:36:50.779 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-19T08:36:50.779 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-19T08:36:50.779 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-19T08:36:50.780 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-19T08:36:50.780 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-19T08:36:50.780 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-19T08:36:50.780 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-19T08:36:50.780 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-19T08:36:50.781 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-19T08:36:50.781 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-19T08:36:50.781 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-19T08:36:50.781 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-19T08:36:50.781 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-19T08:36:50.782 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-19T08:36:50.782 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-19T08:36:50.782 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-19T08:36:50.782 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-19T08:36:50.782 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-19T08:36:50.782 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-19T08:36:50.783 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-19T08:36:50.783 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-19T08:36:50.783 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-19T08:36:50.783 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-19T08:36:50.783 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-19T08:36:50.784 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-19T08:36:50.784 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-19T08:36:50.784 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-19T08:36:50.784 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-19T08:36:50.784 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-19T08:36:50.785 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-19T08:36:50.785 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-19T08:36:50.785 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-19T08:36:50.785 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-19T08:36:50.785 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-19T08:36:50.786 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-19T08:36:50.786 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-19T08:36:50.786 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-19T08:36:50.786 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-19T08:36:50.786 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-19T08:36:50.787 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-19T08:36:50.787 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-19T08:36:50.787 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-19T08:36:50.787 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-19T08:36:50.787 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-19T08:36:50.787 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-19T08:36:50.788 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-19T08:36:50.788 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-19T08:36:50.788 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-19T08:36:50.788 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-19T08:36:50.788 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-19T08:36:50.789 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-19T08:36:50.789 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-19T08:36:50.789 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-19T08:36:50.789 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-19T08:36:50.789 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 129/134 2023-10-19T08:36:50.790 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-19T08:36:50.790 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:18.0.0-5610.g6f3e6b48.el8.x86_64 131/134 2023-10-19T08:36:50.790 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-19T08:36:50.790 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-19T08:36:50.903 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-19T08:36:50.912 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-19T08:36:51.073 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-10-19T08:36:51.244 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-10-19T08:36:51.324 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-10-19T08:36:51.545 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-10-19T08:36:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-10-19T08:36:51.557 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-19T08:36:51.764 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-19T08:36:51.765 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-19T08:36:51.990 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-10-19T08:36:52.210 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-19T08:36:52.706 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-10-19T08:36:52.706 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-2:18.0.0-5610.g6f3e6b48.el8.x86_64 1/134 2023-10-19T08:36:52.707 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-base-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2/134 2023-10-19T08:36:52.707 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-common-2:18.0.0-5610.g6f3e6b48.el8.x86_64 3/134 2023-10-19T08:36:52.707 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-fuse-2:18.0.0-5610.g6f3e6b48.el8.x86_64 4/134 2023-10-19T08:36:52.707 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5610.g6f3e6 5/134 2023-10-19T08:36:52.707 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mds-2:18.0.0-5610.g6f3e6b48.el8.x86_64 6/134 2023-10-19T08:36:52.708 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-2:18.0.0-5610.g6f3e6b48.el8.x86_64 7/134 2023-10-19T08:36:52.708 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mon-2:18.0.0-5610.g6f3e6b48.el8.x86_64 8/134 2023-10-19T08:36:52.708 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-osd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 9/134 2023-10-19T08:36:52.708 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-radosgw-2:18.0.0-5610.g6f3e6b48.el8.x86_64 10/134 2023-10-19T08:36:52.708 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-selinux-2:18.0.0-5610.g6f3e6b48.el8.x86_64 11/134 2023-10-19T08:36:52.708 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-test-2:18.0.0-5610.g6f3e6b48.el8.x86_64 12/134 2023-10-19T08:36:52.709 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-mirror-2:18.0.0-5610.g6f3e6b48.el8.x86_64 13/134 2023-10-19T08:36:52.709 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs-devel-2:18.0.0-5610.g6f3e6b48.el8.x86_ 14/134 2023-10-19T08:36:52.709 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 15/134 2023-10-19T08:36:52.709 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephsqlite-2:18.0.0-5610.g6f3e6b48.el8.x86_64 16/134 2023-10-19T08:36:52.709 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados-devel-2:18.0.0-5610.g6f3e6b48.el8.x86_6 17/134 2023-10-19T08:36:52.709 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libradosstriper1-2:18.0.0-5610.g6f3e6b48.el8.x86 18/134 2023-10-19T08:36:52.710 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librgw2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 19/134 2023-10-19T08:36:52.710 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5610.g6f3e6b48.el 20/134 2023-10-19T08:36:52.710 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-common-2:18.0.0-5610.g6f3e6b48.el8. 21/134 2023-10-19T08:36:52.710 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cephfs-2:18.0.0-5610.g6f3e6b48.el8.x86_6 22/134 2023-10-19T08:36:52.710 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rados-2:18.0.0-5610.g6f3e6b48.el8.x86_64 23/134 2023-10-19T08:36:52.711 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rbd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 24/134 2023-10-19T08:36:52.711 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rgw-2:18.0.0-5610.g6f3e6b48.el8.x86_64 25/134 2023-10-19T08:36:52.711 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-fuse-2:18.0.0-5610.g6f3e6b48.el8.x86_64 26/134 2023-10-19T08:36:52.711 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-mirror-2:18.0.0-5610.g6f3e6b48.el8.x86_64 27/134 2023-10-19T08:36:52.712 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-nbd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 28/134 2023-10-19T08:36:52.712 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5610.g6f3e6b48. 29/134 2023-10-19T08:36:52.712 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5610.g6f3e6b48.el8.noa 30/134 2023-10-19T08:36:52.720 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5610.g6f3e6b48.el8.n 31/134 2023-10-19T08:36:52.721 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5610.g6f3 32/134 2023-10-19T08:36:52.721 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5610.g6f3e6b48.el 33/134 2023-10-19T08:36:52.721 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5610.g6f3e6b48.el8.noarch 34/134 2023-10-19T08:36:52.721 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5610.g6f3e6b48.e 35/134 2023-10-19T08:36:52.721 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-volume-2:18.0.0-5610.g6f3e6b48.el8.noarch 36/134 2023-10-19T08:36:52.722 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephadm-2:18.0.0-5610.g6f3e6b48.el8.noarch 37/134 2023-10-19T08:36:52.722 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-top-2:18.0.0-5610.g6f3e6b48.el8.noarch 38/134 2023-10-19T08:36:52.722 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-10-19T08:36:52.722 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-10-19T08:36:52.722 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-10-19T08:36:52.723 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-10-19T08:36:52.723 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-10-19T08:36:52.723 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-10-19T08:36:52.723 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-10-19T08:36:52.723 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-10-19T08:36:52.723 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-10-19T08:36:52.724 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-10-19T08:36:52.724 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-10-19T08:36:52.724 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-10-19T08:36:52.724 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-10-19T08:36:52.724 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-10-19T08:36:52.725 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-10-19T08:36:52.725 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-10-19T08:36:52.725 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-10-19T08:36:52.725 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-10-19T08:36:52.725 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-10-19T08:36:52.725 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-10-19T08:36:52.726 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-10-19T08:36:52.726 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-10-19T08:36:52.726 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-10-19T08:36:52.726 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-10-19T08:36:52.726 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-10-19T08:36:52.727 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-10-19T08:36:52.727 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-10-19T08:36:52.727 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-10-19T08:36:52.727 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-10-19T08:36:52.727 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-10-19T08:36:52.728 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-10-19T08:36:52.728 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-10-19T08:36:52.728 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-10-19T08:36:52.728 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-10-19T08:36:52.728 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-10-19T08:36:52.728 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-10-19T08:36:52.729 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-10-19T08:36:52.729 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-10-19T08:36:52.729 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-10-19T08:36:52.729 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-10-19T08:36:52.729 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-10-19T08:36:52.730 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-10-19T08:36:52.730 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-10-19T08:36:52.730 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-10-19T08:36:52.730 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-10-19T08:36:52.730 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-10-19T08:36:52.731 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-10-19T08:36:52.731 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-10-19T08:36:52.731 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-10-19T08:36:52.731 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-10-19T08:36:52.731 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-10-19T08:36:52.731 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-10-19T08:36:52.732 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-10-19T08:36:52.732 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-10-19T08:36:52.732 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-10-19T08:36:52.732 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-10-19T08:36:52.732 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-10-19T08:36:52.733 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-10-19T08:36:52.733 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-10-19T08:36:52.733 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-10-19T08:36:52.733 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-10-19T08:36:52.733 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-10-19T08:36:52.734 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-10-19T08:36:52.734 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-10-19T08:36:52.734 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-10-19T08:36:52.734 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-10-19T08:36:52.735 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-10-19T08:36:52.735 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-10-19T08:36:52.735 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-10-19T08:36:52.735 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-10-19T08:36:52.735 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-10-19T08:36:52.736 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-10-19T08:36:52.736 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-10-19T08:36:52.736 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-10-19T08:36:52.736 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-10-19T08:36:52.736 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-10-19T08:36:52.737 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-10-19T08:36:52.737 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-10-19T08:36:52.737 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-10-19T08:36:52.737 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-10-19T08:36:52.737 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-10-19T08:36:52.738 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-10-19T08:36:52.738 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-10-19T08:36:52.738 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-10-19T08:36:52.738 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-10-19T08:36:52.738 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-10-19T08:36:52.739 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-10-19T08:36:52.739 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-10-19T08:36:52.739 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-10-19T08:36:52.739 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-10-19T08:36:52.739 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 129/134 2023-10-19T08:36:52.739 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-10-19T08:36:52.740 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:18.0.0-5610.g6f3e6b48.el8.x86_64 131/134 2023-10-19T08:36:52.740 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-10-19T08:36:52.740 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-10-19T08:36:53.534 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-19T08:36:53.535 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:54 ago on Thu 19 Oct 2023 08:34:59 AM UTC. 2023-10-19T08:36:55.527 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-10-19T08:36:55.528 INFO:teuthology.orchestra.run.smithi079.stdout:Last metadata expiration check: 0:01:55 ago on Thu 19 Oct 2023 08:35:00 AM UTC. 2023-10-19T08:36:56.480 INFO:teuthology.orchestra.run.smithi089.stdout:Installed products updated. 2023-10-19T08:36:56.701 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:36:56.702 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2023-10-19T08:36:56.702 INFO:teuthology.orchestra.run.smithi089.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-19T08:36:56.702 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.702 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.702 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2023-10-19T08:36:56.703 INFO:teuthology.orchestra.run.smithi089.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-19T08:36:56.703 INFO:teuthology.orchestra.run.smithi089.stdout: automake-1.16.1-7.el8.noarch 2023-10-19T08:36:56.703 INFO:teuthology.orchestra.run.smithi089.stdout: bison-3.0.4-10.el8.x86_64 2023-10-19T08:36:56.703 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.703 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.704 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.704 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.704 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:56.704 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.704 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.705 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.705 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:56.705 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:56.705 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:56.705 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:56.705 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:56.706 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.706 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.706 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:56.706 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.706 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.707 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.707 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-volume-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:56.707 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:56.707 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.707 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-top-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:56.708 INFO:teuthology.orchestra.run.smithi089.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-19T08:36:56.708 INFO:teuthology.orchestra.run.smithi089.stdout: flex-2.6.1-9.el8.x86_64 2023-10-19T08:36:56.708 INFO:teuthology.orchestra.run.smithi089.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-19T08:36:56.708 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-19T08:36:56.708 INFO:teuthology.orchestra.run.smithi089.stdout: jq-1.6-3.el8.x86_64 2023-10-19T08:36:56.709 INFO:teuthology.orchestra.run.smithi089.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-19T08:36:56.709 INFO:teuthology.orchestra.run.smithi089.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-19T08:36:56.709 INFO:teuthology.orchestra.run.smithi089.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-19T08:36:56.709 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.709 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.710 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.710 INFO:teuthology.orchestra.run.smithi089.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-19T08:36:56.710 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-19T08:36:56.710 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-19T08:36:56.710 INFO:teuthology.orchestra.run.smithi089.stdout: libpq-13.5-1.el8.x86_64 2023-10-19T08:36:56.710 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-19T08:36:56.711 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-19T08:36:56.711 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.711 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.711 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-19T08:36:56.711 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.712 INFO:teuthology.orchestra.run.smithi089.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-19T08:36:56.712 INFO:teuthology.orchestra.run.smithi089.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-19T08:36:56.712 INFO:teuthology.orchestra.run.smithi089.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-19T08:36:56.712 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-19T08:36:56.712 INFO:teuthology.orchestra.run.smithi089.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-19T08:36:56.713 INFO:teuthology.orchestra.run.smithi089.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-19T08:36:56.713 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-19T08:36:56.713 INFO:teuthology.orchestra.run.smithi089.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-19T08:36:56.713 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-19T08:36:56.713 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-19T08:36:56.714 INFO:teuthology.orchestra.run.smithi089.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-19T08:36:56.714 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-19T08:36:56.714 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-19T08:36:56.714 INFO:teuthology.orchestra.run.smithi089.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-19T08:36:56.714 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-19T08:36:56.715 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-19T08:36:56.715 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-19T08:36:56.715 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-19T08:36:56.715 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-19T08:36:56.715 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-19T08:36:56.716 INFO:teuthology.orchestra.run.smithi089.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-19T08:36:56.716 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-19T08:36:56.716 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.716 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.716 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.717 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-19T08:36:56.717 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-19T08:36:56.717 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-19T08:36:56.717 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-19T08:36:56.717 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-19T08:36:56.718 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-19T08:36:56.718 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-19T08:36:56.718 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-19T08:36:56.718 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-19T08:36:56.718 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-19T08:36:56.719 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-19T08:36:56.719 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-19T08:36:56.719 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-19T08:36:56.719 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-19T08:36:56.719 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-19T08:36:56.720 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-19T08:36:56.720 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-19T08:36:56.720 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-19T08:36:56.721 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-19T08:36:56.721 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-19T08:36:56.721 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-19T08:36:56.721 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-19T08:36:56.721 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-2.6-1.el8.noarch 2023-10-19T08:36:56.721 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-19T08:36:56.722 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-19T08:36:56.722 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-19T08:36:56.722 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-19T08:36:56.722 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-19T08:36:56.722 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-19T08:36:56.723 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.723 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.723 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-19T08:36:56.723 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-19T08:36:56.723 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.724 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-19T08:36:56.724 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-19T08:36:56.724 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-19T08:36:56.724 INFO:teuthology.orchestra.run.smithi089.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-19T08:36:56.724 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-19T08:36:56.725 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-19T08:36:56.725 INFO:teuthology.orchestra.run.smithi089.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-19T08:36:56.725 INFO:teuthology.orchestra.run.smithi089.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-19T08:36:56.725 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-19T08:36:56.725 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-19T08:36:56.725 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-19T08:36:56.726 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-19T08:36:56.726 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-19T08:36:56.726 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.726 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.726 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:56.727 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-19T08:36:56.727 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-19T08:36:56.727 INFO:teuthology.orchestra.run.smithi089.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-19T08:36:56.727 INFO:teuthology.orchestra.run.smithi089.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-19T08:36:56.727 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-19T08:36:56.728 INFO:teuthology.orchestra.run.smithi089.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-19T08:36:56.728 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:36:56.728 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2023-10-19T08:36:56.885 DEBUG:teuthology.parallel:result is None 2023-10-19T08:36:58.425 INFO:teuthology.orchestra.run.smithi079.stdout:Installed products updated. 2023-10-19T08:36:58.653 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:36:58.653 INFO:teuthology.orchestra.run.smithi079.stdout:Upgraded: 2023-10-19T08:36:58.654 INFO:teuthology.orchestra.run.smithi079.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-10-19T08:36:58.654 INFO:teuthology.orchestra.run.smithi079.stdout: librados2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.654 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.654 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2023-10-19T08:36:58.655 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-10-19T08:36:58.655 INFO:teuthology.orchestra.run.smithi079.stdout: automake-1.16.1-7.el8.noarch 2023-10-19T08:36:58.655 INFO:teuthology.orchestra.run.smithi079.stdout: bison-3.0.4-10.el8.x86_64 2023-10-19T08:36:58.655 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.655 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.655 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.656 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.656 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:58.656 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.656 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.656 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.657 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:58.657 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:58.657 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:58.657 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:58.657 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:58.658 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.658 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.658 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:58.658 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.658 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.659 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.659 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:58.659 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:58.659 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.659 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top-2:18.0.0-5610.g6f3e6b48.el8.noarch 2023-10-19T08:36:58.660 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-10-19T08:36:58.660 INFO:teuthology.orchestra.run.smithi079.stdout: flex-2.6.1-9.el8.x86_64 2023-10-19T08:36:58.660 INFO:teuthology.orchestra.run.smithi079.stdout: fuse-2.9.7-15.el8.x86_64 2023-10-19T08:36:58.660 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-19T08:36:58.660 INFO:teuthology.orchestra.run.smithi079.stdout: jq-1.6-3.el8.x86_64 2023-10-19T08:36:58.661 INFO:teuthology.orchestra.run.smithi079.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-19T08:36:58.661 INFO:teuthology.orchestra.run.smithi079.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-10-19T08:36:58.661 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-19T08:36:58.661 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.661 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.662 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.662 INFO:teuthology.orchestra.run.smithi079.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-10-19T08:36:58.662 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-10-19T08:36:58.662 INFO:teuthology.orchestra.run.smithi079.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-19T08:36:58.662 INFO:teuthology.orchestra.run.smithi079.stdout: libpq-13.5-1.el8.x86_64 2023-10-19T08:36:58.663 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-10-19T08:36:58.663 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-19T08:36:58.663 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.663 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.664 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-19T08:36:58.664 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.664 INFO:teuthology.orchestra.run.smithi079.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-19T08:36:58.664 INFO:teuthology.orchestra.run.smithi079.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-19T08:36:58.664 INFO:teuthology.orchestra.run.smithi079.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-19T08:36:58.665 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-19T08:36:58.665 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-10-19T08:36:58.665 INFO:teuthology.orchestra.run.smithi079.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-19T08:36:58.665 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-19T08:36:58.665 INFO:teuthology.orchestra.run.smithi079.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-19T08:36:58.665 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-0.3.15-3.el8.x86_64 2023-10-19T08:36:58.666 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-10-19T08:36:58.666 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-10-19T08:36:58.666 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-19T08:36:58.666 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-19T08:36:58.667 INFO:teuthology.orchestra.run.smithi079.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-19T08:36:58.667 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-19T08:36:58.667 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-19T08:36:58.667 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-10-19T08:36:58.667 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-19T08:36:58.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-19T08:36:58.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-19T08:36:58.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-19T08:36:58.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-19T08:36:58.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-19T08:36:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-10-19T08:36:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-19T08:36:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-19T08:36:58.670 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-10-19T08:36:58.670 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-19T08:36:58.670 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-19T08:36:58.670 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-19T08:36:58.670 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-19T08:36:58.671 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-19T08:36:58.671 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-19T08:36:58.671 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-19T08:36:58.671 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-19T08:36:58.671 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-19T08:36:58.672 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-19T08:36:58.672 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-19T08:36:58.672 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-19T08:36:58.672 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-19T08:36:58.672 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-19T08:36:58.673 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-19T08:36:58.673 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-19T08:36:58.673 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-19T08:36:58.673 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend-2.6-1.el8.noarch 2023-10-19T08:36:58.673 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-19T08:36:58.673 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-19T08:36:58.674 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-19T08:36:58.674 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-19T08:36:58.674 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-19T08:36:58.674 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-19T08:36:58.674 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.675 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.675 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-19T08:36:58.675 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-19T08:36:58.675 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.675 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-19T08:36:58.676 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-19T08:36:58.676 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-10-19T08:36:58.676 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-19T08:36:58.676 INFO:teuthology.orchestra.run.smithi079.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-19T08:36:58.676 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-19T08:36:58.677 INFO:teuthology.orchestra.run.smithi079.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-19T08:36:58.677 INFO:teuthology.orchestra.run.smithi079.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-19T08:36:58.677 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-19T08:36:58.677 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-19T08:36:58.677 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-19T08:36:58.678 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-19T08:36:58.678 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-19T08:36:58.678 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.678 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.678 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd-2:18.0.0-5610.g6f3e6b48.el8.x86_64 2023-10-19T08:36:58.679 INFO:teuthology.orchestra.run.smithi079.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-19T08:36:58.679 INFO:teuthology.orchestra.run.smithi079.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-19T08:36:58.679 INFO:teuthology.orchestra.run.smithi079.stdout: uuid-1.6.2-43.el8.x86_64 2023-10-19T08:36:58.679 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-10-19T08:36:58.679 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-19T08:36:58.680 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-10-19T08:36:58.680 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:36:58.680 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2023-10-19T08:36:58.842 DEBUG:teuthology.parallel:result is None 2023-10-19T08:36:58.843 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=6f3e6b48891b9b50415c0822b6b870797fcda16d 2023-10-19T08:36:58.993 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-19T08:36:59.017 INFO:teuthology.orchestra.run.smithi079.stdout:18.0.0-5610.g6f3e6b48.el8 2023-10-19T08:36:59.017 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5610.g6f3e6b48.el8 2023-10-19T08:36:59.018 INFO:teuthology.task.install:The correct ceph version 18.0.0-5610.g6f3e6b48 is installed. 2023-10-19T08:36:59.018 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=6f3e6b48891b9b50415c0822b6b870797fcda16d 2023-10-19T08:36:59.237 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-19T08:36:59.265 INFO:teuthology.orchestra.run.smithi089.stdout:18.0.0-5610.g6f3e6b48.el8 2023-10-19T08:36:59.266 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5610.g6f3e6b48.el8 2023-10-19T08:36:59.266 INFO:teuthology.task.install:The correct ceph version 18.0.0-5610.g6f3e6b48 is installed. 2023-10-19T08:36:59.267 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-19T08:36:59.285 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:36:59.286 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-19T08:36:59.331 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:36:59.331 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-19T08:36:59.377 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-19T08:36:59.378 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:36:59.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2023-10-19T08:36:59.407 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-19T08:36:59.475 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:36:59.476 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2023-10-19T08:36:59.506 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-19T08:36:59.574 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-19T08:36:59.575 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:36:59.575 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-19T08:36:59.603 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-19T08:36:59.670 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:36:59.670 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-19T08:36:59.699 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-19T08:36:59.767 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-19T08:36:59.767 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:36:59.768 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2023-10-19T08:36:59.795 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-19T08:36:59.862 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:36:59.863 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2023-10-19T08:36:59.890 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-19T08:36:59.959 INFO:teuthology.run_tasks:Running task ceph... 2023-10-19T08:37:00.259 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-19T08:37:00.261 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /var/log/ceph 2023-10-19T08:37:00.263 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2023-10-19T08:37:00.294 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-19T08:37:00.295 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-19T08:37:00.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-19T08:37:00.364 INFO:tasks.ceph:Creating extra log directories... 2023-10-19T08:37:00.365 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-19T08:37:00.402 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-19T08:37:00.439 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-19T08:37:00.440 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-19T08:37:00.463 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-19T08:37:00.464 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:00.464 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-19T08:37:00.486 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-19T08:37:00.647 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-19T08:37:00.674 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:37:00.674 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-19T08:37:00.693 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-19T08:37:00.846 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-19T08:37:00.879 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-19T08:37:00.879 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'but it is still running', 'slow request', 'MDS_CLIENT_LATE_RELEASE', 't responding to mclientcaps', 'file system flag refuse_client_session is set', 'Degraded data redundancy', 'MDS_CLIENTS_LAGGY', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-19T08:37:00.880 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dparmar-2023-10-19_08:18:21-fs:functional-wip-63105-distro-default-smithi/7432255', 'branch': 'wip-63105', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery}', 'email': None, 'first_in_suite': False, 'job_id': '7432255', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'dparmar-2023-10-19_08:18:21-fs:functional-wip-63105-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-63105'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'but it is still running', 'slow request', 'MDS_CLIENT_LATE_RELEASE', 't responding to mclientcaps', 'file system flag refuse_client_session is set', 'Degraded data redundancy', 'MDS_CLIENTS_LAGGY', 'Reduced data availability'], 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-63105', 'sha1': '3183a022e354f76c22fd51e4469422a5f509200d'}}, 'owner': 'scheduled_dparmar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7791, 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-63105', 'suite_path': '/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/dparmar18/ceph', 'suite_sha1': '3183a022e354f76c22fd51e4469422a5f509200d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi079.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi089.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6f3e6b48891b9b50415c0822b6b870797fcda16d'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_client_recovery']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '202b180cb047e798fb131047314a862593f45403', 'timestamp': '2023-10-19_08:18:21', 'tube': 'smithi', 'user': 'dparmar', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-19T08:37:00.881 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-19T08:37:00.883 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-19T08:37:00.931 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/run/ceph 2023-10-19T08:37:00.940 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2023-10-19T08:37:00.998 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:00.998 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2023-10-19T08:37:01.022 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-19T08:37:01.022 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2023-10-19T08:37:01.079 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-19T08:37:01.079 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T08:37:01.079 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 389671 Links: 1 2023-10-19T08:37:01.080 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T08:37:01.080 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T08:37:01.080 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-10-19 08:36:52.405348324 +0000 2023-10-19T08:37:01.080 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-10-19 08:34:13.320040828 +0000 2023-10-19T08:37:01.080 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-10-19 08:34:13.320040828 +0000 2023-10-19T08:37:01.081 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2023-10-19T08:37:01.081 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-19T08:37:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-10-19T08:37:01.144 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-10-19T08:37:01.145 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000227809 s, 2.2 MB/s 2023-10-19T08:37:01.146 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-19T08:37:01.204 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2023-10-19T08:37:01.261 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-19T08:37:01.261 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T08:37:01.261 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 390590 Links: 1 2023-10-19T08:37:01.262 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T08:37:01.262 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T08:37:01.262 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-10-19 08:36:52.406348301 +0000 2023-10-19T08:37:01.262 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-10-19 08:34:13.862028518 +0000 2023-10-19T08:37:01.263 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-10-19 08:34:13.862028518 +0000 2023-10-19T08:37:01.263 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2023-10-19T08:37:01.263 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-19T08:37:01.326 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-10-19T08:37:01.327 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-10-19T08:37:01.327 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000225082 s, 2.3 MB/s 2023-10-19T08:37:01.328 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-19T08:37:01.386 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2023-10-19T08:37:01.443 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-19T08:37:01.443 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T08:37:01.443 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 388618 Links: 1 2023-10-19T08:37:01.444 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T08:37:01.444 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T08:37:01.444 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-10-19 08:36:52.406348301 +0000 2023-10-19T08:37:01.444 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-10-19 08:34:14.376016844 +0000 2023-10-19T08:37:01.444 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-10-19 08:34:14.376016844 +0000 2023-10-19T08:37:01.445 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2023-10-19T08:37:01.445 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-19T08:37:01.508 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-10-19T08:37:01.509 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-10-19T08:37:01.509 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000204043 s, 2.5 MB/s 2023-10-19T08:37:01.510 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-19T08:37:01.567 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2023-10-19T08:37:01.624 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-19T08:37:01.624 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T08:37:01.625 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 6h/6d Inode: 389853 Links: 1 2023-10-19T08:37:01.625 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T08:37:01.625 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T08:37:01.625 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2023-10-19 08:36:52.406348301 +0000 2023-10-19T08:37:01.625 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2023-10-19 08:34:14.889005193 +0000 2023-10-19T08:37:01.626 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2023-10-19 08:34:14.889005193 +0000 2023-10-19T08:37:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2023-10-19T08:37:01.626 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-19T08:37:01.689 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2023-10-19T08:37:01.689 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2023-10-19T08:37:01.689 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000172714 s, 3.0 MB/s 2023-10-19T08:37:01.690 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-19T08:37:01.747 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-19T08:37:01.748 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:37:01.748 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2023-10-19T08:37:01.769 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-19T08:37:01.769 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2023-10-19T08:37:01.829 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-19T08:37:01.829 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T08:37:01.829 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 393370 Links: 1 2023-10-19T08:37:01.829 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T08:37:01.829 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T08:37:01.830 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-10-19 08:36:50.458197192 +0000 2023-10-19T08:37:01.830 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-10-19 08:34:13.342391320 +0000 2023-10-19T08:37:01.830 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-10-19 08:34:13.342391320 +0000 2023-10-19T08:37:01.830 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-10-19T08:37:01.831 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-19T08:37:01.898 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-10-19T08:37:01.898 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-10-19T08:37:01.898 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000266505 s, 1.9 MB/s 2023-10-19T08:37:01.899 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-19T08:37:01.960 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2023-10-19T08:37:02.018 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-19T08:37:02.019 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T08:37:02.019 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 391652 Links: 1 2023-10-19T08:37:02.019 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T08:37:02.019 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T08:37:02.019 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-10-19 08:36:50.459197170 +0000 2023-10-19T08:37:02.020 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-10-19 08:34:13.879379237 +0000 2023-10-19T08:37:02.020 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-10-19 08:34:13.879379237 +0000 2023-10-19T08:37:02.020 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-10-19T08:37:02.020 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-19T08:37:02.085 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-10-19T08:37:02.086 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-10-19T08:37:02.086 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000244937 s, 2.1 MB/s 2023-10-19T08:37:02.087 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-19T08:37:02.145 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2023-10-19T08:37:02.204 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-19T08:37:02.204 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T08:37:02.204 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 386786 Links: 1 2023-10-19T08:37:02.204 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T08:37:02.205 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T08:37:02.205 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-10-19 08:36:50.459197170 +0000 2023-10-19T08:37:02.205 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-10-19 08:34:14.371368167 +0000 2023-10-19T08:37:02.205 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-10-19 08:34:14.371368167 +0000 2023-10-19T08:37:02.205 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-10-19T08:37:02.206 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-19T08:37:02.270 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-10-19T08:37:02.270 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-10-19T08:37:02.271 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000241665 s, 2.1 MB/s 2023-10-19T08:37:02.272 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-19T08:37:02.330 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2023-10-19T08:37:02.387 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-19T08:37:02.388 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-19T08:37:02.388 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 6h/6d Inode: 393584 Links: 1 2023-10-19T08:37:02.388 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-19T08:37:02.388 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2023-10-19T08:37:02.388 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-10-19 08:36:50.459197170 +0000 2023-10-19T08:37:02.389 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-10-19 08:34:14.872356895 +0000 2023-10-19T08:37:02.389 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-10-19 08:34:14.872356895 +0000 2023-10-19T08:37:02.389 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-10-19T08:37:02.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-19T08:37:02.453 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-10-19T08:37:02.453 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-10-19T08:37:02.453 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000217368 s, 2.4 MB/s 2023-10-19T08:37:02.454 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-19T08:37:02.513 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-19T08:37:02.514 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-19T08:37:02.514 INFO:tasks.ceph:Generating config... 2023-10-19T08:37:02.533 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-19T08:37:02.534 INFO:tasks.ceph:[client] debug client = 20 2023-10-19T08:37:02.534 INFO:tasks.ceph:[client] debug ms = 1 2023-10-19T08:37:02.534 INFO:tasks.ceph:[client] pid file = 2023-10-19T08:37:02.535 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-19T08:37:02.535 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-19T08:37:02.535 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-19T08:37:02.535 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-19T08:37:02.536 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-19T08:37:02.536 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-19T08:37:02.536 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-19T08:37:02.537 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-19T08:37:02.537 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-19T08:37:02.537 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-19T08:37:02.537 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-19T08:37:02.538 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-19T08:37:02.538 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-19T08:37:02.538 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-19T08:37:02.538 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-19T08:37:02.539 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-19T08:37:02.539 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-19T08:37:02.539 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-19T08:37:02.539 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-19T08:37:02.540 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-19T08:37:02.540 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-19T08:37:02.540 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-19T08:37:02.540 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-19T08:37:02.541 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-19T08:37:02.541 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-19T08:37:02.541 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-19T08:37:02.542 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-19T08:37:02.542 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-19T08:37:02.542 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-19T08:37:02.542 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-19T08:37:02.543 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-19T08:37:02.543 INFO:tasks.ceph:Setting up mon.a... 2023-10-19T08:37:02.543 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-19T08:37:02.604 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.keyring 2023-10-19T08:37:02.607 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-19T08:37:02.655 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-19T08:37:02.683 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.79'), ('mon.b', '172.21.15.89'), ('mon.c', '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]')] 2023-10-19T08:37:02.684 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.79,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-19T08:37:02.685 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:02.685 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-19T08:37:02.740 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.79 --add b 172.21.15.89 --addv c '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-19T08:37:02.829 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-19T08:37:02.829 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: generated fsid 98eaa3c1-94c8-49a6-8b8d-caae2bee3a98 2023-10-19T08:37:02.830 INFO:teuthology.orchestra.run.smithi079.stdout:setting min_mon_release = pacific 2023-10-19T08:37:02.830 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 0 2023-10-19T08:37:02.830 INFO:teuthology.orchestra.run.smithi079.stdout:fsid 98eaa3c1-94c8-49a6-8b8d-caae2bee3a98 2023-10-19T08:37:02.830 INFO:teuthology.orchestra.run.smithi079.stdout:last_changed 2023-10-19T08:37:02.826504+0000 2023-10-19T08:37:02.830 INFO:teuthology.orchestra.run.smithi079.stdout:created 2023-10-19T08:37:02.826504+0000 2023-10-19T08:37:02.831 INFO:teuthology.orchestra.run.smithi079.stdout:min_mon_release 16 (pacific) 2023-10-19T08:37:02.831 INFO:teuthology.orchestra.run.smithi079.stdout:election_strategy: 1 2023-10-19T08:37:02.831 INFO:teuthology.orchestra.run.smithi079.stdout:0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2023-10-19T08:37:02.831 INFO:teuthology.orchestra.run.smithi079.stdout:1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2023-10-19T08:37:02.831 INFO:teuthology.orchestra.run.smithi079.stdout:2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2023-10-19T08:37:02.832 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-19T08:37:02.833 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-19T08:37:02.849 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 98eaa3c1-94c8-49a6-8b8d-caae2bee3a98... 2023-10-19T08:37:02.850 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-19T08:37:02.893 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-19T08:37:02.936 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2023-10-19T08:37:02.936 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2023-10-19T08:37:02.936 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-19T08:37:02.936 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2023-10-19T08:37:02.936 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.937 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2023-10-19T08:37:02.937 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.937 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2023-10-19T08:37:02.937 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.937 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2023-10-19T08:37:02.938 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2023-10-19T08:37:02.938 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.938 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2023-10-19T08:37:02.938 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2023-10-19T08:37:02.938 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.939 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-19T08:37:02.939 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2023-10-19T08:37:02.939 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.939 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2023-10-19T08:37:02.939 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-19T08:37:02.940 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.940 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2023-10-19T08:37:02.940 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.940 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2023-10-19T08:37:02.940 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2023-10-19T08:37:02.940 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2023-10-19T08:37:02.941 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2023-10-19T08:37:02.941 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2023-10-19T08:37:02.941 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2023-10-19T08:37:02.941 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2023-10-19T08:37:02.941 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-19T08:37:02.942 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-19T08:37:02.942 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2023-10-19T08:37:02.942 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.942 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-19T08:37:02.942 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.943 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2023-10-19T08:37:02.943 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.943 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2023-10-19T08:37:02.943 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.944 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2023-10-19T08:37:02.944 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2023-10-19T08:37:02.944 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2023-10-19T08:37:02.944 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.79,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2023-10-19T08:37:02.944 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 98eaa3c1-94c8-49a6-8b8d-caae2bee3a98 2023-10-19T08:37:02.944 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.945 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2023-10-19T08:37:02.945 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2023-10-19T08:37:02.945 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.945 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2023-10-19T08:37:02.945 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2023-10-19T08:37:02.946 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2023-10-19T08:37:02.946 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.946 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2023-10-19T08:37:02.946 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2023-10-19T08:37:02.946 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.947 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2023-10-19T08:37:02.947 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2023-10-19T08:37:02.947 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2023-10-19T08:37:02.947 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.947 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2023-10-19T08:37:02.948 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2023-10-19T08:37:02.948 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.948 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2023-10-19T08:37:02.948 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.948 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2023-10-19T08:37:02.948 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.949 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2023-10-19T08:37:02.949 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.949 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2023-10-19T08:37:02.949 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2023-10-19T08:37:02.949 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.950 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2023-10-19T08:37:02.950 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2023-10-19T08:37:02.950 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2023-10-19T08:37:02.950 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2023-10-19T08:37:02.950 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 20 2023-10-19T08:37:02.951 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 20 2023-10-19T08:37:02.951 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-10-19T08:37:02.951 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2023-10-19T08:37:02.951 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 10 2023-10-19T08:37:02.951 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2023-10-19T08:37:02.952 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2023-10-19T08:37:02.952 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2023-10-19T08:37:02.952 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2023-10-19T08:37:02.952 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2023-10-19T08:37:02.952 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2023-10-19T08:37:02.953 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.953 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2023-10-19T08:37:02.953 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-10-19T08:37:02.953 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2023-10-19T08:37:02.953 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2023-10-19T08:37:02.953 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2023-10-19T08:37:02.954 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2023-10-19T08:37:02.954 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2023-10-19T08:37:02.954 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2023-10-19T08:37:02.954 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.954 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2023-10-19T08:37:02.955 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-10-19T08:37:02.955 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2023-10-19T08:37:02.955 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2023-10-19T08:37:02.955 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2023-10-19T08:37:02.955 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2023-10-19T08:37:02.956 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2023-10-19T08:37:02.956 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2023-10-19T08:37:02.956 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2023-10-19T08:37:02.956 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2023-10-19T08:37:02.956 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2023-10-19T08:37:02.957 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.957 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-19T08:37:02.957 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2023-10-19T08:37:02.957 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2023-10-19T08:37:02.957 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.958 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2023-10-19T08:37:02.958 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-19T08:37:02.958 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-19T08:37:02.958 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.958 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2023-10-19T08:37:02.959 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2023-10-19T08:37:02.959 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.959 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2023-10-19T08:37:02.959 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2023-10-19T08:37:02.959 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:02.959 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2023-10-19T08:37:02.960 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2023-10-19T08:37:02.960 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2023-10-19T08:37:02.960 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2023-10-19T08:37:02.960 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-19T08:37:02.960 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-19T08:37:02.961 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2023-10-19T08:37:02.961 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2023-10-19T08:37:02.961 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-10-19T08:37:02.961 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = "" 2023-10-19T08:37:02.961 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2023-10-19T08:37:02.962 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2023-10-19T08:37:02.962 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2023-10-19T08:37:02.962 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2023-10-19T08:37:02.962 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2023-10-19T08:37:02.962 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2023-10-19T08:37:02.963 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2023-10-19T08:37:02.963 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2023-10-19T08:37:02.963 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2023-10-19T08:37:02.963 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2023-10-19T08:37:02.963 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2023-10-19T08:37:02.963 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds balancer = 20 2023-10-19T08:37:02.964 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2023-10-19T08:37:02.964 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2023-10-19T08:37:02.964 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = True 2023-10-19T08:37:02.964 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2023-10-19T08:37:02.964 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = True 2023-10-19T08:37:02.965 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2023-10-19T08:37:02.965 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2023-10-19T08:37:02.965 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2023-10-19T08:37:02.966 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2023-10-19T08:37:02.967 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2023-10-19T08:37:02.967 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-19T08:37:02.967 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2023-10-19T08:37:02.967 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.968 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2023-10-19T08:37:02.968 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.968 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2023-10-19T08:37:02.968 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.968 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2023-10-19T08:37:02.969 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2023-10-19T08:37:02.969 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.969 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2023-10-19T08:37:02.969 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2023-10-19T08:37:02.969 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.970 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-19T08:37:02.970 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2023-10-19T08:37:02.970 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.970 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2023-10-19T08:37:02.970 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-19T08:37:02.971 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.971 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2023-10-19T08:37:02.971 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.971 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2023-10-19T08:37:02.971 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2023-10-19T08:37:02.972 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2023-10-19T08:37:02.972 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2023-10-19T08:37:02.972 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2023-10-19T08:37:02.972 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2023-10-19T08:37:02.972 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2023-10-19T08:37:02.972 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-19T08:37:02.973 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-19T08:37:02.973 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2023-10-19T08:37:02.973 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.973 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-19T08:37:02.973 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.974 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2023-10-19T08:37:02.974 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.974 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2023-10-19T08:37:02.974 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.974 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2023-10-19T08:37:02.975 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2023-10-19T08:37:02.975 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2023-10-19T08:37:02.975 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.79,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2023-10-19T08:37:02.975 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = 98eaa3c1-94c8-49a6-8b8d-caae2bee3a98 2023-10-19T08:37:02.975 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.976 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2023-10-19T08:37:02.976 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2023-10-19T08:37:02.976 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.976 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2023-10-19T08:37:02.976 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2023-10-19T08:37:02.976 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock profile = high_recovery_ops 2023-10-19T08:37:02.977 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.977 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2023-10-19T08:37:02.977 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2023-10-19T08:37:02.977 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.977 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2023-10-19T08:37:02.978 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2023-10-19T08:37:02.978 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2023-10-19T08:37:02.978 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.978 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2023-10-19T08:37:02.978 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2023-10-19T08:37:02.979 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.979 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2023-10-19T08:37:02.979 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.979 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2023-10-19T08:37:02.979 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.980 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2023-10-19T08:37:02.980 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.980 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2023-10-19T08:37:02.980 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2023-10-19T08:37:02.980 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.980 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2023-10-19T08:37:02.981 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2023-10-19T08:37:02.981 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2023-10-19T08:37:02.981 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2023-10-19T08:37:02.981 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 20 2023-10-19T08:37:02.981 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 20 2023-10-19T08:37:02.982 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-10-19T08:37:02.982 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2023-10-19T08:37:02.982 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 10 2023-10-19T08:37:02.982 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2023-10-19T08:37:02.982 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2023-10-19T08:37:02.983 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2023-10-19T08:37:02.983 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 0.95 2023-10-19T08:37:02.983 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = bluestore 2023-10-19T08:37:02.983 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2023-10-19T08:37:02.983 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.984 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2023-10-19T08:37:02.984 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-10-19T08:37:02.984 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2023-10-19T08:37:02.984 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-10-19T08:37:02.984 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-10-19T08:37:02.984 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-10-19T08:37:02.985 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-10-19T08:37:02.985 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2023-10-19T08:37:02.985 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.985 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2023-10-19T08:37:02.985 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-10-19T08:37:02.986 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-10-19T08:37:02.986 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2023-10-19T08:37:02.986 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-10-19T08:37:02.986 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2023-10-19T08:37:02.986 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2023-10-19T08:37:02.987 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-10-19T08:37:02.987 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2023-10-19T08:37:02.987 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2023-10-19T08:37:02.987 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-10-19T08:37:02.987 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.988 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-19T08:37:02.988 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2023-10-19T08:37:02.988 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2023-10-19T08:37:02.988 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.988 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2023-10-19T08:37:02.988 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-19T08:37:02.989 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-19T08:37:02.989 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.989 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2023-10-19T08:37:02.989 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2023-10-19T08:37:02.989 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.990 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2023-10-19T08:37:02.990 INFO:teuthology.orchestra.run.smithi089.stdout: mon op complaint time = 120 2023-10-19T08:37:02.990 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-10-19T08:37:02.990 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2023-10-19T08:37:02.990 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2023-10-19T08:37:02.991 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2023-10-19T08:37:02.991 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2023-10-19T08:37:02.991 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-19T08:37:02.991 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-19T08:37:02.991 INFO:teuthology.orchestra.run.smithi089.stdout: client mount timeout = 600 2023-10-19T08:37:02.992 INFO:teuthology.orchestra.run.smithi089.stdout: debug client = 20 2023-10-19T08:37:02.992 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-10-19T08:37:02.992 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = "" 2023-10-19T08:37:02.992 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2023-10-19T08:37:02.992 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2023-10-19T08:37:02.993 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2023-10-19T08:37:02.993 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2023-10-19T08:37:02.993 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2023-10-19T08:37:02.993 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2023-10-19T08:37:02.993 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2023-10-19T08:37:02.994 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2023-10-19T08:37:02.994 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.d] 2023-10-19T08:37:02.994 INFO:teuthology.orchestra.run.smithi089.stdout:[mds] 2023-10-19T08:37:02.994 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds = 20 2023-10-19T08:37:02.994 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds balancer = 20 2023-10-19T08:37:02.994 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-10-19T08:37:02.995 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug frag = True 2023-10-19T08:37:02.995 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug scatterstat = True 2023-10-19T08:37:02.995 INFO:teuthology.orchestra.run.smithi089.stdout: mds op complaint time = 180 2023-10-19T08:37:02.995 INFO:teuthology.orchestra.run.smithi089.stdout: mds verify scatter = True 2023-10-19T08:37:02.995 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2023-10-19T08:37:02.996 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2023-10-19T08:37:02.996 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2023-10-19T08:37:02.996 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-19T08:37:02.997 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-19T08:37:03.064 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-19T08:37:03.064 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:03.065 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-19T08:37:03.081 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:03.081 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-19T08:37:03.138 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi079.front.sepia.ceph.com 2023-10-19T08:37:03.138 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:03.139 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-19T08:37:03.139 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-19T08:37:03.215 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:03.215 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-19T08:37:03.272 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2023-10-19T08:37:03.272 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:37:03.272 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-19T08:37:03.273 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-19T08:37:03.314 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:37:03.315 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-19T08:37:03.373 INFO:tasks.ceph:Setting up mon nodes... 2023-10-19T08:37:03.373 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-19T08:37:03.373 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-19T08:37:03.426 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-19T08:37:03.429 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-19T08:37:03.499 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-19T08:37:03.501 INFO:tasks.ceph:Setting up mds nodes... 2023-10-19T08:37:03.502 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-19T08:37:03.555 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-19T08:37:03.557 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-19T08:37:03.583 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-19T08:37:03.676 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-19T08:37:03.678 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-19T08:37:03.705 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-19T08:37:03.760 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-19T08:37:03.763 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-19T08:37:03.790 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-19T08:37:03.884 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-19T08:37:03.886 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-19T08:37:03.912 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-19T08:37:03.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-19T08:37:03.956 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-19T08:37:03.969 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-19T08:37:04.053 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-19T08:37:04.066 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-19T08:37:04.109 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-19T08:37:04.122 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-19T08:37:04.205 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-19T08:37:04.218 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-19T08:37:04.219 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-19T08:37:04.219 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-19T08:37:04.246 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-19T08:37:04.246 INFO:tasks.ceph:role: osd.0 2023-10-19T08:37:04.247 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-19T08:37:04.247 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-19T08:37:04.320 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-19T08:37:04.320 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-19T08:37:04.320 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-19T08:37:04.321 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-19T08:37:04.321 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-19T08:37:04.321 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-10-19T08:37:04.321 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-19T08:37:04.321 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-19T08:37:04.322 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-19T08:37:04.322 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-19T08:37:04.748 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-10-19T08:37:04.750 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-10-19T08:37:04.751 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-19T08:37:04.931 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-19T08:37:04.967 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-19T08:37:05.036 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-19T08:37:05.036 INFO:tasks.ceph:role: osd.1 2023-10-19T08:37:05.036 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-19T08:37:05.037 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-19T08:37:05.110 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-19T08:37:05.111 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-19T08:37:05.111 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-19T08:37:05.111 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-19T08:37:05.111 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-19T08:37:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-10-19T08:37:05.112 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-19T08:37:05.112 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-19T08:37:05.112 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-19T08:37:05.113 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-19T08:37:05.526 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-10-19T08:37:05.528 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-10-19T08:37:05.528 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-19T08:37:05.648 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-19T08:37:05.680 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-19T08:37:05.747 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-19T08:37:05.748 INFO:tasks.ceph:role: osd.2 2023-10-19T08:37:05.748 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-19T08:37:05.748 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-19T08:37:05.822 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-19T08:37:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-19T08:37:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-19T08:37:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-19T08:37:05.823 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-19T08:37:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-10-19T08:37:05.824 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-19T08:37:05.824 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-19T08:37:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-19T08:37:05.824 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-19T08:37:06.270 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-10-19T08:37:06.271 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-10-19T08:37:06.272 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-19T08:37:06.425 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-19T08:37:06.456 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-19T08:37:06.523 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-19T08:37:06.523 INFO:tasks.ceph:role: osd.3 2023-10-19T08:37:06.523 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-19T08:37:06.524 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-19T08:37:06.597 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-19T08:37:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-19T08:37:06.597 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-19T08:37:06.598 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-19T08:37:06.598 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-19T08:37:06.598 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2023-10-19T08:37:06.598 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-19T08:37:06.599 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-19T08:37:06.599 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-19T08:37:06.599 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-19T08:37:07.042 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2023-10-19T08:37:07.043 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2023-10-19T08:37:07.044 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-19T08:37:07.225 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-19T08:37:07.257 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-19T08:37:07.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:07.358+0000 7fb270d33640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-19T08:37:07.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:07.358+0000 7fb270d33640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-19T08:37:07.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:07.358+0000 7fb270d33640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-19T08:37:07.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:07.358+0000 7fb270d33640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-19T08:37:07.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:07.358+0000 7fb270d33640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-19T08:37:07.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:07.358+0000 7fb270d33640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-19T08:37:10.227 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-19T08:37:10.257 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-19T08:37:10.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:10.342+0000 7f1fa947c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-19T08:37:10.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:10.342+0000 7f1fa947c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-19T08:37:10.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:10.342+0000 7f1fa947c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-19T08:37:10.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:10.342+0000 7f1fa947c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-19T08:37:10.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:10.342+0000 7f1fa947c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-19T08:37:10.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:10.343+0000 7f1fa947c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-19T08:37:13.221 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-19T08:37:13.253 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-19T08:37:13.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:13.341+0000 7f89a8ab2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-19T08:37:13.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:13.341+0000 7f89a8ab2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-19T08:37:13.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:13.341+0000 7f89a8ab2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-19T08:37:13.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:13.341+0000 7f89a8ab2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-19T08:37:13.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:13.341+0000 7f89a8ab2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-19T08:37:13.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:13.342+0000 7f89a8ab2640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-19T08:37:16.213 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-19T08:37:16.244 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-19T08:37:16.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:16.331+0000 7f08a3fd6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-19T08:37:16.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:16.331+0000 7f08a3fd6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-19T08:37:16.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:16.331+0000 7f08a3fd6640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-19T08:37:16.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:16.331+0000 7f08a3fd6640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-19T08:37:16.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:16.331+0000 7f08a3fd6640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-19T08:37:16.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:16.332+0000 7f08a3fd6640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-19T08:37:19.219 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-19T08:37:19.251 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-19T08:37:19.284 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-19T08:37:19.284 INFO:tasks.ceph:role: osd.4 2023-10-19T08:37:19.284 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-19T08:37:19.285 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-19T08:37:19.361 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-19T08:37:19.362 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-19T08:37:19.362 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-19T08:37:19.362 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-19T08:37:19.364 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-19T08:37:19.364 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-10-19T08:37:19.364 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-19T08:37:19.365 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-19T08:37:19.365 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-19T08:37:19.365 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-19T08:37:19.796 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-10-19T08:37:19.798 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-10-19T08:37:19.798 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-19T08:37:19.972 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-19T08:37:20.007 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-19T08:37:20.077 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-19T08:37:20.078 INFO:tasks.ceph:role: osd.5 2023-10-19T08:37:20.078 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-19T08:37:20.079 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-19T08:37:20.153 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-19T08:37:20.154 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-19T08:37:20.154 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-19T08:37:20.154 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-19T08:37:20.154 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-19T08:37:20.155 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-10-19T08:37:20.155 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-19T08:37:20.155 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-19T08:37:20.155 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-19T08:37:20.155 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-19T08:37:20.575 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-10-19T08:37:20.576 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-10-19T08:37:20.577 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-19T08:37:20.692 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-19T08:37:20.725 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-19T08:37:20.793 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-19T08:37:20.794 INFO:tasks.ceph:role: osd.6 2023-10-19T08:37:20.794 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-19T08:37:20.794 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-19T08:37:20.869 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-19T08:37:20.870 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-19T08:37:20.870 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-19T08:37:20.870 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-19T08:37:20.871 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-19T08:37:20.871 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-10-19T08:37:20.871 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-19T08:37:20.871 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-19T08:37:20.871 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-19T08:37:20.871 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-19T08:37:21.320 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-10-19T08:37:21.322 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-10-19T08:37:21.322 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-19T08:37:21.509 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-19T08:37:21.545 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-19T08:37:21.615 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-19T08:37:21.616 INFO:tasks.ceph:role: osd.7 2023-10-19T08:37:21.616 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com 2023-10-19T08:37:21.617 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-19T08:37:21.693 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-19T08:37:21.693 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-19T08:37:21.693 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-19T08:37:21.694 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-19T08:37:21.694 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-19T08:37:21.694 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-10-19T08:37:21.694 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-19T08:37:21.694 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-19T08:37:21.695 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-19T08:37:21.695 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-19T08:37:22.131 INFO:teuthology.orchestra.run.smithi089.stdout:Discarding blocks...Done. 2023-10-19T08:37:22.133 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-10-19T08:37:22.133 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-19T08:37:22.310 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-19T08:37:22.347 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-19T08:37:22.588 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:22.584+0000 7f7f5c079640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-19T08:37:22.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:22.584+0000 7f7f5c079640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-19T08:37:22.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:22.584+0000 7f7f5c079640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-19T08:37:22.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:22.584+0000 7f7f5c079640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-19T08:37:22.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:22.584+0000 7f7f5c079640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-19T08:37:22.589 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:22.584+0000 7f7f5c079640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-19T08:37:25.464 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-19T08:37:25.495 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-19T08:37:25.586 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:25.581+0000 7fbeaf023640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-19T08:37:25.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:25.582+0000 7fbeaf023640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-19T08:37:25.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:25.582+0000 7fbeaf023640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-19T08:37:25.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:25.582+0000 7fbeaf023640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-19T08:37:25.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:25.582+0000 7fbeaf023640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-19T08:37:25.587 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:25.582+0000 7fbeaf023640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-19T08:37:28.445 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-19T08:37:28.477 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-19T08:37:28.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:28.563+0000 7f11acea1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-19T08:37:28.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:28.564+0000 7f11acea1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-19T08:37:28.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:28.564+0000 7f11acea1640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-19T08:37:28.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:28.564+0000 7f11acea1640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-19T08:37:28.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:28.564+0000 7f11acea1640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-19T08:37:28.569 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:28.564+0000 7f11acea1640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-19T08:37:30.882 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-19T08:37:30.885 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-19T08:37:31.435 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-19T08:37:31.467 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-19T08:37:31.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:31.554+0000 7f39f0528640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-19T08:37:31.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:31.554+0000 7f39f0528640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-19T08:37:31.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:31.554+0000 7f39f0528640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-19T08:37:31.558 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:31.554+0000 7f39f0528640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-19T08:37:31.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:31.554+0000 7f39f0528640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-19T08:37:31.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:31.555+0000 7f39f0528640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-19T08:37:34.425 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-19T08:37:34.457 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-19T08:37:34.458 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:34.458 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-19T08:37:34.490 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:34.490 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-19T08:37:34.561 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:34.561 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-19T08:37:34.631 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:34.631 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-19T08:37:34.699 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:34.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-19T08:37:34.767 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:34.768 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-19T08:37:34.837 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:34.837 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-19T08:37:34.905 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:37:34.906 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-19T08:37:34.938 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:37:34.938 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-19T08:37:35.008 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:37:35.008 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-19T08:37:35.076 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:37:35.077 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-19T08:37:35.145 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:37:35.145 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-19T08:37:35.213 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:37:35.213 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-19T08:37:35.281 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:37:35.281 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-19T08:37:35.349 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:35.349 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-19T08:37:35.370 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:35.370 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-19T08:37:35.428 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:37:35.429 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-19T08:37:35.447 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:37:35.447 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-19T08:37:35.504 INFO:tasks.ceph:Adding keys to all mons... 2023-10-19T08:37:35.504 DEBUG:teuthology.orchestra.run.smithi079:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-19T08:37:35.506 DEBUG:teuthology.orchestra.run.smithi089:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-19T08:37:35.547 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.y] 2023-10-19T08:37:35.548 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCv6jBll1dKGRAAcKZS0nDWub5kgQZ4ShNAwA== 2023-10-19T08:37:35.548 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2023-10-19T08:37:35.548 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCv6jBlnJvyIBAA5CCYUY/m7XTuBBbaH2faUQ== 2023-10-19T08:37:35.549 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2023-10-19T08:37:35.549 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCv6jBlE+UmKBAAQcGew88xsfCbIeH6sKoKHg== 2023-10-19T08:37:35.549 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.0] 2023-10-19T08:37:35.550 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCz6jBlKpxjFRAA7bc2CQz4Nug/Fkzdoc7sHQ== 2023-10-19T08:37:35.550 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.1] 2023-10-19T08:37:35.551 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQC26jBlCEmDFBAAKcEobHtHlfHwF2oJdyXONw== 2023-10-19T08:37:35.551 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.2] 2023-10-19T08:37:35.551 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQC56jBl/ltwFBAAHdF1nNg0I5VDBPcVMzUl1g== 2023-10-19T08:37:35.552 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.3] 2023-10-19T08:37:35.552 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQC86jBleC/cExAALSOi1fgmoBwhkgg+mY38ug== 2023-10-19T08:37:35.552 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.x] 2023-10-19T08:37:35.552 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCv6jBlZFuYHRAAVAyQYSMzID3fBQDreAsrEQ== 2023-10-19T08:37:35.552 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2023-10-19T08:37:35.553 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCv6jBlSGcxLRAArR4Yisfda8hNdE24VX+Iew== 2023-10-19T08:37:35.553 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2023-10-19T08:37:35.553 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCv6jBlfqWMNBAA+yfxFN/u0YqO3C8vNdaUQg== 2023-10-19T08:37:35.553 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.4] 2023-10-19T08:37:35.553 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDC6jBll/jlIhAAn331gpqzITvkjY/ODrPORw== 2023-10-19T08:37:35.554 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.5] 2023-10-19T08:37:35.554 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDF6jBl0MHDIhAALJq+E3GIdtx9z0pUISKVGQ== 2023-10-19T08:37:35.554 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.6] 2023-10-19T08:37:35.554 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDI6jBlfxawIRAAfbj0ibYV6zAX5ItB2t4zKQ== 2023-10-19T08:37:35.554 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.7] 2023-10-19T08:37:35.555 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDL6jBldjkUIRAAWESg3WqLjepitJakeSSawA== 2023-10-19T08:37:35.555 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2023-10-19T08:37:35.555 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCv6jBlFLbeOBAAsiQ+nNFDq+Mc3VC54pqOmw== 2023-10-19T08:37:35.555 INFO:teuthology.orchestra.run.smithi079.stdout:[client.2] 2023-10-19T08:37:35.555 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCw6jBln8MDAxAAAPzm3ecYTPTNPG9eq1dj/g== 2023-10-19T08:37:35.556 INFO:teuthology.orchestra.run.smithi079.stdout:[client.1] 2023-10-19T08:37:35.556 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCw6jBljjRbBhAANTvUjVBQixD9X3Qc3kbVgw== 2023-10-19T08:37:35.556 INFO:teuthology.orchestra.run.smithi079.stdout:[client.3] 2023-10-19T08:37:35.556 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCw6jBlJy8eDBAAxtalioH9VY4HglfA57v1rA== 2023-10-19T08:37:35.569 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.y] 2023-10-19T08:37:35.569 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCv6jBll1dKGRAAcKZS0nDWub5kgQZ4ShNAwA== 2023-10-19T08:37:35.570 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2023-10-19T08:37:35.570 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCv6jBlnJvyIBAA5CCYUY/m7XTuBBbaH2faUQ== 2023-10-19T08:37:35.570 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2023-10-19T08:37:35.570 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCv6jBlE+UmKBAAQcGew88xsfCbIeH6sKoKHg== 2023-10-19T08:37:35.570 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2023-10-19T08:37:35.571 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCz6jBlKpxjFRAA7bc2CQz4Nug/Fkzdoc7sHQ== 2023-10-19T08:37:35.571 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2023-10-19T08:37:35.571 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQC26jBlCEmDFBAAKcEobHtHlfHwF2oJdyXONw== 2023-10-19T08:37:35.571 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2023-10-19T08:37:35.572 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQC56jBl/ltwFBAAHdF1nNg0I5VDBPcVMzUl1g== 2023-10-19T08:37:35.572 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.3] 2023-10-19T08:37:35.572 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQC86jBleC/cExAALSOi1fgmoBwhkgg+mY38ug== 2023-10-19T08:37:35.572 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.x] 2023-10-19T08:37:35.573 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCv6jBlZFuYHRAAVAyQYSMzID3fBQDreAsrEQ== 2023-10-19T08:37:35.573 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2023-10-19T08:37:35.573 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCv6jBlSGcxLRAArR4Yisfda8hNdE24VX+Iew== 2023-10-19T08:37:35.573 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.d] 2023-10-19T08:37:35.574 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCv6jBlfqWMNBAA+yfxFN/u0YqO3C8vNdaUQg== 2023-10-19T08:37:35.574 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.4] 2023-10-19T08:37:35.574 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDC6jBll/jlIhAAn331gpqzITvkjY/ODrPORw== 2023-10-19T08:37:35.574 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.5] 2023-10-19T08:37:35.574 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDF6jBl0MHDIhAALJq+E3GIdtx9z0pUISKVGQ== 2023-10-19T08:37:35.575 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.6] 2023-10-19T08:37:35.575 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDI6jBlfxawIRAAfbj0ibYV6zAX5ItB2t4zKQ== 2023-10-19T08:37:35.575 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.7] 2023-10-19T08:37:35.575 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQDL6jBldjkUIRAAWESg3WqLjepitJakeSSawA== 2023-10-19T08:37:35.575 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2023-10-19T08:37:35.576 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCv6jBlFLbeOBAAsiQ+nNFDq+Mc3VC54pqOmw== 2023-10-19T08:37:35.576 INFO:teuthology.orchestra.run.smithi089.stdout:[client.2] 2023-10-19T08:37:35.576 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCw6jBln8MDAxAAAPzm3ecYTPTNPG9eq1dj/g== 2023-10-19T08:37:35.576 INFO:teuthology.orchestra.run.smithi089.stdout:[client.1] 2023-10-19T08:37:35.576 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCw6jBljjRbBhAANTvUjVBQixD9X3Qc3kbVgw== 2023-10-19T08:37:35.577 INFO:teuthology.orchestra.run.smithi089.stdout:[client.3] 2023-10-19T08:37:35.577 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQCw6jBlJy8eDBAAxtalioH9VY4HglfA57v1rA== 2023-10-19T08:37:35.578 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-19T08:37:35.599 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-19T08:37:35.671 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-19T08:37:35.674 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-19T08:37:35.731 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-19T08:37:35.733 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-19T08:37:35.789 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-19T08:37:35.792 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-19T08:37:35.844 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-19T08:37:35.847 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-19T08:37:35.900 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-19T08:37:35.902 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-19T08:37:35.954 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-19T08:37:35.957 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-19T08:37:36.009 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-19T08:37:36.012 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-19T08:37:36.065 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-19T08:37:36.068 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-19T08:37:36.124 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-19T08:37:36.126 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-19T08:37:36.182 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-19T08:37:36.184 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-19T08:37:36.237 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-19T08:37:36.239 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-19T08:37:36.292 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-19T08:37:36.294 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-19T08:37:36.347 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-19T08:37:36.350 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-19T08:37:36.403 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-19T08:37:36.405 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-19T08:37:36.462 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-19T08:37:36.464 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-19T08:37:36.520 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-19T08:37:36.523 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-19T08:37:36.579 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-19T08:37:36.581 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-19T08:37:36.637 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-19T08:37:36.637 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-19T08:37:36.664 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-19T08:37:36.761 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-19T08:37:36.788 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-19T08:37:36.815 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-19T08:37:36.913 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-19T08:37:36.939 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-19T08:37:37.006 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-19T08:37:37.103 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-19T08:37:37.129 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-19T08:37:37.131 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-19T08:37:37.185 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-19T08:37:37.185 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-19T08:37:37.186 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-19T08:37:37.188 INFO:tasks.ceph.mon.a:Started 2023-10-19T08:37:37.188 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-19T08:37:37.189 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-19T08:37:37.227 INFO:tasks.ceph.mon.b:Started 2023-10-19T08:37:37.228 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-19T08:37:37.228 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-19T08:37:37.230 INFO:tasks.ceph.mon.c:Started 2023-10-19T08:37:37.230 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-19T08:37:37.231 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-19T08:37:37.231 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-19T08:37:37.233 INFO:tasks.ceph.mgr.y:Started 2023-10-19T08:37:37.233 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-19T08:37:37.234 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-19T08:37:37.236 INFO:tasks.ceph.mgr.x:Started 2023-10-19T08:37:37.236 INFO:tasks.ceph:Setting crush tunables to default 2023-10-19T08:37:37.236 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd crush tunables default 2023-10-19T08:37:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.356+0000 7ff92a082700 1 Processor -- start 2023-10-19T08:37:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.356+0000 7ff92a082700 1 -- start start 2023-10-19T08:37:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.356+0000 7ff92a082700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff9240b1de0 0x7ff9240b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.356+0000 7ff92a082700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9240cc700 con 0x7ff9240b22e0 2023-10-19T08:37:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.356+0000 7ff92a082700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9240cc9e0 con 0x7ff924159d40 2023-10-19T08:37:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.356+0000 7ff92a082700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff92415a120 con 0x7ff9240b1de0 2023-10-19T08:37:37.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.357+0000 7ff923fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff9240b22e0 0x7ff9240cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55120/0 (socket says 172.21.15.79:55120) 2023-10-19T08:37:37.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.357+0000 7ff923fff700 1 -- 172.21.15.79:0/1487848332 learned_addr learned my addr 172.21.15.79:0/1487848332 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:37:37.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.357+0000 7ff922ffd700 1 --2- 172.21.15.79:0/1487848332 >> v2:172.21.15.89:3300/0 conn(0x7ff9240b1de0 0x7ff9240b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:37.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.357+0000 7ff922ffd700 1 -- 172.21.15.79:0/1487848332 >> v2:172.21.15.89:3300/0 conn(0x7ff9240b1de0 msgr2=0x7ff9240b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-19T08:37:37.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.357+0000 7ff922ffd700 1 -- 172.21.15.79:0/1487848332 >> v2:172.21.15.89:3300/0 conn(0x7ff9240b1de0 msgr2=0x7ff9240b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-19T08:37:37.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.357+0000 7ff922ffd700 1 --2- 172.21.15.79:0/1487848332 >> v2:172.21.15.89:3300/0 conn(0x7ff9240b1de0 0x7ff9240b55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-19T08:37:37.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.357+0000 7ff922ffd700 1 --2- 172.21.15.79:0/1487848332 >> v2:172.21.15.89:3300/0 conn(0x7ff9240b1de0 0x7ff9240b55c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-19T08:37:37.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.539+0000 7ff9227fc700 1 -- 172.21.15.79:0/1487848332 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582349303 0 0) 0x7ff9240cc700 con 0x7ff9240b22e0 2023-10-19T08:37:37.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.539+0000 7ff9227fc700 1 -- 172.21.15.79:0/1487848332 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9100057c0 con 0x7ff9240b22e0 2023-10-19T08:37:37.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.540+0000 7ff9227fc700 1 -- 172.21.15.79:0/1487848332 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2900467849 0 0) 0x7ff9100057c0 con 0x7ff9240b22e0 2023-10-19T08:37:37.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.540+0000 7ff9227fc700 1 -- 172.21.15.79:0/1487848332 >> v2:172.21.15.89:3300/0 conn(0x7ff9240b1de0 msgr2=0x7ff9240b55c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-19T08:37:37.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.540+0000 7ff9227fc700 1 --2- 172.21.15.79:0/1487848332 >> v2:172.21.15.89:3300/0 conn(0x7ff9240b1de0 0x7ff9240b55c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:37.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.540+0000 7ff9227fc700 1 -- 172.21.15.79:0/1487848332 >> v1:172.21.15.89:6789/0 conn(0x7ff924159d40 legacy=0x7ff9240b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:37.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.540+0000 7ff9227fc700 1 -- 172.21.15.79:0/1487848332 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9240cccc0 con 0x7ff9240b22e0 2023-10-19T08:37:37.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.540+0000 7ff9227fc700 1 -- 172.21.15.79:0/1487848332 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7ff91c001670 con 0x7ff9240b22e0 2023-10-19T08:37:37.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.540+0000 7ff9227fc700 1 -- 172.21.15.79:0/1487848332 >> v1:172.21.15.79:6789/0 conn(0x7ff9240b22e0 legacy=0x7ff9240cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:37.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.540+0000 7ff9227fc700 1 --2- 172.21.15.79:0/1487848332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff910005c80 0x7ff9100060a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:37.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.540+0000 7ff9227fc700 1 --2- 172.21.15.79:0/1487848332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff910006a60 0x7ff910006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:37.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.540+0000 7ff9227fc700 1 --2- 172.21.15.79:0/1487848332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff910007490 0x7ff91000dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:37.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.540+0000 7ff9227fc700 1 -- 172.21.15.79:0/1487848332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92415a120 con 0x7ff910005c80 2023-10-19T08:37:37.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.540+0000 7ff9227fc700 1 -- 172.21.15.79:0/1487848332 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91000e3f0 con 0x7ff910007490 2023-10-19T08:37:37.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.540+0000 7ff9227fc700 1 -- 172.21.15.79:0/1487848332 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91000e5b0 con 0x7ff910006a60 2023-10-19T08:37:37.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.540+0000 7ff9237fe700 1 --2- 172.21.15.79:0/1487848332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff910005c80 0x7ff9100060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:37.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.540+0000 7ff923fff700 1 --2- 172.21.15.79:0/1487848332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff910007490 0x7ff91000dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:37.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.540+0000 7ff922ffd700 1 --2- 172.21.15.79:0/1487848332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff910006a60 0x7ff910006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:37.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.540+0000 7ff9237fe700 1 -- 172.21.15.79:0/1487848332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff910006a60 msgr2=0x7ff910006ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:37.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.541+0000 7ff9237fe700 1 --2- 172.21.15.79:0/1487848332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff910006a60 0x7ff910006ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:37.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.541+0000 7ff9237fe700 1 -- 172.21.15.79:0/1487848332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff910007490 msgr2=0x7ff91000dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:37.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.541+0000 7ff9237fe700 1 --2- 172.21.15.79:0/1487848332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff910007490 0x7ff91000dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:37.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.541+0000 7ff9237fe700 1 -- 172.21.15.79:0/1487848332 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9100057c0 con 0x7ff910005c80 2023-10-19T08:37:37.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.541+0000 7ff922ffd700 1 --2- 172.21.15.79:0/1487848332 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff910006a60 0x7ff910006ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:37:37.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.541+0000 7ff923fff700 1 --2- 172.21.15.79:0/1487848332 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff910007490 0x7ff91000dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:37:37.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.541+0000 7ff923fff700 1 -- 172.21.15.79:0/1487848332 reap_dead start 2023-10-19T08:37:37.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.541+0000 7ff9237fe700 1 --2- 172.21.15.79:0/1487848332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff910005c80 0x7ff9100060a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff91400c190 tx=0x7ff910007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b8f4af0aaf1241 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:37.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.541+0000 7ff9227fc700 1 -- 172.21.15.79:0/1487848332 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914001db0 con 0x7ff910005c80 2023-10-19T08:37:37.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.541+0000 7ff9227fc700 1 -- 172.21.15.79:0/1487848332 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91400ccf0 con 0x7ff910005c80 2023-10-19T08:37:37.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.541+0000 7ff9227fc700 1 -- 172.21.15.79:0/1487848332 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914003c40 con 0x7ff910005c80 2023-10-19T08:37:37.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.542+0000 7ff92a082700 1 -- 172.21.15.79:0/1487848332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff910005c80 msgr2=0x7ff9100060a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:37.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.542+0000 7ff92a082700 1 --2- 172.21.15.79:0/1487848332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff910005c80 0x7ff9100060a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff91400c190 tx=0x7ff910007a90 comp rx=0 tx=0).stop 2023-10-19T08:37:37.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.542+0000 7ff92a082700 1 -- 172.21.15.79:0/1487848332 shutdown_connections 2023-10-19T08:37:37.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.542+0000 7ff92a082700 1 --2- 172.21.15.79:0/1487848332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff910005c80 0x7ff9100060a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:37.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.542+0000 7ff92a082700 1 -- 172.21.15.79:0/1487848332 >> 172.21.15.79:0/1487848332 conn(0x7ff92406dce0 msgr2=0x7ff92406e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:37.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.542+0000 7ff92a082700 1 -- 172.21.15.79:0/1487848332 shutdown_connections 2023-10-19T08:37:37.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.542+0000 7ff92a082700 1 -- 172.21.15.79:0/1487848332 wait complete. 2023-10-19T08:37:37.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.543+0000 7ff92a082700 1 Processor -- start 2023-10-19T08:37:37.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.543+0000 7ff92a082700 1 -- start start 2023-10-19T08:37:37.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.544+0000 7ff92a082700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff910005c80 0x7ff92415c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:37.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.544+0000 7ff92a082700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9240c4860 0x7ff92415ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:37.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.544+0000 7ff92a082700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9241f27f0 0x7ff92414d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:37.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.544+0000 7ff92a082700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92415b4c0 con 0x7ff9241f27f0 2023-10-19T08:37:37.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.544+0000 7ff92a082700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff92415b7a0 con 0x7ff9240c4860 2023-10-19T08:37:37.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.544+0000 7ff92a082700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92415ba80 con 0x7ff910005c80 2023-10-19T08:37:37.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.544+0000 7ff9237fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff910005c80 0x7ff92415c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:37.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.545+0000 7ff922ffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9240c4860 0x7ff92415ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:37.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.545+0000 7ff9237fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff910005c80 0x7ff92415c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:47690/0 (socket says 172.21.15.79:47690) 2023-10-19T08:37:37.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.545+0000 7ff9237fe700 1 -- 172.21.15.79:0/1074120120 learned_addr learned my addr 172.21.15.79:0/1074120120 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:37.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.545+0000 7ff923fff700 1 --2- 172.21.15.79:0/1074120120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9241f27f0 0x7ff92414d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:37.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.545+0000 7ff923fff700 1 -- 172.21.15.79:0/1074120120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff910005c80 msgr2=0x7ff92415c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:37.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.545+0000 7ff923fff700 1 --2- 172.21.15.79:0/1074120120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff910005c80 0x7ff92415c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:37.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.545+0000 7ff923fff700 1 -- 172.21.15.79:0/1074120120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9240c4860 msgr2=0x7ff92415ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:37.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.545+0000 7ff923fff700 1 --2- 172.21.15.79:0/1074120120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9240c4860 0x7ff92415ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:37.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.545+0000 7ff923fff700 1 -- 172.21.15.79:0/1074120120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92415bd60 con 0x7ff9241f27f0 2023-10-19T08:37:37.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.545+0000 7ff9237fe700 1 --2- 172.21.15.79:0/1074120120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff910005c80 0x7ff92415c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:37:37.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.545+0000 7ff922ffd700 1 --2- 172.21.15.79:0/1074120120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9240c4860 0x7ff92415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:37:37.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.545+0000 7ff923fff700 1 --2- 172.21.15.79:0/1074120120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9241f27f0 0x7ff92414d080 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff9240b27b0 tx=0x7ff91c00d7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:37.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.546+0000 7ff91bfff700 1 -- 172.21.15.79:0/1074120120 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c004a70 con 0x7ff9241f27f0 2023-10-19T08:37:37.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.546+0000 7ff91bfff700 1 -- 172.21.15.79:0/1074120120 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91c004bf0 con 0x7ff9241f27f0 2023-10-19T08:37:37.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.546+0000 7ff91bfff700 1 -- 172.21.15.79:0/1074120120 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91c007070 con 0x7ff9241f27f0 2023-10-19T08:37:37.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.546+0000 7ff92a082700 1 -- 172.21.15.79:0/1074120120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92415c040 con 0x7ff9241f27f0 2023-10-19T08:37:37.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.546+0000 7ff92a082700 1 -- 172.21.15.79:0/1074120120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9241f2c70 con 0x7ff9241f27f0 2023-10-19T08:37:37.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.547+0000 7ff91bfff700 1 -- 172.21.15.79:0/1074120120 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff91c0071d0 con 0x7ff9241f27f0 2023-10-19T08:37:37.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.547+0000 7ff91bfff700 1 -- 172.21.15.79:0/1074120120 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff91c014d80 con 0x7ff9241f27f0 2023-10-19T08:37:37.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.547+0000 7ff92a082700 1 -- 172.21.15.79:0/1074120120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9241f2ec0 con 0x7ff9241f27f0 2023-10-19T08:37:37.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.549+0000 7ff91bfff700 1 -- 172.21.15.79:0/1074120120 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff91c007610 con 0x7ff9241f27f0 2023-10-19T08:37:37.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.625+0000 7ff92a082700 1 -- 172.21.15.79:0/1074120120 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff92404ee70 con 0x7ff9241f27f0 2023-10-19T08:37:37.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.627+0000 7ff91bfff700 1 -- 172.21.15.79:0/1074120120 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff91c014430 con 0x7ff9241f27f0 2023-10-19T08:37:37.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.628+0000 7ff92a082700 1 -- 172.21.15.79:0/1074120120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9241f27f0 msgr2=0x7ff92414d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:37.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.628+0000 7ff92a082700 1 --2- 172.21.15.79:0/1074120120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9241f27f0 0x7ff92414d080 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff9240b27b0 tx=0x7ff91c00d7a0 comp rx=0 tx=0).stop 2023-10-19T08:37:37.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.628+0000 7ff92a082700 1 -- 172.21.15.79:0/1074120120 shutdown_connections 2023-10-19T08:37:37.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.628+0000 7ff92a082700 1 --2- 172.21.15.79:0/1074120120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff9241f27f0 0x7ff92414d080 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:37.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.628+0000 7ff92a082700 1 --2- 172.21.15.79:0/1074120120 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff910005c80 0x7ff92415c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:37.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.628+0000 7ff92a082700 1 --2- 172.21.15.79:0/1074120120 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9240c4860 0x7ff92415ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:37.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.628+0000 7ff92a082700 1 -- 172.21.15.79:0/1074120120 >> 172.21.15.79:0/1074120120 conn(0x7ff92406dce0 msgr2=0x7ff9240b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:37.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.629+0000 7ff92a082700 1 -- 172.21.15.79:0/1074120120 shutdown_connections 2023-10-19T08:37:37.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:37.629+0000 7ff92a082700 1 -- 172.21.15.79:0/1074120120 wait complete. 2023-10-19T08:37:37.635 INFO:teuthology.orchestra.run.smithi079.stderr:adjusted tunables profile to default 2023-10-19T08:37:37.644 INFO:tasks.ceph:check_enable_crimson: False 2023-10-19T08:37:37.644 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-19T08:37:37.645 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:37.645 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-19T08:37:37.665 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:37.662+0000 7f1c359e2200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-19T08:37:37.666 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:37.662+0000 7fae2a735200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-19T08:37:37.673 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:37.674 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-19T08:37:37.730 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:37.727+0000 7f1c359e2200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-19T08:37:37.736 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:37.733+0000 7fae2a735200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-19T08:37:37.741 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:37.741 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-19T08:37:37.805 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:37.802+0000 7f1c359e2200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-19T08:37:37.807 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:37:37.808 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-19T08:37:37.816 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:37.812+0000 7fae2a735200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-19T08:37:37.841 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:37:37.842 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-19T08:37:37.869 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:37:37.869 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-19T08:37:37.886 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:37.883+0000 7f1c359e2200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-19T08:37:37.898 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:37.895+0000 7fae2a735200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-19T08:37:37.911 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:37:37.912 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-19T08:37:37.980 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:37:37.981 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-19T08:37:38.037 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:38.034+0000 7f1c359e2200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-19T08:37:38.039 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:38.036+0000 7fae2a735200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-19T08:37:38.047 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 8fc732cf-6693-47af-b4fa-58f49d64d4b7 0 2023-10-19T08:37:38.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.205+0000 7fb242dd2700 1 Processor -- start 2023-10-19T08:37:38.208 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.205+0000 7fb242dd2700 1 -- start start 2023-10-19T08:37:38.210 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.206+0000 7fb242dd2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb23c0b1de0 0x7fb23c0b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:38.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.206+0000 7fb242dd2700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23c0cc700 con 0x7fb23c159d40 2023-10-19T08:37:38.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.206+0000 7fb242dd2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23c0cc9e0 con 0x7fb23c0b22e0 2023-10-19T08:37:38.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.206+0000 7fb242dd2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23c15a120 con 0x7fb23c0b1de0 2023-10-19T08:37:38.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.206+0000 7fb23bfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb23c0b1de0 0x7fb23c0b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:38.211 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.206+0000 7fb24136f700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fb23c0b22e0 0x7fb23c0cdc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:53708/0 (socket says 172.21.15.89:53708) 2023-10-19T08:37:38.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.206+0000 7fb24136f700 1 -- 172.21.15.89:0/970891920 learned_addr learned my addr 172.21.15.89:0/970891920 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-10-19T08:37:38.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.206+0000 7fb23bfff700 1 -- 172.21.15.89:0/970891920 >> v1:172.21.15.89:6789/0 conn(0x7fb23c0b22e0 legacy=0x7fb23c0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.206+0000 7fb23bfff700 1 -- 172.21.15.89:0/970891920 >> v1:172.21.15.79:6789/0 conn(0x7fb23c159d40 legacy=0x7fb23c0b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.206+0000 7fb23bfff700 1 -- 172.21.15.89:0/970891920 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c0cccc0 con 0x7fb23c0b1de0 2023-10-19T08:37:38.212 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.206+0000 7fb23bfff700 1 --2- 172.21.15.89:0/970891920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c0b1de0 0x7fb23c0b55c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb228009840 tx=0x7fb228009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e2b0259baa42335 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:38.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.206+0000 7fb23b7fe700 1 -- 172.21.15.89:0/970891920 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb228011830 con 0x7fb23c0b1de0 2023-10-19T08:37:38.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.207+0000 7fb23b7fe700 1 -- 172.21.15.89:0/970891920 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb228011990 con 0x7fb23c0b1de0 2023-10-19T08:37:38.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.207+0000 7fb23b7fe700 1 -- 172.21.15.89:0/970891920 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb228011d20 con 0x7fb23c0b1de0 2023-10-19T08:37:38.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.207+0000 7fb242dd2700 1 -- 172.21.15.89:0/970891920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c0b1de0 msgr2=0x7fb23c0b55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.213 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.207+0000 7fb242dd2700 1 --2- 172.21.15.89:0/970891920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c0b1de0 0x7fb23c0b55c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb228009840 tx=0x7fb228009b50 comp rx=0 tx=0).stop 2023-10-19T08:37:38.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.207+0000 7fb242dd2700 1 -- 172.21.15.89:0/970891920 shutdown_connections 2023-10-19T08:37:38.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.207+0000 7fb242dd2700 1 --2- 172.21.15.89:0/970891920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c0b1de0 0x7fb23c0b55c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.207+0000 7fb242dd2700 1 -- 172.21.15.89:0/970891920 >> 172.21.15.89:0/970891920 conn(0x7fb23c06dce0 msgr2=0x7fb23c06e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:38.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.207+0000 7fb242dd2700 1 -- 172.21.15.89:0/970891920 shutdown_connections 2023-10-19T08:37:38.214 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.207+0000 7fb242dd2700 1 -- 172.21.15.89:0/970891920 wait complete. 2023-10-19T08:37:38.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.209+0000 7fb242dd2700 1 Processor -- start 2023-10-19T08:37:38.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.209+0000 7fb242dd2700 1 -- start start 2023-10-19T08:37:38.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb242dd2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb23c0b1de0 0x7fb23c167510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:38.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb242dd2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb23c0b22e0 0x7fb23c0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:38.218 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb242dd2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c159d40 0x7fb23c0c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:38.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb242dd2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c167a50 con 0x7fb23c0b22e0 2023-10-19T08:37:38.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb242dd2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c14fdd0 con 0x7fb23c159d40 2023-10-19T08:37:38.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb242dd2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c14faf0 con 0x7fb23c0b1de0 2023-10-19T08:37:38.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb24136f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c159d40 0x7fb23c0c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:38.219 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb240b6e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb23c0b1de0 0x7fb23c167510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:38.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb240b6e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb23c0b1de0 0x7fb23c167510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:59416/0 (socket says 172.21.15.89:59416) 2023-10-19T08:37:38.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb24136f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c159d40 0x7fb23c0c5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52070/0 (socket says 172.21.15.89:52070) 2023-10-19T08:37:38.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb240b6e700 1 -- 172.21.15.89:0/3209462621 learned_addr learned my addr 172.21.15.89:0/3209462621 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-19T08:37:38.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb23bfff700 1 --2- 172.21.15.89:0/3209462621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb23c0b22e0 0x7fb23c0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:38.220 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb240b6e700 1 -- 172.21.15.89:0/3209462621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c159d40 msgr2=0x7fb23c0c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb240b6e700 1 --2- 172.21.15.89:0/3209462621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c159d40 0x7fb23c0c5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb240b6e700 1 -- 172.21.15.89:0/3209462621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb23c0b22e0 msgr2=0x7fb23c0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb240b6e700 1 --2- 172.21.15.89:0/3209462621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb23c0b22e0 0x7fb23c0b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb240b6e700 1 -- 172.21.15.89:0/3209462621 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2280094a0 con 0x7fb23c0b1de0 2023-10-19T08:37:38.221 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb24136f700 1 --2- 172.21.15.89:0/3209462621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c159d40 0x7fb23c0c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:37:38.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb23bfff700 1 --2- 172.21.15.89:0/3209462621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb23c0b22e0 0x7fb23c0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:37:38.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.210+0000 7fb240b6e700 1 --2- 172.21.15.89:0/3209462621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb23c0b1de0 0x7fb23c167510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb23000c450 tx=0x7fb23000c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:38.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.211+0000 7fb2397fa700 1 -- 172.21.15.89:0/3209462621 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2300052d0 con 0x7fb23c0b1de0 2023-10-19T08:37:38.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.211+0000 7fb2397fa700 1 -- 172.21.15.89:0/3209462621 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb230005430 con 0x7fb23c0b1de0 2023-10-19T08:37:38.222 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.211+0000 7fb242dd2700 1 -- 172.21.15.89:0/3209462621 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb23c166540 con 0x7fb23c0b1de0 2023-10-19T08:37:38.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.211+0000 7fb2397fa700 1 -- 172.21.15.89:0/3209462621 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2300038c0 con 0x7fb23c0b1de0 2023-10-19T08:37:38.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.211+0000 7fb242dd2700 1 -- 172.21.15.89:0/3209462621 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb23c166b00 con 0x7fb23c0b1de0 2023-10-19T08:37:38.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.211+0000 7fb2397fa700 1 -- 172.21.15.89:0/3209462621 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb230003d20 con 0x7fb23c0b1de0 2023-10-19T08:37:38.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.211+0000 7fb2397fa700 1 -- 172.21.15.89:0/3209462621 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb23001c780 con 0x7fb23c0b1de0 2023-10-19T08:37:38.223 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.212+0000 7fb242dd2700 1 -- 172.21.15.89:0/3209462621 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23c04ee70 con 0x7fb23c0b1de0 2023-10-19T08:37:38.224 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.214+0000 7fb2397fa700 1 -- 172.21.15.89:0/3209462621 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb230017070 con 0x7fb23c0b1de0 2023-10-19T08:37:38.300 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.297+0000 7fb242dd2700 1 -- 172.21.15.89:0/3209462621 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8fc732cf-6693-47af-b4fa-58f49d64d4b7", "id": 0} v 0) v1 -- 0x7fb23c06f8c0 con 0x7fb23c0b1de0 2023-10-19T08:37:38.306 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.300+0000 7fb2397fa700 1 -- 172.21.15.89:0/3209462621 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8fc732cf-6693-47af-b4fa-58f49d64d4b7", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb230011cc0 con 0x7fb23c0b1de0 2023-10-19T08:37:38.307 INFO:teuthology.orchestra.run.smithi089.stdout:0 2023-10-19T08:37:38.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.301+0000 7fb242dd2700 1 -- 172.21.15.89:0/3209462621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb23c0b1de0 msgr2=0x7fb23c167510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.301+0000 7fb242dd2700 1 --2- 172.21.15.89:0/3209462621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb23c0b1de0 0x7fb23c167510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb23000c450 tx=0x7fb23000c760 comp rx=0 tx=0).stop 2023-10-19T08:37:38.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.301+0000 7fb242dd2700 1 -- 172.21.15.89:0/3209462621 shutdown_connections 2023-10-19T08:37:38.308 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.301+0000 7fb242dd2700 1 --2- 172.21.15.89:0/3209462621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb23c159d40 0x7fb23c0c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.301+0000 7fb242dd2700 1 --2- 172.21.15.89:0/3209462621 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb23c0b1de0 0x7fb23c167510 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.301+0000 7fb242dd2700 1 --2- 172.21.15.89:0/3209462621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb23c0b22e0 0x7fb23c0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.301+0000 7fb242dd2700 1 -- 172.21.15.89:0/3209462621 >> 172.21.15.89:0/3209462621 conn(0x7fb23c06dce0 msgr2=0x7fb23c0ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:38.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.301+0000 7fb242dd2700 1 -- 172.21.15.89:0/3209462621 shutdown_connections 2023-10-19T08:37:38.309 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.301+0000 7fb242dd2700 1 -- 172.21.15.89:0/3209462621 wait complete. 2023-10-19T08:37:38.315 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 3df762c5-6cab-4019-84af-5d38457c64f2 1 2023-10-19T08:37:38.426 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:38.423+0000 7fae2a735200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-19T08:37:38.435 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.432+0000 7f0c6e9ba700 1 Processor -- start 2023-10-19T08:37:38.436 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.432+0000 7f0c6e9ba700 1 -- start start 2023-10-19T08:37:38.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.434+0000 7f0c6e9ba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68159d40 0x7f0c680b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:38.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.434+0000 7f0c6e9ba700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0c680b1de0 0x7f0c680cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:38.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.434+0000 7f0c6e9ba700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c680cc700 con 0x7f0c680b22e0 2023-10-19T08:37:38.439 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.434+0000 7f0c6e9ba700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c6815a120 con 0x7f0c680b1de0 2023-10-19T08:37:38.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.434+0000 7f0c6e9ba700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680cc9e0 con 0x7f0c68159d40 2023-10-19T08:37:38.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.434+0000 7f0c67fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68159d40 0x7f0c680b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:38.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.434+0000 7f0c67fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68159d40 0x7f0c680b55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:59422/0 (socket says 172.21.15.89:59422) 2023-10-19T08:37:38.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.434+0000 7f0c67fff700 1 -- 172.21.15.89:0/4291797096 learned_addr learned my addr 172.21.15.89:0/4291797096 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-19T08:37:38.440 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.434+0000 7f0c6cf57700 1 --2- 172.21.15.89:0/4291797096 >> v2:172.21.15.79:3300/0 conn(0x7f0c680b1de0 0x7f0c680cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:38.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.434+0000 7f0c67fff700 1 -- 172.21.15.89:0/4291797096 >> v2:172.21.15.79:3300/0 conn(0x7f0c680b1de0 msgr2=0x7f0c680cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:38.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.434+0000 7f0c67fff700 1 --2- 172.21.15.89:0/4291797096 >> v2:172.21.15.79:3300/0 conn(0x7f0c680b1de0 0x7f0c680cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.434+0000 7f0c67fff700 1 -- 172.21.15.89:0/4291797096 >> v1:172.21.15.79:6789/0 conn(0x7f0c680b22e0 legacy=0x7f0c680b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.434+0000 7f0c67fff700 1 -- 172.21.15.89:0/4291797096 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c680cccc0 con 0x7f0c68159d40 2023-10-19T08:37:38.441 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.434+0000 7f0c67fff700 1 --2- 172.21.15.89:0/4291797096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68159d40 0x7f0c680b55c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800bb90 tx=0x7f0c5800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42e559fcb35983b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:38.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.434+0000 7f0c66ffd700 1 -- 172.21.15.89:0/4291797096 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5800dd30 con 0x7f0c68159d40 2023-10-19T08:37:38.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.434+0000 7f0c66ffd700 1 -- 172.21.15.89:0/4291797096 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5800de90 con 0x7f0c68159d40 2023-10-19T08:37:38.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.434+0000 7f0c66ffd700 1 -- 172.21.15.89:0/4291797096 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58010690 con 0x7f0c68159d40 2023-10-19T08:37:38.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.435+0000 7f0c6e9ba700 1 -- 172.21.15.89:0/4291797096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68159d40 msgr2=0x7f0c680b55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.442 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.435+0000 7f0c6e9ba700 1 --2- 172.21.15.89:0/4291797096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68159d40 0x7f0c680b55c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800bb90 tx=0x7f0c5800bea0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.435+0000 7f0c6e9ba700 1 -- 172.21.15.89:0/4291797096 shutdown_connections 2023-10-19T08:37:38.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.435+0000 7f0c6e9ba700 1 --2- 172.21.15.89:0/4291797096 >> v2:172.21.15.79:3300/0 conn(0x7f0c680b1de0 0x7f0c680cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.435+0000 7f0c6e9ba700 1 --2- 172.21.15.89:0/4291797096 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68159d40 0x7f0c680b55c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.435+0000 7f0c6e9ba700 1 -- 172.21.15.89:0/4291797096 >> 172.21.15.89:0/4291797096 conn(0x7f0c6806dce0 msgr2=0x7f0c6806e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:38.443 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.435+0000 7f0c6e9ba700 1 -- 172.21.15.89:0/4291797096 shutdown_connections 2023-10-19T08:37:38.444 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.435+0000 7f0c6e9ba700 1 -- 172.21.15.89:0/4291797096 wait complete. 2023-10-19T08:37:38.446 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.436+0000 7f0c6e9ba700 1 Processor -- start 2023-10-19T08:37:38.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.437+0000 7f0c6e9ba700 1 -- start start 2023-10-19T08:37:38.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.437+0000 7f0c6e9ba700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c680b1de0 0x7f0c681550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:38.447 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.437+0000 7f0c6e9ba700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c680b22e0 0x7f0c680c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:38.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.437+0000 7f0c6e9ba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68159d40 0x7f0c680c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:38.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.437+0000 7f0c6e9ba700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c681e2c10 con 0x7f0c680b22e0 2023-10-19T08:37:38.448 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.437+0000 7f0c6e9ba700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680c6580 con 0x7f0c680b1de0 2023-10-19T08:37:38.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.437+0000 7f0c6e9ba700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c681e2320 con 0x7f0c68159d40 2023-10-19T08:37:38.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.438+0000 7f0c6cf57700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68159d40 0x7f0c680c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:38.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.438+0000 7f0c6cf57700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68159d40 0x7f0c680c6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:59432/0 (socket says 172.21.15.89:59432) 2023-10-19T08:37:38.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.438+0000 7f0c67fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c680b1de0 0x7f0c681550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:38.449 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.438+0000 7f0c6cf57700 1 -- 172.21.15.89:0/492956377 learned_addr learned my addr 172.21.15.89:0/492956377 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-19T08:37:38.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.438+0000 7f0c677fe700 1 --2- 172.21.15.89:0/492956377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c680b22e0 0x7f0c680c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:38.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.438+0000 7f0c6cf57700 1 -- 172.21.15.89:0/492956377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c680b1de0 msgr2=0x7f0c681550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.438+0000 7f0c6cf57700 1 --2- 172.21.15.89:0/492956377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c680b1de0 0x7f0c681550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.438+0000 7f0c6cf57700 1 -- 172.21.15.89:0/492956377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c680b22e0 msgr2=0x7f0c680c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.450 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.438+0000 7f0c6cf57700 1 --2- 172.21.15.89:0/492956377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c680b22e0 0x7f0c680c5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.438+0000 7f0c6cf57700 1 -- 172.21.15.89:0/492956377 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5800b7f0 con 0x7f0c68159d40 2023-10-19T08:37:38.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.438+0000 7f0c67fff700 1 --2- 172.21.15.89:0/492956377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c680b1de0 0x7f0c681550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:37:38.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.438+0000 7f0c6cf57700 1 --2- 172.21.15.89:0/492956377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68159d40 0x7f0c680c6040 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000efc0 tx=0x7f0c6000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:38.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.438+0000 7f0c64ff9700 1 -- 172.21.15.89:0/492956377 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60009ea0 con 0x7f0c68159d40 2023-10-19T08:37:38.451 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.438+0000 7f0c64ff9700 1 -- 172.21.15.89:0/492956377 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6000f040 con 0x7f0c68159d40 2023-10-19T08:37:38.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.438+0000 7f0c6e9ba700 1 -- 172.21.15.89:0/492956377 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c681e25c0 con 0x7f0c68159d40 2023-10-19T08:37:38.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.438+0000 7f0c64ff9700 1 -- 172.21.15.89:0/492956377 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60014480 con 0x7f0c68159d40 2023-10-19T08:37:38.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.438+0000 7f0c6e9ba700 1 -- 172.21.15.89:0/492956377 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c680c45f0 con 0x7f0c68159d40 2023-10-19T08:37:38.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.438+0000 7f0c64ff9700 1 -- 172.21.15.89:0/492956377 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0c600148e0 con 0x7f0c68159d40 2023-10-19T08:37:38.452 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.438+0000 7f0c64ff9700 1 -- 172.21.15.89:0/492956377 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f0c6001dda0 con 0x7f0c68159d40 2023-10-19T08:37:38.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.439+0000 7f0c6e9ba700 1 -- 172.21.15.89:0/492956377 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6804ee70 con 0x7f0c68159d40 2023-10-19T08:37:38.453 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.441+0000 7f0c64ff9700 1 -- 172.21.15.89:0/492956377 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f0c6003bb00 con 0x7f0c68159d40 2023-10-19T08:37:38.453 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:38.442+0000 7f1c359e2200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-19T08:37:38.528 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.525+0000 7f0c6e9ba700 1 -- 172.21.15.89:0/492956377 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3df762c5-6cab-4019-84af-5d38457c64f2", "id": 1} v 0) v1 -- 0x7f0c6806f8c0 con 0x7f0c68159d40 2023-10-19T08:37:38.536 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.533+0000 7f0c64ff9700 1 -- 172.21.15.89:0/492956377 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3df762c5-6cab-4019-84af-5d38457c64f2", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0c6002a070 con 0x7f0c68159d40 2023-10-19T08:37:38.536 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-19T08:37:38.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.534+0000 7f0c6e9ba700 1 -- 172.21.15.89:0/492956377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68159d40 msgr2=0x7f0c680c6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.537 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.534+0000 7f0c6e9ba700 1 --2- 172.21.15.89:0/492956377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68159d40 0x7f0c680c6040 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000efc0 tx=0x7f0c6000c3a0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.534+0000 7f0c6e9ba700 1 -- 172.21.15.89:0/492956377 shutdown_connections 2023-10-19T08:37:38.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.534+0000 7f0c6e9ba700 1 --2- 172.21.15.89:0/492956377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c68159d40 0x7f0c680c6040 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.534+0000 7f0c6e9ba700 1 --2- 172.21.15.89:0/492956377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c680b1de0 0x7f0c681550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.534+0000 7f0c6e9ba700 1 --2- 172.21.15.89:0/492956377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c680b22e0 0x7f0c680c5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.538 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.534+0000 7f0c6e9ba700 1 -- 172.21.15.89:0/492956377 >> 172.21.15.89:0/492956377 conn(0x7f0c6806dce0 msgr2=0x7f0c680d04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:38.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.534+0000 7f0c6e9ba700 1 -- 172.21.15.89:0/492956377 shutdown_connections 2023-10-19T08:37:38.539 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.534+0000 7f0c6e9ba700 1 -- 172.21.15.89:0/492956377 wait complete. 2023-10-19T08:37:38.544 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:38.541+0000 7fae2a735200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-19T08:37:38.550 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new c263a092-506b-4051-bd17-c7082ab857e5 2 2023-10-19T08:37:38.565 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:38.562+0000 7f1c359e2200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-19T08:37:38.632 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:38.629+0000 7fae2a735200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-19T08:37:38.650 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:38.647+0000 7f1c359e2200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-19T08:37:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.667+0000 7fdcaeef6700 1 Processor -- start 2023-10-19T08:37:38.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.667+0000 7fdcaeef6700 1 -- start start 2023-10-19T08:37:38.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.668+0000 7fdcaeef6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdca80ce830 0x7fdca815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:38.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.668+0000 7fdcaeef6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca80cec40 con 0x7fdca806a930 2023-10-19T08:37:38.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.668+0000 7fdcaeef6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca8070670 con 0x7fdca815ce90 2023-10-19T08:37:38.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.668+0000 7fdcaeef6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca806faf0 con 0x7fdca80ce830 2023-10-19T08:37:38.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.668+0000 7fdcacc92700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fdca815ce90 0x7fdca806a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:53728/0 (socket says 172.21.15.89:53728) 2023-10-19T08:37:38.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.668+0000 7fdcacc92700 1 -- 172.21.15.89:0/3866398051 learned_addr learned my addr 172.21.15.89:0/3866398051 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-10-19T08:37:38.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.668+0000 7fdcad493700 1 --2- 172.21.15.89:0/3866398051 >> v2:172.21.15.79:3300/0 conn(0x7fdca80ce830 0x7fdca815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:38.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.668+0000 7fdca77fe700 1 -- 172.21.15.89:0/3866398051 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1565985991 0 0) 0x7fdca8070670 con 0x7fdca815ce90 2023-10-19T08:37:38.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.668+0000 7fdca77fe700 1 -- 172.21.15.89:0/3866398051 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc980035b0 con 0x7fdca815ce90 2023-10-19T08:37:38.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.668+0000 7fdca77fe700 1 -- 172.21.15.89:0/3866398051 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025335979 0 0) 0x7fdca80cec40 con 0x7fdca806a930 2023-10-19T08:37:38.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.668+0000 7fdca77fe700 1 -- 172.21.15.89:0/3866398051 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdca8070670 con 0x7fdca806a930 2023-10-19T08:37:38.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.668+0000 7fdcad493700 1 -- 172.21.15.89:0/3866398051 >> v1:172.21.15.89:6789/0 conn(0x7fdca815ce90 legacy=0x7fdca806a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.668+0000 7fdca77fe700 1 -- 172.21.15.89:0/3866398051 <== mon.1 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2782805333 0 0) 0x7fdc980035b0 con 0x7fdca815ce90 2023-10-19T08:37:38.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.668+0000 7fdcad493700 1 -- 172.21.15.89:0/3866398051 >> v1:172.21.15.79:6789/0 conn(0x7fdca806a930 legacy=0x7fdca80cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.668+0000 7fdcad493700 1 -- 172.21.15.89:0/3866398051 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca806fdd0 con 0x7fdca80ce830 2023-10-19T08:37:38.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.668+0000 7fdcad493700 1 --2- 172.21.15.89:0/3866398051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdca80ce830 0x7fdca815df90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009d90 tx=0x7fdca000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2b592d872b875 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:38.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.669+0000 7fdca77fe700 1 -- 172.21.15.89:0/3866398051 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca000e070 con 0x7fdca80ce830 2023-10-19T08:37:38.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.669+0000 7fdca77fe700 1 -- 172.21.15.89:0/3866398051 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca0003a20 con 0x7fdca80ce830 2023-10-19T08:37:38.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.669+0000 7fdca77fe700 1 -- 172.21.15.89:0/3866398051 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c0016b0 con 0x7fdca80ce830 2023-10-19T08:37:38.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.669+0000 7fdcaeef6700 1 -- 172.21.15.89:0/3866398051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdca80ce830 msgr2=0x7fdca815df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.669+0000 7fdcaeef6700 1 --2- 172.21.15.89:0/3866398051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdca80ce830 0x7fdca815df90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009d90 tx=0x7fdca000b330 comp rx=0 tx=0).stop 2023-10-19T08:37:38.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.669+0000 7fdcaeef6700 1 -- 172.21.15.89:0/3866398051 shutdown_connections 2023-10-19T08:37:38.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.669+0000 7fdcaeef6700 1 --2- 172.21.15.89:0/3866398051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdca80ce830 0x7fdca815df90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.669+0000 7fdcaeef6700 1 -- 172.21.15.89:0/3866398051 >> 172.21.15.89:0/3866398051 conn(0x7fdca806dce0 msgr2=0x7fdca806e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:38.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.669+0000 7fdcaeef6700 1 -- 172.21.15.89:0/3866398051 shutdown_connections 2023-10-19T08:37:38.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.669+0000 7fdcaeef6700 1 -- 172.21.15.89:0/3866398051 wait complete. 2023-10-19T08:37:38.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.670+0000 7fdcaeef6700 1 Processor -- start 2023-10-19T08:37:38.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.670+0000 7fdcaeef6700 1 -- start start 2023-10-19T08:37:38.680 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.671+0000 7fdcaeef6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdca806a930 0x7fdca815a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:38.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.671+0000 7fdcaeef6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdca80ce830 0x7fdca80b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:38.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.671+0000 7fdcaeef6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdca815ce90 0x7fdca80c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:38.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.671+0000 7fdcaeef6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca80c8490 con 0x7fdca815ce90 2023-10-19T08:37:38.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.671+0000 7fdcaeef6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca81f2880 con 0x7fdca806a930 2023-10-19T08:37:38.681 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.671+0000 7fdcaeef6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca815a6d0 con 0x7fdca80ce830 2023-10-19T08:37:38.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.671+0000 7fdca7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdca80ce830 0x7fdca80b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:38.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.671+0000 7fdca7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdca80ce830 0x7fdca80b38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:59440/0 (socket says 172.21.15.89:59440) 2023-10-19T08:37:38.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.671+0000 7fdca7fff700 1 -- 172.21.15.89:0/2132106909 learned_addr learned my addr 172.21.15.89:0/2132106909 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-19T08:37:38.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.671+0000 7fdcad493700 1 --2- 172.21.15.89:0/2132106909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdca815ce90 0x7fdca80c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:38.682 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.671+0000 7fdcacc92700 1 --2- 172.21.15.89:0/2132106909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdca806a930 0x7fdca815a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:38.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.672+0000 7fdca7fff700 1 -- 172.21.15.89:0/2132106909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdca806a930 msgr2=0x7fdca815a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.672+0000 7fdca7fff700 1 --2- 172.21.15.89:0/2132106909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdca806a930 0x7fdca815a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.672+0000 7fdca7fff700 1 -- 172.21.15.89:0/2132106909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdca815ce90 msgr2=0x7fdca80c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.672+0000 7fdca7fff700 1 --2- 172.21.15.89:0/2132106909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdca815ce90 0x7fdca80c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.683 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.672+0000 7fdca7fff700 1 -- 172.21.15.89:0/2132106909 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0009a70 con 0x7fdca80ce830 2023-10-19T08:37:38.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.672+0000 7fdcacc92700 1 --2- 172.21.15.89:0/2132106909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdca806a930 0x7fdca815a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:37:38.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.672+0000 7fdca7fff700 1 --2- 172.21.15.89:0/2132106909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdca80ce830 0x7fdca80b38c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400c520 tx=0x7fdc9400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:38.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.672+0000 7fdca57fa700 1 -- 172.21.15.89:0/2132106909 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc940052d0 con 0x7fdca80ce830 2023-10-19T08:37:38.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.672+0000 7fdca57fa700 1 -- 172.21.15.89:0/2132106909 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc94005430 con 0x7fdca80ce830 2023-10-19T08:37:38.684 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.672+0000 7fdcaeef6700 1 -- 172.21.15.89:0/2132106909 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca80c7910 con 0x7fdca80ce830 2023-10-19T08:37:38.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.672+0000 7fdca57fa700 1 -- 172.21.15.89:0/2132106909 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc940038c0 con 0x7fdca80ce830 2023-10-19T08:37:38.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.672+0000 7fdcaeef6700 1 -- 172.21.15.89:0/2132106909 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca80c7ed0 con 0x7fdca80ce830 2023-10-19T08:37:38.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.672+0000 7fdca57fa700 1 -- 172.21.15.89:0/2132106909 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdc94003d20 con 0x7fdca80ce830 2023-10-19T08:37:38.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.672+0000 7fdca57fa700 1 -- 172.21.15.89:0/2132106909 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fdc94012840 con 0x7fdca80ce830 2023-10-19T08:37:38.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.673+0000 7fdcaeef6700 1 -- 172.21.15.89:0/2132106909 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca81f29d0 con 0x7fdca80ce830 2023-10-19T08:37:38.685 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.675+0000 7fdca57fa700 1 -- 172.21.15.89:0/2132106909 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fdca81f29d0 con 0x7fdca80ce830 2023-10-19T08:37:38.714 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:38.710+0000 7fae2a735200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-19T08:37:38.735 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:38.732+0000 7f1c359e2200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-19T08:37:38.762 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.759+0000 7fdcaeef6700 1 -- 172.21.15.89:0/2132106909 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c263a092-506b-4051-bd17-c7082ab857e5", "id": 2} v 0) v1 -- 0x7fdca80b1d60 con 0x7fdca80ce830 2023-10-19T08:37:38.769 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.766+0000 7fdca57fa700 1 -- 172.21.15.89:0/2132106909 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c263a092-506b-4051-bd17-c7082ab857e5", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdc94017070 con 0x7fdca80ce830 2023-10-19T08:37:38.769 INFO:teuthology.orchestra.run.smithi089.stdout:2 2023-10-19T08:37:38.770 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.767+0000 7fdcaeef6700 1 -- 172.21.15.89:0/2132106909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdca80ce830 msgr2=0x7fdca80b38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.767+0000 7fdcaeef6700 1 --2- 172.21.15.89:0/2132106909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdca80ce830 0x7fdca80b38c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400c520 tx=0x7fdc9400c830 comp rx=0 tx=0).stop 2023-10-19T08:37:38.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.767+0000 7fdcaeef6700 1 -- 172.21.15.89:0/2132106909 shutdown_connections 2023-10-19T08:37:38.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.767+0000 7fdcaeef6700 1 --2- 172.21.15.89:0/2132106909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdca815ce90 0x7fdca80c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.771 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.767+0000 7fdcaeef6700 1 --2- 172.21.15.89:0/2132106909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdca806a930 0x7fdca815a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.767+0000 7fdcaeef6700 1 --2- 172.21.15.89:0/2132106909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdca80ce830 0x7fdca80b38c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.767+0000 7fdcaeef6700 1 -- 172.21.15.89:0/2132106909 >> 172.21.15.89:0/2132106909 conn(0x7fdca806dce0 msgr2=0x7fdca80ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:38.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.767+0000 7fdcaeef6700 1 -- 172.21.15.89:0/2132106909 shutdown_connections 2023-10-19T08:37:38.772 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.767+0000 7fdcaeef6700 1 -- 172.21.15.89:0/2132106909 wait complete. 2023-10-19T08:37:38.782 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 0e13ba18-f5ea-4162-9665-4bf965b07b49 3 2023-10-19T08:37:38.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.942+0000 7f1a5773a700 1 Processor -- start 2023-10-19T08:37:38.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.942+0000 7f1a5773a700 1 -- start start 2023-10-19T08:37:38.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.943+0000 7f1a5773a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1a5015ce90 0x7f1a5015df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:38.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.943+0000 7f1a5773a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1a5006a220 0x7f1a5006a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:38.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.943+0000 7f1a5773a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a50070670 con 0x7f1a500cc870 2023-10-19T08:37:38.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.943+0000 7f1a5773a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5006abf0 con 0x7f1a5015ce90 2023-10-19T08:37:38.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.943+0000 7f1a5773a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5006faf0 con 0x7f1a5006a220 2023-10-19T08:37:38.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.943+0000 7f1a54cd5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1a5006a220 0x7f1a5006a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:38.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.943+0000 7f1a55cd7700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1a500cc870 0x7f1a500cccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:53742/0 (socket says 172.21.15.89:53742) 2023-10-19T08:37:38.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.943+0000 7f1a55cd7700 1 -- 172.21.15.89:0/795124620 learned_addr learned my addr 172.21.15.89:0/795124620 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-10-19T08:37:38.949 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.943+0000 7f1a554d6700 1 --2- 172.21.15.89:0/795124620 >> v2:172.21.15.79:3300/0 conn(0x7f1a5015ce90 0x7f1a5015df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:38.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.943+0000 7f1a47fff700 1 -- 172.21.15.89:0/795124620 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1895093165 0 0) 0x7f1a50070670 con 0x7f1a500cc870 2023-10-19T08:37:38.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.943+0000 7f1a47fff700 1 -- 172.21.15.89:0/795124620 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a3c0035b0 con 0x7f1a500cc870 2023-10-19T08:37:38.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.943+0000 7f1a54cd5700 1 -- 172.21.15.89:0/795124620 >> v2:172.21.15.79:3300/0 conn(0x7f1a5015ce90 msgr2=0x7f1a5015df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:38.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.943+0000 7f1a54cd5700 1 --2- 172.21.15.89:0/795124620 >> v2:172.21.15.79:3300/0 conn(0x7f1a5015ce90 0x7f1a5015df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.950 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.943+0000 7f1a54cd5700 1 -- 172.21.15.89:0/795124620 >> v1:172.21.15.89:6789/0 conn(0x7f1a500cc870 legacy=0x7f1a500cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.943+0000 7f1a54cd5700 1 -- 172.21.15.89:0/795124620 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5006fdd0 con 0x7f1a5006a220 2023-10-19T08:37:38.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.943+0000 7f1a54cd5700 1 --2- 172.21.15.89:0/795124620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a5006a220 0x7f1a5006a6b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1a5006ecf0 tx=0x7f1a40009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f45aeb3328a6e286 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:38.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.944+0000 7f1a47fff700 1 -- 172.21.15.89:0/795124620 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a40011830 con 0x7f1a5006a220 2023-10-19T08:37:38.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.944+0000 7f1a47fff700 1 -- 172.21.15.89:0/795124620 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a40011990 con 0x7f1a5006a220 2023-10-19T08:37:38.951 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.944+0000 7f1a47fff700 1 -- 172.21.15.89:0/795124620 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a40011d20 con 0x7f1a5006a220 2023-10-19T08:37:38.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.944+0000 7f1a5773a700 1 -- 172.21.15.89:0/795124620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a5006a220 msgr2=0x7f1a5006a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.944+0000 7f1a5773a700 1 --2- 172.21.15.89:0/795124620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a5006a220 0x7f1a5006a6b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1a5006ecf0 tx=0x7f1a40009b20 comp rx=0 tx=0).stop 2023-10-19T08:37:38.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.944+0000 7f1a5773a700 1 -- 172.21.15.89:0/795124620 shutdown_connections 2023-10-19T08:37:38.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.944+0000 7f1a5773a700 1 --2- 172.21.15.89:0/795124620 >> v2:172.21.15.79:3300/0 conn(0x7f1a5015ce90 0x7f1a5015df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.952 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.944+0000 7f1a5773a700 1 --2- 172.21.15.89:0/795124620 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a5006a220 0x7f1a5006a6b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.944+0000 7f1a5773a700 1 -- 172.21.15.89:0/795124620 >> 172.21.15.89:0/795124620 conn(0x7f1a5006dce0 msgr2=0x7f1a5006e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:38.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.944+0000 7f1a5773a700 1 -- 172.21.15.89:0/795124620 shutdown_connections 2023-10-19T08:37:38.953 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.944+0000 7f1a5773a700 1 -- 172.21.15.89:0/795124620 wait complete. 2023-10-19T08:37:38.955 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.946+0000 7f1a5773a700 1 Processor -- start 2023-10-19T08:37:38.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.946+0000 7f1a5773a700 1 -- start start 2023-10-19T08:37:38.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.946+0000 7f1a5773a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5006a220 0x7f1a500c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:38.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.946+0000 7f1a5773a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a500cc870 0x7f1a501f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:38.956 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.946+0000 7f1a5773a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a5015ce90 0x7f1a501f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:38.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.946+0000 7f1a5773a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a500c9c70 con 0x7f1a5006a220 2023-10-19T08:37:38.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.946+0000 7f1a5773a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5014dd60 con 0x7f1a500cc870 2023-10-19T08:37:38.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.946+0000 7f1a5773a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a500c93d0 con 0x7f1a5015ce90 2023-10-19T08:37:38.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.946+0000 7f1a54cd5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a500cc870 0x7f1a501f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:38.957 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.946+0000 7f1a54cd5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a500cc870 0x7f1a501f1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52102/0 (socket says 172.21.15.89:52102) 2023-10-19T08:37:38.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.946+0000 7f1a54cd5700 1 -- 172.21.15.89:0/3730306900 learned_addr learned my addr 172.21.15.89:0/3730306900 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-19T08:37:38.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.947+0000 7f1a55cd7700 1 --2- 172.21.15.89:0/3730306900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a5015ce90 0x7f1a501f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:38.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.947+0000 7f1a554d6700 1 --2- 172.21.15.89:0/3730306900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5006a220 0x7f1a500c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:38.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.947+0000 7f1a554d6700 1 -- 172.21.15.89:0/3730306900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a5015ce90 msgr2=0x7f1a501f5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.958 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.947+0000 7f1a554d6700 1 --2- 172.21.15.89:0/3730306900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a5015ce90 0x7f1a501f5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.947+0000 7f1a554d6700 1 -- 172.21.15.89:0/3730306900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a500cc870 msgr2=0x7f1a501f1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:38.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.947+0000 7f1a554d6700 1 --2- 172.21.15.89:0/3730306900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a500cc870 0x7f1a501f1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:38.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.947+0000 7f1a554d6700 1 -- 172.21.15.89:0/3730306900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a400094a0 con 0x7f1a5006a220 2023-10-19T08:37:38.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.947+0000 7f1a55cd7700 1 --2- 172.21.15.89:0/3730306900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a5015ce90 0x7f1a501f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:37:38.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.947+0000 7f1a54cd5700 1 --2- 172.21.15.89:0/3730306900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a500cc870 0x7f1a501f1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:37:38.959 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.947+0000 7f1a554d6700 1 --2- 172.21.15.89:0/3730306900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5006a220 0x7f1a500c8df0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00e870 tx=0x7f1a4c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:38.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.947+0000 7f1a45ffb700 1 -- 172.21.15.89:0/3730306900 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c013680 con 0x7f1a5006a220 2023-10-19T08:37:38.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.947+0000 7f1a45ffb700 1 -- 172.21.15.89:0/3730306900 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c0137e0 con 0x7f1a5006a220 2023-10-19T08:37:38.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.947+0000 7f1a5773a700 1 -- 172.21.15.89:0/3730306900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a500c96b0 con 0x7f1a5006a220 2023-10-19T08:37:38.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.947+0000 7f1a45ffb700 1 -- 172.21.15.89:0/3730306900 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c013b90 con 0x7f1a5006a220 2023-10-19T08:37:38.960 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.947+0000 7f1a5773a700 1 -- 172.21.15.89:0/3730306900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a50158e10 con 0x7f1a5006a220 2023-10-19T08:37:38.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.948+0000 7f1a45ffb700 1 -- 172.21.15.89:0/3730306900 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1a4c005a20 con 0x7f1a5006a220 2023-10-19T08:37:38.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.948+0000 7f1a45ffb700 1 -- 172.21.15.89:0/3730306900 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f1a4c005cd0 con 0x7f1a5006a220 2023-10-19T08:37:38.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.948+0000 7f1a5773a700 1 -- 172.21.15.89:0/3730306900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5004ee70 con 0x7f1a5006a220 2023-10-19T08:37:38.961 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:38.951+0000 7f1a45ffb700 1 -- 172.21.15.89:0/3730306900 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1a4c021060 con 0x7f1a5006a220 2023-10-19T08:37:39.035 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.032+0000 7f1a5773a700 1 -- 172.21.15.89:0/3730306900 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0e13ba18-f5ea-4162-9665-4bf965b07b49", "id": 3} v 0) v1 -- 0x7f1a500b1960 con 0x7f1a5006a220 2023-10-19T08:37:39.040 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.038+0000 7f1a45ffb700 1 -- 172.21.15.89:0/3730306900 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e13ba18-f5ea-4162-9665-4bf965b07b49", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1a4c029020 con 0x7f1a5006a220 2023-10-19T08:37:39.041 INFO:teuthology.orchestra.run.smithi089.stdout:3 2023-10-19T08:37:39.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.038+0000 7f1a5773a700 1 -- 172.21.15.89:0/3730306900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5006a220 msgr2=0x7f1a500c8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.038+0000 7f1a5773a700 1 --2- 172.21.15.89:0/3730306900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5006a220 0x7f1a500c8df0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00e870 tx=0x7f1a4c00eb80 comp rx=0 tx=0).stop 2023-10-19T08:37:39.042 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.039+0000 7f1a5773a700 1 -- 172.21.15.89:0/3730306900 shutdown_connections 2023-10-19T08:37:39.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.039+0000 7f1a5773a700 1 --2- 172.21.15.89:0/3730306900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1a5015ce90 0x7f1a501f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.039+0000 7f1a5773a700 1 --2- 172.21.15.89:0/3730306900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a5006a220 0x7f1a500c8df0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.039+0000 7f1a5773a700 1 --2- 172.21.15.89:0/3730306900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a500cc870 0x7f1a501f1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.039+0000 7f1a5773a700 1 -- 172.21.15.89:0/3730306900 >> 172.21.15.89:0/3730306900 conn(0x7f1a5006dce0 msgr2=0x7f1a500ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:39.043 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.039+0000 7f1a5773a700 1 -- 172.21.15.89:0/3730306900 shutdown_connections 2023-10-19T08:37:39.044 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.039+0000 7f1a5773a700 1 -- 172.21.15.89:0/3730306900 wait complete. 2023-10-19T08:37:39.053 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 98bd5f90-96c8-4ab8-9905-892af9c61de3 4 2023-10-19T08:37:39.155 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:39.152+0000 7fae2a735200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-19T08:37:39.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.173+0000 7f58c9f51700 1 Processor -- start 2023-10-19T08:37:39.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.173+0000 7f58c9f51700 1 -- start start 2023-10-19T08:37:39.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.173+0000 7f58c9f51700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f58c415ce90 0x7f58c415df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.173+0000 7f58c9f51700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58c406a6b0 0x7f58c40ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.173+0000 7f58c9f51700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c4070670 con 0x7f58c406a220 2023-10-19T08:37:39.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.173+0000 7f58c9f51700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c406ab40 con 0x7f58c415ce90 2023-10-19T08:37:39.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.173+0000 7f58c9f51700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40cd4c0 con 0x7f58c406a6b0 2023-10-19T08:37:39.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.174+0000 7f58c3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58c406a6b0 0x7f58c40ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.174+0000 7f58c3fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58c406a6b0 0x7f58c40ccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:59460/0 (socket says 172.21.15.89:59460) 2023-10-19T08:37:39.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.174+0000 7f58c3fff700 1 -- 172.21.15.89:0/3313359769 learned_addr learned my addr 172.21.15.89:0/3313359769 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-19T08:37:39.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.174+0000 7f58c37fe700 1 --2- 172.21.15.89:0/3313359769 >> v2:172.21.15.79:3300/0 conn(0x7f58c415ce90 0x7f58c415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.174+0000 7f58c3fff700 1 -- 172.21.15.89:0/3313359769 >> v2:172.21.15.79:3300/0 conn(0x7f58c415ce90 msgr2=0x7f58c415df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:39.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.174+0000 7f58c3fff700 1 --2- 172.21.15.89:0/3313359769 >> v2:172.21.15.79:3300/0 conn(0x7f58c415ce90 0x7f58c415df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.174+0000 7f58c3fff700 1 -- 172.21.15.89:0/3313359769 >> v1:172.21.15.79:6789/0 conn(0x7f58c406a220 legacy=0x7f58c40cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.174+0000 7f58c3fff700 1 -- 172.21.15.89:0/3313359769 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c406faf0 con 0x7f58c406a6b0 2023-10-19T08:37:39.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.174+0000 7f58c37fe700 1 --2- 172.21.15.89:0/3313359769 >> v2:172.21.15.79:3300/0 conn(0x7f58c415ce90 0x7f58c415df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:37:39.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.174+0000 7f58c3fff700 1 --2- 172.21.15.89:0/3313359769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58c406a6b0 0x7f58c40ccf80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0098f0 tx=0x7f58bc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d19aefd2df85b37c server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:39.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.174+0000 7f58c27fc700 1 -- 172.21.15.89:0/3313359769 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc00b8a0 con 0x7f58c406a6b0 2023-10-19T08:37:39.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.174+0000 7f58c27fc700 1 -- 172.21.15.89:0/3313359769 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58bc00ba00 con 0x7f58c406a6b0 2023-10-19T08:37:39.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.174+0000 7f58c27fc700 1 -- 172.21.15.89:0/3313359769 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc00bd90 con 0x7f58c406a6b0 2023-10-19T08:37:39.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.175+0000 7f58c9f51700 1 -- 172.21.15.89:0/3313359769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58c406a6b0 msgr2=0x7f58c40ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.175+0000 7f58c9f51700 1 --2- 172.21.15.89:0/3313359769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58c406a6b0 0x7f58c40ccf80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f58bc0098f0 tx=0x7f58bc009c00 comp rx=0 tx=0).stop 2023-10-19T08:37:39.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.175+0000 7f58c9f51700 1 -- 172.21.15.89:0/3313359769 shutdown_connections 2023-10-19T08:37:39.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.175+0000 7f58c9f51700 1 --2- 172.21.15.89:0/3313359769 >> v2:172.21.15.79:3300/0 conn(0x7f58c415ce90 0x7f58c415df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.175+0000 7f58c9f51700 1 --2- 172.21.15.89:0/3313359769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58c406a6b0 0x7f58c40ccf80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.175+0000 7f58c9f51700 1 -- 172.21.15.89:0/3313359769 >> 172.21.15.89:0/3313359769 conn(0x7f58c406dce0 msgr2=0x7f58c406e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:39.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.175+0000 7f58c9f51700 1 -- 172.21.15.89:0/3313359769 shutdown_connections 2023-10-19T08:37:39.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.175+0000 7f58c9f51700 1 -- 172.21.15.89:0/3313359769 wait complete. 2023-10-19T08:37:39.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.176+0000 7f58c9f51700 1 Processor -- start 2023-10-19T08:37:39.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.176+0000 7f58c9f51700 1 -- start start 2023-10-19T08:37:39.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.177+0000 7f58c9f51700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58c406a220 0x7f58c4152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.177+0000 7f58c9f51700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58c406a6b0 0x7f58c40b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.177+0000 7f58c9f51700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58c415ce90 0x7f58c40ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.186 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.177+0000 7f58c9f51700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c4152d70 con 0x7f58c415ce90 2023-10-19T08:37:39.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.177+0000 7f58c9f51700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40b4170 con 0x7f58c406a6b0 2023-10-19T08:37:39.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.177+0000 7f58c9f51700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40b4600 con 0x7f58c406a220 2023-10-19T08:37:39.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.177+0000 7f58c37fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58c406a220 0x7f58c4152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.177+0000 7f58c37fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58c406a220 0x7f58c4152830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:59462/0 (socket says 172.21.15.89:59462) 2023-10-19T08:37:39.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.177+0000 7f58c37fe700 1 -- 172.21.15.89:0/1580638173 learned_addr learned my addr 172.21.15.89:0/1580638173 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-19T08:37:39.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.177+0000 7f58c3fff700 1 --2- 172.21.15.89:0/1580638173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58c415ce90 0x7f58c40ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.177+0000 7f58c2ffd700 1 --2- 172.21.15.89:0/1580638173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58c406a6b0 0x7f58c40b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.177+0000 7f58c37fe700 1 -- 172.21.15.89:0/1580638173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58c406a6b0 msgr2=0x7f58c40b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.177+0000 7f58c37fe700 1 --2- 172.21.15.89:0/1580638173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58c406a6b0 0x7f58c40b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.177+0000 7f58c37fe700 1 -- 172.21.15.89:0/1580638173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58c415ce90 msgr2=0x7f58c40ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.177+0000 7f58c37fe700 1 --2- 172.21.15.89:0/1580638173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58c415ce90 0x7f58c40ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.177+0000 7f58c37fe700 1 -- 172.21.15.89:0/1580638173 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc009550 con 0x7f58c406a220 2023-10-19T08:37:39.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.177+0000 7f58c37fe700 1 --2- 172.21.15.89:0/1580638173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58c406a220 0x7f58c4152830 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009fa0 tx=0x7f58b400d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:39.189 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:39.177+0000 7f1c359e2200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-19T08:37:39.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.178+0000 7f58bbfff700 1 -- 172.21.15.89:0/1580638173 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b400dd50 con 0x7f58c406a220 2023-10-19T08:37:39.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.178+0000 7f58bbfff700 1 -- 172.21.15.89:0/1580638173 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b400f040 con 0x7f58c406a220 2023-10-19T08:37:39.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.178+0000 7f58c9f51700 1 -- 172.21.15.89:0/1580638173 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c40b3280 con 0x7f58c406a220 2023-10-19T08:37:39.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.178+0000 7f58bbfff700 1 -- 172.21.15.89:0/1580638173 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4003c60 con 0x7f58c406a220 2023-10-19T08:37:39.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.178+0000 7f58c9f51700 1 -- 172.21.15.89:0/1580638173 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c40b3840 con 0x7f58c406a220 2023-10-19T08:37:39.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.178+0000 7f58bbfff700 1 -- 172.21.15.89:0/1580638173 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f58b4004330 con 0x7f58c406a220 2023-10-19T08:37:39.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.178+0000 7f58bbfff700 1 -- 172.21.15.89:0/1580638173 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f58b40045e0 con 0x7f58c406a220 2023-10-19T08:37:39.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.179+0000 7f58c9f51700 1 -- 172.21.15.89:0/1580638173 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c404ee70 con 0x7f58c406a220 2023-10-19T08:37:39.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.181+0000 7f58bbfff700 1 -- 172.21.15.89:0/1580638173 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f58b4024060 con 0x7f58c406a220 2023-10-19T08:37:39.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.264+0000 7f58c9f51700 1 -- 172.21.15.89:0/1580638173 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "98bd5f90-96c8-4ab8-9905-892af9c61de3", "id": 4} v 0) v1 -- 0x7f58c40c3490 con 0x7f58c406a220 2023-10-19T08:37:39.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.271+0000 7f58bbfff700 1 -- 172.21.15.89:0/1580638173 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "98bd5f90-96c8-4ab8-9905-892af9c61de3", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f58b401a070 con 0x7f58c406a220 2023-10-19T08:37:39.274 INFO:teuthology.orchestra.run.smithi089.stdout:4 2023-10-19T08:37:39.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.272+0000 7f58c9f51700 1 -- 172.21.15.89:0/1580638173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58c406a220 msgr2=0x7f58c4152830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.275 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.272+0000 7f58c9f51700 1 --2- 172.21.15.89:0/1580638173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58c406a220 0x7f58c4152830 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009fa0 tx=0x7f58b400d3b0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.272+0000 7f58c9f51700 1 -- 172.21.15.89:0/1580638173 shutdown_connections 2023-10-19T08:37:39.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.272+0000 7f58c9f51700 1 --2- 172.21.15.89:0/1580638173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58c415ce90 0x7f58c40ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.272+0000 7f58c9f51700 1 --2- 172.21.15.89:0/1580638173 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58c406a220 0x7f58c4152830 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.272+0000 7f58c9f51700 1 --2- 172.21.15.89:0/1580638173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58c406a6b0 0x7f58c40b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.276 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.272+0000 7f58c9f51700 1 -- 172.21.15.89:0/1580638173 >> 172.21.15.89:0/1580638173 conn(0x7f58c406dce0 msgr2=0x7f58c4159d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:39.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.272+0000 7f58c9f51700 1 -- 172.21.15.89:0/1580638173 shutdown_connections 2023-10-19T08:37:39.277 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.272+0000 7f58c9f51700 1 -- 172.21.15.89:0/1580638173 wait complete. 2023-10-19T08:37:39.287 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 34a448aa-ee32-4915-9c76-968440526e50 5 2023-10-19T08:37:39.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.403+0000 7f8d1bdf0700 1 Processor -- start 2023-10-19T08:37:39.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.403+0000 7f8d1bdf0700 1 -- start start 2023-10-19T08:37:39.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.404+0000 7f8d1bdf0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d1415b050 0x7f8d1406f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.404+0000 7f8d1bdf0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8d1406ed80 0x7f8d140b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.404+0000 7f8d1bdf0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d140ca210 con 0x7f8d140c9af0 2023-10-19T08:37:39.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.404+0000 7f8d1bdf0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1406af40 con 0x7f8d1406ed80 2023-10-19T08:37:39.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.404+0000 7f8d1bdf0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140caa20 con 0x7f8d1415b050 2023-10-19T08:37:39.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.404+0000 7f8d19b8c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d1415b050 0x7f8d1406f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.404+0000 7f8d1a38d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8d1406ed80 0x7f8d140b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.404+0000 7f8d19b8c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d1415b050 0x7f8d1406f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:59468/0 (socket says 172.21.15.89:59468) 2023-10-19T08:37:39.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.404+0000 7f8d19b8c700 1 -- 172.21.15.89:0/1284576047 learned_addr learned my addr 172.21.15.89:0/1284576047 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-19T08:37:39.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.404+0000 7f8d1a38d700 1 --2- 172.21.15.89:0/1284576047 >> v2:172.21.15.89:3300/0 conn(0x7f8d1406ed80 0x7f8d140b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52122/0 (socket says 172.21.15.89:52122) 2023-10-19T08:37:39.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.404+0000 7f8d19b8c700 1 -- 172.21.15.89:0/1284576047 >> v2:172.21.15.89:3300/0 conn(0x7f8d1406ed80 msgr2=0x7f8d140b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:39.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.404+0000 7f8d19b8c700 1 --2- 172.21.15.89:0/1284576047 >> v2:172.21.15.89:3300/0 conn(0x7f8d1406ed80 0x7f8d140b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.404+0000 7f8d19b8c700 1 -- 172.21.15.89:0/1284576047 >> v1:172.21.15.79:6789/0 conn(0x7f8d140c9af0 legacy=0x7f8d1406e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.404+0000 7f8d19b8c700 1 -- 172.21.15.89:0/1284576047 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1406abf0 con 0x7f8d1415b050 2023-10-19T08:37:39.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.404+0000 7f8d1a38d700 1 --2- 172.21.15.89:0/1284576047 >> v2:172.21.15.89:3300/0 conn(0x7f8d1406ed80 0x7f8d140b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:37:39.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.404+0000 7f8d19b8c700 1 --2- 172.21.15.89:0/1284576047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d1415b050 0x7f8d1406f560 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8d100098f0 tx=0x7f8d10009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf028208ff4702b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:39.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.405+0000 7f8d18b8a700 1 -- 172.21.15.89:0/1284576047 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d10011830 con 0x7f8d1415b050 2023-10-19T08:37:39.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.405+0000 7f8d18b8a700 1 -- 172.21.15.89:0/1284576047 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d10011990 con 0x7f8d1415b050 2023-10-19T08:37:39.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.405+0000 7f8d18b8a700 1 -- 172.21.15.89:0/1284576047 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d10011d20 con 0x7f8d1415b050 2023-10-19T08:37:39.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.405+0000 7f8d1bdf0700 1 -- 172.21.15.89:0/1284576047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d1415b050 msgr2=0x7f8d1406f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.405+0000 7f8d1bdf0700 1 --2- 172.21.15.89:0/1284576047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d1415b050 0x7f8d1406f560 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8d100098f0 tx=0x7f8d10009c00 comp rx=0 tx=0).stop 2023-10-19T08:37:39.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.405+0000 7f8d1bdf0700 1 -- 172.21.15.89:0/1284576047 shutdown_connections 2023-10-19T08:37:39.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.405+0000 7f8d1bdf0700 1 --2- 172.21.15.89:0/1284576047 >> v2:172.21.15.89:3300/0 conn(0x7f8d1406ed80 0x7f8d140b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.405+0000 7f8d1bdf0700 1 --2- 172.21.15.89:0/1284576047 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d1415b050 0x7f8d1406f560 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.405+0000 7f8d1bdf0700 1 -- 172.21.15.89:0/1284576047 >> 172.21.15.89:0/1284576047 conn(0x7f8d1406d020 msgr2=0x7f8d1406d430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:39.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.405+0000 7f8d1bdf0700 1 -- 172.21.15.89:0/1284576047 shutdown_connections 2023-10-19T08:37:39.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.405+0000 7f8d1bdf0700 1 -- 172.21.15.89:0/1284576047 wait complete. 2023-10-19T08:37:39.416 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.406+0000 7f8d1bdf0700 1 Processor -- start 2023-10-19T08:37:39.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.406+0000 7f8d1bdf0700 1 -- start start 2023-10-19T08:37:39.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.407+0000 7f8d1bdf0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d1406ed80 0x7f8d141f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.407+0000 7f8d1bdf0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d140c9af0 0x7f8d140cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.407+0000 7f8d1bdf0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1415b050 0x7f8d140cd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.417 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.407+0000 7f8d1bdf0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140ac520 con 0x7f8d1415b050 2023-10-19T08:37:39.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.407+0000 7f8d1bdf0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140cdfd0 con 0x7f8d1406ed80 2023-10-19T08:37:39.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.407+0000 7f8d1bdf0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d140ce2b0 con 0x7f8d140c9af0 2023-10-19T08:37:39.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.407+0000 7f8d1938b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d140c9af0 0x7f8d140cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.407+0000 7f8d19b8c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d1406ed80 0x7f8d141f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.418 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.407+0000 7f8d1938b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d140c9af0 0x7f8d140cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:59476/0 (socket says 172.21.15.89:59476) 2023-10-19T08:37:39.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.407+0000 7f8d19b8c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d1406ed80 0x7f8d141f5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52124/0 (socket says 172.21.15.89:52124) 2023-10-19T08:37:39.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.407+0000 7f8d1938b700 1 -- 172.21.15.89:0/2171384528 learned_addr learned my addr 172.21.15.89:0/2171384528 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-19T08:37:39.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.407+0000 7f8d1a38d700 1 --2- 172.21.15.89:0/2171384528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1415b050 0x7f8d140cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.408+0000 7f8d1938b700 1 -- 172.21.15.89:0/2171384528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d1406ed80 msgr2=0x7f8d141f5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.408+0000 7f8d1938b700 1 --2- 172.21.15.89:0/2171384528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d1406ed80 0x7f8d141f5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.408+0000 7f8d1938b700 1 -- 172.21.15.89:0/2171384528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1415b050 msgr2=0x7f8d140cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.408+0000 7f8d1938b700 1 --2- 172.21.15.89:0/2171384528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1415b050 0x7f8d140cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.408+0000 7f8d1938b700 1 -- 172.21.15.89:0/2171384528 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c009a70 con 0x7f8d140c9af0 2023-10-19T08:37:39.420 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.408+0000 7f8d1938b700 1 --2- 172.21.15.89:0/2171384528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d140c9af0 0x7f8d140cd410 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400c4e0 tx=0x7f8d0400c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:39.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.408+0000 7f8d0a7fc700 1 -- 172.21.15.89:0/2171384528 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d040052d0 con 0x7f8d140c9af0 2023-10-19T08:37:39.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.408+0000 7f8d0a7fc700 1 -- 172.21.15.89:0/2171384528 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d04005430 con 0x7f8d140c9af0 2023-10-19T08:37:39.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.408+0000 7f8d1bdf0700 1 -- 172.21.15.89:0/2171384528 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d10009550 con 0x7f8d140c9af0 2023-10-19T08:37:39.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.408+0000 7f8d0a7fc700 1 -- 172.21.15.89:0/2171384528 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d040038c0 con 0x7f8d140c9af0 2023-10-19T08:37:39.421 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.408+0000 7f8d1bdf0700 1 -- 172.21.15.89:0/2171384528 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d140ce870 con 0x7f8d140c9af0 2023-10-19T08:37:39.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.408+0000 7f8d0a7fc700 1 -- 172.21.15.89:0/2171384528 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8d04003d20 con 0x7f8d140c9af0 2023-10-19T08:37:39.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.408+0000 7f8d0a7fc700 1 -- 172.21.15.89:0/2171384528 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f8d04011d60 con 0x7f8d140c9af0 2023-10-19T08:37:39.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.409+0000 7f8d1bdf0700 1 -- 172.21.15.89:0/2171384528 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1404ee70 con 0x7f8d140c9af0 2023-10-19T08:37:39.422 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.411+0000 7f8d0a7fc700 1 -- 172.21.15.89:0/2171384528 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f8d04017070 con 0x7f8d140c9af0 2023-10-19T08:37:39.496 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.492+0000 7f8d1bdf0700 1 -- 172.21.15.89:0/2171384528 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "34a448aa-ee32-4915-9c76-968440526e50", "id": 5} v 0) v1 -- 0x7f8d1415e350 con 0x7f8d140c9af0 2023-10-19T08:37:39.504 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.501+0000 7f8d0a7fc700 1 -- 172.21.15.89:0/2171384528 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "34a448aa-ee32-4915-9c76-968440526e50", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8d04011590 con 0x7f8d140c9af0 2023-10-19T08:37:39.504 INFO:teuthology.orchestra.run.smithi089.stdout:5 2023-10-19T08:37:39.505 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.502+0000 7f8d1bdf0700 1 -- 172.21.15.89:0/2171384528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d140c9af0 msgr2=0x7f8d140cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.502+0000 7f8d1bdf0700 1 --2- 172.21.15.89:0/2171384528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d140c9af0 0x7f8d140cd410 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400c4e0 tx=0x7f8d0400c7f0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.502+0000 7f8d1bdf0700 1 -- 172.21.15.89:0/2171384528 shutdown_connections 2023-10-19T08:37:39.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.502+0000 7f8d1bdf0700 1 --2- 172.21.15.89:0/2171384528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1415b050 0x7f8d140cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.502+0000 7f8d1bdf0700 1 --2- 172.21.15.89:0/2171384528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d1406ed80 0x7f8d141f5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.506 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.502+0000 7f8d1bdf0700 1 --2- 172.21.15.89:0/2171384528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d140c9af0 0x7f8d140cd410 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.502+0000 7f8d1bdf0700 1 -- 172.21.15.89:0/2171384528 >> 172.21.15.89:0/2171384528 conn(0x7f8d1406d020 msgr2=0x7f8d140b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:39.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.502+0000 7f8d1bdf0700 1 -- 172.21.15.89:0/2171384528 shutdown_connections 2023-10-19T08:37:39.507 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.502+0000 7f8d1bdf0700 1 -- 172.21.15.89:0/2171384528 wait complete. 2023-10-19T08:37:39.516 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 2f526ed0-57ba-44b2-9d4c-d07c5700b0e4 6 2023-10-19T08:37:39.662 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.659+0000 7f572c1dd700 1 Processor -- start 2023-10-19T08:37:39.663 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.660+0000 7f572c1dd700 1 -- start start 2023-10-19T08:37:39.665 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.660+0000 7f572c1dd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f572415ce90 0x7f572415df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.660+0000 7f572c1dd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f572406a220 0x7f572406a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.660+0000 7f572c1dd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5724070670 con 0x7f57240cc870 2023-10-19T08:37:39.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.660+0000 7f572c1dd700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572406abf0 con 0x7f572415ce90 2023-10-19T08:37:39.666 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.660+0000 7f572c1dd700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572406faf0 con 0x7f572406a220 2023-10-19T08:37:39.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.660+0000 7f5729778700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f572406a220 0x7f572406a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.660+0000 7f572a77a700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f57240cc870 0x7f57240cccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:53778/0 (socket says 172.21.15.89:53778) 2023-10-19T08:37:39.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.661+0000 7f572a77a700 1 -- 172.21.15.89:0/1431036740 learned_addr learned my addr 172.21.15.89:0/1431036740 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-10-19T08:37:39.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.661+0000 7f5729f79700 1 --2- 172.21.15.89:0/1431036740 >> v2:172.21.15.79:3300/0 conn(0x7f572415ce90 0x7f572415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.667 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.661+0000 7f5729778700 1 -- 172.21.15.89:0/1431036740 >> v2:172.21.15.79:3300/0 conn(0x7f572415ce90 msgr2=0x7f572415df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:39.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.661+0000 7f5729778700 1 --2- 172.21.15.89:0/1431036740 >> v2:172.21.15.79:3300/0 conn(0x7f572415ce90 0x7f572415df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.661+0000 7f5729778700 1 -- 172.21.15.89:0/1431036740 >> v1:172.21.15.89:6789/0 conn(0x7f57240cc870 legacy=0x7f57240cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.661+0000 7f5728f77700 1 -- 172.21.15.89:0/1431036740 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827554543 0 0) 0x7f5724070670 con 0x7f57240cc870 2023-10-19T08:37:39.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.661+0000 7f5729778700 1 -- 172.21.15.89:0/1431036740 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572406fdd0 con 0x7f572406a220 2023-10-19T08:37:39.668 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.661+0000 7f5729778700 1 --2- 172.21.15.89:0/1431036740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f572406a220 0x7f572406a6b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f572406ecf0 tx=0x7f5714009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6b8431ffb9f7f74 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:39.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.661+0000 7f5728f77700 1 -- 172.21.15.89:0/1431036740 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714011830 con 0x7f572406a220 2023-10-19T08:37:39.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.661+0000 7f5728f77700 1 -- 172.21.15.89:0/1431036740 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5714011990 con 0x7f572406a220 2023-10-19T08:37:39.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.661+0000 7f5728f77700 1 -- 172.21.15.89:0/1431036740 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714011d20 con 0x7f572406a220 2023-10-19T08:37:39.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.662+0000 7f572c1dd700 1 -- 172.21.15.89:0/1431036740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f572406a220 msgr2=0x7f572406a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.669 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.662+0000 7f572c1dd700 1 --2- 172.21.15.89:0/1431036740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f572406a220 0x7f572406a6b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f572406ecf0 tx=0x7f5714009b20 comp rx=0 tx=0).stop 2023-10-19T08:37:39.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.662+0000 7f572c1dd700 1 -- 172.21.15.89:0/1431036740 shutdown_connections 2023-10-19T08:37:39.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.662+0000 7f572c1dd700 1 --2- 172.21.15.89:0/1431036740 >> v2:172.21.15.79:3300/0 conn(0x7f572415ce90 0x7f572415df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.662+0000 7f572c1dd700 1 --2- 172.21.15.89:0/1431036740 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f572406a220 0x7f572406a6b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.670 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.662+0000 7f572c1dd700 1 -- 172.21.15.89:0/1431036740 >> 172.21.15.89:0/1431036740 conn(0x7f572406dce0 msgr2=0x7f572406e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:39.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.662+0000 7f572c1dd700 1 -- 172.21.15.89:0/1431036740 shutdown_connections 2023-10-19T08:37:39.671 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.662+0000 7f572c1dd700 1 -- 172.21.15.89:0/1431036740 wait complete. 2023-10-19T08:37:39.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.663+0000 7f572c1dd700 1 Processor -- start 2023-10-19T08:37:39.673 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.663+0000 7f572c1dd700 1 -- start start 2023-10-19T08:37:39.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.664+0000 7f572c1dd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f572406a220 0x7f572415aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.664+0000 7f572c1dd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57240cc870 0x7f57240c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.664+0000 7f572c1dd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f572415ce90 0x7f57241f3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.664+0000 7f572c1dd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57240c38b0 con 0x7f572415ce90 2023-10-19T08:37:39.674 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.664+0000 7f572c1dd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57240c3b90 con 0x7f57240cc870 2023-10-19T08:37:39.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.664+0000 7f572c1dd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57240c3e70 con 0x7f572406a220 2023-10-19T08:37:39.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.664+0000 7f5729778700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57240cc870 0x7f57240c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.664+0000 7f5729778700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57240cc870 0x7f57240c7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52138/0 (socket says 172.21.15.89:52138) 2023-10-19T08:37:39.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.664+0000 7f5729778700 1 -- 172.21.15.89:0/954721349 learned_addr learned my addr 172.21.15.89:0/954721349 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-19T08:37:39.675 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.664+0000 7f5729f79700 1 --2- 172.21.15.89:0/954721349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f572406a220 0x7f572415aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.664+0000 7f572a77a700 1 --2- 172.21.15.89:0/954721349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f572415ce90 0x7f57241f3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.664+0000 7f5729778700 1 -- 172.21.15.89:0/954721349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f572406a220 msgr2=0x7f572415aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.664+0000 7f5729778700 1 --2- 172.21.15.89:0/954721349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f572406a220 0x7f572415aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.664+0000 7f5729778700 1 -- 172.21.15.89:0/954721349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f572415ce90 msgr2=0x7f57241f3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.676 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.664+0000 7f5729778700 1 --2- 172.21.15.89:0/954721349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f572415ce90 0x7f57241f3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.664+0000 7f5729778700 1 -- 172.21.15.89:0/954721349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57140094a0 con 0x7f57240cc870 2023-10-19T08:37:39.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.664+0000 7f572a77a700 1 --2- 172.21.15.89:0/954721349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f572415ce90 0x7f57241f3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:37:39.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.664+0000 7f5729778700 1 --2- 172.21.15.89:0/954721349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57240cc870 0x7f57240c7730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f57140090b0 tx=0x7f5714004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:39.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.664+0000 7f571a7fc700 1 -- 172.21.15.89:0/954721349 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57140036a0 con 0x7f57240cc870 2023-10-19T08:37:39.677 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.665+0000 7f571a7fc700 1 -- 172.21.15.89:0/954721349 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571401f070 con 0x7f57240cc870 2023-10-19T08:37:39.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.665+0000 7f572c1dd700 1 -- 172.21.15.89:0/954721349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57240c4150 con 0x7f57240cc870 2023-10-19T08:37:39.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.665+0000 7f571a7fc700 1 -- 172.21.15.89:0/954721349 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714003a20 con 0x7f57240cc870 2023-10-19T08:37:39.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.665+0000 7f572c1dd700 1 -- 172.21.15.89:0/954721349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572415afd0 con 0x7f57240cc870 2023-10-19T08:37:39.678 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.665+0000 7f571a7fc700 1 -- 172.21.15.89:0/954721349 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5714026480 con 0x7f57240cc870 2023-10-19T08:37:39.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.665+0000 7f571a7fc700 1 -- 172.21.15.89:0/954721349 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f5714021070 con 0x7f57240cc870 2023-10-19T08:37:39.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.665+0000 7f572c1dd700 1 -- 172.21.15.89:0/954721349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57240c4670 con 0x7f57240cc870 2023-10-19T08:37:39.679 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.668+0000 7f571a7fc700 1 -- 172.21.15.89:0/954721349 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f57240c4670 con 0x7f57240cc870 2023-10-19T08:37:39.754 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.751+0000 7f572c1dd700 1 -- 172.21.15.89:0/954721349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2f526ed0-57ba-44b2-9d4c-d07c5700b0e4", "id": 6} v 0) v1 -- 0x7f5724070340 con 0x7f57240cc870 2023-10-19T08:37:39.765 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.762+0000 7f571a7fc700 1 -- 172.21.15.89:0/954721349 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2f526ed0-57ba-44b2-9d4c-d07c5700b0e4", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5714015020 con 0x7f57240cc870 2023-10-19T08:37:39.765 INFO:teuthology.orchestra.run.smithi089.stdout:6 2023-10-19T08:37:39.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.763+0000 7f572c1dd700 1 -- 172.21.15.89:0/954721349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57240cc870 msgr2=0x7f57240c7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.766 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.763+0000 7f572c1dd700 1 --2- 172.21.15.89:0/954721349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57240cc870 0x7f57240c7730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f57140090b0 tx=0x7f5714004750 comp rx=0 tx=0).stop 2023-10-19T08:37:39.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.763+0000 7f572c1dd700 1 -- 172.21.15.89:0/954721349 shutdown_connections 2023-10-19T08:37:39.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.763+0000 7f572c1dd700 1 --2- 172.21.15.89:0/954721349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f572415ce90 0x7f57241f3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.763+0000 7f572c1dd700 1 --2- 172.21.15.89:0/954721349 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f572406a220 0x7f572415aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.763+0000 7f572c1dd700 1 --2- 172.21.15.89:0/954721349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57240cc870 0x7f57240c7730 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.767 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.763+0000 7f572c1dd700 1 -- 172.21.15.89:0/954721349 >> 172.21.15.89:0/954721349 conn(0x7f572406dce0 msgr2=0x7f57240cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:39.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.763+0000 7f572c1dd700 1 -- 172.21.15.89:0/954721349 shutdown_connections 2023-10-19T08:37:39.768 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.763+0000 7f572c1dd700 1 -- 172.21.15.89:0/954721349 wait complete. 2023-10-19T08:37:39.778 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new d0001967-3981-4ebe-8dfb-aa38db091f0d 7 2023-10-19T08:37:39.781 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:39.777+0000 7fae2a735200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-19T08:37:39.837 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:39.834+0000 7f1c359e2200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-19T08:37:39.848 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:39.845+0000 7fae2a735200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-19T08:37:39.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.895+0000 7fc70fead700 1 Processor -- start 2023-10-19T08:37:39.900 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.896+0000 7fc70fead700 1 -- start start 2023-10-19T08:37:39.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.896+0000 7fc70fead700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc70806a930 0x7fc70815df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.896+0000 7fc70fead700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7080cc870 0x7fc7080cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.902 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.896+0000 7fc70fead700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc708070670 con 0x7fc70815ce90 2023-10-19T08:37:39.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.896+0000 7fc70fead700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70806faf0 con 0x7fc70806a930 2023-10-19T08:37:39.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.896+0000 7fc70fead700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70806fdd0 con 0x7fc7080cc870 2023-10-19T08:37:39.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.897+0000 7fc70d448700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc70806a930 0x7fc70815df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.897+0000 7fc70e44a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7080cc870 0x7fc7080cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.903 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.897+0000 7fc70dc49700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fc70815ce90 0x7fc70806a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:53786/0 (socket says 172.21.15.89:53786) 2023-10-19T08:37:39.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.897+0000 7fc70dc49700 1 -- 172.21.15.89:0/2175697183 learned_addr learned my addr 172.21.15.89:0/2175697183 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-10-19T08:37:39.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.897+0000 7fc70e44a700 1 -- 172.21.15.89:0/2175697183 >> v2:172.21.15.89:3300/0 conn(0x7fc70806a930 msgr2=0x7fc70815df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:39.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.897+0000 7fc70e44a700 1 --2- 172.21.15.89:0/2175697183 >> v2:172.21.15.89:3300/0 conn(0x7fc70806a930 0x7fc70815df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.897+0000 7fc70e44a700 1 -- 172.21.15.89:0/2175697183 >> v1:172.21.15.89:6789/0 conn(0x7fc70815ce90 legacy=0x7fc70806a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.904 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.897+0000 7fc70e44a700 1 -- 172.21.15.89:0/2175697183 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7080700b0 con 0x7fc7080cc870 2023-10-19T08:37:39.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.897+0000 7fc70d448700 1 --2- 172.21.15.89:0/2175697183 >> v2:172.21.15.89:3300/0 conn(0x7fc70806a930 0x7fc70815df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:37:39.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.897+0000 7fc70e44a700 1 --2- 172.21.15.89:0/2175697183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7080cc870 0x7fc7080cccc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc700009d90 tx=0x7fc70000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5adc1e6de7347998 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:39.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.897+0000 7fc70cc47700 1 -- 172.21.15.89:0/2175697183 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70000e070 con 0x7fc7080cc870 2023-10-19T08:37:39.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.897+0000 7fc70cc47700 1 -- 172.21.15.89:0/2175697183 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70000bb20 con 0x7fc7080cc870 2023-10-19T08:37:39.905 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.897+0000 7fc70cc47700 1 -- 172.21.15.89:0/2175697183 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700012430 con 0x7fc7080cc870 2023-10-19T08:37:39.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.898+0000 7fc70fead700 1 -- 172.21.15.89:0/2175697183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7080cc870 msgr2=0x7fc7080cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.898+0000 7fc70fead700 1 --2- 172.21.15.89:0/2175697183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7080cc870 0x7fc7080cccc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc700009d90 tx=0x7fc70000b330 comp rx=0 tx=0).stop 2023-10-19T08:37:39.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.898+0000 7fc70fead700 1 -- 172.21.15.89:0/2175697183 shutdown_connections 2023-10-19T08:37:39.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.898+0000 7fc70fead700 1 --2- 172.21.15.89:0/2175697183 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7080cc870 0x7fc7080cccc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.906 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.898+0000 7fc70fead700 1 --2- 172.21.15.89:0/2175697183 >> v2:172.21.15.89:3300/0 conn(0x7fc70806a930 0x7fc70815df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.898+0000 7fc70fead700 1 -- 172.21.15.89:0/2175697183 >> 172.21.15.89:0/2175697183 conn(0x7fc70806dce0 msgr2=0x7fc70806e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:39.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.898+0000 7fc70fead700 1 -- 172.21.15.89:0/2175697183 shutdown_connections 2023-10-19T08:37:39.907 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.898+0000 7fc70fead700 1 -- 172.21.15.89:0/2175697183 wait complete. 2023-10-19T08:37:39.909 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.900+0000 7fc70fead700 1 Processor -- start 2023-10-19T08:37:39.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.900+0000 7fc70fead700 1 -- start start 2023-10-19T08:37:39.910 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.901+0000 7fc70fead700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc70806a930 0x7fc7081541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.901+0000 7fc70fead700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7080cc870 0x7fc7080c3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.901+0000 7fc70fead700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc70815ce90 0x7fc7080c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:39.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.901+0000 7fc70fead700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7080cb770 con 0x7fc70806a930 2023-10-19T08:37:39.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.901+0000 7fc70fead700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7080b4960 con 0x7fc7080cc870 2023-10-19T08:37:39.911 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.901+0000 7fc70fead700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7081546e0 con 0x7fc70815ce90 2023-10-19T08:37:39.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.901+0000 7fc70d448700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7080cc870 0x7fc7080c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.901+0000 7fc70e44a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc70815ce90 0x7fc7080c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.902+0000 7fc70d448700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7080cc870 0x7fc7080c3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52150/0 (socket says 172.21.15.89:52150) 2023-10-19T08:37:39.912 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.902+0000 7fc70e44a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc70815ce90 0x7fc7080c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:59502/0 (socket says 172.21.15.89:59502) 2023-10-19T08:37:39.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.902+0000 7fc70d448700 1 -- 172.21.15.89:0/1391317345 learned_addr learned my addr 172.21.15.89:0/1391317345 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-10-19T08:37:39.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.902+0000 7fc70dc49700 1 --2- 172.21.15.89:0/1391317345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc70806a930 0x7fc7081541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:39.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.902+0000 7fc70e44a700 1 -- 172.21.15.89:0/1391317345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7080cc870 msgr2=0x7fc7080c3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.902+0000 7fc70e44a700 1 --2- 172.21.15.89:0/1391317345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7080cc870 0x7fc7080c3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.913 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.902+0000 7fc70e44a700 1 -- 172.21.15.89:0/1391317345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc70806a930 msgr2=0x7fc7081541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:39.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.902+0000 7fc70e44a700 1 --2- 172.21.15.89:0/1391317345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc70806a930 0x7fc7081541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:39.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.902+0000 7fc70e44a700 1 -- 172.21.15.89:0/1391317345 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f80094a0 con 0x7fc70815ce90 2023-10-19T08:37:39.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.902+0000 7fc70d448700 1 --2- 172.21.15.89:0/1391317345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7080cc870 0x7fc7080c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:37:39.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.902+0000 7fc70e44a700 1 --2- 172.21.15.89:0/1391317345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc70815ce90 0x7fc7080c3cc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc700016000 tx=0x7fc700004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:39.914 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.902+0000 7fc6fe7fc700 1 -- 172.21.15.89:0/1391317345 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700012430 con 0x7fc70815ce90 2023-10-19T08:37:39.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.902+0000 7fc6fe7fc700 1 -- 172.21.15.89:0/1391317345 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc700020070 con 0x7fc70815ce90 2023-10-19T08:37:39.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.902+0000 7fc6fe7fc700 1 -- 172.21.15.89:0/1391317345 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7000098f0 con 0x7fc70815ce90 2023-10-19T08:37:39.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.902+0000 7fc70fead700 1 -- 172.21.15.89:0/1391317345 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc700009a70 con 0x7fc70815ce90 2023-10-19T08:37:39.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.902+0000 7fc70fead700 1 -- 172.21.15.89:0/1391317345 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7080cb490 con 0x7fc70815ce90 2023-10-19T08:37:39.915 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.902+0000 7fc6fe7fc700 1 -- 172.21.15.89:0/1391317345 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc700004340 con 0x7fc70815ce90 2023-10-19T08:37:39.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.902+0000 7fc6fe7fc700 1 -- 172.21.15.89:0/1391317345 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fc700022070 con 0x7fc70815ce90 2023-10-19T08:37:39.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.903+0000 7fc70fead700 1 -- 172.21.15.89:0/1391317345 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc708070340 con 0x7fc70815ce90 2023-10-19T08:37:39.916 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.905+0000 7fc6fe7fc700 1 -- 172.21.15.89:0/1391317345 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fc70002c060 con 0x7fc70815ce90 2023-10-19T08:37:39.916 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:39.910+0000 7f1c359e2200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-19T08:37:40.001 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:39.998+0000 7fc70fead700 1 -- 172.21.15.89:0/1391317345 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d0001967-3981-4ebe-8dfb-aa38db091f0d", "id": 7} v 0) v1 -- 0x7fc70804ee70 con 0x7fc70815ce90 2023-10-19T08:37:40.009 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:40.006+0000 7fc6fe7fc700 1 -- 172.21.15.89:0/1391317345 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d0001967-3981-4ebe-8dfb-aa38db091f0d", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc7000047d0 con 0x7fc70815ce90 2023-10-19T08:37:40.009 INFO:teuthology.orchestra.run.smithi089.stdout:7 2023-10-19T08:37:40.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:40.007+0000 7fc70fead700 1 -- 172.21.15.89:0/1391317345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc70815ce90 msgr2=0x7fc7080c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:40.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:40.007+0000 7fc70fead700 1 --2- 172.21.15.89:0/1391317345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc70815ce90 0x7fc7080c3cc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc700016000 tx=0x7fc700004ad0 comp rx=0 tx=0).stop 2023-10-19T08:37:40.010 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:40.007+0000 7fc70fead700 1 -- 172.21.15.89:0/1391317345 shutdown_connections 2023-10-19T08:37:40.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:40.007+0000 7fc70fead700 1 --2- 172.21.15.89:0/1391317345 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc70815ce90 0x7fc7080c3cc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:40.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:40.007+0000 7fc70fead700 1 --2- 172.21.15.89:0/1391317345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc70806a930 0x7fc7081541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:40.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:40.007+0000 7fc70fead700 1 --2- 172.21.15.89:0/1391317345 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7080cc870 0x7fc7080c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:40.011 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:40.007+0000 7fc70fead700 1 -- 172.21.15.89:0/1391317345 >> 172.21.15.89:0/1391317345 conn(0x7fc70806dce0 msgr2=0x7fc70806e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:40.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:40.007+0000 7fc70fead700 1 -- 172.21.15.89:0/1391317345 shutdown_connections 2023-10-19T08:37:40.012 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:37:40.007+0000 7fc70fead700 1 -- 172.21.15.89:0/1391317345 wait complete. 2023-10-19T08:37:40.022 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-19T08:37:40.022 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-19T08:37:40.024 INFO:tasks.ceph.osd.0:Started 2023-10-19T08:37:40.025 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-19T08:37:40.025 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-19T08:37:40.027 INFO:tasks.ceph.osd.1:Started 2023-10-19T08:37:40.027 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-19T08:37:40.028 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-19T08:37:40.029 INFO:tasks.ceph.osd.2:Started 2023-10-19T08:37:40.030 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-19T08:37:40.030 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-19T08:37:40.032 INFO:tasks.ceph.osd.3:Started 2023-10-19T08:37:40.033 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-19T08:37:40.033 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-19T08:37:40.035 INFO:tasks.ceph.osd.4:Started 2023-10-19T08:37:40.036 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-19T08:37:40.036 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-19T08:37:40.038 INFO:tasks.ceph.osd.5:Started 2023-10-19T08:37:40.038 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-19T08:37:40.039 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-19T08:37:40.041 INFO:tasks.ceph.osd.6:Started 2023-10-19T08:37:40.041 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-19T08:37:40.041 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-19T08:37:40.043 INFO:tasks.ceph.osd.7:Started 2023-10-19T08:37:40.044 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:37:40.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.191+0000 7ff20e04e700 1 Processor -- start 2023-10-19T08:37:40.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.191+0000 7ff20e04e700 1 -- start start 2023-10-19T08:37:40.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.192+0000 7ff20e04e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff20815aed0 0x7ff2080cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:40.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.192+0000 7ff20e04e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2080d0480 0x7ff2080b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:40.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.192+0000 7ff20e04e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20815b2b0 con 0x7ff2080b2ca0 2023-10-19T08:37:40.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.192+0000 7ff20e04e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2080b3130 con 0x7ff20815aed0 2023-10-19T08:37:40.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.192+0000 7ff20e04e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2080cf420 con 0x7ff2080d0480 2023-10-19T08:37:40.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.192+0000 7ff2077fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff20815aed0 0x7ff2080cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:40.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.192+0000 7ff2077fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff20815aed0 0x7ff2080cee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45102/0 (socket says 172.21.15.79:45102) 2023-10-19T08:37:40.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.192+0000 7ff2077fe700 1 -- 172.21.15.79:0/329769969 learned_addr learned my addr 172.21.15.79:0/329769969 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:40.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.192+0000 7ff206ffd700 1 --2- 172.21.15.79:0/329769969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2080d0480 0x7ff2080b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:40.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.192+0000 7ff2077fe700 1 -- 172.21.15.79:0/329769969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2080d0480 msgr2=0x7ff2080b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:40.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.192+0000 7ff2077fe700 1 --2- 172.21.15.79:0/329769969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2080d0480 0x7ff2080b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:40.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.192+0000 7ff2077fe700 1 -- 172.21.15.79:0/329769969 >> v1:172.21.15.89:6789/0 conn(0x7ff2080b2ca0 legacy=0x7ff2080707c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:40.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.192+0000 7ff2077fe700 1 -- 172.21.15.79:0/329769969 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2080cf700 con 0x7ff20815aed0 2023-10-19T08:37:40.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.192+0000 7ff2077fe700 1 --2- 172.21.15.79:0/329769969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff20815aed0 0x7ff2080cee20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff1f80098f0 tx=0x7ff1f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3370b20189adc33 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:40.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.192+0000 7ff2067fc700 1 -- 172.21.15.79:0/329769969 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8011830 con 0x7ff20815aed0 2023-10-19T08:37:40.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.192+0000 7ff2067fc700 1 -- 172.21.15.79:0/329769969 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f8011990 con 0x7ff20815aed0 2023-10-19T08:37:40.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.192+0000 7ff2067fc700 1 -- 172.21.15.79:0/329769969 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f8011d20 con 0x7ff20815aed0 2023-10-19T08:37:40.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.193+0000 7ff20e04e700 1 -- 172.21.15.79:0/329769969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff20815aed0 msgr2=0x7ff2080cee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:40.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.193+0000 7ff20e04e700 1 --2- 172.21.15.79:0/329769969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff20815aed0 0x7ff2080cee20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff1f80098f0 tx=0x7ff1f8009c00 comp rx=0 tx=0).stop 2023-10-19T08:37:40.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.193+0000 7ff20e04e700 1 -- 172.21.15.79:0/329769969 shutdown_connections 2023-10-19T08:37:40.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.193+0000 7ff20e04e700 1 --2- 172.21.15.79:0/329769969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff20815aed0 0x7ff2080cee20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:40.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.193+0000 7ff20e04e700 1 --2- 172.21.15.79:0/329769969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2080d0480 0x7ff2080b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:40.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.193+0000 7ff20e04e700 1 -- 172.21.15.79:0/329769969 >> 172.21.15.79:0/329769969 conn(0x7ff2080cd760 msgr2=0x7ff2080cdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:40.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.193+0000 7ff20e04e700 1 -- 172.21.15.79:0/329769969 shutdown_connections 2023-10-19T08:37:40.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.193+0000 7ff20e04e700 1 -- 172.21.15.79:0/329769969 wait complete. 2023-10-19T08:37:40.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.194+0000 7ff20e04e700 1 Processor -- start 2023-10-19T08:37:40.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.194+0000 7ff20e04e700 1 -- start start 2023-10-19T08:37:40.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.195+0000 7ff20e04e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2080b2ca0 0x7ff2081594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:40.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.195+0000 7ff20e04e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2080d0480 0x7ff20815c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:40.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.195+0000 7ff20e04e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff20815aed0 0x7ff20815ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:40.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.195+0000 7ff20e04e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff208159a20 con 0x7ff20815aed0 2023-10-19T08:37:40.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.195+0000 7ff20e04e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20814e390 con 0x7ff2080d0480 2023-10-19T08:37:40.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.195+0000 7ff20e04e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20814f680 con 0x7ff2080b2ca0 2023-10-19T08:37:40.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.195+0000 7ff2077fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2080b2ca0 0x7ff2081594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:40.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.195+0000 7ff207fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff20815aed0 0x7ff20815ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:40.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.195+0000 7ff2077fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2080b2ca0 0x7ff2081594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:47732/0 (socket says 172.21.15.79:47732) 2023-10-19T08:37:40.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.195+0000 7ff2077fe700 1 -- 172.21.15.79:0/210489077 learned_addr learned my addr 172.21.15.79:0/210489077 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:40.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.195+0000 7ff206ffd700 1 --2- 172.21.15.79:0/210489077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2080d0480 0x7ff20815c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:40.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.196+0000 7ff207fff700 1 -- 172.21.15.79:0/210489077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2080b2ca0 msgr2=0x7ff2081594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:40.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.196+0000 7ff207fff700 1 --2- 172.21.15.79:0/210489077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2080b2ca0 0x7ff2081594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:40.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.196+0000 7ff207fff700 1 -- 172.21.15.79:0/210489077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2080d0480 msgr2=0x7ff20815c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:40.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.196+0000 7ff207fff700 1 --2- 172.21.15.79:0/210489077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2080d0480 0x7ff20815c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:40.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.196+0000 7ff207fff700 1 -- 172.21.15.79:0/210489077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f8009550 con 0x7ff20815aed0 2023-10-19T08:37:40.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.196+0000 7ff207fff700 1 --2- 172.21.15.79:0/210489077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff20815aed0 0x7ff20815ca30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff20000cae0 tx=0x7ff20000cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:40.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.196+0000 7ff1effff700 1 -- 172.21.15.79:0/210489077 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff200003c00 con 0x7ff20815aed0 2023-10-19T08:37:40.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.196+0000 7ff1effff700 1 -- 172.21.15.79:0/210489077 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff200003d60 con 0x7ff20815aed0 2023-10-19T08:37:40.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.196+0000 7ff1effff700 1 -- 172.21.15.79:0/210489077 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20000aa20 con 0x7ff20815aed0 2023-10-19T08:37:40.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.196+0000 7ff20e04e700 1 -- 172.21.15.79:0/210489077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff20814e5e0 con 0x7ff20815aed0 2023-10-19T08:37:40.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.196+0000 7ff20e04e700 1 -- 172.21.15.79:0/210489077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff20814eba0 con 0x7ff20815aed0 2023-10-19T08:37:40.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.196+0000 7ff1effff700 1 -- 172.21.15.79:0/210489077 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff2000050d0 con 0x7ff20815aed0 2023-10-19T08:37:40.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.196+0000 7ff1effff700 1 -- 172.21.15.79:0/210489077 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff200012b90 con 0x7ff20815aed0 2023-10-19T08:37:40.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.197+0000 7ff20e04e700 1 -- 172.21.15.79:0/210489077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20804ee70 con 0x7ff20815aed0 2023-10-19T08:37:40.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.201+0000 7ff1effff700 1 -- 172.21.15.79:0/210489077 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff200012da0 con 0x7ff20815aed0 2023-10-19T08:37:40.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.270+0000 7ff20e04e700 1 -- 172.21.15.79:0/210489077 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2080c4590 con 0x7ff20815aed0 2023-10-19T08:37:41.408 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:40.628+0000 7f1c359e2200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-19T08:37:41.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.271+0000 7ff1effff700 1 -- 172.21.15.79:0/210489077 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff2000054c0 con 0x7ff20815aed0 2023-10-19T08:37:41.409 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-10-19T08:37:40.646+0000 7f1f96e41640 -1 Falling back to public interface 2023-10-19T08:37:41.409 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:41.410 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":10,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:37:39.999281+0000","last_up_change":"0.000000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:37:41.410 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-10-19T08:37:40.646+0000 7f340f1f7640 -1 Falling back to public interface 2023-10-19T08:37:41.411 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-10-19T08:37:40.655+0000 7ff113a61640 -1 Falling back to public interface 2023-10-19T08:37:41.412 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-10-19T08:37:40.663+0000 7fb000c64640 -1 Falling back to public interface 2023-10-19T08:37:41.413 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:40.712+0000 7f1c359e2200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-19T08:37:41.414 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:40.851+0000 7f1c359e2200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-19T08:37:41.414 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:41.087+0000 7f1c359e2200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-19T08:37:41.414 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:41.297+0000 7f1c359e2200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-19T08:37:41.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.272+0000 7ff20e04e700 1 -- 172.21.15.79:0/210489077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff20815aed0 msgr2=0x7ff20815ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:41.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.272+0000 7ff20e04e700 1 --2- 172.21.15.79:0/210489077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff20815aed0 0x7ff20815ca30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff20000cae0 tx=0x7ff20000cdf0 comp rx=0 tx=0).stop 2023-10-19T08:37:41.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.272+0000 7ff20e04e700 1 -- 172.21.15.79:0/210489077 shutdown_connections 2023-10-19T08:37:41.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.272+0000 7ff20e04e700 1 --2- 172.21.15.79:0/210489077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff20815aed0 0x7ff20815ca30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:41.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.272+0000 7ff20e04e700 1 --2- 172.21.15.79:0/210489077 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff2080b2ca0 0x7ff2081594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:41.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.272+0000 7ff20e04e700 1 --2- 172.21.15.79:0/210489077 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2080d0480 0x7ff20815c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.272+0000 7ff20e04e700 1 -- 172.21.15.79:0/210489077 >> 172.21.15.79:0/210489077 conn(0x7ff2080cd760 msgr2=0x7ff208151910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.272+0000 7ff20e04e700 1 -- 172.21.15.79:0/210489077 shutdown_connections 2023-10-19T08:37:41.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:40.272+0000 7ff20e04e700 1 -- 172.21.15.79:0/210489077 wait complete. 2023-10-19T08:37:41.419 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-19T08:37:41.419 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-19T08:37:41.420 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:40.575+0000 7fae2a735200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-19T08:37:41.420 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:40.653+0000 7fae2a735200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-19T08:37:41.421 INFO:tasks.ceph.osd.0.smithi079.stderr:2023-10-19T08:37:40.654+0000 7fb337508640 -1 Falling back to public interface 2023-10-19T08:37:41.421 INFO:tasks.ceph.osd.2.smithi079.stderr:2023-10-19T08:37:40.654+0000 7f7629373640 -1 Falling back to public interface 2023-10-19T08:37:41.422 INFO:tasks.ceph.osd.2.smithi079.stderr:2023-10-19T08:37:40.654+0000 7f7620731700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-10-19T08:37:41.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2023-10-19T08:37:40.657+0000 7fb91c867640 -1 Falling back to public interface 2023-10-19T08:37:41.423 INFO:tasks.ceph.osd.3.smithi079.stderr:2023-10-19T08:37:40.657+0000 7feb64bf7640 -1 Falling back to public interface 2023-10-19T08:37:41.424 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:40.798+0000 7fae2a735200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-19T08:37:41.424 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:41.034+0000 7fae2a735200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-19T08:37:41.425 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:41.247+0000 7fae2a735200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-19T08:37:41.425 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:41.379+0000 7fae2a735200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-19T08:37:41.431 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:41.428+0000 7f1c359e2200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-19T08:37:41.600 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:41.597+0000 7fae2a735200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-19T08:37:41.649 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:41.646+0000 7f1c359e2200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-19T08:37:41.754 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:41.751+0000 7fae2a735200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-19T08:37:41.804 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:41.801+0000 7f1c359e2200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-19T08:37:41.869 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:41.866+0000 7fae2a735200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-19T08:37:41.917 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:41.914+0000 7f1c359e2200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-19T08:37:42.190 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:42.187+0000 7fae2a735200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-19T08:37:42.225 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-19T08:37:42.234 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:42.231+0000 7f1c359e2200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-19T08:37:42.291 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:42.288+0000 7fae2a735200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-19T08:37:42.335 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:42.332+0000 7f1c359e2200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-19T08:37:42.340 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.337+0000 7ffb7a2dd700 1 Processor -- start 2023-10-19T08:37:42.340 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.337+0000 7ffb7a2dd700 1 -- start start 2023-10-19T08:37:42.342 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.337+0000 7ffb7a2dd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb7415cf00 0x7ffb740b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:42.343 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.338+0000 7ffb7a2dd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb740b8b10 0x7ffb740cda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:42.343 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.338+0000 7ffb7a2dd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb740b7f60 con 0x7ffb740cdfb0 2023-10-19T08:37:42.343 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.338+0000 7ffb7a2dd700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb740ce440 con 0x7ffb740b8b10 2023-10-19T08:37:42.343 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.338+0000 7ffb7a2dd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb740b7350 con 0x7ffb7415cf00 2023-10-19T08:37:42.344 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.338+0000 7ffb737fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb740b8b10 0x7ffb740cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:42.344 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.338+0000 7ffb737fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ffb740b8b10 0x7ffb740cda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45116/0 (socket says 172.21.15.79:45116) 2023-10-19T08:37:42.344 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.338+0000 7ffb737fe700 1 -- 172.21.15.79:0/503675899 learned_addr learned my addr 172.21.15.79:0/503675899 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:42.344 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.338+0000 7ffb73fff700 1 --2- 172.21.15.79:0/503675899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb7415cf00 0x7ffb740b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:42.344 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.338+0000 7ffb737fe700 1 -- 172.21.15.79:0/503675899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb7415cf00 msgr2=0x7ffb740b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:42.345 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.338+0000 7ffb737fe700 1 --2- 172.21.15.79:0/503675899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb7415cf00 0x7ffb740b69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:42.345 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.338+0000 7ffb737fe700 1 -- 172.21.15.79:0/503675899 >> v1:172.21.15.89:6789/0 conn(0x7ffb740cdfb0 legacy=0x7ffb740b4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:42.345 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.338+0000 7ffb737fe700 1 -- 172.21.15.79:0/503675899 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb740b7630 con 0x7ffb740b8b10 2023-10-19T08:37:42.345 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.338+0000 7ffb737fe700 1 --2- 172.21.15.79:0/503675899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740b8b10 0x7ffb740cda70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ffb680098f0 tx=0x7ffb68009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18633eabd5faa57 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:42.345 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.338+0000 7ffb72ffd700 1 -- 172.21.15.79:0/503675899 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68011830 con 0x7ffb740b8b10 2023-10-19T08:37:42.345 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.338+0000 7ffb72ffd700 1 -- 172.21.15.79:0/503675899 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb68011990 con 0x7ffb740b8b10 2023-10-19T08:37:42.346 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.338+0000 7ffb72ffd700 1 -- 172.21.15.79:0/503675899 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68011d20 con 0x7ffb740b8b10 2023-10-19T08:37:42.346 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.339+0000 7ffb7a2dd700 1 -- 172.21.15.79:0/503675899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740b8b10 msgr2=0x7ffb740cda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:42.346 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.339+0000 7ffb7a2dd700 1 --2- 172.21.15.79:0/503675899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740b8b10 0x7ffb740cda70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ffb680098f0 tx=0x7ffb68009c00 comp rx=0 tx=0).stop 2023-10-19T08:37:42.346 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.339+0000 7ffb7a2dd700 1 -- 172.21.15.79:0/503675899 shutdown_connections 2023-10-19T08:37:42.347 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.339+0000 7ffb7a2dd700 1 --2- 172.21.15.79:0/503675899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb7415cf00 0x7ffb740b69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:42.347 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.339+0000 7ffb7a2dd700 1 --2- 172.21.15.79:0/503675899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740b8b10 0x7ffb740cda70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:42.347 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.339+0000 7ffb7a2dd700 1 -- 172.21.15.79:0/503675899 >> 172.21.15.79:0/503675899 conn(0x7ffb74071db0 msgr2=0x7ffb740721c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:42.347 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.339+0000 7ffb7a2dd700 1 -- 172.21.15.79:0/503675899 shutdown_connections 2023-10-19T08:37:42.348 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.339+0000 7ffb7a2dd700 1 -- 172.21.15.79:0/503675899 wait complete. 2023-10-19T08:37:42.351 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.341+0000 7ffb7a2dd700 1 Processor -- start 2023-10-19T08:37:42.351 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.341+0000 7ffb7a2dd700 1 -- start start 2023-10-19T08:37:42.351 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.342+0000 7ffb7a2dd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb740b8b10 0x7ffb741f2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:42.351 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.342+0000 7ffb7a2dd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740cdfb0 0x7ffb7415d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:42.352 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.342+0000 7ffb7a2dd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb7415cf00 0x7ffb7415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:42.352 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.342+0000 7ffb7a2dd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7415ecf0 con 0x7ffb740cdfb0 2023-10-19T08:37:42.352 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.342+0000 7ffb7a2dd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb74145cd0 con 0x7ffb7415cf00 2023-10-19T08:37:42.352 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.342+0000 7ffb7a2dd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7415e0e0 con 0x7ffb740b8b10 2023-10-19T08:37:42.353 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.342+0000 7ffb737fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740cdfb0 0x7ffb7415d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:42.353 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.342+0000 7ffb737fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740cdfb0 0x7ffb7415d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45122/0 (socket says 172.21.15.79:45122) 2023-10-19T08:37:42.353 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.342+0000 7ffb737fe700 1 -- 172.21.15.79:0/836906157 learned_addr learned my addr 172.21.15.79:0/836906157 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:42.353 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.342+0000 7ffb73fff700 1 --2- 172.21.15.79:0/836906157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb740b8b10 0x7ffb741f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:42.354 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.342+0000 7ffb7887a700 1 --2- 172.21.15.79:0/836906157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb7415cf00 0x7ffb7415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:42.354 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.342+0000 7ffb737fe700 1 -- 172.21.15.79:0/836906157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb740b8b10 msgr2=0x7ffb741f2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:42.354 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.342+0000 7ffb737fe700 1 --2- 172.21.15.79:0/836906157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb740b8b10 0x7ffb741f2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:42.354 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.342+0000 7ffb737fe700 1 -- 172.21.15.79:0/836906157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb7415cf00 msgr2=0x7ffb7415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:42.354 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.342+0000 7ffb737fe700 1 --2- 172.21.15.79:0/836906157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb7415cf00 0x7ffb7415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:42.355 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.342+0000 7ffb737fe700 1 -- 172.21.15.79:0/836906157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb68009550 con 0x7ffb740cdfb0 2023-10-19T08:37:42.355 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.342+0000 7ffb73fff700 1 --2- 172.21.15.79:0/836906157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb740b8b10 0x7ffb741f2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:37:42.355 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.342+0000 7ffb737fe700 1 --2- 172.21.15.79:0/836906157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740cdfb0 0x7ffb7415d570 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009c40 tx=0x7ffb68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:42.355 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.343+0000 7ffb70ff9700 1 -- 172.21.15.79:0/836906157 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68004400 con 0x7ffb740cdfb0 2023-10-19T08:37:42.356 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.343+0000 7ffb70ff9700 1 -- 172.21.15.79:0/836906157 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6801f070 con 0x7ffb740cdfb0 2023-10-19T08:37:42.356 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.343+0000 7ffb7a2dd700 1 -- 172.21.15.79:0/836906157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7415e3c0 con 0x7ffb740cdfb0 2023-10-19T08:37:42.356 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.343+0000 7ffb70ff9700 1 -- 172.21.15.79:0/836906157 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb680038e0 con 0x7ffb740cdfb0 2023-10-19T08:37:42.356 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.343+0000 7ffb7a2dd700 1 -- 172.21.15.79:0/836906157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7415e980 con 0x7ffb740cdfb0 2023-10-19T08:37:42.357 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.343+0000 7ffb70ff9700 1 -- 172.21.15.79:0/836906157 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ffb68021030 con 0x7ffb740cdfb0 2023-10-19T08:37:42.357 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.343+0000 7ffb70ff9700 1 -- 172.21.15.79:0/836906157 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ffb6802d440 con 0x7ffb740cdfb0 2023-10-19T08:37:42.357 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.344+0000 7ffb7a2dd700 1 -- 172.21.15.79:0/836906157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb740d3660 con 0x7ffb740cdfb0 2023-10-19T08:37:42.357 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.346+0000 7ffb70ff9700 1 -- 172.21.15.79:0/836906157 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ffb68015020 con 0x7ffb740cdfb0 2023-10-19T08:37:42.419 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.415+0000 7ffb7a2dd700 1 -- 172.21.15.79:0/836906157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb740d0900 con 0x7ffb740cdfb0 2023-10-19T08:37:42.419 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.416+0000 7ffb70ff9700 1 -- 172.21.15.79:0/836906157 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ffb6801a450 con 0x7ffb740cdfb0 2023-10-19T08:37:42.420 INFO:teuthology.misc.health.smithi079.stdout: 2023-10-19T08:37:42.420 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":10,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:37:39.999281+0000","last_up_change":"0.000000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:37:42.421 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.417+0000 7ffb7a2dd700 1 -- 172.21.15.79:0/836906157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740cdfb0 msgr2=0x7ffb7415d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:42.422 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.417+0000 7ffb7a2dd700 1 --2- 172.21.15.79:0/836906157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740cdfb0 0x7ffb7415d570 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009c40 tx=0x7ffb68004750 comp rx=0 tx=0).stop 2023-10-19T08:37:42.422 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.417+0000 7ffb7a2dd700 1 -- 172.21.15.79:0/836906157 shutdown_connections 2023-10-19T08:37:42.422 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.417+0000 7ffb7a2dd700 1 --2- 172.21.15.79:0/836906157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffb7415cf00 0x7ffb7415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:42.423 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.417+0000 7ffb7a2dd700 1 --2- 172.21.15.79:0/836906157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffb740b8b10 0x7ffb741f2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:42.423 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.417+0000 7ffb7a2dd700 1 --2- 172.21.15.79:0/836906157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb740cdfb0 0x7ffb7415d570 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:42.423 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.417+0000 7ffb7a2dd700 1 -- 172.21.15.79:0/836906157 >> 172.21.15.79:0/836906157 conn(0x7ffb74071db0 msgr2=0x7ffb740d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:42.423 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.417+0000 7ffb7a2dd700 1 -- 172.21.15.79:0/836906157 shutdown_connections 2023-10-19T08:37:42.423 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:42.417+0000 7ffb7a2dd700 1 -- 172.21.15.79:0/836906157 wait complete. 2023-10-19T08:37:42.431 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-19T08:37:42.483 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:42.480+0000 7fae2a735200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-19T08:37:42.519 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:42.517+0000 7f1c359e2200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-19T08:37:43.077 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:43.073+0000 7fae2a735200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-19T08:37:43.108 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-10-19T08:37:43.105+0000 7f1c359e2200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-19T08:37:44.102 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:44.098+0000 7fade2747700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-19T08:37:44.102 INFO:tasks.ceph.mgr.y.smithi079.stderr:2023-10-19T08:37:44.098+0000 7fade2747700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-19T08:37:44.208 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-10-19T08:37:44.202+0000 7f1f96e41640 -1 osd.6 0 log_to_monitors true 2023-10-19T08:37:44.209 INFO:tasks.ceph.osd.2.smithi079.stderr:2023-10-19T08:37:44.206+0000 7f7629373640 -1 osd.2 0 log_to_monitors true 2023-10-19T08:37:44.221 INFO:tasks.ceph.osd.1.smithi079.stderr:2023-10-19T08:37:44.218+0000 7fb91c867640 -1 osd.1 0 log_to_monitors true 2023-10-19T08:37:44.223 INFO:tasks.ceph.osd.0.smithi079.stderr:2023-10-19T08:37:44.220+0000 7fb337508640 -1 osd.0 0 log_to_monitors true 2023-10-19T08:37:44.226 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-10-19T08:37:44.223+0000 7fb000c64640 -1 osd.7 0 log_to_monitors true 2023-10-19T08:37:44.233 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-10-19T08:37:44.230+0000 7ff113a61640 -1 osd.5 0 log_to_monitors true 2023-10-19T08:37:44.234 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-10-19T08:37:44.231+0000 7f340f1f7640 -1 osd.4 0 log_to_monitors true 2023-10-19T08:37:44.237 INFO:tasks.ceph.osd.3.smithi079.stderr:2023-10-19T08:37:44.234+0000 7feb64bf7640 -1 osd.3 0 log_to_monitors true 2023-10-19T08:37:48.087 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-10-19T08:37:48.083+0000 7ff107e19700 -1 osd.5 0 waiting for initial osdmap 2023-10-19T08:37:48.121 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-10-19T08:37:48.117+0000 7ff0ff9f3700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T08:37:48.174 INFO:tasks.ceph.osd.2.smithi079.stderr:2023-10-19T08:37:48.171+0000 7f761d72b700 -1 osd.2 0 waiting for initial osdmap 2023-10-19T08:37:48.180 INFO:tasks.ceph.osd.3.smithi079.stderr:2023-10-19T08:37:48.177+0000 7feb58faf700 -1 osd.3 0 waiting for initial osdmap 2023-10-19T08:37:48.183 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-10-19T08:37:48.179+0000 7f1f8b1f9700 -1 osd.6 0 waiting for initial osdmap 2023-10-19T08:37:48.185 INFO:tasks.ceph.osd.3.smithi079.stderr:2023-10-19T08:37:48.181+0000 7feb50b89700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T08:37:48.189 INFO:tasks.ceph.osd.2.smithi079.stderr:2023-10-19T08:37:48.186+0000 7f7615305700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T08:37:48.189 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-10-19T08:37:48.185+0000 7f1f82dd3700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T08:37:48.192 INFO:tasks.ceph.osd.1.smithi079.stderr:2023-10-19T08:37:48.189+0000 7fb910c1f700 -1 osd.1 0 waiting for initial osdmap 2023-10-19T08:37:48.199 INFO:tasks.ceph.osd.0.smithi079.stderr:2023-10-19T08:37:48.196+0000 7fb32b8c0700 -1 osd.0 0 waiting for initial osdmap 2023-10-19T08:37:48.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2023-10-19T08:37:48.204+0000 7fb9087f9700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T08:37:48.211 INFO:tasks.ceph.osd.0.smithi079.stderr:2023-10-19T08:37:48.208+0000 7fb32349a700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T08:37:48.215 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-10-19T08:37:48.211+0000 7faff501c700 -1 osd.7 0 waiting for initial osdmap 2023-10-19T08:37:48.226 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-10-19T08:37:48.222+0000 7fafecbf6700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T08:37:48.827 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-10-19T08:37:48.823+0000 7f34035af700 -1 osd.4 0 waiting for initial osdmap 2023-10-19T08:37:48.843 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-10-19T08:37:48.839+0000 7f33fb189700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-19T08:37:49.237 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-19T08:37:49.354 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.351+0000 7f7118cca700 1 Processor -- start 2023-10-19T08:37:49.355 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.351+0000 7f7118cca700 1 -- start start 2023-10-19T08:37:49.357 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.352+0000 7f7118cca700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7114159f10 0x7f71140cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:49.357 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.352+0000 7f7118cca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71140ceed0 0x7f71140b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:49.357 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.352+0000 7f7118cca700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71140ce610 con 0x7f71140724f0 2023-10-19T08:37:49.358 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.352+0000 7f7118cca700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711406b470 con 0x7f7114159f10 2023-10-19T08:37:49.358 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.352+0000 7f7118cca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711415a2f0 con 0x7f71140ceed0 2023-10-19T08:37:49.358 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.352+0000 7f7112d9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71140ceed0 0x7f71140b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:49.358 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.352+0000 7f711259c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7114159f10 0x7f71140cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:49.358 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.352+0000 7f7112d9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71140ceed0 0x7f71140b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:47972/0 (socket says 172.21.15.79:47972) 2023-10-19T08:37:49.359 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.352+0000 7f7112d9d700 1 -- 172.21.15.79:0/3730294546 learned_addr learned my addr 172.21.15.79:0/3730294546 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:49.359 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.352+0000 7f7111d9b700 1 --1- 172.21.15.79:0/3730294546 >> v1:172.21.15.89:6789/0 conn(0x7f71140724f0 0x7f71140ce7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:40260/0 (socket says 172.21.15.79:40260) 2023-10-19T08:37:49.359 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.352+0000 7f7112d9d700 1 -- 172.21.15.79:0/3730294546 >> v2:172.21.15.89:3300/0 conn(0x7f7114159f10 msgr2=0x7f71140cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:49.359 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.352+0000 7f7112d9d700 1 --2- 172.21.15.79:0/3730294546 >> v2:172.21.15.89:3300/0 conn(0x7f7114159f10 0x7f71140cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:49.359 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.352+0000 7f7112d9d700 1 -- 172.21.15.79:0/3730294546 >> v1:172.21.15.89:6789/0 conn(0x7f71140724f0 legacy=0x7f71140ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:49.359 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.352+0000 7f7112d9d700 1 -- 172.21.15.79:0/3730294546 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71140cb8e0 con 0x7f71140ceed0 2023-10-19T08:37:49.360 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.352+0000 7f7112d9d700 1 --2- 172.21.15.79:0/3730294546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71140ceed0 0x7f71140b2140 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f710c009e50 tx=0x7f710c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d03d533d1355acb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:49.360 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.353+0000 7f711159a700 1 -- 172.21.15.79:0/3730294546 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c00e070 con 0x7f71140ceed0 2023-10-19T08:37:49.360 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.353+0000 7f711159a700 1 -- 172.21.15.79:0/3730294546 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c00b910 con 0x7f71140ceed0 2023-10-19T08:37:49.360 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.353+0000 7f711159a700 1 -- 172.21.15.79:0/3730294546 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c00bcc0 con 0x7f71140ceed0 2023-10-19T08:37:49.360 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.353+0000 7f7118cca700 1 -- 172.21.15.79:0/3730294546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71140ceed0 msgr2=0x7f71140b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:49.360 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.353+0000 7f7118cca700 1 --2- 172.21.15.79:0/3730294546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71140ceed0 0x7f71140b2140 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f710c009e50 tx=0x7f710c00b330 comp rx=0 tx=0).stop 2023-10-19T08:37:49.361 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.353+0000 7f7118cca700 1 -- 172.21.15.79:0/3730294546 shutdown_connections 2023-10-19T08:37:49.361 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.353+0000 7f7118cca700 1 --2- 172.21.15.79:0/3730294546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71140ceed0 0x7f71140b2140 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:49.361 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.353+0000 7f7118cca700 1 --2- 172.21.15.79:0/3730294546 >> v2:172.21.15.89:3300/0 conn(0x7f7114159f10 0x7f71140cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:49.361 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.353+0000 7f7118cca700 1 -- 172.21.15.79:0/3730294546 >> 172.21.15.79:0/3730294546 conn(0x7f71140b0de0 msgr2=0x7f71140b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:49.361 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.353+0000 7f7118cca700 1 -- 172.21.15.79:0/3730294546 shutdown_connections 2023-10-19T08:37:49.362 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.353+0000 7f7118cca700 1 -- 172.21.15.79:0/3730294546 wait complete. 2023-10-19T08:37:49.364 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.355+0000 7f7118cca700 1 Processor -- start 2023-10-19T08:37:49.364 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.355+0000 7f7118cca700 1 -- start start 2023-10-19T08:37:49.365 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.355+0000 7f7118cca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71140724f0 0x7f71140adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:49.365 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.355+0000 7f7118cca700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71140ceed0 0x7f71141532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:49.365 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.355+0000 7f7118cca700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7114159f10 0x7f71141575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:49.365 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.355+0000 7f7118cca700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71140c8420 con 0x7f7114159f10 2023-10-19T08:37:49.365 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.355+0000 7f7118cca700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71140ae4f0 con 0x7f71140ceed0 2023-10-19T08:37:49.366 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.355+0000 7f7118cca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71140c8fd0 con 0x7f71140724f0 2023-10-19T08:37:49.366 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.356+0000 7f7112d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7114159f10 0x7f71141575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:49.366 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.356+0000 7f7112d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7114159f10 0x7f71141575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45354/0 (socket says 172.21.15.79:45354) 2023-10-19T08:37:49.366 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.356+0000 7f7112d9d700 1 -- 172.21.15.79:0/575230597 learned_addr learned my addr 172.21.15.79:0/575230597 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:49.366 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.356+0000 7f711259c700 1 --2- 172.21.15.79:0/575230597 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71140724f0 0x7f71140adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:49.367 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.356+0000 7f7111d9b700 1 --2- 172.21.15.79:0/575230597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71140ceed0 0x7f71141532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:49.367 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.356+0000 7f7112d9d700 1 -- 172.21.15.79:0/575230597 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71140724f0 msgr2=0x7f71140adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:49.367 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.356+0000 7f7112d9d700 1 --2- 172.21.15.79:0/575230597 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71140724f0 0x7f71140adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:49.367 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.356+0000 7f7112d9d700 1 -- 172.21.15.79:0/575230597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71140ceed0 msgr2=0x7f71141532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:49.367 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.356+0000 7f7112d9d700 1 --2- 172.21.15.79:0/575230597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71140ceed0 0x7f71141532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:49.367 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.356+0000 7f7112d9d700 1 -- 172.21.15.79:0/575230597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710c009b30 con 0x7f7114159f10 2023-10-19T08:37:49.368 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.356+0000 7f7112d9d700 1 --2- 172.21.15.79:0/575230597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7114159f10 0x7f71141575e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f710c012000 tx=0x7f710c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:49.368 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.356+0000 7f7102ffd700 1 -- 172.21.15.79:0/575230597 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c004800 con 0x7f7114159f10 2023-10-19T08:37:49.368 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.356+0000 7f7102ffd700 1 -- 172.21.15.79:0/575230597 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c004960 con 0x7f7114159f10 2023-10-19T08:37:49.368 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.356+0000 7f7102ffd700 1 -- 172.21.15.79:0/575230597 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c01c680 con 0x7f7114159f10 2023-10-19T08:37:49.368 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.356+0000 7f7118cca700 1 -- 172.21.15.79:0/575230597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71140c78a0 con 0x7f7114159f10 2023-10-19T08:37:49.369 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.356+0000 7f7118cca700 1 -- 172.21.15.79:0/575230597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71140c7e60 con 0x7f7114159f10 2023-10-19T08:37:49.369 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.357+0000 7f7118cca700 1 -- 172.21.15.79:0/575230597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7114074350 con 0x7f7114159f10 2023-10-19T08:37:49.369 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.358+0000 7f7102ffd700 1 -- 172.21.15.79:0/575230597 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f710c01c7e0 con 0x7f7114159f10 2023-10-19T08:37:49.369 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.358+0000 7f7102ffd700 1 --2- 172.21.15.79:0/575230597 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f70f406a050 0x7f70f406c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:49.369 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.358+0000 7f711259c700 1 --2- 172.21.15.79:0/575230597 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f70f406a050 0x7f70f406c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:49.370 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.358+0000 7f7102ffd700 1 -- 172.21.15.79:0/575230597 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f710c089960 con 0x7f7114159f10 2023-10-19T08:37:49.370 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.358+0000 7f711259c700 1 --2- 172.21.15.79:0/575230597 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f70f406a050 0x7f70f406c510 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f710400b240 tx=0x7f710400b420 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:49.370 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.363+0000 7f7102ffd700 1 -- 172.21.15.79:0/575230597 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f710c0557f0 con 0x7f7114159f10 2023-10-19T08:37:49.556 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.553+0000 7f7118cca700 1 -- 172.21.15.79:0/575230597 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71140c6180 con 0x7f7114159f10 2023-10-19T08:37:49.557 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.553+0000 7f7102ffd700 1 -- 172.21.15.79:0/575230597 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10848 (secure 0 0 0) 0x7f710c058e10 con 0x7f7114159f10 2023-10-19T08:37:49.557 INFO:teuthology.misc.health.smithi079.stdout: 2023-10-19T08:37:49.557 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":13,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:37:49.102853+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:37:49.559 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.555+0000 7f7118cca700 1 -- 172.21.15.79:0/575230597 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f70f406a050 msgr2=0x7f70f406c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:49.559 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.555+0000 7f7118cca700 1 --2- 172.21.15.79:0/575230597 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f70f406a050 0x7f70f406c510 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f710400b240 tx=0x7f710400b420 comp rx=0 tx=0).stop 2023-10-19T08:37:49.560 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.555+0000 7f7118cca700 1 -- 172.21.15.79:0/575230597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7114159f10 msgr2=0x7f71141575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:49.560 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.555+0000 7f7118cca700 1 --2- 172.21.15.79:0/575230597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7114159f10 0x7f71141575e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f710c012000 tx=0x7f710c004ad0 comp rx=0 tx=0).stop 2023-10-19T08:37:49.560 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.555+0000 7f7118cca700 1 -- 172.21.15.79:0/575230597 shutdown_connections 2023-10-19T08:37:49.560 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.555+0000 7f7118cca700 1 --2- 172.21.15.79:0/575230597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7114159f10 0x7f71141575e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:49.560 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.555+0000 7f7118cca700 1 --2- 172.21.15.79:0/575230597 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f70f406a050 0x7f70f406c510 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:49.561 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.555+0000 7f7118cca700 1 --2- 172.21.15.79:0/575230597 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71140724f0 0x7f71140adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:49.561 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.555+0000 7f7118cca700 1 --2- 172.21.15.79:0/575230597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71140ceed0 0x7f71141532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:49.561 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.555+0000 7f7118cca700 1 -- 172.21.15.79:0/575230597 >> 172.21.15.79:0/575230597 conn(0x7f71140b0de0 msgr2=0x7f7114156b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:49.561 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.556+0000 7f7118cca700 1 -- 172.21.15.79:0/575230597 shutdown_connections 2023-10-19T08:37:49.561 INFO:teuthology.misc.health.smithi079.stderr:2023-10-19T08:37:49.556+0000 7f7118cca700 1 -- 172.21.15.79:0/575230597 wait complete. 2023-10-19T08:37:49.570 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-19T08:37:49.570 INFO:tasks.ceph:Creating RBD pool 2023-10-19T08:37:49.571 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-19T08:37:49.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.687+0000 7f9ad2d09700 1 Processor -- start 2023-10-19T08:37:49.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.687+0000 7f9ad2d09700 1 -- start start 2023-10-19T08:37:49.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.687+0000 7f9ad2d09700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9acc06e650 0x7f9acc06eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:49.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.687+0000 7f9ad2d09700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9acc0cab60 con 0x7f9acc06f620 2023-10-19T08:37:49.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.687+0000 7f9ad2d09700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9acc06a930 con 0x7f9acc1594b0 2023-10-19T08:37:49.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.687+0000 7f9ad2d09700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9acc0cedb0 con 0x7f9acc06e650 2023-10-19T08:37:49.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acbfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9acc06f620 0x7f9acc06a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55458/0 (socket says 172.21.15.79:55458) 2023-10-19T08:37:49.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acbfff700 1 -- 172.21.15.79:0/1361881129 learned_addr learned my addr 172.21.15.79:0/1361881129 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:37:49.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9ad12a6700 1 --2- 172.21.15.79:0/1361881129 >> v2:172.21.15.89:3300/0 conn(0x7f9acc06e650 0x7f9acc06eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:49.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acb7fe700 1 -- 172.21.15.79:0/1361881129 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543926412 0 0) 0x7f9acc0cab60 con 0x7f9acc06f620 2023-10-19T08:37:49.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acb7fe700 1 -- 172.21.15.79:0/1361881129 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9abc0035b0 con 0x7f9acc06f620 2023-10-19T08:37:49.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acb7fe700 1 -- 172.21.15.79:0/1361881129 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2794453555 0 0) 0x7f9abc0035b0 con 0x7f9acc06f620 2023-10-19T08:37:49.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acb7fe700 1 -- 172.21.15.79:0/1361881129 >> v2:172.21.15.89:3300/0 conn(0x7f9acc06e650 msgr2=0x7f9acc06eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:49.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acb7fe700 1 --2- 172.21.15.79:0/1361881129 >> v2:172.21.15.89:3300/0 conn(0x7f9acc06e650 0x7f9acc06eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:49.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acb7fe700 1 -- 172.21.15.79:0/1361881129 >> v1:172.21.15.89:6789/0 conn(0x7f9acc1594b0 legacy=0x7f9acc0ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:49.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acb7fe700 1 -- 172.21.15.79:0/1361881129 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc0ca550 con 0x7f9acc06f620 2023-10-19T08:37:49.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acb7fe700 1 -- 172.21.15.79:0/1361881129 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f9ab8001670 con 0x7f9acc06f620 2023-10-19T08:37:49.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acb7fe700 1 -- 172.21.15.79:0/1361881129 >> v1:172.21.15.79:6789/0 conn(0x7f9acc06f620 legacy=0x7f9acc06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:49.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acb7fe700 1 --2- 172.21.15.79:0/1361881129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9abc003a70 0x7f9abc003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:49.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acb7fe700 1 --2- 172.21.15.79:0/1361881129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9abc004850 0x7f9abc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:49.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acb7fe700 1 --2- 172.21.15.79:0/1361881129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9abc005280 0x7f9abc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:49.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acb7fe700 1 -- 172.21.15.79:0/1361881129 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc00c1b0 con 0x7f9abc004850 2023-10-19T08:37:49.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acb7fe700 1 -- 172.21.15.79:0/1361881129 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc00c320 con 0x7f9abc005280 2023-10-19T08:37:49.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acb7fe700 1 -- 172.21.15.79:0/1361881129 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc00c4e0 con 0x7f9abc003a70 2023-10-19T08:37:49.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acbfff700 1 --2- 172.21.15.79:0/1361881129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9abc004850 0x7f9abc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:49.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9ad12a6700 1 --2- 172.21.15.79:0/1361881129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9abc005280 0x7f9abc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:49.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9ad0aa5700 1 --2- 172.21.15.79:0/1361881129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9abc003a70 0x7f9abc003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:49.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acbfff700 1 -- 172.21.15.79:0/1361881129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9abc003a70 msgr2=0x7f9abc003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:49.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acbfff700 1 --2- 172.21.15.79:0/1361881129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9abc003a70 0x7f9abc003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:49.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acbfff700 1 -- 172.21.15.79:0/1361881129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9abc005280 msgr2=0x7f9abc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:49.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acbfff700 1 --2- 172.21.15.79:0/1361881129 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9abc005280 0x7f9abc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:49.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9acbfff700 1 -- 172.21.15.79:0/1361881129 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc0035b0 con 0x7f9abc004850 2023-10-19T08:37:49.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9ad12a6700 1 -- 172.21.15.79:0/1361881129 reap_dead start 2023-10-19T08:37:49.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.688+0000 7f9ad0aa5700 1 --2- 172.21.15.79:0/1361881129 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9abc003a70 0x7f9abc003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:37:49.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.689+0000 7f9acbfff700 1 --2- 172.21.15.79:0/1361881129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9abc004850 0x7f9abc004cd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800c270 tx=0x7f9abc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2712a9e3d85531a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:49.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.689+0000 7f9acb7fe700 1 -- 172.21.15.79:0/1361881129 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8007c10 con 0x7f9abc004850 2023-10-19T08:37:49.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.689+0000 7f9acb7fe700 1 -- 172.21.15.79:0/1361881129 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab800cd10 con 0x7f9abc004850 2023-10-19T08:37:49.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.689+0000 7f9acb7fe700 1 -- 172.21.15.79:0/1361881129 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8005ba0 con 0x7f9abc004850 2023-10-19T08:37:49.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.689+0000 7f9ad2d09700 1 -- 172.21.15.79:0/1361881129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9abc004850 msgr2=0x7f9abc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:49.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.689+0000 7f9ad2d09700 1 --2- 172.21.15.79:0/1361881129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9abc004850 0x7f9abc004cd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800c270 tx=0x7f9abc005880 comp rx=0 tx=0).stop 2023-10-19T08:37:49.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.689+0000 7f9ad2d09700 1 -- 172.21.15.79:0/1361881129 shutdown_connections 2023-10-19T08:37:49.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.689+0000 7f9ad2d09700 1 --2- 172.21.15.79:0/1361881129 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9abc004850 0x7f9abc004cd0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:49.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.689+0000 7f9ad2d09700 1 -- 172.21.15.79:0/1361881129 >> 172.21.15.79:0/1361881129 conn(0x7f9acc06d000 msgr2=0x7f9acc06d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:49.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.689+0000 7f9ad2d09700 1 -- 172.21.15.79:0/1361881129 shutdown_connections 2023-10-19T08:37:49.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.689+0000 7f9ad2d09700 1 -- 172.21.15.79:0/1361881129 wait complete. 2023-10-19T08:37:49.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.690+0000 7f9ad2d09700 1 Processor -- start 2023-10-19T08:37:49.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.690+0000 7f9ad2d09700 1 -- start start 2023-10-19T08:37:49.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.691+0000 7f9ad2d09700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9abc004850 0x7f9acc0af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:49.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.691+0000 7f9ad2d09700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9acc0ab8e0 0x7f9acc0abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:49.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.691+0000 7f9ad2d09700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9acc152300 0x7f9acc1527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:49.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.691+0000 7f9ad2d09700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc0ac580 con 0x7f9acc152300 2023-10-19T08:37:49.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.691+0000 7f9ad2d09700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc0ac860 con 0x7f9abc004850 2023-10-19T08:37:49.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.691+0000 7f9ad2d09700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc0acb40 con 0x7f9acc0ab8e0 2023-10-19T08:37:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.692+0000 7f9ad12a6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9acc152300 0x7f9acc1527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.692+0000 7f9ad12a6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9acc152300 0x7f9acc1527b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45400/0 (socket says 172.21.15.79:45400) 2023-10-19T08:37:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.692+0000 7f9ad12a6700 1 -- 172.21.15.79:0/3727491910 learned_addr learned my addr 172.21.15.79:0/3727491910 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:49.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.692+0000 7f9acbfff700 1 --2- 172.21.15.79:0/3727491910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9acc0ab8e0 0x7f9acc0abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.692+0000 7f9ad0aa5700 1 --2- 172.21.15.79:0/3727491910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9abc004850 0x7f9acc0af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.692+0000 7f9ad12a6700 1 -- 172.21.15.79:0/3727491910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9acc0ab8e0 msgr2=0x7f9acc0abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.692+0000 7f9ad12a6700 1 --2- 172.21.15.79:0/3727491910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9acc0ab8e0 0x7f9acc0abd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:49.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.692+0000 7f9ad12a6700 1 -- 172.21.15.79:0/3727491910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9abc004850 msgr2=0x7f9acc0af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.692+0000 7f9ad12a6700 1 --2- 172.21.15.79:0/3727491910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9abc004850 0x7f9acc0af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.692+0000 7f9ad12a6700 1 -- 172.21.15.79:0/3727491910 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc0c6ef0 con 0x7f9acc152300 2023-10-19T08:37:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.692+0000 7f9ad12a6700 1 --2- 172.21.15.79:0/3727491910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9acc152300 0x7f9acc1527b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0c2ca0 tx=0x7f9ac4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.692+0000 7f9ac97fa700 1 -- 172.21.15.79:0/3727491910 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac40099e0 con 0x7f9acc152300 2023-10-19T08:37:49.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.692+0000 7f9ac97fa700 1 -- 172.21.15.79:0/3727491910 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac4010050 con 0x7f9acc152300 2023-10-19T08:37:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.692+0000 7f9ac97fa700 1 -- 172.21.15.79:0/3727491910 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4009d60 con 0x7f9acc152300 2023-10-19T08:37:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.692+0000 7f9ad2d09700 1 -- 172.21.15.79:0/3727491910 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9acc0ac2a0 con 0x7f9acc152300 2023-10-19T08:37:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.692+0000 7f9ad2d09700 1 -- 172.21.15.79:0/3727491910 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9acc0c6b50 con 0x7f9acc152300 2023-10-19T08:37:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.693+0000 7f9ad2d09700 1 -- 172.21.15.79:0/3727491910 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9acc04ee70 con 0x7f9acc152300 2023-10-19T08:37:49.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.693+0000 7f9ac97fa700 1 -- 172.21.15.79:0/3727491910 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f9ac4013430 con 0x7f9acc152300 2023-10-19T08:37:49.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.694+0000 7f9ac97fa700 1 --2- 172.21.15.79:0/3727491910 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9ab006a050 0x7f9ab006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:49.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.694+0000 7f9ad0aa5700 1 --2- 172.21.15.79:0/3727491910 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9ab006a050 0x7f9ab006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:49.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.694+0000 7f9ac97fa700 1 -- 172.21.15.79:0/3727491910 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f9ac4088340 con 0x7f9acc152300 2023-10-19T08:37:49.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.694+0000 7f9ad0aa5700 1 --2- 172.21.15.79:0/3727491910 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9ab006a050 0x7f9ab006c510 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9acc069dc0 tx=0x7f9ac0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:49.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.698+0000 7f9ac97fa700 1 -- 172.21.15.79:0/3727491910 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f9ac4054150 con 0x7f9acc152300 2023-10-19T08:37:49.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:49.889+0000 7f9ad2d09700 1 -- 172.21.15.79:0/3727491910 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f9acc0b5120 con 0x7f9acc152300 2023-10-19T08:37:50.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.110+0000 7f9ac97fa700 1 -- 172.21.15.79:0/3727491910 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f9ac4057770 con 0x7f9acc152300 2023-10-19T08:37:50.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.113+0000 7f9ad2d09700 1 -- 172.21.15.79:0/3727491910 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9ab006a050 msgr2=0x7f9ab006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:50.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.113+0000 7f9ad2d09700 1 --2- 172.21.15.79:0/3727491910 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9ab006a050 0x7f9ab006c510 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9acc069dc0 tx=0x7f9ac0009040 comp rx=0 tx=0).stop 2023-10-19T08:37:50.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.113+0000 7f9ad2d09700 1 -- 172.21.15.79:0/3727491910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9acc152300 msgr2=0x7f9acc1527b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:50.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.113+0000 7f9ad2d09700 1 --2- 172.21.15.79:0/3727491910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9acc152300 0x7f9acc1527b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0c2ca0 tx=0x7f9ac4004600 comp rx=0 tx=0).stop 2023-10-19T08:37:50.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.113+0000 7f9ad2d09700 1 -- 172.21.15.79:0/3727491910 shutdown_connections 2023-10-19T08:37:50.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.113+0000 7f9ad2d09700 1 --2- 172.21.15.79:0/3727491910 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9acc152300 0x7f9acc1527b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:50.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.113+0000 7f9ad2d09700 1 --2- 172.21.15.79:0/3727491910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9abc004850 0x7f9acc0af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:50.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.113+0000 7f9ad2d09700 1 --2- 172.21.15.79:0/3727491910 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9ab006a050 0x7f9ab006c510 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:50.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.113+0000 7f9ad2d09700 1 --2- 172.21.15.79:0/3727491910 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9acc0ab8e0 0x7f9acc0abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:50.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.113+0000 7f9ad2d09700 1 -- 172.21.15.79:0/3727491910 >> 172.21.15.79:0/3727491910 conn(0x7f9acc06d000 msgr2=0x7f9acc156de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:50.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.113+0000 7f9ad2d09700 1 -- 172.21.15.79:0/3727491910 shutdown_connections 2023-10-19T08:37:50.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.113+0000 7f9ad2d09700 1 -- 172.21.15.79:0/3727491910 wait complete. 2023-10-19T08:37:50.119 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'rbd' created 2023-10-19T08:37:50.129 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-19T08:37:50.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.248+0000 7f5db3aae700 1 Processor -- start 2023-10-19T08:37:50.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.249+0000 7f5db3aae700 1 -- start start 2023-10-19T08:37:50.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.249+0000 7f5db3aae700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5dac0cc340 0x7f5dac0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:50.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.249+0000 7f5db3aae700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dac06af60 con 0x7f5dac06ab80 2023-10-19T08:37:50.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.249+0000 7f5db3aae700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dac0cec60 con 0x7f5dac0ce830 2023-10-19T08:37:50.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.249+0000 7f5db3aae700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dac15d9c0 con 0x7f5dac0cc340 2023-10-19T08:37:50.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.250+0000 7f5db184a700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5dac06ab80 0x7f5dac0b1f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55478/0 (socket says 172.21.15.79:55478) 2023-10-19T08:37:50.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.250+0000 7f5db1049700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5dac0cc340 0x7f5dac0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:50.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.250+0000 7f5db184a700 1 -- 172.21.15.79:0/2742604280 learned_addr learned my addr 172.21.15.79:0/2742604280 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:37:50.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.250+0000 7f5db1049700 1 -- 172.21.15.79:0/2742604280 >> v1:172.21.15.89:6789/0 conn(0x7f5dac0ce830 legacy=0x7f5dac06faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:50.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.250+0000 7f5db1049700 1 -- 172.21.15.79:0/2742604280 >> v1:172.21.15.79:6789/0 conn(0x7f5dac06ab80 legacy=0x7f5dac0b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:50.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.250+0000 7f5db1049700 1 -- 172.21.15.79:0/2742604280 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac15dca0 con 0x7f5dac0cc340 2023-10-19T08:37:50.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.250+0000 7f5db0848700 1 -- 172.21.15.79:0/2742604280 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720156132 0 0) 0x7f5d9c001110 con 0x7f5dac06ab80 2023-10-19T08:37:50.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.250+0000 7f5db1049700 1 --2- 172.21.15.79:0/2742604280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dac0cc340 0x7f5dac0ce2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5da8009840 tx=0x7f5da8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d70404f735db284 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:50.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.250+0000 7f5db0848700 1 -- 172.21.15.79:0/2742604280 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da8004230 con 0x7f5dac0cc340 2023-10-19T08:37:50.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.250+0000 7f5db0848700 1 -- 172.21.15.79:0/2742604280 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da8004390 con 0x7f5dac0cc340 2023-10-19T08:37:50.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.250+0000 7f5db0848700 1 -- 172.21.15.79:0/2742604280 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da80036a0 con 0x7f5dac0cc340 2023-10-19T08:37:50.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.251+0000 7f5db3aae700 1 -- 172.21.15.79:0/2742604280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dac0cc340 msgr2=0x7f5dac0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:50.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.251+0000 7f5db3aae700 1 --2- 172.21.15.79:0/2742604280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dac0cc340 0x7f5dac0ce2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5da8009840 tx=0x7f5da8009b50 comp rx=0 tx=0).stop 2023-10-19T08:37:50.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.251+0000 7f5db3aae700 1 -- 172.21.15.79:0/2742604280 shutdown_connections 2023-10-19T08:37:50.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.251+0000 7f5db3aae700 1 --2- 172.21.15.79:0/2742604280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dac0cc340 0x7f5dac0ce2f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:50.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.251+0000 7f5db3aae700 1 -- 172.21.15.79:0/2742604280 >> 172.21.15.79:0/2742604280 conn(0x7f5dac06dd90 msgr2=0x7f5dac06e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:50.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.251+0000 7f5db3aae700 1 -- 172.21.15.79:0/2742604280 shutdown_connections 2023-10-19T08:37:50.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.251+0000 7f5db3aae700 1 -- 172.21.15.79:0/2742604280 wait complete. 2023-10-19T08:37:50.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.252+0000 7f5db3aae700 1 Processor -- start 2023-10-19T08:37:50.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.252+0000 7f5db3aae700 1 -- start start 2023-10-19T08:37:50.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5db3aae700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5dac06ab80 0x7f5dac0ac770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:50.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5db3aae700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5dac0cc340 0x7f5dac15b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:50.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5db3aae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dac0ce830 0x7f5dac15b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:50.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5db3aae700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac0b3ba0 con 0x7f5dac0ce830 2023-10-19T08:37:50.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5db3aae700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac0c8970 con 0x7f5dac0cc340 2023-10-19T08:37:50.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5db3aae700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac0b3df0 con 0x7f5dac06ab80 2023-10-19T08:37:50.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5db204b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dac0ce830 0x7f5dac15b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:50.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5db204b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dac0ce830 0x7f5dac15b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45416/0 (socket says 172.21.15.79:45416) 2023-10-19T08:37:50.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5db204b700 1 -- 172.21.15.79:0/663137145 learned_addr learned my addr 172.21.15.79:0/663137145 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:50.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5db184a700 1 --2- 172.21.15.79:0/663137145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5dac06ab80 0x7f5dac0ac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:50.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5db1049700 1 --2- 172.21.15.79:0/663137145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5dac0cc340 0x7f5dac15b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:50.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5db204b700 1 -- 172.21.15.79:0/663137145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5dac06ab80 msgr2=0x7f5dac0ac770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:50.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5db204b700 1 --2- 172.21.15.79:0/663137145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5dac06ab80 0x7f5dac0ac770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:50.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5db204b700 1 -- 172.21.15.79:0/663137145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5dac0cc340 msgr2=0x7f5dac15b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:50.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5db204b700 1 --2- 172.21.15.79:0/663137145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5dac0cc340 0x7f5dac15b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:50.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5db204b700 1 -- 172.21.15.79:0/663137145 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da80094a0 con 0x7f5dac0ce830 2023-10-19T08:37:50.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5db204b700 1 --2- 172.21.15.79:0/663137145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dac0ce830 0x7f5dac15b9f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5da400cb60 tx=0x7f5da400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:50.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5da27fc700 1 -- 172.21.15.79:0/663137145 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da400ab10 con 0x7f5dac0ce830 2023-10-19T08:37:50.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5da27fc700 1 -- 172.21.15.79:0/663137145 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da400ac70 con 0x7f5dac0ce830 2023-10-19T08:37:50.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5db3aae700 1 -- 172.21.15.79:0/663137145 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dac0b40d0 con 0x7f5dac0ce830 2023-10-19T08:37:50.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5da27fc700 1 -- 172.21.15.79:0/663137145 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da4012420 con 0x7f5dac0ce830 2023-10-19T08:37:50.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.253+0000 7f5db3aae700 1 -- 172.21.15.79:0/663137145 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dac0accb0 con 0x7f5dac0ce830 2023-10-19T08:37:50.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.254+0000 7f5db3aae700 1 -- 172.21.15.79:0/663137145 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dac0acea0 con 0x7f5dac0ce830 2023-10-19T08:37:50.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.255+0000 7f5da27fc700 1 -- 172.21.15.79:0/663137145 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f5da4012580 con 0x7f5dac0ce830 2023-10-19T08:37:50.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.255+0000 7f5da27fc700 1 --2- 172.21.15.79:0/663137145 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5d9006a050 0x7f5d9006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:50.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.255+0000 7f5db184a700 1 --2- 172.21.15.79:0/663137145 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5d9006a050 0x7f5d9006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:50.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.255+0000 7f5da27fc700 1 -- 172.21.15.79:0/663137145 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 5188+0+0 (secure 0 0 0) 0x7f5da4088380 con 0x7f5dac0ce830 2023-10-19T08:37:50.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.256+0000 7f5db184a700 1 --2- 172.21.15.79:0/663137145 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5d9006a050 0x7f5d9006c510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c000f60 tx=0x7f5d9c007c90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:50.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.260+0000 7f5da27fc700 1 -- 172.21.15.79:0/663137145 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f5da4053f40 con 0x7f5dac0ce830 2023-10-19T08:37:50.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:50.452+0000 7f5db3aae700 1 -- 172.21.15.79:0/663137145 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5dac0b45f0 con 0x7f5dac0ce830 2023-10-19T08:37:51.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.112+0000 7f5da27fc700 1 -- 172.21.15.79:0/663137145 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f5dac0b45f0 con 0x7f5dac0ce830 2023-10-19T08:37:51.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.116+0000 7f5db3aae700 1 -- 172.21.15.79:0/663137145 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5d9006a050 msgr2=0x7f5d9006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:51.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.116+0000 7f5db3aae700 1 --2- 172.21.15.79:0/663137145 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5d9006a050 0x7f5d9006c510 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c000f60 tx=0x7f5d9c007c90 comp rx=0 tx=0).stop 2023-10-19T08:37:51.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.116+0000 7f5db3aae700 1 -- 172.21.15.79:0/663137145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dac0ce830 msgr2=0x7f5dac15b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:51.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.116+0000 7f5db3aae700 1 --2- 172.21.15.79:0/663137145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dac0ce830 0x7f5dac15b9f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5da400cb60 tx=0x7f5da400cf20 comp rx=0 tx=0).stop 2023-10-19T08:37:51.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.116+0000 7f5db3aae700 1 -- 172.21.15.79:0/663137145 shutdown_connections 2023-10-19T08:37:51.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.116+0000 7f5db3aae700 1 --2- 172.21.15.79:0/663137145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dac0ce830 0x7f5dac15b9f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.116+0000 7f5db3aae700 1 --2- 172.21.15.79:0/663137145 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5d9006a050 0x7f5d9006c510 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.116+0000 7f5db3aae700 1 --2- 172.21.15.79:0/663137145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5dac06ab80 0x7f5dac0ac770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.116+0000 7f5db3aae700 1 --2- 172.21.15.79:0/663137145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5dac0cc340 0x7f5dac15b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.116+0000 7f5db3aae700 1 -- 172.21.15.79:0/663137145 >> 172.21.15.79:0/663137145 conn(0x7f5dac06dd90 msgr2=0x7f5dac0ca920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:51.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.116+0000 7f5db3aae700 1 -- 172.21.15.79:0/663137145 shutdown_connections 2023-10-19T08:37:51.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.116+0000 7f5db3aae700 1 -- 172.21.15.79:0/663137145 wait complete. 2023-10-19T08:37:51.123 INFO:teuthology.orchestra.run.smithi079.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-19T08:37:51.135 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-19T08:37:51.135 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-19T08:37:51.136 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-19T08:37:51.138 INFO:tasks.ceph.mds.a:Started 2023-10-19T08:37:51.138 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-19T08:37:51.139 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-19T08:37:51.141 INFO:tasks.ceph.mds.c:Started 2023-10-19T08:37:51.141 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-19T08:37:51.141 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-19T08:37:51.144 INFO:tasks.ceph.mds.b:Started 2023-10-19T08:37:51.145 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-19T08:37:51.145 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-19T08:37:51.147 INFO:tasks.ceph.mds.d:Started 2023-10-19T08:37:51.148 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-19T08:37:51.148 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:37:51.232 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2023-10-19T08:37:51.238 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2023-10-19T08:37:51.241 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-10-19T08:37:51.246 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-10-19T08:37:51.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.296+0000 7f134434c700 1 Processor -- start 2023-10-19T08:37:51.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.296+0000 7f134434c700 1 -- start start 2023-10-19T08:37:51.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.297+0000 7f134434c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f133c15e570 0x7f133c0d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:51.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.297+0000 7f134434c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f133c0b25f0 con 0x7f133c0b0c00 2023-10-19T08:37:51.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.297+0000 7f134434c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f133c0afd60 con 0x7f133c0cb6f0 2023-10-19T08:37:51.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.297+0000 7f134434c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c0af810 con 0x7f133c15e570 2023-10-19T08:37:51.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.297+0000 7f13420e8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f133c15e570 0x7f133c0d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:51.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.297+0000 7f13420e8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f133c15e570 0x7f133c0d1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45472/0 (socket says 172.21.15.79:45472) 2023-10-19T08:37:51.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.297+0000 7f13420e8700 1 -- 172.21.15.79:0/4231082826 learned_addr learned my addr 172.21.15.79:0/4231082826 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:51.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.297+0000 7f13428e9700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f133c0b0c00 0x7f133c0ad9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55548/0 (socket says 172.21.15.79:55548) 2023-10-19T08:37:51.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.297+0000 7f13420e8700 1 -- 172.21.15.79:0/4231082826 >> v1:172.21.15.89:6789/0 conn(0x7f133c0cb6f0 legacy=0x7f133c0b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:51.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.297+0000 7f13410e6700 1 -- 172.21.15.79:0/4231082826 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449092204 0 0) 0x7f133c0afd60 con 0x7f133c0cb6f0 2023-10-19T08:37:51.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.297+0000 7f13420e8700 1 -- 172.21.15.79:0/4231082826 >> v1:172.21.15.79:6789/0 conn(0x7f133c0b0c00 legacy=0x7f133c0ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:51.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.297+0000 7f13420e8700 1 -- 172.21.15.79:0/4231082826 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c0aef70 con 0x7f133c15e570 2023-10-19T08:37:51.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.297+0000 7f13420e8700 1 --2- 172.21.15.79:0/4231082826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c15e570 0x7f133c0d1990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13380098f0 tx=0x7f1338009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6a2197fbdf3e2e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:51.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.297+0000 7f13410e6700 1 -- 172.21.15.79:0/4231082826 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1338004230 con 0x7f133c15e570 2023-10-19T08:37:51.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.297+0000 7f13410e6700 1 -- 172.21.15.79:0/4231082826 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1338004390 con 0x7f133c15e570 2023-10-19T08:37:51.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.297+0000 7f13410e6700 1 -- 172.21.15.79:0/4231082826 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380036a0 con 0x7f133c15e570 2023-10-19T08:37:51.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.298+0000 7f134434c700 1 -- 172.21.15.79:0/4231082826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c15e570 msgr2=0x7f133c0d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:51.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.298+0000 7f134434c700 1 --2- 172.21.15.79:0/4231082826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c15e570 0x7f133c0d1990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13380098f0 tx=0x7f1338009c00 comp rx=0 tx=0).stop 2023-10-19T08:37:51.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.298+0000 7f134434c700 1 -- 172.21.15.79:0/4231082826 shutdown_connections 2023-10-19T08:37:51.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.298+0000 7f134434c700 1 --2- 172.21.15.79:0/4231082826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c15e570 0x7f133c0d1990 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.298+0000 7f134434c700 1 -- 172.21.15.79:0/4231082826 >> 172.21.15.79:0/4231082826 conn(0x7f133c09a0b0 msgr2=0x7f133c0d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:51.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.298+0000 7f134434c700 1 -- 172.21.15.79:0/4231082826 shutdown_connections 2023-10-19T08:37:51.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.298+0000 7f134434c700 1 -- 172.21.15.79:0/4231082826 wait complete. 2023-10-19T08:37:51.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.299+0000 7f134434c700 1 Processor -- start 2023-10-19T08:37:51.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.300+0000 7f134434c700 1 -- start start 2023-10-19T08:37:51.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.300+0000 7f134434c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f133c0b0c00 0x7f133c15c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:51.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.300+0000 7f134434c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c0cb6f0 0x7f133c159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:51.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.300+0000 7f134434c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c15e570 0x7f133c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:51.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.300+0000 7f134434c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c15a430 con 0x7f133c0cb6f0 2023-10-19T08:37:51.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.300+0000 7f134434c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c15b1f0 con 0x7f133c15e570 2023-10-19T08:37:51.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.300+0000 7f134434c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c15b4d0 con 0x7f133c0b0c00 2023-10-19T08:37:51.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.301+0000 7f13418e7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c0cb6f0 0x7f133c159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:51.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.301+0000 7f13418e7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c0cb6f0 0x7f133c159ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45480/0 (socket says 172.21.15.79:45480) 2023-10-19T08:37:51.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.301+0000 7f13418e7700 1 -- 172.21.15.79:0/1469661490 learned_addr learned my addr 172.21.15.79:0/1469661490 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:51.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.301+0000 7f13420e8700 1 --2- 172.21.15.79:0/1469661490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f133c0b0c00 0x7f133c15c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:51.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.301+0000 7f13428e9700 1 --2- 172.21.15.79:0/1469661490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c15e570 0x7f133c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:51.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.301+0000 7f13418e7700 1 -- 172.21.15.79:0/1469661490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f133c0b0c00 msgr2=0x7f133c15c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:51.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.301+0000 7f13418e7700 1 --2- 172.21.15.79:0/1469661490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f133c0b0c00 0x7f133c15c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.301+0000 7f13418e7700 1 -- 172.21.15.79:0/1469661490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c15e570 msgr2=0x7f133c06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:51.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.301+0000 7f13418e7700 1 --2- 172.21.15.79:0/1469661490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c15e570 0x7f133c06f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.301+0000 7f13418e7700 1 -- 172.21.15.79:0/1469661490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1338009550 con 0x7f133c0cb6f0 2023-10-19T08:37:51.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.301+0000 7f13420e8700 1 --2- 172.21.15.79:0/1469661490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f133c0b0c00 0x7f133c15c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:37:51.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.301+0000 7f13418e7700 1 --2- 172.21.15.79:0/1469661490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c0cb6f0 0x7f133c159ef0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f132c00c450 tx=0x7f132c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:51.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.301+0000 7f1332ffd700 1 -- 172.21.15.79:0/1469661490 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c0054e0 con 0x7f133c0cb6f0 2023-10-19T08:37:51.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.301+0000 7f1332ffd700 1 -- 172.21.15.79:0/1469661490 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c003680 con 0x7f133c0cb6f0 2023-10-19T08:37:51.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.301+0000 7f134434c700 1 -- 172.21.15.79:0/1469661490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c15b7b0 con 0x7f133c0cb6f0 2023-10-19T08:37:51.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.301+0000 7f1332ffd700 1 -- 172.21.15.79:0/1469661490 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c003a30 con 0x7f133c0cb6f0 2023-10-19T08:37:51.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.301+0000 7f134434c700 1 -- 172.21.15.79:0/1469661490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c15bd70 con 0x7f133c0cb6f0 2023-10-19T08:37:51.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.302+0000 7f134434c700 1 -- 172.21.15.79:0/1469661490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c04ee70 con 0x7f133c0cb6f0 2023-10-19T08:37:51.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.303+0000 7f1332ffd700 1 -- 172.21.15.79:0/1469661490 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f132c003b90 con 0x7f133c0cb6f0 2023-10-19T08:37:51.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.303+0000 7f1332ffd700 1 --2- 172.21.15.79:0/1469661490 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f132006a050 0x7f132006c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:51.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.303+0000 7f1332ffd700 1 -- 172.21.15.79:0/1469661490 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f132c0875e0 con 0x7f133c0cb6f0 2023-10-19T08:37:51.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.303+0000 7f13420e8700 1 --2- 172.21.15.79:0/1469661490 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f132006a050 0x7f132006c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:51.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.303+0000 7f13420e8700 1 --2- 172.21.15.79:0/1469661490 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f132006a050 0x7f132006c510 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1338009130 tx=0x7f1338008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:51.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.307+0000 7f1332ffd700 1 -- 172.21.15.79:0/1469661490 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f132c053070 con 0x7f133c0cb6f0 2023-10-19T08:37:51.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.519+0000 7f134434c700 1 -- 172.21.15.79:0/1469661490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f133c0b6bd0 con 0x7f133c0cb6f0 2023-10-19T08:37:51.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.520+0000 7f1332ffd700 1 -- 172.21.15.79:0/1469661490 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+14601 (secure 0 0 0) 0x7f132c017070 con 0x7f133c0cb6f0 2023-10-19T08:37:51.523 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:51.524 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":15,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:37:51.106030+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:37:51.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.522+0000 7f134434c700 1 -- 172.21.15.79:0/1469661490 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f132006a050 msgr2=0x7f132006c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:51.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.522+0000 7f134434c700 1 --2- 172.21.15.79:0/1469661490 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f132006a050 0x7f132006c510 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1338009130 tx=0x7f1338008030 comp rx=0 tx=0).stop 2023-10-19T08:37:51.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.522+0000 7f134434c700 1 -- 172.21.15.79:0/1469661490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c0cb6f0 msgr2=0x7f133c159ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:51.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.522+0000 7f134434c700 1 --2- 172.21.15.79:0/1469661490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c0cb6f0 0x7f133c159ef0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f132c00c450 tx=0x7f132c00c810 comp rx=0 tx=0).stop 2023-10-19T08:37:51.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.522+0000 7f134434c700 1 -- 172.21.15.79:0/1469661490 shutdown_connections 2023-10-19T08:37:51.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.522+0000 7f134434c700 1 --2- 172.21.15.79:0/1469661490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c15e570 0x7f133c06f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.522+0000 7f134434c700 1 --2- 172.21.15.79:0/1469661490 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f132006a050 0x7f132006c510 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.522+0000 7f134434c700 1 --2- 172.21.15.79:0/1469661490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f133c0b0c00 0x7f133c15c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.522+0000 7f134434c700 1 --2- 172.21.15.79:0/1469661490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f133c0cb6f0 0x7f133c159ef0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.522+0000 7f134434c700 1 -- 172.21.15.79:0/1469661490 >> 172.21.15.79:0/1469661490 conn(0x7f133c09a0b0 msgr2=0x7f133c1533a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:51.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.522+0000 7f134434c700 1 -- 172.21.15.79:0/1469661490 shutdown_connections 2023-10-19T08:37:51.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.522+0000 7f134434c700 1 -- 172.21.15.79:0/1469661490 wait complete. 2023-10-19T08:37:51.540 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-19T08:37:51.540 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:37:51.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.663+0000 7fc09bc07700 1 Processor -- start 2023-10-19T08:37:51.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.664+0000 7fc09bc07700 1 -- start start 2023-10-19T08:37:51.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.664+0000 7fc09bc07700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc0940cd270 0x7fc09406a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:51.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.664+0000 7fc09bc07700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0940703b0 0x7fc09406a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:51.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.664+0000 7fc09bc07700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc09406f910 0x7fc094160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:51.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.664+0000 7fc09bc07700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc094160a80 con 0x7fc09406f910 2023-10-19T08:37:51.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.664+0000 7fc09bc07700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0940b1fe0 con 0x7fc0940cd270 2023-10-19T08:37:51.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.664+0000 7fc09bc07700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940ce2b0 con 0x7fc0940703b0 2023-10-19T08:37:51.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.665+0000 7fc09a1a4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc09406f910 0x7fc094160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:51.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.665+0000 7fc09a1a4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc09406f910 0x7fc094160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45496/0 (socket says 172.21.15.79:45496) 2023-10-19T08:37:51.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.665+0000 7fc09a1a4700 1 -- 172.21.15.79:0/3080948381 learned_addr learned my addr 172.21.15.79:0/3080948381 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:51.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.665+0000 7fc0999a3700 1 --2- 172.21.15.79:0/3080948381 >> v2:172.21.15.89:3300/0 conn(0x7fc0940cd270 0x7fc09406a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:51.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.665+0000 7fc0991a2700 1 --2- 172.21.15.79:0/3080948381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0940703b0 0x7fc09406a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:51.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.665+0000 7fc09a1a4700 1 -- 172.21.15.79:0/3080948381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0940703b0 msgr2=0x7fc09406a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:51.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.665+0000 7fc09a1a4700 1 --2- 172.21.15.79:0/3080948381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0940703b0 0x7fc09406a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.665+0000 7fc09a1a4700 1 -- 172.21.15.79:0/3080948381 >> v2:172.21.15.89:3300/0 conn(0x7fc0940cd270 msgr2=0x7fc09406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:51.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.665+0000 7fc09a1a4700 1 --2- 172.21.15.79:0/3080948381 >> v2:172.21.15.89:3300/0 conn(0x7fc0940cd270 0x7fc09406a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.665+0000 7fc09a1a4700 1 -- 172.21.15.79:0/3080948381 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0940ce550 con 0x7fc09406f910 2023-10-19T08:37:51.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.665+0000 7fc09a1a4700 1 --2- 172.21.15.79:0/3080948381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09406f910 0x7fc094160c70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc0940717c0 tx=0x7fc08c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c24921459541c8a server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:51.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.665+0000 7fc0989a1700 1 -- 172.21.15.79:0/3080948381 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c00e070 con 0x7fc09406f910 2023-10-19T08:37:51.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.665+0000 7fc0989a1700 1 -- 172.21.15.79:0/3080948381 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c00b910 con 0x7fc09406f910 2023-10-19T08:37:51.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.665+0000 7fc0989a1700 1 -- 172.21.15.79:0/3080948381 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c00bcc0 con 0x7fc09406f910 2023-10-19T08:37:51.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.666+0000 7fc09bc07700 1 -- 172.21.15.79:0/3080948381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09406f910 msgr2=0x7fc094160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:51.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.666+0000 7fc09bc07700 1 --2- 172.21.15.79:0/3080948381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09406f910 0x7fc094160c70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc0940717c0 tx=0x7fc08c00b330 comp rx=0 tx=0).stop 2023-10-19T08:37:51.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.666+0000 7fc09bc07700 1 -- 172.21.15.79:0/3080948381 shutdown_connections 2023-10-19T08:37:51.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.666+0000 7fc09bc07700 1 --2- 172.21.15.79:0/3080948381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09406f910 0x7fc094160c70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.666+0000 7fc09bc07700 1 --2- 172.21.15.79:0/3080948381 >> v2:172.21.15.89:3300/0 conn(0x7fc0940cd270 0x7fc09406a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.666+0000 7fc09bc07700 1 --2- 172.21.15.79:0/3080948381 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0940703b0 0x7fc09406a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.666+0000 7fc09bc07700 1 -- 172.21.15.79:0/3080948381 >> 172.21.15.79:0/3080948381 conn(0x7fc09406dcc0 msgr2=0x7fc09406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:51.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.666+0000 7fc09bc07700 1 -- 172.21.15.79:0/3080948381 shutdown_connections 2023-10-19T08:37:51.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.666+0000 7fc09bc07700 1 -- 172.21.15.79:0/3080948381 wait complete. 2023-10-19T08:37:51.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.667+0000 7fc09bc07700 1 Processor -- start 2023-10-19T08:37:51.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.667+0000 7fc09bc07700 1 -- start start 2023-10-19T08:37:51.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc09bc07700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09406f910 0x7fc09414e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:51.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc09bc07700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0940703b0 0x7fc0940afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:51.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc09bc07700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0940cd270 0x7fc0940b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:51.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc09bc07700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940c7d60 con 0x7fc09406f910 2023-10-19T08:37:51.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc09bc07700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940c4e40 con 0x7fc0940cd270 2023-10-19T08:37:51.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc09bc07700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09414e5f0 con 0x7fc0940703b0 2023-10-19T08:37:51.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc0999a3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09406f910 0x7fc09414e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:51.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc0999a3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09406f910 0x7fc09414e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45498/0 (socket says 172.21.15.79:45498) 2023-10-19T08:37:51.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc0999a3700 1 -- 172.21.15.79:0/2730052051 learned_addr learned my addr 172.21.15.79:0/2730052051 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:51.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc0991a2700 1 --2- 172.21.15.79:0/2730052051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0940703b0 0x7fc0940afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:51.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc09a1a4700 1 --2- 172.21.15.79:0/2730052051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0940cd270 0x7fc0940b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:51.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc0999a3700 1 -- 172.21.15.79:0/2730052051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0940703b0 msgr2=0x7fc0940afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:51.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc0999a3700 1 --2- 172.21.15.79:0/2730052051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0940703b0 0x7fc0940afee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc0999a3700 1 -- 172.21.15.79:0/2730052051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0940cd270 msgr2=0x7fc0940b0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:51.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc0999a3700 1 --2- 172.21.15.79:0/2730052051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0940cd270 0x7fc0940b0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc0999a3700 1 -- 172.21.15.79:0/2730052051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c009b30 con 0x7fc09406f910 2023-10-19T08:37:51.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc0999a3700 1 --2- 172.21.15.79:0/2730052051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09406f910 0x7fc09414e0b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc08400e9b0 tx=0x7fc08400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:51.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc08a7fc700 1 -- 172.21.15.79:0/2730052051 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084009710 con 0x7fc09406f910 2023-10-19T08:37:51.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc08a7fc700 1 -- 172.21.15.79:0/2730052051 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08400ee50 con 0x7fc09406f910 2023-10-19T08:37:51.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc09bc07700 1 -- 172.21.15.79:0/2730052051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0940c70e0 con 0x7fc09406f910 2023-10-19T08:37:51.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc08a7fc700 1 -- 172.21.15.79:0/2730052051 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08400ca50 con 0x7fc09406f910 2023-10-19T08:37:51.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.668+0000 7fc09bc07700 1 -- 172.21.15.79:0/2730052051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0940c76a0 con 0x7fc09406f910 2023-10-19T08:37:51.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.669+0000 7fc09bc07700 1 -- 172.21.15.79:0/2730052051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09404ee70 con 0x7fc09406f910 2023-10-19T08:37:51.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.670+0000 7fc08a7fc700 1 -- 172.21.15.79:0/2730052051 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7fc08400cbb0 con 0x7fc09406f910 2023-10-19T08:37:51.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.670+0000 7fc08a7fc700 1 --2- 172.21.15.79:0/2730052051 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc07806a050 0x7fc07806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:51.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.670+0000 7fc08a7fc700 1 -- 172.21.15.79:0/2730052051 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc084088100 con 0x7fc09406f910 2023-10-19T08:37:51.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.675+0000 7fc08a7fc700 1 -- 172.21.15.79:0/2730052051 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc084053c20 con 0x7fc09406f910 2023-10-19T08:37:51.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.680+0000 7fc0991a2700 1 --2- 172.21.15.79:0/2730052051 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc07806a050 0x7fc07806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:51.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.680+0000 7fc0991a2700 1 --2- 172.21.15.79:0/2730052051 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc07806a050 0x7fc07806c510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc09415ee10 tx=0x7fc090009210 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.869+0000 7fc09bc07700 1 -- 172.21.15.79:0/2730052051 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc0940b1820 con 0x7fc09406f910 2023-10-19T08:37:51.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.869+0000 7fc08a7fc700 1 -- 172.21.15.79:0/2730052051 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc084021020 con 0x7fc09406f910 2023-10-19T08:37:51.873 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:37:51.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.871+0000 7fc09bc07700 1 -- 172.21.15.79:0/2730052051 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc07806a050 msgr2=0x7fc07806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:51.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.871+0000 7fc09bc07700 1 --2- 172.21.15.79:0/2730052051 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc07806a050 0x7fc07806c510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc09415ee10 tx=0x7fc090009210 comp rx=0 tx=0).stop 2023-10-19T08:37:51.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.871+0000 7fc09bc07700 1 -- 172.21.15.79:0/2730052051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09406f910 msgr2=0x7fc09414e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:51.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.871+0000 7fc09bc07700 1 --2- 172.21.15.79:0/2730052051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09406f910 0x7fc09414e0b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc08400e9b0 tx=0x7fc08400ecc0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.871+0000 7fc09bc07700 1 -- 172.21.15.79:0/2730052051 shutdown_connections 2023-10-19T08:37:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.871+0000 7fc09bc07700 1 --2- 172.21.15.79:0/2730052051 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc0940cd270 0x7fc0940b0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.871+0000 7fc09bc07700 1 --2- 172.21.15.79:0/2730052051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc09406f910 0x7fc09414e0b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.871+0000 7fc09bc07700 1 --2- 172.21.15.79:0/2730052051 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc07806a050 0x7fc07806c510 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.871+0000 7fc09bc07700 1 --2- 172.21.15.79:0/2730052051 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc0940703b0 0x7fc0940afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:51.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.871+0000 7fc09bc07700 1 -- 172.21.15.79:0/2730052051 >> 172.21.15.79:0/2730052051 conn(0x7fc09406dcc0 msgr2=0x7fc0940b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:51.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.871+0000 7fc09bc07700 1 -- 172.21.15.79:0/2730052051 shutdown_connections 2023-10-19T08:37:51.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:51.871+0000 7fc09bc07700 1 -- 172.21.15.79:0/2730052051 wait complete. 2023-10-19T08:37:51.887 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:37:52.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.011+0000 7f9acaef0700 1 Processor -- start 2023-10-19T08:37:52.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.011+0000 7f9acaef0700 1 -- start start 2023-10-19T08:37:52.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.012+0000 7f9acaef0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ac406a930 0x7f9ac40cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:52.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.012+0000 7f9acaef0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9ac40703b0 0x7f9ac40cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:52.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.012+0000 7f9acaef0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac40b1fe0 con 0x7f9ac40cd270 2023-10-19T08:37:52.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.012+0000 7f9acaef0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac4160a80 con 0x7f9ac40703b0 2023-10-19T08:37:52.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.012+0000 7f9acaef0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40ce2b0 con 0x7f9ac406a930 2023-10-19T08:37:52.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.012+0000 7f9ac8c8c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9ac40cd270 0x7f9ac406a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55588/0 (socket says 172.21.15.79:55588) 2023-10-19T08:37:52.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.012+0000 7f9ac8c8c700 1 -- 172.21.15.79:0/2288650624 learned_addr learned my addr 172.21.15.79:0/2288650624 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:37:52.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.012+0000 7f9ac3fff700 1 --2- 172.21.15.79:0/2288650624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ac406a930 0x7f9ac40cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:52.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.012+0000 7f9ac948d700 1 --2- 172.21.15.79:0/2288650624 >> v2:172.21.15.89:3300/0 conn(0x7f9ac40703b0 0x7f9ac40cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:52.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.013+0000 7f9ac37fe700 1 -- 172.21.15.79:0/2288650624 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096472860 0 0) 0x7f9ac40b1fe0 con 0x7f9ac40cd270 2023-10-19T08:37:52.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.013+0000 7f9ac37fe700 1 -- 172.21.15.79:0/2288650624 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ab40035b0 con 0x7f9ac40cd270 2023-10-19T08:37:52.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.013+0000 7f9ac3fff700 1 -- 172.21.15.79:0/2288650624 >> v2:172.21.15.89:3300/0 conn(0x7f9ac40703b0 msgr2=0x7f9ac40cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:52.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.013+0000 7f9ac3fff700 1 --2- 172.21.15.79:0/2288650624 >> v2:172.21.15.89:3300/0 conn(0x7f9ac40703b0 0x7f9ac40cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.013+0000 7f9ac3fff700 1 -- 172.21.15.79:0/2288650624 >> v1:172.21.15.79:6789/0 conn(0x7f9ac40cd270 legacy=0x7f9ac406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:52.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.013+0000 7f9ac3fff700 1 -- 172.21.15.79:0/2288650624 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac40ce550 con 0x7f9ac406a930 2023-10-19T08:37:52.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.013+0000 7f9ac948d700 1 --2- 172.21.15.79:0/2288650624 >> v2:172.21.15.89:3300/0 conn(0x7f9ac40703b0 0x7f9ac40cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:37:52.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.013+0000 7f9ac3fff700 1 --2- 172.21.15.79:0/2288650624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ac406a930 0x7f9ac40cb290 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009840 tx=0x7f9ab0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94174c86bae79779 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:52.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.013+0000 7f9ac37fe700 1 -- 172.21.15.79:0/2288650624 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0011830 con 0x7f9ac406a930 2023-10-19T08:37:52.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.013+0000 7f9ac37fe700 1 -- 172.21.15.79:0/2288650624 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab0011990 con 0x7f9ac406a930 2023-10-19T08:37:52.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.013+0000 7f9ac37fe700 1 -- 172.21.15.79:0/2288650624 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0011d20 con 0x7f9ac406a930 2023-10-19T08:37:52.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.014+0000 7f9acaef0700 1 -- 172.21.15.79:0/2288650624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ac406a930 msgr2=0x7f9ac40cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:52.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.014+0000 7f9acaef0700 1 --2- 172.21.15.79:0/2288650624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ac406a930 0x7f9ac40cb290 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009840 tx=0x7f9ab0009b50 comp rx=0 tx=0).stop 2023-10-19T08:37:52.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.014+0000 7f9acaef0700 1 -- 172.21.15.79:0/2288650624 shutdown_connections 2023-10-19T08:37:52.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.014+0000 7f9acaef0700 1 --2- 172.21.15.79:0/2288650624 >> v2:172.21.15.89:3300/0 conn(0x7f9ac40703b0 0x7f9ac40cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.014+0000 7f9acaef0700 1 --2- 172.21.15.79:0/2288650624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ac406a930 0x7f9ac40cb290 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.014+0000 7f9acaef0700 1 -- 172.21.15.79:0/2288650624 >> 172.21.15.79:0/2288650624 conn(0x7f9ac406dcc0 msgr2=0x7f9ac406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:52.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.014+0000 7f9acaef0700 1 -- 172.21.15.79:0/2288650624 shutdown_connections 2023-10-19T08:37:52.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.014+0000 7f9acaef0700 1 -- 172.21.15.79:0/2288650624 wait complete. 2023-10-19T08:37:52.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.015+0000 7f9acaef0700 1 Processor -- start 2023-10-19T08:37:52.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.015+0000 7f9acaef0700 1 -- start start 2023-10-19T08:37:52.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9acaef0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ac406a930 0x7f9ac40afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:52.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9acaef0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac40703b0 0x7f9ac40c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:52.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9acaef0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ac40cd270 0x7f9ac41f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:52.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9acaef0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40c58d0 con 0x7f9ac40703b0 2023-10-19T08:37:52.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9acaef0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40c4d50 con 0x7f9ac406a930 2023-10-19T08:37:52.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9acaef0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40c5030 con 0x7f9ac40cd270 2023-10-19T08:37:52.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9ac3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac40703b0 0x7f9ac40c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:52.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9ac3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac40703b0 0x7f9ac40c5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45524/0 (socket says 172.21.15.79:45524) 2023-10-19T08:37:52.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9ac3fff700 1 -- 172.21.15.79:0/1252692977 learned_addr learned my addr 172.21.15.79:0/1252692977 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:52.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9ac8c8c700 1 --2- 172.21.15.79:0/1252692977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ac406a930 0x7f9ac40afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:52.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9ac948d700 1 --2- 172.21.15.79:0/1252692977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ac40cd270 0x7f9ac41f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:52.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9ac3fff700 1 -- 172.21.15.79:0/1252692977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ac40cd270 msgr2=0x7f9ac41f4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:52.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9ac3fff700 1 --2- 172.21.15.79:0/1252692977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ac40cd270 0x7f9ac41f4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9ac3fff700 1 -- 172.21.15.79:0/1252692977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ac406a930 msgr2=0x7f9ac40afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:52.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9ac3fff700 1 --2- 172.21.15.79:0/1252692977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ac406a930 0x7f9ac40afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9ac3fff700 1 -- 172.21.15.79:0/1252692977 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab00094a0 con 0x7f9ac40703b0 2023-10-19T08:37:52.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9ac3fff700 1 --2- 172.21.15.79:0/1252692977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac40703b0 0x7f9ac40c5f50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009fd0 tx=0x7f9ab0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:52.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9ac17fa700 1 -- 172.21.15.79:0/1252692977 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00036a0 con 0x7f9ac40703b0 2023-10-19T08:37:52.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9ac17fa700 1 -- 172.21.15.79:0/1252692977 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab001e070 con 0x7f9ac40703b0 2023-10-19T08:37:52.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9acaef0700 1 -- 172.21.15.79:0/1252692977 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac40c5310 con 0x7f9ac40703b0 2023-10-19T08:37:52.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9ac17fa700 1 -- 172.21.15.79:0/1252692977 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0003a40 con 0x7f9ac40703b0 2023-10-19T08:37:52.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.016+0000 7f9acaef0700 1 -- 172.21.15.79:0/1252692977 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac40b02a0 con 0x7f9ac40703b0 2023-10-19T08:37:52.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.017+0000 7f9acaef0700 1 -- 172.21.15.79:0/1252692977 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac4150dd0 con 0x7f9ac40703b0 2023-10-19T08:37:52.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.018+0000 7f9ac17fa700 1 -- 172.21.15.79:0/1252692977 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f9ab0003ba0 con 0x7f9ac40703b0 2023-10-19T08:37:52.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.018+0000 7f9ac17fa700 1 --2- 172.21.15.79:0/1252692977 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9aa806a050 0x7f9aa806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:52.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.018+0000 7f9ac17fa700 1 -- 172.21.15.79:0/1252692977 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9ab0088fa0 con 0x7f9ac40703b0 2023-10-19T08:37:52.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.018+0000 7f9ac8c8c700 1 --2- 172.21.15.79:0/1252692977 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9aa806a050 0x7f9aa806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:52.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.019+0000 7f9ac8c8c700 1 --2- 172.21.15.79:0/1252692977 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9aa806a050 0x7f9aa806c510 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8007fd0 tx=0x7f9ab8007dc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:52.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.023+0000 7f9ac17fa700 1 -- 172.21.15.79:0/1252692977 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f9ac4150dd0 con 0x7f9ac40703b0 2023-10-19T08:37:52.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.215+0000 7f9acaef0700 1 -- 172.21.15.79:0/1252692977 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9ac4150dd0 con 0x7f9ac40703b0 2023-10-19T08:37:52.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.216+0000 7f9ac17fa700 1 -- 172.21.15.79:0/1252692977 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9ac4150dd0 con 0x7f9ac40703b0 2023-10-19T08:37:52.220 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:37:52.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.218+0000 7f9acaef0700 1 -- 172.21.15.79:0/1252692977 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9aa806a050 msgr2=0x7f9aa806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:52.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.218+0000 7f9acaef0700 1 --2- 172.21.15.79:0/1252692977 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9aa806a050 0x7f9aa806c510 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8007fd0 tx=0x7f9ab8007dc0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.218+0000 7f9acaef0700 1 -- 172.21.15.79:0/1252692977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac40703b0 msgr2=0x7f9ac40c5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:52.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.218+0000 7f9acaef0700 1 --2- 172.21.15.79:0/1252692977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac40703b0 0x7f9ac40c5f50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0009fd0 tx=0x7f9ab0004750 comp rx=0 tx=0).stop 2023-10-19T08:37:52.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.218+0000 7f9acaef0700 1 -- 172.21.15.79:0/1252692977 shutdown_connections 2023-10-19T08:37:52.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.218+0000 7f9acaef0700 1 --2- 172.21.15.79:0/1252692977 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9aa806a050 0x7f9aa806c510 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.218+0000 7f9acaef0700 1 --2- 172.21.15.79:0/1252692977 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ac40cd270 0x7f9ac41f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.218+0000 7f9acaef0700 1 --2- 172.21.15.79:0/1252692977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ac406a930 0x7f9ac40afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.218+0000 7f9acaef0700 1 --2- 172.21.15.79:0/1252692977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ac40703b0 0x7f9ac40c5f50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.218+0000 7f9acaef0700 1 -- 172.21.15.79:0/1252692977 >> 172.21.15.79:0/1252692977 conn(0x7f9ac406dcc0 msgr2=0x7f9ac415fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:52.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.218+0000 7f9acaef0700 1 -- 172.21.15.79:0/1252692977 shutdown_connections 2023-10-19T08:37:52.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.218+0000 7f9acaef0700 1 -- 172.21.15.79:0/1252692977 wait complete. 2023-10-19T08:37:52.233 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T08:37:52.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.354+0000 7f063ee3b700 1 Processor -- start 2023-10-19T08:37:52.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.354+0000 7f063ee3b700 1 -- start start 2023-10-19T08:37:52.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.355+0000 7f063ee3b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f063815e570 0x7f06380d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:52.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.355+0000 7f063ee3b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06380b0c00 0x7f06380ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:52.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.355+0000 7f063ee3b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06380b25f0 con 0x7f06380cb6f0 2023-10-19T08:37:52.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.355+0000 7f063ee3b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06380afd60 con 0x7f063815e570 2023-10-19T08:37:52.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.355+0000 7f063ee3b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06380af810 con 0x7f06380b0c00 2023-10-19T08:37:52.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.355+0000 7f063cbd7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f063815e570 0x7f06380d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:52.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.355+0000 7f063d3d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06380b0c00 0x7f06380ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:52.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.355+0000 7f063d3d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06380b0c00 0x7f06380ad9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:48162/0 (socket says 172.21.15.79:48162) 2023-10-19T08:37:52.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.355+0000 7f063cbd7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f063815e570 0x7f06380d1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:60012/0 (socket says 172.21.15.79:60012) 2023-10-19T08:37:52.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.355+0000 7f063d3d8700 1 -- 172.21.15.79:0/3131986155 learned_addr learned my addr 172.21.15.79:0/3131986155 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:52.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.355+0000 7f0637fff700 1 --1- 172.21.15.79:0/3131986155 >> v1:172.21.15.89:6789/0 conn(0x7f06380cb6f0 0x7f06380b04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:40450/0 (socket says 172.21.15.79:40450) 2023-10-19T08:37:52.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.355+0000 7f063cbd7700 1 -- 172.21.15.79:0/3131986155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06380b0c00 msgr2=0x7f06380ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:52.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.355+0000 7f063cbd7700 1 --2- 172.21.15.79:0/3131986155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06380b0c00 0x7f06380ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.355+0000 7f063cbd7700 1 -- 172.21.15.79:0/3131986155 >> v1:172.21.15.89:6789/0 conn(0x7f06380cb6f0 legacy=0x7f06380b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:52.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.355+0000 7f063cbd7700 1 -- 172.21.15.79:0/3131986155 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06380aef70 con 0x7f063815e570 2023-10-19T08:37:52.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.355+0000 7f063cbd7700 1 --2- 172.21.15.79:0/3131986155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f063815e570 0x7f06380d1990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f062c009840 tx=0x7f062c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b562b2df7012da5a server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:52.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.356+0000 7f06377fe700 1 -- 172.21.15.79:0/3131986155 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c011830 con 0x7f063815e570 2023-10-19T08:37:52.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.356+0000 7f06377fe700 1 -- 172.21.15.79:0/3131986155 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c011990 con 0x7f063815e570 2023-10-19T08:37:52.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.356+0000 7f06377fe700 1 -- 172.21.15.79:0/3131986155 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c011d20 con 0x7f063815e570 2023-10-19T08:37:52.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.356+0000 7f063ee3b700 1 -- 172.21.15.79:0/3131986155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f063815e570 msgr2=0x7f06380d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:52.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.356+0000 7f063ee3b700 1 --2- 172.21.15.79:0/3131986155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f063815e570 0x7f06380d1990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f062c009840 tx=0x7f062c009b50 comp rx=0 tx=0).stop 2023-10-19T08:37:52.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.356+0000 7f063ee3b700 1 -- 172.21.15.79:0/3131986155 shutdown_connections 2023-10-19T08:37:52.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.356+0000 7f063ee3b700 1 --2- 172.21.15.79:0/3131986155 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f06380b0c00 0x7f06380ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.356+0000 7f063ee3b700 1 --2- 172.21.15.79:0/3131986155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f063815e570 0x7f06380d1990 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.356+0000 7f063ee3b700 1 -- 172.21.15.79:0/3131986155 >> 172.21.15.79:0/3131986155 conn(0x7f063809a0b0 msgr2=0x7f06380d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:52.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.356+0000 7f063ee3b700 1 -- 172.21.15.79:0/3131986155 shutdown_connections 2023-10-19T08:37:52.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.356+0000 7f063ee3b700 1 -- 172.21.15.79:0/3131986155 wait complete. 2023-10-19T08:37:52.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.358+0000 7f063ee3b700 1 Processor -- start 2023-10-19T08:37:52.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.358+0000 7f063ee3b700 1 -- start start 2023-10-19T08:37:52.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.359+0000 7f063ee3b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06380b0c00 0x7f06381f13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:52.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.359+0000 7f063ee3b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06380cb6f0 0x7f0638153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:52.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.359+0000 7f063ee3b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f063815e570 0x7f06380ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:52.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.359+0000 7f063ee3b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06381575f0 con 0x7f06380cb6f0 2023-10-19T08:37:52.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.359+0000 7f063ee3b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0638154620 con 0x7f06380b0c00 2023-10-19T08:37:52.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.359+0000 7f063ee3b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0638154900 con 0x7f063815e570 2023-10-19T08:37:52.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.359+0000 7f0637fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06380cb6f0 0x7f0638153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:52.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.359+0000 7f0637fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06380cb6f0 0x7f0638153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45542/0 (socket says 172.21.15.79:45542) 2023-10-19T08:37:52.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.359+0000 7f0637fff700 1 -- 172.21.15.79:0/960998365 learned_addr learned my addr 172.21.15.79:0/960998365 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:52.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.359+0000 7f063d3d8700 1 --2- 172.21.15.79:0/960998365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f063815e570 0x7f06380ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:52.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.359+0000 7f063cbd7700 1 --2- 172.21.15.79:0/960998365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06380b0c00 0x7f06381f13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:52.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.359+0000 7f0637fff700 1 -- 172.21.15.79:0/960998365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f063815e570 msgr2=0x7f06380ae0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:52.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.359+0000 7f0637fff700 1 --2- 172.21.15.79:0/960998365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f063815e570 0x7f06380ae0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.359+0000 7f0637fff700 1 -- 172.21.15.79:0/960998365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06380b0c00 msgr2=0x7f06381f13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:52.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.359+0000 7f0637fff700 1 --2- 172.21.15.79:0/960998365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06380b0c00 0x7f06381f13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.359+0000 7f0637fff700 1 -- 172.21.15.79:0/960998365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c0094a0 con 0x7f06380cb6f0 2023-10-19T08:37:52.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.360+0000 7f0637fff700 1 --2- 172.21.15.79:0/960998365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06380cb6f0 0x7f0638153df0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f062400c4f0 tx=0x7f062400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:52.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.360+0000 7f06357fa700 1 -- 172.21.15.79:0/960998365 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624005cb0 con 0x7f06380cb6f0 2023-10-19T08:37:52.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.360+0000 7f06357fa700 1 -- 172.21.15.79:0/960998365 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0624005e10 con 0x7f06380cb6f0 2023-10-19T08:37:52.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.360+0000 7f063ee3b700 1 -- 172.21.15.79:0/960998365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0638154be0 con 0x7f06380cb6f0 2023-10-19T08:37:52.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.360+0000 7f06357fa700 1 -- 172.21.15.79:0/960998365 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06240072d0 con 0x7f06380cb6f0 2023-10-19T08:37:52.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.360+0000 7f063ee3b700 1 -- 172.21.15.79:0/960998365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0638154330 con 0x7f06380cb6f0 2023-10-19T08:37:52.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.361+0000 7f063ee3b700 1 -- 172.21.15.79:0/960998365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063804ee70 con 0x7f06380cb6f0 2023-10-19T08:37:52.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.361+0000 7f06357fa700 1 -- 172.21.15.79:0/960998365 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f0624007430 con 0x7f06380cb6f0 2023-10-19T08:37:52.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.361+0000 7f06357fa700 1 --2- 172.21.15.79:0/960998365 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f061c06a050 0x7f061c06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:52.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.361+0000 7f06357fa700 1 -- 172.21.15.79:0/960998365 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f06240874b0 con 0x7f06380cb6f0 2023-10-19T08:37:52.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.361+0000 7f063cbd7700 1 --2- 172.21.15.79:0/960998365 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f061c06a050 0x7f061c06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:52.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.362+0000 7f063cbd7700 1 --2- 172.21.15.79:0/960998365 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f061c06a050 0x7f061c06c510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f062c000c00 tx=0x7f062c01c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:52.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.366+0000 7f06357fa700 1 -- 172.21.15.79:0/960998365 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f0624053090 con 0x7f06380cb6f0 2023-10-19T08:37:52.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.598+0000 7f063ee3b700 1 -- 172.21.15.79:0/960998365 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06380adc50 con 0x7f06380cb6f0 2023-10-19T08:37:52.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.599+0000 7f06357fa700 1 -- 172.21.15.79:0/960998365 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3688 (secure 0 0 0) 0x7f0624017e80 con 0x7f06380cb6f0 2023-10-19T08:37:52.603 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:52.603 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3710906518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3710906518},{"type":"v1","addr":"172.21.15.89:6835","nonce":3710906518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3037310614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3037310614},{"type":"v1","addr":"172.21.15.79:6835","nonce":3037310614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/79656061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":79656061},{"type":"v1","addr":"172.21.15.79:6837","nonce":79656061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6833/3076620199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3076620199},{"type":"v1","addr":"172.21.15.89:6833","nonce":3076620199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-19T08:37:52.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.601+0000 7f063ee3b700 1 -- 172.21.15.79:0/960998365 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f061c06a050 msgr2=0x7f061c06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:52.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.601+0000 7f063ee3b700 1 --2- 172.21.15.79:0/960998365 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f061c06a050 0x7f061c06c510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f062c000c00 tx=0x7f062c01c040 comp rx=0 tx=0).stop 2023-10-19T08:37:52.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.601+0000 7f063ee3b700 1 -- 172.21.15.79:0/960998365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06380cb6f0 msgr2=0x7f0638153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:52.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.601+0000 7f063ee3b700 1 --2- 172.21.15.79:0/960998365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06380cb6f0 0x7f0638153df0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f062400c4f0 tx=0x7f062400c8b0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.601+0000 7f063ee3b700 1 -- 172.21.15.79:0/960998365 shutdown_connections 2023-10-19T08:37:52.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.601+0000 7f063ee3b700 1 --2- 172.21.15.79:0/960998365 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f061c06a050 0x7f061c06c510 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.601+0000 7f063ee3b700 1 --2- 172.21.15.79:0/960998365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f063815e570 0x7f06380ae0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.601+0000 7f063ee3b700 1 --2- 172.21.15.79:0/960998365 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f06380b0c00 0x7f06381f13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.601+0000 7f063ee3b700 1 --2- 172.21.15.79:0/960998365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06380cb6f0 0x7f0638153df0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.601+0000 7f063ee3b700 1 -- 172.21.15.79:0/960998365 >> 172.21.15.79:0/960998365 conn(0x7f063809a0b0 msgr2=0x7f0638070290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:52.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.601+0000 7f063ee3b700 1 -- 172.21.15.79:0/960998365 shutdown_connections 2023-10-19T08:37:52.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.601+0000 7f063ee3b700 1 -- 172.21.15.79:0/960998365 wait complete. 2023-10-19T08:37:52.607 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 3 2023-10-19T08:37:52.618 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:37:52.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.735+0000 7f5b82607700 1 Processor -- start 2023-10-19T08:37:52.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.735+0000 7f5b82607700 1 -- start start 2023-10-19T08:37:52.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.736+0000 7f5b82607700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b7c0af170 0x7f5b7c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:52.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.736+0000 7f5b82607700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5b7c0b1de0 0x7f5b7c0b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:52.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.736+0000 7f5b82607700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7c15de50 con 0x7f5b7c0cd800 2023-10-19T08:37:52.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.736+0000 7f5b82607700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7c0af550 con 0x7f5b7c0b1de0 2023-10-19T08:37:52.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.736+0000 7f5b82607700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0b16b0 con 0x7f5b7c0af170 2023-10-19T08:37:52.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.736+0000 7f5b80ba4700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5b7c0cd800 0x7f5b7c06a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55624/0 (socket says 172.21.15.79:55624) 2023-10-19T08:37:52.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.736+0000 7f5b80ba4700 1 -- 172.21.15.79:0/1466485050 learned_addr learned my addr 172.21.15.79:0/1466485050 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:37:52.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.736+0000 7f5b7bfff700 1 --2- 172.21.15.79:0/1466485050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b7c0af170 0x7f5b7c0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.736+0000 7f5b7b7fe700 1 --2- 172.21.15.79:0/1466485050 >> v2:172.21.15.89:3300/0 conn(0x7f5b7c0b1de0 0x7f5b7c0b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.736+0000 7f5b7affd700 1 -- 172.21.15.79:0/1466485050 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291543397 0 0) 0x7f5b7c15de50 con 0x7f5b7c0cd800 2023-10-19T08:37:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.736+0000 7f5b7affd700 1 -- 172.21.15.79:0/1466485050 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b640035b0 con 0x7f5b7c0cd800 2023-10-19T08:37:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.736+0000 7f5b7bfff700 1 -- 172.21.15.79:0/1466485050 >> v2:172.21.15.89:3300/0 conn(0x7f5b7c0b1de0 msgr2=0x7f5b7c0b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:52.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.736+0000 7f5b7bfff700 1 --2- 172.21.15.79:0/1466485050 >> v2:172.21.15.89:3300/0 conn(0x7f5b7c0b1de0 0x7f5b7c0b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.736+0000 7f5b7bfff700 1 -- 172.21.15.79:0/1466485050 >> v1:172.21.15.79:6789/0 conn(0x7f5b7c0cd800 legacy=0x7f5b7c06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:52.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.736+0000 7f5b7bfff700 1 -- 172.21.15.79:0/1466485050 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c15e130 con 0x7f5b7c0af170 2023-10-19T08:37:52.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.736+0000 7f5b7b7fe700 1 --2- 172.21.15.79:0/1466485050 >> v2:172.21.15.89:3300/0 conn(0x7f5b7c0b1de0 0x7f5b7c0b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:37:52.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.737+0000 7f5b7bfff700 1 --2- 172.21.15.79:0/1466485050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b7c0af170 0x7f5b7c0cd0c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5b70009840 tx=0x7f5b70009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15513844b945ea77 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:52.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.737+0000 7f5b7affd700 1 -- 172.21.15.79:0/1466485050 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70011830 con 0x7f5b7c0af170 2023-10-19T08:37:52.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.737+0000 7f5b7affd700 1 -- 172.21.15.79:0/1466485050 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b70011990 con 0x7f5b7c0af170 2023-10-19T08:37:52.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.737+0000 7f5b7affd700 1 -- 172.21.15.79:0/1466485050 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70011d20 con 0x7f5b7c0af170 2023-10-19T08:37:52.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.737+0000 7f5b82607700 1 -- 172.21.15.79:0/1466485050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b7c0af170 msgr2=0x7f5b7c0cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:52.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.737+0000 7f5b82607700 1 --2- 172.21.15.79:0/1466485050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b7c0af170 0x7f5b7c0cd0c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5b70009840 tx=0x7f5b70009b50 comp rx=0 tx=0).stop 2023-10-19T08:37:52.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.737+0000 7f5b82607700 1 -- 172.21.15.79:0/1466485050 shutdown_connections 2023-10-19T08:37:52.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.737+0000 7f5b82607700 1 --2- 172.21.15.79:0/1466485050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b7c0af170 0x7f5b7c0cd0c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.737+0000 7f5b82607700 1 --2- 172.21.15.79:0/1466485050 >> v2:172.21.15.89:3300/0 conn(0x7f5b7c0b1de0 0x7f5b7c0b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.737+0000 7f5b82607700 1 -- 172.21.15.79:0/1466485050 >> 172.21.15.79:0/1466485050 conn(0x7f5b7c06dcc0 msgr2=0x7f5b7c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:52.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.737+0000 7f5b82607700 1 -- 172.21.15.79:0/1466485050 shutdown_connections 2023-10-19T08:37:52.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.737+0000 7f5b82607700 1 -- 172.21.15.79:0/1466485050 wait complete. 2023-10-19T08:37:52.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.738+0000 7f5b82607700 1 Processor -- start 2023-10-19T08:37:52.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.739+0000 7f5b82607700 1 -- start start 2023-10-19T08:37:52.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.739+0000 7f5b82607700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b7c0af170 0x7f5b7c0c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:52.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.739+0000 7f5b82607700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b7c0b1de0 0x7f5b7c0c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:52.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.739+0000 7f5b82607700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b7c0cd800 0x7f5b7c0c3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:52.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.739+0000 7f5b82607700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c1f3a30 con 0x7f5b7c0af170 2023-10-19T08:37:52.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.739+0000 7f5b82607700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0c9070 con 0x7f5b7c0cd800 2023-10-19T08:37:52.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.739+0000 7f5b82607700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c1f3190 con 0x7f5b7c0b1de0 2023-10-19T08:37:52.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.739+0000 7f5b7bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b7c0af170 0x7f5b7c0c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:52.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.739+0000 7f5b7bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b7c0af170 0x7f5b7c0c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45554/0 (socket says 172.21.15.79:45554) 2023-10-19T08:37:52.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.739+0000 7f5b7bfff700 1 -- 172.21.15.79:0/832774554 learned_addr learned my addr 172.21.15.79:0/832774554 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:52.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.739+0000 7f5b7b7fe700 1 --2- 172.21.15.79:0/832774554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b7c0b1de0 0x7f5b7c0c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:52.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.739+0000 7f5b80ba4700 1 --2- 172.21.15.79:0/832774554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b7c0cd800 0x7f5b7c0c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:52.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.740+0000 7f5b7bfff700 1 -- 172.21.15.79:0/832774554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b7c0b1de0 msgr2=0x7f5b7c0c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:52.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.740+0000 7f5b7bfff700 1 --2- 172.21.15.79:0/832774554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b7c0b1de0 0x7f5b7c0c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.740+0000 7f5b7bfff700 1 -- 172.21.15.79:0/832774554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b7c0cd800 msgr2=0x7f5b7c0c3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:52.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.740+0000 7f5b7bfff700 1 --2- 172.21.15.79:0/832774554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b7c0cd800 0x7f5b7c0c3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.740+0000 7f5b7bfff700 1 -- 172.21.15.79:0/832774554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c0094a0 con 0x7f5b7c0af170 2023-10-19T08:37:52.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.740+0000 7f5b7bfff700 1 --2- 172.21.15.79:0/832774554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b7c0af170 0x7f5b7c0c8b30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5b700090b0 tx=0x7f5b70004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:52.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.740+0000 7f5b78ff9700 1 -- 172.21.15.79:0/832774554 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b700036a0 con 0x7f5b7c0af170 2023-10-19T08:37:52.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.740+0000 7f5b78ff9700 1 -- 172.21.15.79:0/832774554 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7001e070 con 0x7f5b7c0af170 2023-10-19T08:37:52.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.740+0000 7f5b82607700 1 -- 172.21.15.79:0/832774554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b700094a0 con 0x7f5b7c0af170 2023-10-19T08:37:52.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.740+0000 7f5b78ff9700 1 -- 172.21.15.79:0/832774554 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b70003a40 con 0x7f5b7c0af170 2023-10-19T08:37:52.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.740+0000 7f5b82607700 1 -- 172.21.15.79:0/832774554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7c1f3750 con 0x7f5b7c0af170 2023-10-19T08:37:52.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.741+0000 7f5b82607700 1 -- 172.21.15.79:0/832774554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7c04ee70 con 0x7f5b7c0af170 2023-10-19T08:37:52.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.741+0000 7f5b78ff9700 1 -- 172.21.15.79:0/832774554 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f5b70003ba0 con 0x7f5b7c0af170 2023-10-19T08:37:52.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.742+0000 7f5b78ff9700 1 --2- 172.21.15.79:0/832774554 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5b6806a050 0x7f5b6806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:52.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.742+0000 7f5b7b7fe700 1 --2- 172.21.15.79:0/832774554 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5b6806a050 0x7f5b6806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:52.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.742+0000 7f5b78ff9700 1 -- 172.21.15.79:0/832774554 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5b70088e80 con 0x7f5b7c0af170 2023-10-19T08:37:52.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.742+0000 7f5b7b7fe700 1 --2- 172.21.15.79:0/832774554 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5b6806a050 0x7f5b6806c510 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0c92d0 tx=0x7f5b6c009210 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:52.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.746+0000 7f5b78ff9700 1 -- 172.21.15.79:0/832774554 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f5b70054a30 con 0x7f5b7c0af170 2023-10-19T08:37:52.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.933+0000 7f5b82607700 1 -- 172.21.15.79:0/832774554 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b7c06b110 con 0x7f5b7c0af170 2023-10-19T08:37:52.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.934+0000 7f5b78ff9700 1 -- 172.21.15.79:0/832774554 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14589 (secure 0 0 0) 0x7f5b70015090 con 0x7f5b7c0af170 2023-10-19T08:37:52.938 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:52.938 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":16,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:37:52.107270+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:37:52.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.936+0000 7f5b82607700 1 -- 172.21.15.79:0/832774554 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5b6806a050 msgr2=0x7f5b6806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:52.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.936+0000 7f5b82607700 1 --2- 172.21.15.79:0/832774554 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5b6806a050 0x7f5b6806c510 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0c92d0 tx=0x7f5b6c009210 comp rx=0 tx=0).stop 2023-10-19T08:37:52.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.936+0000 7f5b82607700 1 -- 172.21.15.79:0/832774554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b7c0af170 msgr2=0x7f5b7c0c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:52.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.936+0000 7f5b82607700 1 --2- 172.21.15.79:0/832774554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b7c0af170 0x7f5b7c0c8b30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5b700090b0 tx=0x7f5b70004750 comp rx=0 tx=0).stop 2023-10-19T08:37:52.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.936+0000 7f5b82607700 1 -- 172.21.15.79:0/832774554 shutdown_connections 2023-10-19T08:37:52.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.936+0000 7f5b82607700 1 --2- 172.21.15.79:0/832774554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b7c0cd800 0x7f5b7c0c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.936+0000 7f5b82607700 1 --2- 172.21.15.79:0/832774554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b7c0af170 0x7f5b7c0c8b30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.936+0000 7f5b82607700 1 --2- 172.21.15.79:0/832774554 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5b6806a050 0x7f5b6806c510 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.936+0000 7f5b82607700 1 --2- 172.21.15.79:0/832774554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5b7c0b1de0 0x7f5b7c0c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:52.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.936+0000 7f5b82607700 1 -- 172.21.15.79:0/832774554 >> 172.21.15.79:0/832774554 conn(0x7f5b7c06dcc0 msgr2=0x7f5b7c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.936+0000 7f5b82607700 1 -- 172.21.15.79:0/832774554 shutdown_connections 2023-10-19T08:37:52.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:52.936+0000 7f5b82607700 1 -- 172.21.15.79:0/832774554 wait complete. 2023-10-19T08:37:52.951 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-19T08:37:52.952 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:37:53.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.070+0000 7f89fb0c5700 1 Processor -- start 2023-10-19T08:37:53.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.071+0000 7f89fb0c5700 1 -- start start 2023-10-19T08:37:53.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.071+0000 7f89fb0c5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89f40b0c00 0x7f89f40d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:53.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.071+0000 7f89fb0c5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89f40cb6f0 0x7f89f40ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:53.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.071+0000 7f89fb0c5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f40b25f0 con 0x7f89f415e570 2023-10-19T08:37:53.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.071+0000 7f89fb0c5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f40afd60 con 0x7f89f40b0c00 2023-10-19T08:37:53.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.071+0000 7f89fb0c5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f40af810 con 0x7f89f40cb6f0 2023-10-19T08:37:53.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.071+0000 7f89f3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f89f40b0c00 0x7f89f40d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:53.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.072+0000 7f89f8e61700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f89f415e570 0x7f89f40b04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55640/0 (socket says 172.21.15.79:55640) 2023-10-19T08:37:53.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.072+0000 7f89f8e61700 1 -- 172.21.15.79:0/3616863513 learned_addr learned my addr 172.21.15.79:0/3616863513 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:37:53.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.072+0000 7f89f9662700 1 --2- 172.21.15.79:0/3616863513 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89f40cb6f0 0x7f89f40ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.072+0000 7f89f3fff700 1 -- 172.21.15.79:0/3616863513 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89f40cb6f0 msgr2=0x7f89f40ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.072+0000 7f89f3fff700 1 --2- 172.21.15.79:0/3616863513 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89f40cb6f0 0x7f89f40ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.072+0000 7f89f3fff700 1 -- 172.21.15.79:0/3616863513 >> v1:172.21.15.79:6789/0 conn(0x7f89f415e570 legacy=0x7f89f40b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.072+0000 7f89f3fff700 1 -- 172.21.15.79:0/3616863513 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f40aef70 con 0x7f89f40b0c00 2023-10-19T08:37:53.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.072+0000 7f89f37fe700 1 -- 172.21.15.79:0/3616863513 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514472202 0 0) 0x7f89f40b25f0 con 0x7f89f415e570 2023-10-19T08:37:53.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.072+0000 7f89f3fff700 1 --2- 172.21.15.79:0/3616863513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40b0c00 0x7f89f40d1990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009840 tx=0x7f89e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b467a42d2f27e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:53.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.072+0000 7f89f37fe700 1 -- 172.21.15.79:0/3616863513 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0011830 con 0x7f89f40b0c00 2023-10-19T08:37:53.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.072+0000 7f89f37fe700 1 -- 172.21.15.79:0/3616863513 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e0011990 con 0x7f89f40b0c00 2023-10-19T08:37:53.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.072+0000 7f89f37fe700 1 -- 172.21.15.79:0/3616863513 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0011d20 con 0x7f89f40b0c00 2023-10-19T08:37:53.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.073+0000 7f89fb0c5700 1 -- 172.21.15.79:0/3616863513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40b0c00 msgr2=0x7f89f40d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.073+0000 7f89fb0c5700 1 --2- 172.21.15.79:0/3616863513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40b0c00 0x7f89f40d1990 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009840 tx=0x7f89e0009b50 comp rx=0 tx=0).stop 2023-10-19T08:37:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.073+0000 7f89fb0c5700 1 -- 172.21.15.79:0/3616863513 shutdown_connections 2023-10-19T08:37:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.073+0000 7f89fb0c5700 1 --2- 172.21.15.79:0/3616863513 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89f40cb6f0 0x7f89f40ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.073+0000 7f89fb0c5700 1 --2- 172.21.15.79:0/3616863513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40b0c00 0x7f89f40d1990 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.073+0000 7f89fb0c5700 1 -- 172.21.15.79:0/3616863513 >> 172.21.15.79:0/3616863513 conn(0x7f89f409a0b0 msgr2=0x7f89f40d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:53.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.073+0000 7f89fb0c5700 1 -- 172.21.15.79:0/3616863513 shutdown_connections 2023-10-19T08:37:53.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.073+0000 7f89fb0c5700 1 -- 172.21.15.79:0/3616863513 wait complete. 2023-10-19T08:37:53.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.074+0000 7f89fb0c5700 1 Processor -- start 2023-10-19T08:37:53.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.074+0000 7f89fb0c5700 1 -- start start 2023-10-19T08:37:53.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89fb0c5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40b0c00 0x7f89f415a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:53.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89fb0c5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89f40cb6f0 0x7f89f415cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:53.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89fb0c5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89f415e570 0x7f89f415d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:53.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89fb0c5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f415a950 con 0x7f89f40b0c00 2023-10-19T08:37:53.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89fb0c5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f40701c0 con 0x7f89f40cb6f0 2023-10-19T08:37:53.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89fb0c5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f40c8250 con 0x7f89f415e570 2023-10-19T08:37:53.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89f8e61700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40b0c00 0x7f89f415a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:53.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89f8e61700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40b0c00 0x7f89f415a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45574/0 (socket says 172.21.15.79:45574) 2023-10-19T08:37:53.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89f8e61700 1 -- 172.21.15.79:0/1408202744 learned_addr learned my addr 172.21.15.79:0/1408202744 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:53.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89f8e61700 1 -- 172.21.15.79:0/1408202744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89f415e570 msgr2=0x7f89f415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:53.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89f8e61700 1 --2- 172.21.15.79:0/1408202744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89f415e570 0x7f89f415d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89f8e61700 1 -- 172.21.15.79:0/1408202744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89f40cb6f0 msgr2=0x7f89f415cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:53.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89f8e61700 1 --2- 172.21.15.79:0/1408202744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89f40cb6f0 0x7f89f415cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89f8e61700 1 -- 172.21.15.79:0/1408202744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e00094a0 con 0x7f89f40b0c00 2023-10-19T08:37:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89f8e61700 1 --2- 172.21.15.79:0/1408202744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40b0c00 0x7f89f415a410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f89e800c580 tx=0x7f89e800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89f17fa700 1 -- 172.21.15.79:0/1408202744 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8004c80 con 0x7f89f40b0c00 2023-10-19T08:37:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89fb0c5700 1 -- 172.21.15.79:0/1408202744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f40c7f50 con 0x7f89f40b0c00 2023-10-19T08:37:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89f17fa700 1 -- 172.21.15.79:0/1408202744 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e8004e00 con 0x7f89f40b0c00 2023-10-19T08:37:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89f17fa700 1 -- 172.21.15.79:0/1408202744 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8007310 con 0x7f89f40b0c00 2023-10-19T08:37:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.075+0000 7f89fb0c5700 1 -- 172.21.15.79:0/1408202744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f40c6890 con 0x7f89f40b0c00 2023-10-19T08:37:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.076+0000 7f89fb0c5700 1 -- 172.21.15.79:0/1408202744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f404ee70 con 0x7f89f40b0c00 2023-10-19T08:37:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.077+0000 7f89f17fa700 1 -- 172.21.15.79:0/1408202744 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f89e8007470 con 0x7f89f40b0c00 2023-10-19T08:37:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.077+0000 7f89f17fa700 1 --2- 172.21.15.79:0/1408202744 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f89d806a050 0x7f89d806c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:53.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.077+0000 7f89f17fa700 1 -- 172.21.15.79:0/1408202744 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f89e8087f30 con 0x7f89f40b0c00 2023-10-19T08:37:53.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.077+0000 7f89f3fff700 1 --2- 172.21.15.79:0/1408202744 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f89d806a050 0x7f89d806c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:53.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.078+0000 7f89f3fff700 1 --2- 172.21.15.79:0/1408202744 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f89d806a050 0x7f89d806c510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f89f409ebc0 tx=0x7f89e0010000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:53.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.082+0000 7f89f17fa700 1 -- 172.21.15.79:0/1408202744 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f89e8053930 con 0x7f89f40b0c00 2023-10-19T08:37:53.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.275+0000 7f89fb0c5700 1 -- 172.21.15.79:0/1408202744 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89f4066470 con 0x7f89f40b0c00 2023-10-19T08:37:53.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.276+0000 7f89f17fa700 1 -- 172.21.15.79:0/1408202744 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89e8056f50 con 0x7f89f40b0c00 2023-10-19T08:37:53.280 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:37:53.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.278+0000 7f89fb0c5700 1 -- 172.21.15.79:0/1408202744 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f89d806a050 msgr2=0x7f89d806c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:53.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.278+0000 7f89fb0c5700 1 --2- 172.21.15.79:0/1408202744 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f89d806a050 0x7f89d806c510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f89f409ebc0 tx=0x7f89e0010000 comp rx=0 tx=0).stop 2023-10-19T08:37:53.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.278+0000 7f89fb0c5700 1 -- 172.21.15.79:0/1408202744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40b0c00 msgr2=0x7f89f415a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:53.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.278+0000 7f89fb0c5700 1 --2- 172.21.15.79:0/1408202744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40b0c00 0x7f89f415a410 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f89e800c580 tx=0x7f89e800c940 comp rx=0 tx=0).stop 2023-10-19T08:37:53.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.278+0000 7f89fb0c5700 1 -- 172.21.15.79:0/1408202744 shutdown_connections 2023-10-19T08:37:53.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.278+0000 7f89fb0c5700 1 --2- 172.21.15.79:0/1408202744 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f89d806a050 0x7f89d806c510 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.278+0000 7f89fb0c5700 1 --2- 172.21.15.79:0/1408202744 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89f415e570 0x7f89f415d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.278+0000 7f89fb0c5700 1 --2- 172.21.15.79:0/1408202744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89f40b0c00 0x7f89f415a410 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.278+0000 7f89fb0c5700 1 --2- 172.21.15.79:0/1408202744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89f40cb6f0 0x7f89f415cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.278+0000 7f89fb0c5700 1 -- 172.21.15.79:0/1408202744 >> 172.21.15.79:0/1408202744 conn(0x7f89f409a0b0 msgr2=0x7f89f40b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:53.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.278+0000 7f89fb0c5700 1 -- 172.21.15.79:0/1408202744 shutdown_connections 2023-10-19T08:37:53.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.278+0000 7f89fb0c5700 1 -- 172.21.15.79:0/1408202744 wait complete. 2023-10-19T08:37:53.294 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:37:53.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.414+0000 7f83cbac3700 1 Processor -- start 2023-10-19T08:37:53.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.415+0000 7f83cbac3700 1 -- start start 2023-10-19T08:37:53.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.415+0000 7f83cbac3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f83c40b0c00 0x7f83c40d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:53.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.415+0000 7f83cbac3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83c40cb6f0 0x7f83c40ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:53.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.415+0000 7f83cbac3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c40b25f0 con 0x7f83c415e570 2023-10-19T08:37:53.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.415+0000 7f83cbac3700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c40afd60 con 0x7f83c40cb6f0 2023-10-19T08:37:53.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.415+0000 7f83cbac3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c40af810 con 0x7f83c40b0c00 2023-10-19T08:37:53.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.416+0000 7f83ca060700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83c40cb6f0 0x7f83c40ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:53.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.416+0000 7f83c985f700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f83c415e570 0x7f83c40b04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55654/0 (socket says 172.21.15.79:55654) 2023-10-19T08:37:53.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.416+0000 7f83ca060700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83c40cb6f0 0x7f83c40ad9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45586/0 (socket says 172.21.15.79:45586) 2023-10-19T08:37:53.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.416+0000 7f83c985f700 1 -- 172.21.15.79:0/748238905 learned_addr learned my addr 172.21.15.79:0/748238905 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:37:53.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.416+0000 7f83c905e700 1 --2- 172.21.15.79:0/748238905 >> v2:172.21.15.89:3300/0 conn(0x7f83c40b0c00 0x7f83c40d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:53.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.416+0000 7f83ca060700 1 -- 172.21.15.79:0/748238905 >> v2:172.21.15.89:3300/0 conn(0x7f83c40b0c00 msgr2=0x7f83c40d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:53.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.416+0000 7f83ca060700 1 --2- 172.21.15.79:0/748238905 >> v2:172.21.15.89:3300/0 conn(0x7f83c40b0c00 0x7f83c40d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.416+0000 7f83ca060700 1 -- 172.21.15.79:0/748238905 >> v1:172.21.15.79:6789/0 conn(0x7f83c415e570 legacy=0x7f83c40b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:53.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.416+0000 7f83ca060700 1 -- 172.21.15.79:0/748238905 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c40aef70 con 0x7f83c40cb6f0 2023-10-19T08:37:53.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.416+0000 7f83c885d700 1 -- 172.21.15.79:0/748238905 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129750555 0 0) 0x7f83c40b25f0 con 0x7f83c415e570 2023-10-19T08:37:53.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.416+0000 7f83ca060700 1 --2- 172.21.15.79:0/748238905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c40cb6f0 0x7f83c40ad9a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f83c40ce960 tx=0x7f83bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f9668df994b46d server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:53.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.416+0000 7f83c885d700 1 -- 172.21.15.79:0/748238905 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc00e070 con 0x7f83c40cb6f0 2023-10-19T08:37:53.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.416+0000 7f83c885d700 1 -- 172.21.15.79:0/748238905 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc00bbd0 con 0x7f83c40cb6f0 2023-10-19T08:37:53.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.416+0000 7f83c885d700 1 -- 172.21.15.79:0/748238905 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc012430 con 0x7f83c40cb6f0 2023-10-19T08:37:53.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.417+0000 7f83cbac3700 1 -- 172.21.15.79:0/748238905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c40cb6f0 msgr2=0x7f83c40ad9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:53.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.417+0000 7f83cbac3700 1 --2- 172.21.15.79:0/748238905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c40cb6f0 0x7f83c40ad9a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f83c40ce960 tx=0x7f83bc00b330 comp rx=0 tx=0).stop 2023-10-19T08:37:53.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.417+0000 7f83cbac3700 1 -- 172.21.15.79:0/748238905 shutdown_connections 2023-10-19T08:37:53.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.417+0000 7f83cbac3700 1 --2- 172.21.15.79:0/748238905 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c40cb6f0 0x7f83c40ad9a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.417+0000 7f83cbac3700 1 --2- 172.21.15.79:0/748238905 >> v2:172.21.15.89:3300/0 conn(0x7f83c40b0c00 0x7f83c40d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.417+0000 7f83cbac3700 1 -- 172.21.15.79:0/748238905 >> 172.21.15.79:0/748238905 conn(0x7f83c409a0b0 msgr2=0x7f83c40d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:53.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.417+0000 7f83cbac3700 1 -- 172.21.15.79:0/748238905 shutdown_connections 2023-10-19T08:37:53.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.417+0000 7f83cbac3700 1 -- 172.21.15.79:0/748238905 wait complete. 2023-10-19T08:37:53.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.418+0000 7f83cbac3700 1 Processor -- start 2023-10-19T08:37:53.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.418+0000 7f83cbac3700 1 -- start start 2023-10-19T08:37:53.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83cbac3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c40b0c00 0x7f83c40b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:53.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83cbac3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c40cb6f0 0x7f83c40c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:53.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83cbac3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c415e570 0x7f83c415b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:53.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83cbac3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c406c010 con 0x7f83c40cb6f0 2023-10-19T08:37:53.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83cbac3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c406b3d0 con 0x7f83c415e570 2023-10-19T08:37:53.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83cbac3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c406b670 con 0x7f83c40b0c00 2023-10-19T08:37:53.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83c905e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c40cb6f0 0x7f83c40c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:53.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83c905e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c40cb6f0 0x7f83c40c63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45590/0 (socket says 172.21.15.79:45590) 2023-10-19T08:37:53.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83c905e700 1 -- 172.21.15.79:0/671967710 learned_addr learned my addr 172.21.15.79:0/671967710 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:53.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83c985f700 1 --2- 172.21.15.79:0/671967710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c40b0c00 0x7f83c40b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:53.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83ca060700 1 --2- 172.21.15.79:0/671967710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c415e570 0x7f83c415b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:53.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83c905e700 1 -- 172.21.15.79:0/671967710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c40b0c00 msgr2=0x7f83c40b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:53.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83c905e700 1 --2- 172.21.15.79:0/671967710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c40b0c00 0x7f83c40b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83c905e700 1 -- 172.21.15.79:0/671967710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c415e570 msgr2=0x7f83c415b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:53.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83c905e700 1 --2- 172.21.15.79:0/671967710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c415e570 0x7f83c415b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83c905e700 1 -- 172.21.15.79:0/671967710 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc009a70 con 0x7f83c40cb6f0 2023-10-19T08:37:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83ca060700 1 --2- 172.21.15.79:0/671967710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c415e570 0x7f83c415b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:37:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83c985f700 1 --2- 172.21.15.79:0/671967710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c40b0c00 0x7f83c40b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:37:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83c905e700 1 --2- 172.21.15.79:0/671967710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c40cb6f0 0x7f83c40c63c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f83c000e810 tx=0x7f83c000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:53.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83ba7fc700 1 -- 172.21.15.79:0/671967710 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c0013610 con 0x7f83c40cb6f0 2023-10-19T08:37:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83ba7fc700 1 -- 172.21.15.79:0/671967710 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c0013770 con 0x7f83c40cb6f0 2023-10-19T08:37:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83cbac3700 1 -- 172.21.15.79:0/671967710 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c406b950 con 0x7f83c40cb6f0 2023-10-19T08:37:53.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83ba7fc700 1 -- 172.21.15.79:0/671967710 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c0013b20 con 0x7f83c40cb6f0 2023-10-19T08:37:53.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.419+0000 7f83cbac3700 1 -- 172.21.15.79:0/671967710 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c406c430 con 0x7f83c40cb6f0 2023-10-19T08:37:53.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.420+0000 7f83cbac3700 1 -- 172.21.15.79:0/671967710 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c406c150 con 0x7f83c40cb6f0 2023-10-19T08:37:53.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.421+0000 7f83ba7fc700 1 -- 172.21.15.79:0/671967710 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f83c0013c80 con 0x7f83c40cb6f0 2023-10-19T08:37:53.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.421+0000 7f83ba7fc700 1 --2- 172.21.15.79:0/671967710 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f83a806a0e0 0x7f83a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:53.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.421+0000 7f83ba7fc700 1 -- 172.21.15.79:0/671967710 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f83c0087f50 con 0x7f83c40cb6f0 2023-10-19T08:37:53.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.421+0000 7f83c985f700 1 --2- 172.21.15.79:0/671967710 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f83a806a0e0 0x7f83a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:53.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.422+0000 7f83c985f700 1 --2- 172.21.15.79:0/671967710 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f83a806a0e0 0x7f83a806c5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f83b4007fd0 tx=0x7f83b4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:53.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.426+0000 7f83ba7fc700 1 -- 172.21.15.79:0/671967710 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f83c406c150 con 0x7f83c40cb6f0 2023-10-19T08:37:53.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.616+0000 7f83cbac3700 1 -- 172.21.15.79:0/671967710 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f83c406c150 con 0x7f83c40cb6f0 2023-10-19T08:37:53.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.616+0000 7f83ba7fc700 1 -- 172.21.15.79:0/671967710 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f83c406c150 con 0x7f83c40cb6f0 2023-10-19T08:37:53.621 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:37:53.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.618+0000 7f83cbac3700 1 -- 172.21.15.79:0/671967710 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f83a806a0e0 msgr2=0x7f83a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:53.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.618+0000 7f83cbac3700 1 --2- 172.21.15.79:0/671967710 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f83a806a0e0 0x7f83a806c5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f83b4007fd0 tx=0x7f83b4009040 comp rx=0 tx=0).stop 2023-10-19T08:37:53.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.618+0000 7f83cbac3700 1 -- 172.21.15.79:0/671967710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c40cb6f0 msgr2=0x7f83c40c63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:53.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.618+0000 7f83cbac3700 1 --2- 172.21.15.79:0/671967710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c40cb6f0 0x7f83c40c63c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f83c000e810 tx=0x7f83c000ebd0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.618+0000 7f83cbac3700 1 -- 172.21.15.79:0/671967710 shutdown_connections 2023-10-19T08:37:53.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.618+0000 7f83cbac3700 1 --2- 172.21.15.79:0/671967710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83c415e570 0x7f83c415b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.618+0000 7f83cbac3700 1 --2- 172.21.15.79:0/671967710 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f83a806a0e0 0x7f83a806c5a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.618+0000 7f83cbac3700 1 --2- 172.21.15.79:0/671967710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83c40b0c00 0x7f83c40b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.618+0000 7f83cbac3700 1 --2- 172.21.15.79:0/671967710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83c40cb6f0 0x7f83c40c63c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.618+0000 7f83cbac3700 1 -- 172.21.15.79:0/671967710 >> 172.21.15.79:0/671967710 conn(0x7f83c409a0b0 msgr2=0x7f83c415c370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.618+0000 7f83cbac3700 1 -- 172.21.15.79:0/671967710 shutdown_connections 2023-10-19T08:37:53.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.618+0000 7f83cbac3700 1 -- 172.21.15.79:0/671967710 wait complete. 2023-10-19T08:37:53.634 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-19T08:37:53.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.750+0000 7efd4881a700 1 Processor -- start 2023-10-19T08:37:53.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.750+0000 7efd4881a700 1 -- start start 2023-10-19T08:37:53.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.751+0000 7efd4881a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd4415d8c0 0x7efd4406a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:53.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.751+0000 7efd4881a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd440cd550 con 0x7efd440af170 2023-10-19T08:37:53.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.751+0000 7efd4881a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4415de50 con 0x7efd440cd0c0 2023-10-19T08:37:53.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.751+0000 7efd4881a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd440af550 con 0x7efd4415d8c0 2023-10-19T08:37:53.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.751+0000 7efd42d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd4415d8c0 0x7efd4406a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.751+0000 7efd4259c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7efd440af170 0x7efd440b1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55678/0 (socket says 172.21.15.79:55678) 2023-10-19T08:37:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.751+0000 7efd4259c700 1 -- 172.21.15.79:0/654285517 learned_addr learned my addr 172.21.15.79:0/654285517 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:37:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.752+0000 7efd42d9d700 1 -- 172.21.15.79:0/654285517 >> v1:172.21.15.89:6789/0 conn(0x7efd440cd0c0 legacy=0x7efd440cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.752+0000 7efd42d9d700 1 -- 172.21.15.79:0/654285517 >> v1:172.21.15.79:6789/0 conn(0x7efd440af170 legacy=0x7efd440b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:53.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.752+0000 7efd42d9d700 1 -- 172.21.15.79:0/654285517 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4415e130 con 0x7efd4415d8c0 2023-10-19T08:37:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.752+0000 7efd4159a700 1 -- 172.21.15.79:0/654285517 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4082302144 0 0) 0x7efd38001110 con 0x7efd440af170 2023-10-19T08:37:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.752+0000 7efd42d9d700 1 --2- 172.21.15.79:0/654285517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd4415d8c0 0x7efd4406a220 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009dc0 tx=0x7efd3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d841dee0381c050 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.752+0000 7efd4159a700 1 -- 172.21.15.79:0/654285517 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c00e070 con 0x7efd4415d8c0 2023-10-19T08:37:53.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.752+0000 7efd4159a700 1 -- 172.21.15.79:0/654285517 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3c00bb90 con 0x7efd4415d8c0 2023-10-19T08:37:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.752+0000 7efd4159a700 1 -- 172.21.15.79:0/654285517 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c012430 con 0x7efd4415d8c0 2023-10-19T08:37:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.752+0000 7efd4881a700 1 -- 172.21.15.79:0/654285517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd4415d8c0 msgr2=0x7efd4406a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.752+0000 7efd4881a700 1 --2- 172.21.15.79:0/654285517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd4415d8c0 0x7efd4406a220 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efd3c009dc0 tx=0x7efd3c00b330 comp rx=0 tx=0).stop 2023-10-19T08:37:53.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.752+0000 7efd4881a700 1 -- 172.21.15.79:0/654285517 shutdown_connections 2023-10-19T08:37:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.752+0000 7efd4881a700 1 --2- 172.21.15.79:0/654285517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd4415d8c0 0x7efd4406a220 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.752+0000 7efd4881a700 1 -- 172.21.15.79:0/654285517 >> 172.21.15.79:0/654285517 conn(0x7efd4406dcc0 msgr2=0x7efd4406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:53.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.753+0000 7efd4881a700 1 -- 172.21.15.79:0/654285517 shutdown_connections 2023-10-19T08:37:53.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.753+0000 7efd4881a700 1 -- 172.21.15.79:0/654285517 wait complete. 2023-10-19T08:37:53.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.754+0000 7efd4881a700 1 Processor -- start 2023-10-19T08:37:53.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.754+0000 7efd4881a700 1 -- start start 2023-10-19T08:37:53.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.754+0000 7efd4881a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd440af170 0x7efd440c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:53.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.754+0000 7efd4881a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd440cd0c0 0x7efd44159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:53.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd4881a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd4415d8c0 0x7efd440b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:53.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd4881a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd44160380 con 0x7efd4415d8c0 2023-10-19T08:37:53.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd4881a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4415fdc0 con 0x7efd440af170 2023-10-19T08:37:53.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd4881a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd441600a0 con 0x7efd440cd0c0 2023-10-19T08:37:53.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd42d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd4415d8c0 0x7efd440b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:53.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd42d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd4415d8c0 0x7efd440b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45616/0 (socket says 172.21.15.79:45616) 2023-10-19T08:37:53.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd42d9d700 1 -- 172.21.15.79:0/2843860357 learned_addr learned my addr 172.21.15.79:0/2843860357 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:53.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd41d9b700 1 --2- 172.21.15.79:0/2843860357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd440cd0c0 0x7efd44159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd4259c700 1 --2- 172.21.15.79:0/2843860357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd440af170 0x7efd440c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd42d9d700 1 -- 172.21.15.79:0/2843860357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd440cd0c0 msgr2=0x7efd44159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd42d9d700 1 --2- 172.21.15.79:0/2843860357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd440cd0c0 0x7efd44159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd42d9d700 1 -- 172.21.15.79:0/2843860357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd440af170 msgr2=0x7efd440c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd42d9d700 1 --2- 172.21.15.79:0/2843860357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd440af170 0x7efd440c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd42d9d700 1 -- 172.21.15.79:0/2843860357 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3c009a70 con 0x7efd4415d8c0 2023-10-19T08:37:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd4259c700 1 --2- 172.21.15.79:0/2843860357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd440af170 0x7efd440c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:37:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd42d9d700 1 --2- 172.21.15.79:0/2843860357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd4415d8c0 0x7efd440b31b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efd44067670 tx=0x7efd3c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd32ffd700 1 -- 172.21.15.79:0/2843860357 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c01b810 con 0x7efd4415d8c0 2023-10-19T08:37:53.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd32ffd700 1 -- 172.21.15.79:0/2843860357 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3c020070 con 0x7efd4415d8c0 2023-10-19T08:37:53.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd4881a700 1 -- 172.21.15.79:0/2843860357 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd440c8580 con 0x7efd4415d8c0 2023-10-19T08:37:53.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd32ffd700 1 -- 172.21.15.79:0/2843860357 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c01bbb0 con 0x7efd4415d8c0 2023-10-19T08:37:53.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.755+0000 7efd4881a700 1 -- 172.21.15.79:0/2843860357 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd44159780 con 0x7efd4415d8c0 2023-10-19T08:37:53.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.756+0000 7efd4881a700 1 -- 172.21.15.79:0/2843860357 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd440b18b0 con 0x7efd4415d8c0 2023-10-19T08:37:53.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.757+0000 7efd32ffd700 1 -- 172.21.15.79:0/2843860357 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efd3c01bd10 con 0x7efd4415d8c0 2023-10-19T08:37:53.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.757+0000 7efd32ffd700 1 --2- 172.21.15.79:0/2843860357 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efd2406a110 0x7efd2406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:53.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.757+0000 7efd32ffd700 1 -- 172.21.15.79:0/2843860357 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7efd3c022070 con 0x7efd4415d8c0 2023-10-19T08:37:53.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.757+0000 7efd4259c700 1 --2- 172.21.15.79:0/2843860357 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efd2406a110 0x7efd2406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:53.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.757+0000 7efd4259c700 1 --2- 172.21.15.79:0/2843860357 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efd2406a110 0x7efd2406c5d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efd38000f60 tx=0x7efd38007e50 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:53.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.761+0000 7efd32ffd700 1 -- 172.21.15.79:0/2843860357 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7efd3c059550 con 0x7efd4415d8c0 2023-10-19T08:37:53.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.954+0000 7efd4881a700 1 -- 172.21.15.79:0/2843860357 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efd440c8aa0 con 0x7efd4415d8c0 2023-10-19T08:37:53.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.954+0000 7efd32ffd700 1 -- 172.21.15.79:0/2843860357 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7efd3c0590e0 con 0x7efd4415d8c0 2023-10-19T08:37:53.959 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:37:53.959 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2023-10-19T08:37:53.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:37:53.960 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2023-10-19T08:37:53.960 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2023-10-19T08:37:53.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:37:53.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:37:53.960 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 2, 2023-10-19T08:37:53.961 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": "rbd" 2023-10-19T08:37:53.961 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:37:53.961 INFO:teuthology.orchestra.run.smithi079.stdout:] 2023-10-19T08:37:53.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.956+0000 7efd4881a700 1 -- 172.21.15.79:0/2843860357 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efd2406a110 msgr2=0x7efd2406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:53.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.956+0000 7efd4881a700 1 --2- 172.21.15.79:0/2843860357 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efd2406a110 0x7efd2406c5d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efd38000f60 tx=0x7efd38007e50 comp rx=0 tx=0).stop 2023-10-19T08:37:53.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.956+0000 7efd4881a700 1 -- 172.21.15.79:0/2843860357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd4415d8c0 msgr2=0x7efd440b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:53.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.956+0000 7efd4881a700 1 --2- 172.21.15.79:0/2843860357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd4415d8c0 0x7efd440b31b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7efd44067670 tx=0x7efd3c004ad0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.956+0000 7efd4881a700 1 -- 172.21.15.79:0/2843860357 shutdown_connections 2023-10-19T08:37:53.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.956+0000 7efd4881a700 1 --2- 172.21.15.79:0/2843860357 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd4415d8c0 0x7efd440b31b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.956+0000 7efd4881a700 1 --2- 172.21.15.79:0/2843860357 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd440af170 0x7efd440c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.956+0000 7efd4881a700 1 --2- 172.21.15.79:0/2843860357 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efd2406a110 0x7efd2406c5d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.956+0000 7efd4881a700 1 --2- 172.21.15.79:0/2843860357 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd440cd0c0 0x7efd44159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:53.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.956+0000 7efd4881a700 1 -- 172.21.15.79:0/2843860357 >> 172.21.15.79:0/2843860357 conn(0x7efd4406dcc0 msgr2=0x7efd440af690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:53.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.956+0000 7efd4881a700 1 -- 172.21.15.79:0/2843860357 shutdown_connections 2023-10-19T08:37:53.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:53.956+0000 7efd4881a700 1 -- 172.21.15.79:0/2843860357 wait complete. 2023-10-19T08:37:53.972 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-19T08:37:53.972 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-19T08:37:54.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.092+0000 7fa90fc65700 1 Processor -- start 2023-10-19T08:37:54.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.092+0000 7fa90fc65700 1 -- start start 2023-10-19T08:37:54.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.093+0000 7fa90fc65700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa9080ce2f0 0x7fa908161a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:54.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.093+0000 7fa90fc65700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9080ce6d0 0x7fa9080b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:54.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.093+0000 7fa90fc65700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa9080cc660 0x7fa90806fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:54.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.093+0000 7fa90fc65700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9080b26e0 con 0x7fa9080cc660 2023-10-19T08:37:54.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.093+0000 7fa90fc65700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa908162080 con 0x7fa9080ce2f0 2023-10-19T08:37:54.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.093+0000 7fa90fc65700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa908162360 con 0x7fa9080ce6d0 2023-10-19T08:37:54.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.093+0000 7fa90e202700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa9080cc660 0x7fa90806fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:54.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.093+0000 7fa90e202700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa9080cc660 0x7fa90806fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45624/0 (socket says 172.21.15.79:45624) 2023-10-19T08:37:54.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.093+0000 7fa90e202700 1 -- 172.21.15.79:0/1713545988 learned_addr learned my addr 172.21.15.79:0/1713545988 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:54.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.093+0000 7fa90d200700 1 --2- 172.21.15.79:0/1713545988 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9080ce6d0 0x7fa9080b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:54.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.093+0000 7fa90da01700 1 --2- 172.21.15.79:0/1713545988 >> v2:172.21.15.89:3300/0 conn(0x7fa9080ce2f0 0x7fa908161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:54.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.094+0000 7fa90e202700 1 -- 172.21.15.79:0/1713545988 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9080ce6d0 msgr2=0x7fa9080b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:54.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.094+0000 7fa90e202700 1 --2- 172.21.15.79:0/1713545988 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9080ce6d0 0x7fa9080b21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:54.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.094+0000 7fa90e202700 1 -- 172.21.15.79:0/1713545988 >> v2:172.21.15.89:3300/0 conn(0x7fa9080ce2f0 msgr2=0x7fa908161a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:54.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.094+0000 7fa90e202700 1 --2- 172.21.15.79:0/1713545988 >> v2:172.21.15.89:3300/0 conn(0x7fa9080ce2f0 0x7fa908161a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:54.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.094+0000 7fa90e202700 1 -- 172.21.15.79:0/1713545988 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa908162640 con 0x7fa9080cc660 2023-10-19T08:37:54.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.094+0000 7fa90e202700 1 --2- 172.21.15.79:0/1713545988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9080cc660 0x7fa90806fd80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa9080d0de0 tx=0x7fa90000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c011a0f08a76ec86 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:54.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.094+0000 7fa90c9ff700 1 -- 172.21.15.79:0/1713545988 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90000e070 con 0x7fa9080cc660 2023-10-19T08:37:54.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.094+0000 7fa90c9ff700 1 -- 172.21.15.79:0/1713545988 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90000b910 con 0x7fa9080cc660 2023-10-19T08:37:54.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.094+0000 7fa90c9ff700 1 -- 172.21.15.79:0/1713545988 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90000bcc0 con 0x7fa9080cc660 2023-10-19T08:37:54.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.095+0000 7fa90fc65700 1 -- 172.21.15.79:0/1713545988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9080cc660 msgr2=0x7fa90806fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:54.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.095+0000 7fa90fc65700 1 --2- 172.21.15.79:0/1713545988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9080cc660 0x7fa90806fd80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa9080d0de0 tx=0x7fa90000b330 comp rx=0 tx=0).stop 2023-10-19T08:37:54.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.095+0000 7fa90fc65700 1 -- 172.21.15.79:0/1713545988 shutdown_connections 2023-10-19T08:37:54.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.095+0000 7fa90fc65700 1 --2- 172.21.15.79:0/1713545988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9080cc660 0x7fa90806fd80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:54.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.095+0000 7fa90fc65700 1 --2- 172.21.15.79:0/1713545988 >> v2:172.21.15.89:3300/0 conn(0x7fa9080ce2f0 0x7fa908161a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:54.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.095+0000 7fa90fc65700 1 --2- 172.21.15.79:0/1713545988 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9080ce6d0 0x7fa9080b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:54.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.095+0000 7fa90fc65700 1 -- 172.21.15.79:0/1713545988 >> 172.21.15.79:0/1713545988 conn(0x7fa90806dd90 msgr2=0x7fa90806e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:54.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.095+0000 7fa90fc65700 1 -- 172.21.15.79:0/1713545988 shutdown_connections 2023-10-19T08:37:54.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.095+0000 7fa90fc65700 1 -- 172.21.15.79:0/1713545988 wait complete. 2023-10-19T08:37:54.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.096+0000 7fa90fc65700 1 Processor -- start 2023-10-19T08:37:54.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.096+0000 7fa90fc65700 1 -- start start 2023-10-19T08:37:54.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa90fc65700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9080cc660 0x7fa9081fac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:54.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa90fc65700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9080ce2f0 0x7fa9080b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:54.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa90fc65700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9080ce6d0 0x7fa908160040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:54.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa90fc65700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9081ec140 con 0x7fa9080ce6d0 2023-10-19T08:37:54.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa90fc65700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9081fb180 con 0x7fa9080ce2f0 2023-10-19T08:37:54.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa90fc65700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9081f7050 con 0x7fa9080cc660 2023-10-19T08:37:54.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa90e202700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9080ce6d0 0x7fa908160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:54.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa90e202700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9080ce6d0 0x7fa908160040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45630/0 (socket says 172.21.15.79:45630) 2023-10-19T08:37:54.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa90e202700 1 -- 172.21.15.79:0/3919403780 learned_addr learned my addr 172.21.15.79:0/3919403780 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:54.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa90da01700 1 --2- 172.21.15.79:0/3919403780 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9080cc660 0x7fa9081fac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:54.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa90d200700 1 --2- 172.21.15.79:0/3919403780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9080ce2f0 0x7fa9080b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:54.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa90e202700 1 -- 172.21.15.79:0/3919403780 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9080cc660 msgr2=0x7fa9081fac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:54.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa90e202700 1 --2- 172.21.15.79:0/3919403780 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9080cc660 0x7fa9081fac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:54.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa90e202700 1 -- 172.21.15.79:0/3919403780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9080ce2f0 msgr2=0x7fa9080b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:54.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa90e202700 1 --2- 172.21.15.79:0/3919403780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9080ce2f0 0x7fa9080b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:54.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa90e202700 1 -- 172.21.15.79:0/3919403780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa900009b30 con 0x7fa9080ce6d0 2023-10-19T08:37:54.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa90e202700 1 --2- 172.21.15.79:0/3919403780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9080ce6d0 0x7fa908160040 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa90806db90 tx=0x7fa900004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:54.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa8fe7fc700 1 -- 172.21.15.79:0/3919403780 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9000099b0 con 0x7fa9080ce6d0 2023-10-19T08:37:54.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa8fe7fc700 1 -- 172.21.15.79:0/3919403780 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9000092e0 con 0x7fa9080ce6d0 2023-10-19T08:37:54.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.097+0000 7fa90fc65700 1 -- 172.21.15.79:0/3919403780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9081f7330 con 0x7fa9080ce6d0 2023-10-19T08:37:54.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.098+0000 7fa8fe7fc700 1 -- 172.21.15.79:0/3919403780 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa900004470 con 0x7fa9080ce6d0 2023-10-19T08:37:54.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.098+0000 7fa90fc65700 1 -- 172.21.15.79:0/3919403780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9081f78f0 con 0x7fa9080ce6d0 2023-10-19T08:37:54.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.098+0000 7fa90fc65700 1 -- 172.21.15.79:0/3919403780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9081ec280 con 0x7fa9080ce6d0 2023-10-19T08:37:54.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.099+0000 7fa8fe7fc700 1 -- 172.21.15.79:0/3919403780 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa9000045d0 con 0x7fa9080ce6d0 2023-10-19T08:37:54.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.099+0000 7fa8fe7fc700 1 --2- 172.21.15.79:0/3919403780 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa8ec06a0e0 0x7fa8ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:54.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.099+0000 7fa8fe7fc700 1 -- 172.21.15.79:0/3919403780 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa9000896f0 con 0x7fa9080ce6d0 2023-10-19T08:37:54.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.099+0000 7fa90da01700 1 --2- 172.21.15.79:0/3919403780 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa8ec06a0e0 0x7fa8ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:54.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.100+0000 7fa90da01700 1 --2- 172.21.15.79:0/3919403780 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa8ec06a0e0 0x7fa8ec06c5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa904009b60 tx=0x7fa904009210 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:54.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.103+0000 7fa8fe7fc700 1 -- 172.21.15.79:0/3919403780 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa9000551c0 con 0x7fa9080ce6d0 2023-10-19T08:37:54.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:54.299+0000 7fa90fc65700 1 -- 172.21.15.79:0/3919403780 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa90804ee70 con 0x7fa9080ce6d0 2023-10-19T08:37:55.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.262+0000 7fa8fe7fc700 1 -- 172.21.15.79:0/3919403780 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa9000587e0 con 0x7fa9080ce6d0 2023-10-19T08:37:55.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.265+0000 7fa90fc65700 1 -- 172.21.15.79:0/3919403780 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa8ec06a0e0 msgr2=0x7fa8ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:55.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.265+0000 7fa90fc65700 1 --2- 172.21.15.79:0/3919403780 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa8ec06a0e0 0x7fa8ec06c5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa904009b60 tx=0x7fa904009210 comp rx=0 tx=0).stop 2023-10-19T08:37:55.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.265+0000 7fa90fc65700 1 -- 172.21.15.79:0/3919403780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9080ce6d0 msgr2=0x7fa908160040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:55.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.265+0000 7fa90fc65700 1 --2- 172.21.15.79:0/3919403780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9080ce6d0 0x7fa908160040 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa90806db90 tx=0x7fa900004ad0 comp rx=0 tx=0).stop 2023-10-19T08:37:55.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.266+0000 7fa90fc65700 1 -- 172.21.15.79:0/3919403780 shutdown_connections 2023-10-19T08:37:55.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.266+0000 7fa90fc65700 1 --2- 172.21.15.79:0/3919403780 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9080ce6d0 0x7fa908160040 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:55.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.266+0000 7fa90fc65700 1 --2- 172.21.15.79:0/3919403780 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa8ec06a0e0 0x7fa8ec06c5a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:55.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.266+0000 7fa90fc65700 1 --2- 172.21.15.79:0/3919403780 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa9080cc660 0x7fa9081fac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:55.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.266+0000 7fa90fc65700 1 --2- 172.21.15.79:0/3919403780 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9080ce2f0 0x7fa9080b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:55.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.266+0000 7fa90fc65700 1 -- 172.21.15.79:0/3919403780 >> 172.21.15.79:0/3919403780 conn(0x7fa90806dd90 msgr2=0x7fa908164810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:55.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.266+0000 7fa90fc65700 1 -- 172.21.15.79:0/3919403780 shutdown_connections 2023-10-19T08:37:55.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.267+0000 7fa90fc65700 1 -- 172.21.15.79:0/3919403780 wait complete. 2023-10-19T08:37:55.275 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2023-10-19T08:37:55.286 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-19T08:37:55.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.409+0000 7fc594c50700 1 Processor -- start 2023-10-19T08:37:55.414 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.409+0000 7fc594c50700 1 -- start start 2023-10-19T08:37:55.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.410+0000 7fc594c50700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc59015aec0 0x7fc5900d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:55.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.410+0000 7fc594c50700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5900d0790 0x7fc5900b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:55.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.410+0000 7fc594c50700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc5900b2d20 0x7fc5900af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:55.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.410+0000 7fc594c50700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59015b2a0 con 0x7fc5900b2d20 2023-10-19T08:37:55.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.410+0000 7fc594c50700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5900b3130 con 0x7fc5900d0790 2023-10-19T08:37:55.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.410+0000 7fc594c50700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5900cf140 con 0x7fc59015aec0 2023-10-19T08:37:55.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.410+0000 7fc58ed9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc5900b2d20 0x7fc5900af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:55.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.411+0000 7fc58ed9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc5900b2d20 0x7fc5900af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45638/0 (socket says 172.21.15.79:45638) 2023-10-19T08:37:55.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.411+0000 7fc58ed9d700 1 -- 172.21.15.79:0/144628679 learned_addr learned my addr 172.21.15.79:0/144628679 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:55.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.411+0000 7fc58e59c700 1 --2- 172.21.15.79:0/144628679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc59015aec0 0x7fc5900d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:55.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.411+0000 7fc58ed9d700 1 -- 172.21.15.79:0/144628679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc59015aec0 msgr2=0x7fc5900d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:55.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.411+0000 7fc58ed9d700 1 --2- 172.21.15.79:0/144628679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc59015aec0 0x7fc5900d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:55.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.411+0000 7fc58dd9b700 1 --2- 172.21.15.79:0/144628679 >> v2:172.21.15.89:3300/0 conn(0x7fc5900d0790 0x7fc5900b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:55.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.411+0000 7fc58ed9d700 1 -- 172.21.15.79:0/144628679 >> v2:172.21.15.89:3300/0 conn(0x7fc5900d0790 msgr2=0x7fc5900b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:55.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.411+0000 7fc58ed9d700 1 --2- 172.21.15.79:0/144628679 >> v2:172.21.15.89:3300/0 conn(0x7fc5900d0790 0x7fc5900b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:55.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.411+0000 7fc58ed9d700 1 -- 172.21.15.79:0/144628679 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5900cf420 con 0x7fc5900b2d20 2023-10-19T08:37:55.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.411+0000 7fc58e59c700 1 --2- 172.21.15.79:0/144628679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc59015aec0 0x7fc5900d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:37:55.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.411+0000 7fc58dd9b700 1 --2- 172.21.15.79:0/144628679 >> v2:172.21.15.89:3300/0 conn(0x7fc5900d0790 0x7fc5900b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:37:55.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.411+0000 7fc58ed9d700 1 --2- 172.21.15.79:0/144628679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5900b2d20 0x7fc5900af7d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc5900718c0 tx=0x7fc58800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d788885aab4168e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:55.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.411+0000 7fc58d59a700 1 -- 172.21.15.79:0/144628679 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58800e070 con 0x7fc5900b2d20 2023-10-19T08:37:55.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.411+0000 7fc58d59a700 1 -- 172.21.15.79:0/144628679 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58800b9c0 con 0x7fc5900b2d20 2023-10-19T08:37:55.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.411+0000 7fc58d59a700 1 -- 172.21.15.79:0/144628679 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58800bd70 con 0x7fc5900b2d20 2023-10-19T08:37:55.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.412+0000 7fc594c50700 1 -- 172.21.15.79:0/144628679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5900b2d20 msgr2=0x7fc5900af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:55.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.412+0000 7fc594c50700 1 --2- 172.21.15.79:0/144628679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5900b2d20 0x7fc5900af7d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc5900718c0 tx=0x7fc58800b330 comp rx=0 tx=0).stop 2023-10-19T08:37:55.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.412+0000 7fc594c50700 1 -- 172.21.15.79:0/144628679 shutdown_connections 2023-10-19T08:37:55.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.412+0000 7fc594c50700 1 --2- 172.21.15.79:0/144628679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc59015aec0 0x7fc5900d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:55.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.412+0000 7fc594c50700 1 --2- 172.21.15.79:0/144628679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5900b2d20 0x7fc5900af7d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:55.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.412+0000 7fc594c50700 1 --2- 172.21.15.79:0/144628679 >> v2:172.21.15.89:3300/0 conn(0x7fc5900d0790 0x7fc5900b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:55.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.412+0000 7fc594c50700 1 -- 172.21.15.79:0/144628679 >> 172.21.15.79:0/144628679 conn(0x7fc5900cd7e0 msgr2=0x7fc5900cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:55.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.412+0000 7fc594c50700 1 -- 172.21.15.79:0/144628679 shutdown_connections 2023-10-19T08:37:55.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.412+0000 7fc594c50700 1 -- 172.21.15.79:0/144628679 wait complete. 2023-10-19T08:37:55.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.413+0000 7fc594c50700 1 Processor -- start 2023-10-19T08:37:55.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.413+0000 7fc594c50700 1 -- start start 2023-10-19T08:37:55.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc594c50700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5900b2d20 0x7fc5900b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:55.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc594c50700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5900d0790 0x7fc59006bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:55.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc594c50700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc59015aec0 0x7fc59015d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:55.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc594c50700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59006d3f0 con 0x7fc59015aec0 2023-10-19T08:37:55.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc594c50700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59015d9e0 con 0x7fc5900d0790 2023-10-19T08:37:55.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc594c50700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59006cf60 con 0x7fc5900b2d20 2023-10-19T08:37:55.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc58ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc59015aec0 0x7fc59015d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:55.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc58ed9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc59015aec0 0x7fc59015d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45648/0 (socket says 172.21.15.79:45648) 2023-10-19T08:37:55.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc58ed9d700 1 -- 172.21.15.79:0/1753228043 learned_addr learned my addr 172.21.15.79:0/1753228043 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:55.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc58e59c700 1 --2- 172.21.15.79:0/1753228043 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5900b2d20 0x7fc5900b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:55.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc58dd9b700 1 --2- 172.21.15.79:0/1753228043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5900d0790 0x7fc59006bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:55.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc58ed9d700 1 -- 172.21.15.79:0/1753228043 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5900b2d20 msgr2=0x7fc5900b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:55.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc58ed9d700 1 --2- 172.21.15.79:0/1753228043 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5900b2d20 0x7fc5900b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:55.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc58ed9d700 1 -- 172.21.15.79:0/1753228043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5900d0790 msgr2=0x7fc59006bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:55.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc58ed9d700 1 --2- 172.21.15.79:0/1753228043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5900d0790 0x7fc59006bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:55.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc58ed9d700 1 -- 172.21.15.79:0/1753228043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc588009b30 con 0x7fc59015aec0 2023-10-19T08:37:55.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc58dd9b700 1 --2- 172.21.15.79:0/1753228043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5900d0790 0x7fc59006bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:37:55.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc58ed9d700 1 --2- 172.21.15.79:0/1753228043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc59015aec0 0x7fc59015d4a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc58800b370 tx=0x7fc588004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:55.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc57effd700 1 -- 172.21.15.79:0/1753228043 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc588004310 con 0x7fc59015aec0 2023-10-19T08:37:55.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc57effd700 1 -- 172.21.15.79:0/1753228043 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc588004470 con 0x7fc59015aec0 2023-10-19T08:37:55.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc57effd700 1 -- 172.21.15.79:0/1753228043 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc588004820 con 0x7fc59015aec0 2023-10-19T08:37:55.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc594c50700 1 -- 172.21.15.79:0/1753228043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59006c350 con 0x7fc59015aec0 2023-10-19T08:37:55.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.414+0000 7fc594c50700 1 -- 172.21.15.79:0/1753228043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59006c910 con 0x7fc59015aec0 2023-10-19T08:37:55.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.415+0000 7fc594c50700 1 -- 172.21.15.79:0/1753228043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc590067470 con 0x7fc59015aec0 2023-10-19T08:37:55.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.416+0000 7fc57effd700 1 -- 172.21.15.79:0/1753228043 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc58801c440 con 0x7fc59015aec0 2023-10-19T08:37:55.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.416+0000 7fc57effd700 1 --2- 172.21.15.79:0/1753228043 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc57006a0e0 0x7fc57006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:55.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.416+0000 7fc57effd700 1 -- 172.21.15.79:0/1753228043 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fc588089970 con 0x7fc59015aec0 2023-10-19T08:37:55.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.416+0000 7fc58e59c700 1 --2- 172.21.15.79:0/1753228043 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc57006a0e0 0x7fc57006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:55.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.416+0000 7fc58e59c700 1 --2- 172.21.15.79:0/1753228043 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc57006a0e0 0x7fc57006c5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc584006fd0 tx=0x7fc584008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:55.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.421+0000 7fc57effd700 1 -- 172.21.15.79:0/1753228043 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc5880552d0 con 0x7fc59015aec0 2023-10-19T08:37:55.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:55.610+0000 7fc594c50700 1 -- 172.21.15.79:0/1753228043 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fc59004ee70 con 0x7fc59015aec0 2023-10-19T08:37:56.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.265+0000 7fc57effd700 1 -- 172.21.15.79:0/1753228043 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7fc5880200d0 con 0x7fc59015aec0 2023-10-19T08:37:56.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.268+0000 7fc594c50700 1 -- 172.21.15.79:0/1753228043 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc57006a0e0 msgr2=0x7fc57006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:56.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.268+0000 7fc594c50700 1 --2- 172.21.15.79:0/1753228043 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc57006a0e0 0x7fc57006c5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc584006fd0 tx=0x7fc584008040 comp rx=0 tx=0).stop 2023-10-19T08:37:56.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.268+0000 7fc594c50700 1 -- 172.21.15.79:0/1753228043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc59015aec0 msgr2=0x7fc59015d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:56.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.268+0000 7fc594c50700 1 --2- 172.21.15.79:0/1753228043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc59015aec0 0x7fc59015d4a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc58800b370 tx=0x7fc588004ad0 comp rx=0 tx=0).stop 2023-10-19T08:37:56.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.269+0000 7fc594c50700 1 -- 172.21.15.79:0/1753228043 shutdown_connections 2023-10-19T08:37:56.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.269+0000 7fc594c50700 1 --2- 172.21.15.79:0/1753228043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc59015aec0 0x7fc59015d4a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:56.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.269+0000 7fc594c50700 1 --2- 172.21.15.79:0/1753228043 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc57006a0e0 0x7fc57006c5a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:56.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.269+0000 7fc594c50700 1 --2- 172.21.15.79:0/1753228043 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5900b2d20 0x7fc5900b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:56.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.269+0000 7fc594c50700 1 --2- 172.21.15.79:0/1753228043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5900d0790 0x7fc59006bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:56.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.269+0000 7fc594c50700 1 -- 172.21.15.79:0/1753228043 >> 172.21.15.79:0/1753228043 conn(0x7fc5900cd7e0 msgr2=0x7fc59015a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:56.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.270+0000 7fc594c50700 1 -- 172.21.15.79:0/1753228043 shutdown_connections 2023-10-19T08:37:56.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.271+0000 7fc594c50700 1 -- 172.21.15.79:0/1753228043 wait complete. 2023-10-19T08:37:56.284 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2023-10-19T08:37:56.298 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-19T08:37:56.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.418+0000 7f65f5d2d700 1 Processor -- start 2023-10-19T08:37:56.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.418+0000 7f65f5d2d700 1 -- start start 2023-10-19T08:37:56.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.419+0000 7f65f5d2d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f65f015e570 0x7f65f00d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:56.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.419+0000 7f65f5d2d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65f00b0c00 0x7f65f00ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:56.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.419+0000 7f65f5d2d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f00b25f0 con 0x7f65f00cb6f0 2023-10-19T08:37:56.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.419+0000 7f65f5d2d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f00afd60 con 0x7f65f00b0c00 2023-10-19T08:37:56.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.419+0000 7f65f5d2d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f00af810 con 0x7f65f015e570 2023-10-19T08:37:56.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.419+0000 7f65effff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65f00b0c00 0x7f65f00ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:56.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.419+0000 7f65effff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65f00b0c00 0x7f65f00ad9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45656/0 (socket says 172.21.15.79:45656) 2023-10-19T08:37:56.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.419+0000 7f65effff700 1 -- 172.21.15.79:0/4118526857 learned_addr learned my addr 172.21.15.79:0/4118526857 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:56.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.419+0000 7f65ef7fe700 1 --2- 172.21.15.79:0/4118526857 >> v2:172.21.15.89:3300/0 conn(0x7f65f015e570 0x7f65f00d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:56.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.419+0000 7f65effff700 1 -- 172.21.15.79:0/4118526857 >> v2:172.21.15.89:3300/0 conn(0x7f65f015e570 msgr2=0x7f65f00d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:56.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.419+0000 7f65effff700 1 --2- 172.21.15.79:0/4118526857 >> v2:172.21.15.89:3300/0 conn(0x7f65f015e570 0x7f65f00d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:56.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.419+0000 7f65effff700 1 -- 172.21.15.79:0/4118526857 >> v1:172.21.15.89:6789/0 conn(0x7f65f00cb6f0 legacy=0x7f65f00b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:56.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.419+0000 7f65effff700 1 -- 172.21.15.79:0/4118526857 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f00aef70 con 0x7f65f00b0c00 2023-10-19T08:37:56.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.420+0000 7f65effff700 1 --2- 172.21.15.79:0/4118526857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f00b0c00 0x7f65f00ad9a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f65f0071540 tx=0x7f65e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b4c26191bb6deb server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:56.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.420+0000 7f65eeffd700 1 -- 172.21.15.79:0/4118526857 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e800e070 con 0x7f65f00b0c00 2023-10-19T08:37:56.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.420+0000 7f65eeffd700 1 -- 172.21.15.79:0/4118526857 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e8003a20 con 0x7f65f00b0c00 2023-10-19T08:37:56.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.420+0000 7f65eeffd700 1 -- 172.21.15.79:0/4118526857 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8003dd0 con 0x7f65f00b0c00 2023-10-19T08:37:56.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.420+0000 7f65f5d2d700 1 -- 172.21.15.79:0/4118526857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f00b0c00 msgr2=0x7f65f00ad9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:56.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.420+0000 7f65f5d2d700 1 --2- 172.21.15.79:0/4118526857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f00b0c00 0x7f65f00ad9a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f65f0071540 tx=0x7f65e800b330 comp rx=0 tx=0).stop 2023-10-19T08:37:56.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.420+0000 7f65f5d2d700 1 -- 172.21.15.79:0/4118526857 shutdown_connections 2023-10-19T08:37:56.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.420+0000 7f65f5d2d700 1 --2- 172.21.15.79:0/4118526857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f00b0c00 0x7f65f00ad9a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:56.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.420+0000 7f65f5d2d700 1 --2- 172.21.15.79:0/4118526857 >> v2:172.21.15.89:3300/0 conn(0x7f65f015e570 0x7f65f00d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:56.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.420+0000 7f65f5d2d700 1 -- 172.21.15.79:0/4118526857 >> 172.21.15.79:0/4118526857 conn(0x7f65f009a0b0 msgr2=0x7f65f00d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:56.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.420+0000 7f65f5d2d700 1 -- 172.21.15.79:0/4118526857 shutdown_connections 2023-10-19T08:37:56.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.420+0000 7f65f5d2d700 1 -- 172.21.15.79:0/4118526857 wait complete. 2023-10-19T08:37:56.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.422+0000 7f65f5d2d700 1 Processor -- start 2023-10-19T08:37:56.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.422+0000 7f65f5d2d700 1 -- start start 2023-10-19T08:37:56.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.422+0000 7f65f5d2d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f00b0c00 0x7f65f01f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:56.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.422+0000 7f65f5d2d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f00cb6f0 0x7f65f0151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:56.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.422+0000 7f65f5d2d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65f015e570 0x7f65f0154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:56.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.422+0000 7f65f5d2d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f0152150 con 0x7f65f00b0c00 2023-10-19T08:37:56.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.422+0000 7f65f5d2d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f01551c0 con 0x7f65f00cb6f0 2023-10-19T08:37:56.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.422+0000 7f65f5d2d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f01554a0 con 0x7f65f015e570 2023-10-19T08:37:56.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.423+0000 7f65ef7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f00b0c00 0x7f65f01f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:56.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.423+0000 7f65ef7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f00b0c00 0x7f65f01f0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45658/0 (socket says 172.21.15.79:45658) 2023-10-19T08:37:56.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.423+0000 7f65ef7fe700 1 -- 172.21.15.79:0/2605783300 learned_addr learned my addr 172.21.15.79:0/2605783300 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:56.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.423+0000 7f65effff700 1 --2- 172.21.15.79:0/2605783300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65f015e570 0x7f65f0154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:56.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.423+0000 7f65e6ffd700 1 --2- 172.21.15.79:0/2605783300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f00cb6f0 0x7f65f0151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:56.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.423+0000 7f65ef7fe700 1 -- 172.21.15.79:0/2605783300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65f015e570 msgr2=0x7f65f0154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:56.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.423+0000 7f65ef7fe700 1 --2- 172.21.15.79:0/2605783300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65f015e570 0x7f65f0154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:56.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.423+0000 7f65ef7fe700 1 -- 172.21.15.79:0/2605783300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f00cb6f0 msgr2=0x7f65f0151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:56.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.423+0000 7f65ef7fe700 1 --2- 172.21.15.79:0/2605783300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f00cb6f0 0x7f65f0151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:56.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.423+0000 7f65ef7fe700 1 -- 172.21.15.79:0/2605783300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e8009b30 con 0x7f65f00b0c00 2023-10-19T08:37:56.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.423+0000 7f65ef7fe700 1 --2- 172.21.15.79:0/2605783300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f00b0c00 0x7f65f01f0ee0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f65e000d800 tx=0x7f65e000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:56.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.423+0000 7f65ecff9700 1 -- 172.21.15.79:0/2605783300 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e00125f0 con 0x7f65f00b0c00 2023-10-19T08:37:56.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.423+0000 7f65ecff9700 1 -- 172.21.15.79:0/2605783300 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e0012750 con 0x7f65f00b0c00 2023-10-19T08:37:56.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.423+0000 7f65f5d2d700 1 -- 172.21.15.79:0/2605783300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f01f06e0 con 0x7f65f00b0c00 2023-10-19T08:37:56.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.423+0000 7f65ecff9700 1 -- 172.21.15.79:0/2605783300 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e0012b00 con 0x7f65f00b0c00 2023-10-19T08:37:56.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.423+0000 7f65f5d2d700 1 -- 172.21.15.79:0/2605783300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f01f0390 con 0x7f65f00b0c00 2023-10-19T08:37:56.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.424+0000 7f65f5d2d700 1 -- 172.21.15.79:0/2605783300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f01f0550 con 0x7f65f00b0c00 2023-10-19T08:37:56.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.425+0000 7f65ecff9700 1 -- 172.21.15.79:0/2605783300 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f65e0012c60 con 0x7f65f00b0c00 2023-10-19T08:37:56.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.425+0000 7f65ecff9700 1 --2- 172.21.15.79:0/2605783300 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f65d006a0e0 0x7f65d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:56.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.425+0000 7f65e6ffd700 1 --2- 172.21.15.79:0/2605783300 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f65d006a0e0 0x7f65d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:56.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.425+0000 7f65ecff9700 1 -- 172.21.15.79:0/2605783300 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f65e00887b0 con 0x7f65f00b0c00 2023-10-19T08:37:56.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.426+0000 7f65e6ffd700 1 --2- 172.21.15.79:0/2605783300 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f65d006a0e0 0x7f65d006c5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f65f0154280 tx=0x7f65d8007ce0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:56.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.430+0000 7f65ecff9700 1 -- 172.21.15.79:0/2605783300 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f65e0053f00 con 0x7f65f00b0c00 2023-10-19T08:37:56.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:56.664+0000 7f65f5d2d700 1 -- 172.21.15.79:0/2605783300 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f65f004ee70 con 0x7f65f00b0c00 2023-10-19T08:37:57.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.279+0000 7f65ecff9700 1 -- 172.21.15.79:0/2605783300 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f65e0057520 con 0x7f65f00b0c00 2023-10-19T08:37:57.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.284+0000 7f65f5d2d700 1 -- 172.21.15.79:0/2605783300 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f65d006a0e0 msgr2=0x7f65d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:57.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.284+0000 7f65f5d2d700 1 --2- 172.21.15.79:0/2605783300 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f65d006a0e0 0x7f65d006c5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f65f0154280 tx=0x7f65d8007ce0 comp rx=0 tx=0).stop 2023-10-19T08:37:57.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.284+0000 7f65f5d2d700 1 -- 172.21.15.79:0/2605783300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f00b0c00 msgr2=0x7f65f01f0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:57.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.284+0000 7f65f5d2d700 1 --2- 172.21.15.79:0/2605783300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f00b0c00 0x7f65f01f0ee0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f65e000d800 tx=0x7f65e000db10 comp rx=0 tx=0).stop 2023-10-19T08:37:57.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.284+0000 7f65f5d2d700 1 -- 172.21.15.79:0/2605783300 shutdown_connections 2023-10-19T08:37:57.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.284+0000 7f65f5d2d700 1 --2- 172.21.15.79:0/2605783300 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f65d006a0e0 0x7f65d006c5a0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f65f0154280 tx=0x7f65d8007ce0 comp rx=0 tx=0).stop 2023-10-19T08:37:57.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.284+0000 7f65f5d2d700 1 --2- 172.21.15.79:0/2605783300 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65f015e570 0x7f65f0154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:57.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.284+0000 7f65f5d2d700 1 --2- 172.21.15.79:0/2605783300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f00b0c00 0x7f65f01f0ee0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:57.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.284+0000 7f65f5d2d700 1 --2- 172.21.15.79:0/2605783300 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f00cb6f0 0x7f65f0151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:57.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.284+0000 7f65f5d2d700 1 -- 172.21.15.79:0/2605783300 >> 172.21.15.79:0/2605783300 conn(0x7f65f009a0b0 msgr2=0x7f65f00cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:57.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.286+0000 7f65f5d2d700 1 -- 172.21.15.79:0/2605783300 shutdown_connections 2023-10-19T08:37:57.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.288+0000 7f65f5d2d700 1 -- 172.21.15.79:0/2605783300 wait complete. 2023-10-19T08:37:57.300 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 3 and data pool 4 2023-10-19T08:37:57.311 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-19T08:37:57.311 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-19T08:37:57.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.432+0000 7f6fdd988700 1 Processor -- start 2023-10-19T08:37:57.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.432+0000 7f6fdd988700 1 -- start start 2023-10-19T08:37:57.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.433+0000 7f6fdd988700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6fd806b330 0x7f6fd806b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:57.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.433+0000 7f6fdd988700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6fd80d1060 0x7f6fd80d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:57.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.433+0000 7f6fdd988700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd80d19f0 con 0x7f6fd8160360 2023-10-19T08:37:57.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.433+0000 7f6fdd988700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd806c3f0 con 0x7f6fd806b330 2023-10-19T08:37:57.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.433+0000 7f6fdd988700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd80cedb0 con 0x7f6fd80d1060 2023-10-19T08:37:57.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.433+0000 7f6fd67fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6fd806b330 0x7f6fd806b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:57.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.433+0000 7f6fd67fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6fd806b330 0x7f6fd806b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45668/0 (socket says 172.21.15.79:45668) 2023-10-19T08:37:57.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.433+0000 7f6fd67fc700 1 -- 172.21.15.79:0/2357789603 learned_addr learned my addr 172.21.15.79:0/2357789603 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:57.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.433+0000 7f6fd77fe700 1 --2- 172.21.15.79:0/2357789603 >> v2:172.21.15.89:3300/0 conn(0x7f6fd80d1060 0x7f6fd80d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:57.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.433+0000 7f6fd67fc700 1 -- 172.21.15.79:0/2357789603 >> v2:172.21.15.89:3300/0 conn(0x7f6fd80d1060 msgr2=0x7f6fd80d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:57.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.433+0000 7f6fd67fc700 1 --2- 172.21.15.79:0/2357789603 >> v2:172.21.15.89:3300/0 conn(0x7f6fd80d1060 0x7f6fd80d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:57.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.433+0000 7f6fd67fc700 1 -- 172.21.15.79:0/2357789603 >> v1:172.21.15.89:6789/0 conn(0x7f6fd8160360 legacy=0x7f6fd80cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:57.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.433+0000 7f6fd67fc700 1 -- 172.21.15.79:0/2357789603 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd80cf950 con 0x7f6fd806b330 2023-10-19T08:37:57.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.433+0000 7f6fd67fc700 1 --2- 172.21.15.79:0/2357789603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fd806b330 0x7f6fd806b7e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80b35b0 tx=0x7f6fcc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d840640379983e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:57.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.433+0000 7f6fd5ffb700 1 -- 172.21.15.79:0/2357789603 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc004230 con 0x7f6fd806b330 2023-10-19T08:37:57.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.433+0000 7f6fd5ffb700 1 -- 172.21.15.79:0/2357789603 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc004390 con 0x7f6fd806b330 2023-10-19T08:37:57.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.433+0000 7f6fd5ffb700 1 -- 172.21.15.79:0/2357789603 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc0036a0 con 0x7f6fd806b330 2023-10-19T08:37:57.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.434+0000 7f6fdd988700 1 -- 172.21.15.79:0/2357789603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fd806b330 msgr2=0x7f6fd806b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:57.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.434+0000 7f6fdd988700 1 --2- 172.21.15.79:0/2357789603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fd806b330 0x7f6fd806b7e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6fd80b35b0 tx=0x7f6fcc009bd0 comp rx=0 tx=0).stop 2023-10-19T08:37:57.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.434+0000 7f6fdd988700 1 -- 172.21.15.79:0/2357789603 shutdown_connections 2023-10-19T08:37:57.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.434+0000 7f6fdd988700 1 --2- 172.21.15.79:0/2357789603 >> v2:172.21.15.89:3300/0 conn(0x7f6fd80d1060 0x7f6fd80d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:57.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.434+0000 7f6fdd988700 1 --2- 172.21.15.79:0/2357789603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fd806b330 0x7f6fd806b7e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:57.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.434+0000 7f6fdd988700 1 -- 172.21.15.79:0/2357789603 >> 172.21.15.79:0/2357789603 conn(0x7f6fd806a400 msgr2=0x7f6fd806a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:57.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.434+0000 7f6fdd988700 1 -- 172.21.15.79:0/2357789603 shutdown_connections 2023-10-19T08:37:57.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.434+0000 7f6fdd988700 1 -- 172.21.15.79:0/2357789603 wait complete. 2023-10-19T08:37:57.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.435+0000 7f6fdd988700 1 Processor -- start 2023-10-19T08:37:57.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.435+0000 7f6fdd988700 1 -- start start 2023-10-19T08:37:57.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.436+0000 7f6fdd988700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fd806b330 0x7f6fd81e7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:57.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.436+0000 7f6fdd988700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd80d1060 0x7f6fd81e83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:57.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.436+0000 7f6fdd988700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fd8160360 0x7f6fd8149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:57.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.436+0000 7f6fdd988700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd81482b0 con 0x7f6fd8160360 2023-10-19T08:37:57.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.436+0000 7f6fdd988700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd81484c0 con 0x7f6fd80d1060 2023-10-19T08:37:57.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.436+0000 7f6fdd988700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd81487a0 con 0x7f6fd806b330 2023-10-19T08:37:57.448 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.436+0000 7f6fd77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fd8160360 0x7f6fd8149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:57.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.436+0000 7f6fd77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fd8160360 0x7f6fd8149280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45676/0 (socket says 172.21.15.79:45676) 2023-10-19T08:37:57.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.436+0000 7f6fd77fe700 1 -- 172.21.15.79:0/3716658317 learned_addr learned my addr 172.21.15.79:0/3716658317 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:57.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.436+0000 7f6fd6ffd700 1 --2- 172.21.15.79:0/3716658317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fd806b330 0x7f6fd81e7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:57.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.436+0000 7f6fd67fc700 1 --2- 172.21.15.79:0/3716658317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd80d1060 0x7f6fd81e83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:57.449 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.436+0000 7f6fd77fe700 1 -- 172.21.15.79:0/3716658317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fd806b330 msgr2=0x7f6fd81e7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:57.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.436+0000 7f6fd77fe700 1 --2- 172.21.15.79:0/3716658317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fd806b330 0x7f6fd81e7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:57.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.436+0000 7f6fd77fe700 1 -- 172.21.15.79:0/3716658317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd80d1060 msgr2=0x7f6fd81e83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:57.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.436+0000 7f6fd77fe700 1 --2- 172.21.15.79:0/3716658317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd80d1060 0x7f6fd81e83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:57.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.436+0000 7f6fd77fe700 1 -- 172.21.15.79:0/3716658317 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc009550 con 0x7f6fd8160360 2023-10-19T08:37:57.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.436+0000 7f6fd67fc700 1 --2- 172.21.15.79:0/3716658317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd80d1060 0x7f6fd81e83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:37:57.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.436+0000 7f6fd6ffd700 1 --2- 172.21.15.79:0/3716658317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fd806b330 0x7f6fd81e7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:37:57.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.436+0000 7f6fd77fe700 1 --2- 172.21.15.79:0/3716658317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fd8160360 0x7f6fd8149280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0007e40 tx=0x7f6fd000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:57.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.437+0000 7f6fbffff700 1 -- 172.21.15.79:0/3716658317 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd000eea0 con 0x7f6fd8160360 2023-10-19T08:37:57.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.437+0000 7f6fbffff700 1 -- 172.21.15.79:0/3716658317 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd0014420 con 0x7f6fd8160360 2023-10-19T08:37:57.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.437+0000 7f6fdd988700 1 -- 172.21.15.79:0/3716658317 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd8148a80 con 0x7f6fd8160360 2023-10-19T08:37:57.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.437+0000 7f6fbffff700 1 -- 172.21.15.79:0/3716658317 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd00147b0 con 0x7f6fd8160360 2023-10-19T08:37:57.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.437+0000 7f6fdd988700 1 -- 172.21.15.79:0/3716658317 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd81e5490 con 0x7f6fd8160360 2023-10-19T08:37:57.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.438+0000 7f6fdd988700 1 -- 172.21.15.79:0/3716658317 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd804ee70 con 0x7f6fd8160360 2023-10-19T08:37:57.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.438+0000 7f6fbffff700 1 -- 172.21.15.79:0/3716658317 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6fd0014910 con 0x7f6fd8160360 2023-10-19T08:37:57.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.438+0000 7f6fbffff700 1 --2- 172.21.15.79:0/3716658317 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6fc406a0e0 0x7f6fc406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:57.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.439+0000 7f6fd6ffd700 1 --2- 172.21.15.79:0/3716658317 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6fc406a0e0 0x7f6fc406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:57.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.439+0000 7f6fbffff700 1 -- 172.21.15.79:0/3716658317 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6fd0088d90 con 0x7f6fd8160360 2023-10-19T08:37:57.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.439+0000 7f6fd6ffd700 1 --2- 172.21.15.79:0/3716658317 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6fc406a0e0 0x7f6fc406c5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8003fc0 tx=0x7f6fc8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:57.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.443+0000 7f6fbffff700 1 -- 172.21.15.79:0/3716658317 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6fd0054480 con 0x7f6fd8160360 2023-10-19T08:37:57.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:57.643+0000 7f6fdd988700 1 -- 172.21.15.79:0/3716658317 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f6fd80b25c0 con 0x7f6fd8160360 2023-10-19T08:37:58.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.270+0000 7f6fbffff700 1 -- 172.21.15.79:0/3716658317 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f6fd0057aa0 con 0x7f6fd8160360 2023-10-19T08:37:58.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.273+0000 7f6fdd988700 1 -- 172.21.15.79:0/3716658317 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6fc406a0e0 msgr2=0x7f6fc406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:58.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.273+0000 7f6fdd988700 1 --2- 172.21.15.79:0/3716658317 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6fc406a0e0 0x7f6fc406c5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8003fc0 tx=0x7f6fc8009040 comp rx=0 tx=0).stop 2023-10-19T08:37:58.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.273+0000 7f6fdd988700 1 -- 172.21.15.79:0/3716658317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fd8160360 msgr2=0x7f6fd8149280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:58.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.273+0000 7f6fdd988700 1 --2- 172.21.15.79:0/3716658317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fd8160360 0x7f6fd8149280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0007e40 tx=0x7f6fd000e3c0 comp rx=0 tx=0).stop 2023-10-19T08:37:58.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.273+0000 7f6fdd988700 1 -- 172.21.15.79:0/3716658317 shutdown_connections 2023-10-19T08:37:58.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.273+0000 7f6fdd988700 1 --2- 172.21.15.79:0/3716658317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6fd8160360 0x7f6fd8149280 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:58.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.273+0000 7f6fdd988700 1 --2- 172.21.15.79:0/3716658317 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6fc406a0e0 0x7f6fc406c5a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:58.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.273+0000 7f6fdd988700 1 --2- 172.21.15.79:0/3716658317 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6fd806b330 0x7f6fd81e7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:58.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.273+0000 7f6fdd988700 1 --2- 172.21.15.79:0/3716658317 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fd80d1060 0x7f6fd81e83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:58.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.273+0000 7f6fdd988700 1 -- 172.21.15.79:0/3716658317 >> 172.21.15.79:0/3716658317 conn(0x7f6fd806a400 msgr2=0x7f6fd80ccca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:58.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.273+0000 7f6fdd988700 1 -- 172.21.15.79:0/3716658317 shutdown_connections 2023-10-19T08:37:58.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.273+0000 7f6fdd988700 1 -- 172.21.15.79:0/3716658317 wait complete. 2023-10-19T08:37:58.293 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-19T08:37:58.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.421+0000 7ff9a1b00700 1 Processor -- start 2023-10-19T08:37:58.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.422+0000 7ff9a1b00700 1 -- start start 2023-10-19T08:37:58.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.422+0000 7ff9a1b00700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff99c15adc0 0x7ff99c0b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:58.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.422+0000 7ff9a1b00700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff99c06f730 0x7ff99c06fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:58.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.422+0000 7ff9a1b00700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99c0ca2a0 con 0x7ff99c06a220 2023-10-19T08:37:58.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.422+0000 7ff9a1b00700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99c0b1900 con 0x7ff99c15adc0 2023-10-19T08:37:58.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.422+0000 7ff9a1b00700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99c0706e0 con 0x7ff99c06f730 2023-10-19T08:37:58.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.422+0000 7ff99b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff99c15adc0 0x7ff99c0b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:58.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.422+0000 7ff99b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff99c15adc0 0x7ff99c0b2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45680/0 (socket says 172.21.15.79:45680) 2023-10-19T08:37:58.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.422+0000 7ff99b7fe700 1 -- 172.21.15.79:0/2998080638 learned_addr learned my addr 172.21.15.79:0/2998080638 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:58.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.423+0000 7ff99affd700 1 --2- 172.21.15.79:0/2998080638 >> v2:172.21.15.89:3300/0 conn(0x7ff99c06f730 0x7ff99c06fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:58.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.423+0000 7ff99b7fe700 1 -- 172.21.15.79:0/2998080638 >> v2:172.21.15.89:3300/0 conn(0x7ff99c06f730 msgr2=0x7ff99c06fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:58.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.423+0000 7ff99b7fe700 1 --2- 172.21.15.79:0/2998080638 >> v2:172.21.15.89:3300/0 conn(0x7ff99c06f730 0x7ff99c06fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:58.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.423+0000 7ff99b7fe700 1 -- 172.21.15.79:0/2998080638 >> v1:172.21.15.89:6789/0 conn(0x7ff99c06a220 legacy=0x7ff99c0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:37:58.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.423+0000 7ff99b7fe700 1 -- 172.21.15.79:0/2998080638 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c0b3470 con 0x7ff99c15adc0 2023-10-19T08:37:58.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.423+0000 7ff99affd700 1 --2- 172.21.15.79:0/2998080638 >> v2:172.21.15.89:3300/0 conn(0x7ff99c06f730 0x7ff99c06fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:37:58.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.423+0000 7ff99b7fe700 1 --2- 172.21.15.79:0/2998080638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff99c15adc0 0x7ff99c0b2f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff99c06b000 tx=0x7ff990009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c944d8a06c6ce5 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:58.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.423+0000 7ff99a7fc700 1 -- 172.21.15.79:0/2998080638 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff990004230 con 0x7ff99c15adc0 2023-10-19T08:37:58.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.423+0000 7ff99a7fc700 1 -- 172.21.15.79:0/2998080638 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff990004390 con 0x7ff99c15adc0 2023-10-19T08:37:58.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.423+0000 7ff99a7fc700 1 -- 172.21.15.79:0/2998080638 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9900036a0 con 0x7ff99c15adc0 2023-10-19T08:37:58.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.423+0000 7ff9a1b00700 1 -- 172.21.15.79:0/2998080638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff99c15adc0 msgr2=0x7ff99c0b2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:58.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.423+0000 7ff9a1b00700 1 --2- 172.21.15.79:0/2998080638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff99c15adc0 0x7ff99c0b2f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff99c06b000 tx=0x7ff990009bd0 comp rx=0 tx=0).stop 2023-10-19T08:37:58.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.424+0000 7ff9a1b00700 1 -- 172.21.15.79:0/2998080638 shutdown_connections 2023-10-19T08:37:58.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.424+0000 7ff9a1b00700 1 --2- 172.21.15.79:0/2998080638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff99c15adc0 0x7ff99c0b2f30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:58.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.424+0000 7ff9a1b00700 1 --2- 172.21.15.79:0/2998080638 >> v2:172.21.15.89:3300/0 conn(0x7ff99c06f730 0x7ff99c06fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:58.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.424+0000 7ff9a1b00700 1 -- 172.21.15.79:0/2998080638 >> 172.21.15.79:0/2998080638 conn(0x7ff99c06dce0 msgr2=0x7ff99c06e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:37:58.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.424+0000 7ff9a1b00700 1 -- 172.21.15.79:0/2998080638 shutdown_connections 2023-10-19T08:37:58.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.424+0000 7ff9a1b00700 1 -- 172.21.15.79:0/2998080638 wait complete. 2023-10-19T08:37:58.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.425+0000 7ff9a1b00700 1 Processor -- start 2023-10-19T08:37:58.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.425+0000 7ff9a1b00700 1 -- start start 2023-10-19T08:37:58.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff9a1b00700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff99c06a220 0x7ff99c0aef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:58.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff9a1b00700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff99c06f730 0x7ff99c1f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:58.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff9a1b00700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff99c15adc0 0x7ff99c151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:58.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff9a1b00700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c0ce9a0 con 0x7ff99c06f730 2023-10-19T08:37:58.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff9a1b00700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c1f6980 con 0x7ff99c06a220 2023-10-19T08:37:58.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff9a1b00700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c0cdd90 con 0x7ff99c15adc0 2023-10-19T08:37:58.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff99affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff99c06f730 0x7ff99c1f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:58.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff99affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff99c06f730 0x7ff99c1f5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45688/0 (socket says 172.21.15.79:45688) 2023-10-19T08:37:58.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff99affd700 1 -- 172.21.15.79:0/3109281572 learned_addr learned my addr 172.21.15.79:0/3109281572 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:37:58.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff99b7fe700 1 --2- 172.21.15.79:0/3109281572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff99c06a220 0x7ff99c0aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:58.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff99affd700 1 -- 172.21.15.79:0/3109281572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff99c15adc0 msgr2=0x7ff99c151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:58.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff99affd700 1 --2- 172.21.15.79:0/3109281572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff99c15adc0 0x7ff99c151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:58.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff99affd700 1 -- 172.21.15.79:0/3109281572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff99c06a220 msgr2=0x7ff99c0aef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:37:58.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff99affd700 1 --2- 172.21.15.79:0/3109281572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff99c06a220 0x7ff99c0aef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:37:58.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff99affd700 1 -- 172.21.15.79:0/3109281572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff990009550 con 0x7ff99c06f730 2023-10-19T08:37:58.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff99affd700 1 --2- 172.21.15.79:0/3109281572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff99c06f730 0x7ff99c1f5d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00c780 tx=0x7ff98c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:58.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff983fff700 1 -- 172.21.15.79:0/3109281572 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c011800 con 0x7ff99c06f730 2023-10-19T08:37:58.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff983fff700 1 -- 172.21.15.79:0/3109281572 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c011960 con 0x7ff99c06f730 2023-10-19T08:37:58.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff9a1b00700 1 -- 172.21.15.79:0/3109281572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99c0ce070 con 0x7ff99c06f730 2023-10-19T08:37:58.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff983fff700 1 -- 172.21.15.79:0/3109281572 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c011cd0 con 0x7ff99c06f730 2023-10-19T08:37:58.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.426+0000 7ff9a1b00700 1 -- 172.21.15.79:0/3109281572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99c0ce630 con 0x7ff99c06f730 2023-10-19T08:37:58.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.427+0000 7ff9a1b00700 1 -- 172.21.15.79:0/3109281572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff99c0ceb50 con 0x7ff99c06f730 2023-10-19T08:37:58.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.428+0000 7ff983fff700 1 -- 172.21.15.79:0/3109281572 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff98c021350 con 0x7ff99c06f730 2023-10-19T08:37:58.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.428+0000 7ff983fff700 1 --2- 172.21.15.79:0/3109281572 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff98806a0e0 0x7ff98806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:37:58.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.428+0000 7ff983fff700 1 -- 172.21.15.79:0/3109281572 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6288+0+0 (secure 0 0 0) 0x7ff98c088610 con 0x7ff99c06f730 2023-10-19T08:37:58.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.428+0000 7ff99b7fe700 1 --2- 172.21.15.79:0/3109281572 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff98806a0e0 0x7ff98806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:37:58.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.428+0000 7ff99b7fe700 1 --2- 172.21.15.79:0/3109281572 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff98806a0e0 0x7ff98806c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff990000c00 tx=0x7ff990008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:37:58.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.432+0000 7ff983fff700 1 -- 172.21.15.79:0/3109281572 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ff99c0ceb50 con 0x7ff99c06f730 2023-10-19T08:37:58.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:37:58.621+0000 7ff9a1b00700 1 -- 172.21.15.79:0/3109281572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff99c0ceb50 con 0x7ff99c06f730 2023-10-19T08:38:00.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.315+0000 7ff983fff700 1 -- 172.21.15.79:0/3109281572 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7ff99c0ceb50 con 0x7ff99c06f730 2023-10-19T08:38:00.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.318+0000 7ff9a1b00700 1 -- 172.21.15.79:0/3109281572 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff98806a0e0 msgr2=0x7ff98806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:00.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.318+0000 7ff9a1b00700 1 --2- 172.21.15.79:0/3109281572 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff98806a0e0 0x7ff98806c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff990000c00 tx=0x7ff990008030 comp rx=0 tx=0).stop 2023-10-19T08:38:00.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.318+0000 7ff9a1b00700 1 -- 172.21.15.79:0/3109281572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff99c06f730 msgr2=0x7ff99c1f5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:00.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.318+0000 7ff9a1b00700 1 --2- 172.21.15.79:0/3109281572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff99c06f730 0x7ff99c1f5d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00c780 tx=0x7ff98c00cb40 comp rx=0 tx=0).stop 2023-10-19T08:38:00.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.318+0000 7ff9a1b00700 1 -- 172.21.15.79:0/3109281572 shutdown_connections 2023-10-19T08:38:00.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.318+0000 7ff9a1b00700 1 --2- 172.21.15.79:0/3109281572 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff98806a0e0 0x7ff98806c5a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:00.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.318+0000 7ff9a1b00700 1 --2- 172.21.15.79:0/3109281572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff99c15adc0 0x7ff99c151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:00.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.318+0000 7ff9a1b00700 1 --2- 172.21.15.79:0/3109281572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff99c06a220 0x7ff99c0aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:00.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.318+0000 7ff9a1b00700 1 --2- 172.21.15.79:0/3109281572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff99c06f730 0x7ff99c1f5d90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:00.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.318+0000 7ff9a1b00700 1 -- 172.21.15.79:0/3109281572 >> 172.21.15.79:0/3109281572 conn(0x7ff99c06dce0 msgr2=0x7ff99c06e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:00.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.318+0000 7ff9a1b00700 1 -- 172.21.15.79:0/3109281572 shutdown_connections 2023-10-19T08:38:00.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.318+0000 7ff9a1b00700 1 -- 172.21.15.79:0/3109281572 wait complete. 2023-10-19T08:38:00.333 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data_ec' created 2023-10-19T08:38:00.343 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-19T08:38:00.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.467+0000 7f980a9d8700 1 Processor -- start 2023-10-19T08:38:00.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.467+0000 7f980a9d8700 1 -- start start 2023-10-19T08:38:00.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.468+0000 7f980a9d8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f98040cc050 0x7f980415a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:00.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.468+0000 7f980a9d8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98040ce7c0 con 0x7f98040ce360 2023-10-19T08:38:00.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.468+0000 7f980a9d8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980415da30 con 0x7f9804154280 2023-10-19T08:38:00.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.468+0000 7f980a9d8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980415b2c0 con 0x7f98040cc050 2023-10-19T08:38:00.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.468+0000 7f9808f75700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f98040cc050 0x7f980415a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:00.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.468+0000 7f9808f75700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f98040cc050 0x7f980415a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45698/0 (socket says 172.21.15.79:45698) 2023-10-19T08:38:00.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.468+0000 7f9808f75700 1 -- 172.21.15.79:0/975155006 learned_addr learned my addr 172.21.15.79:0/975155006 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:00.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.468+0000 7f98037fe700 1 --1- 172.21.15.79:0/975155006 >> v1:172.21.15.79:6789/0 conn(0x7f98040ce360 0x7f98040cb940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55768/0 (socket says 172.21.15.79:55768) 2023-10-19T08:38:00.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.468+0000 7f9808f75700 1 -- 172.21.15.79:0/975155006 >> v1:172.21.15.89:6789/0 conn(0x7f9804154280 legacy=0x7f980415df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:00.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.468+0000 7f9808f75700 1 -- 172.21.15.79:0/975155006 >> v1:172.21.15.79:6789/0 conn(0x7f98040ce360 legacy=0x7f98040cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:00.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.468+0000 7f9808f75700 1 -- 172.21.15.79:0/975155006 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980415aa20 con 0x7f98040cc050 2023-10-19T08:38:00.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.469+0000 7f9808f75700 1 --2- 172.21.15.79:0/975155006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98040cc050 0x7f980415a2c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00d150 tx=0x7f97fc00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4390e832aedf082 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:00.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.469+0000 7f9802ffd700 1 -- 172.21.15.79:0/975155006 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc010070 con 0x7f98040cc050 2023-10-19T08:38:00.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.469+0000 7f9802ffd700 1 -- 172.21.15.79:0/975155006 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc00dd80 con 0x7f98040cc050 2023-10-19T08:38:00.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.469+0000 7f9802ffd700 1 -- 172.21.15.79:0/975155006 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc00b310 con 0x7f98040cc050 2023-10-19T08:38:00.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.469+0000 7f980a9d8700 1 -- 172.21.15.79:0/975155006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98040cc050 msgr2=0x7f980415a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:00.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.469+0000 7f980a9d8700 1 --2- 172.21.15.79:0/975155006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98040cc050 0x7f980415a2c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00d150 tx=0x7f97fc00d460 comp rx=0 tx=0).stop 2023-10-19T08:38:00.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.469+0000 7f980a9d8700 1 -- 172.21.15.79:0/975155006 shutdown_connections 2023-10-19T08:38:00.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.469+0000 7f980a9d8700 1 --2- 172.21.15.79:0/975155006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f98040cc050 0x7f980415a2c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:00.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.469+0000 7f980a9d8700 1 -- 172.21.15.79:0/975155006 >> 172.21.15.79:0/975155006 conn(0x7f980406dd90 msgr2=0x7f980406e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:00.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.469+0000 7f980a9d8700 1 -- 172.21.15.79:0/975155006 shutdown_connections 2023-10-19T08:38:00.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.469+0000 7f980a9d8700 1 -- 172.21.15.79:0/975155006 wait complete. 2023-10-19T08:38:00.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.470+0000 7f980a9d8700 1 Processor -- start 2023-10-19T08:38:00.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.471+0000 7f980a9d8700 1 -- start start 2023-10-19T08:38:00.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.471+0000 7f980a9d8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98040ce360 0x7f9804156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:00.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.471+0000 7f980a9d8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9804154280 0x7f9804154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:00.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.471+0000 7f980a9d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98041ee070 0x7f9804144f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:00.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.471+0000 7f980a9d8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98040c4f90 con 0x7f9804154280 2023-10-19T08:38:00.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.471+0000 7f980a9d8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98041574b0 con 0x7f98040ce360 2023-10-19T08:38:00.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.471+0000 7f980a9d8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98040b1ae0 con 0x7f98041ee070 2023-10-19T08:38:00.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.472+0000 7f98037fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9804154280 0x7f9804154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:00.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.472+0000 7f98037fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9804154280 0x7f9804154660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45702/0 (socket says 172.21.15.79:45702) 2023-10-19T08:38:00.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.472+0000 7f98037fe700 1 -- 172.21.15.79:0/1595847151 learned_addr learned my addr 172.21.15.79:0/1595847151 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:00.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.472+0000 7f9803fff700 1 --2- 172.21.15.79:0/1595847151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98040ce360 0x7f9804156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:00.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.472+0000 7f9808f75700 1 --2- 172.21.15.79:0/1595847151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98041ee070 0x7f9804144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:00.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.472+0000 7f98037fe700 1 -- 172.21.15.79:0/1595847151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98041ee070 msgr2=0x7f9804144f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:00.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.472+0000 7f98037fe700 1 --2- 172.21.15.79:0/1595847151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98041ee070 0x7f9804144f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:00.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.472+0000 7f98037fe700 1 -- 172.21.15.79:0/1595847151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98040ce360 msgr2=0x7f9804156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:00.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.472+0000 7f98037fe700 1 --2- 172.21.15.79:0/1595847151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98040ce360 0x7f9804156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:00.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.472+0000 7f98037fe700 1 -- 172.21.15.79:0/1595847151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97fc00bd40 con 0x7f9804154280 2023-10-19T08:38:00.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.472+0000 7f9803fff700 1 --2- 172.21.15.79:0/1595847151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98040ce360 0x7f9804156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:00.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.472+0000 7f98037fe700 1 --2- 172.21.15.79:0/1595847151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9804154280 0x7f9804154660 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f97f400c490 tx=0x7f97f400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:00.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.472+0000 7f9800ff9700 1 -- 172.21.15.79:0/1595847151 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f4005cb0 con 0x7f9804154280 2023-10-19T08:38:00.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.472+0000 7f9800ff9700 1 -- 172.21.15.79:0/1595847151 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f4005e10 con 0x7f9804154280 2023-10-19T08:38:00.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.472+0000 7f980a9d8700 1 -- 172.21.15.79:0/1595847151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98040b1dc0 con 0x7f9804154280 2023-10-19T08:38:00.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.472+0000 7f9800ff9700 1 -- 172.21.15.79:0/1595847151 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f40072d0 con 0x7f9804154280 2023-10-19T08:38:00.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.472+0000 7f980a9d8700 1 -- 172.21.15.79:0/1595847151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98040b2380 con 0x7f9804154280 2023-10-19T08:38:00.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.473+0000 7f980a9d8700 1 -- 172.21.15.79:0/1595847151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980404ee70 con 0x7f9804154280 2023-10-19T08:38:00.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.474+0000 7f9800ff9700 1 -- 172.21.15.79:0/1595847151 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f97f4007430 con 0x7f9804154280 2023-10-19T08:38:00.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.474+0000 7f9800ff9700 1 --2- 172.21.15.79:0/1595847151 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f97f006a0e0 0x7f97f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:00.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.474+0000 7f9803fff700 1 --2- 172.21.15.79:0/1595847151 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f97f006a0e0 0x7f97f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:00.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.474+0000 7f9800ff9700 1 -- 172.21.15.79:0/1595847151 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f97f4087b30 con 0x7f9804154280 2023-10-19T08:38:00.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.474+0000 7f9803fff700 1 --2- 172.21.15.79:0/1595847151 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f97f006a0e0 0x7f97f006c5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f97f8006fd0 tx=0x7f97f8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:00.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.479+0000 7f9800ff9700 1 -- 172.21.15.79:0/1595847151 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f97f4053090 con 0x7f9804154280 2023-10-19T08:38:00.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:00.667+0000 7f980a9d8700 1 -- 172.21.15.79:0/1595847151 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f98040af550 con 0x7f9804154280 2023-10-19T08:38:00.952 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-19T08:38:00.955 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-19T08:38:01.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.323+0000 7f9800ff9700 1 -- 172.21.15.79:0/1595847151 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f97f40170c0 con 0x7f9804154280 2023-10-19T08:38:01.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.327+0000 7f980a9d8700 1 -- 172.21.15.79:0/1595847151 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f97f006a0e0 msgr2=0x7f97f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:01.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.327+0000 7f980a9d8700 1 --2- 172.21.15.79:0/1595847151 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f97f006a0e0 0x7f97f006c5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f97f8006fd0 tx=0x7f97f8008040 comp rx=0 tx=0).stop 2023-10-19T08:38:01.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.327+0000 7f980a9d8700 1 -- 172.21.15.79:0/1595847151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9804154280 msgr2=0x7f9804154660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:01.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.327+0000 7f980a9d8700 1 --2- 172.21.15.79:0/1595847151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9804154280 0x7f9804154660 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f97f400c490 tx=0x7f97f400c850 comp rx=0 tx=0).stop 2023-10-19T08:38:01.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.327+0000 7f980a9d8700 1 -- 172.21.15.79:0/1595847151 shutdown_connections 2023-10-19T08:38:01.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.327+0000 7f980a9d8700 1 --2- 172.21.15.79:0/1595847151 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f97f006a0e0 0x7f97f006c5a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:01.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.327+0000 7f980a9d8700 1 --2- 172.21.15.79:0/1595847151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98041ee070 0x7f9804144f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:01.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.327+0000 7f980a9d8700 1 --2- 172.21.15.79:0/1595847151 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98040ce360 0x7f9804156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:01.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.327+0000 7f980a9d8700 1 --2- 172.21.15.79:0/1595847151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9804154280 0x7f9804154660 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f97f400c490 tx=0x7f97f400c850 comp rx=0 tx=0).stop 2023-10-19T08:38:01.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.327+0000 7f980a9d8700 1 -- 172.21.15.79:0/1595847151 >> 172.21.15.79:0/1595847151 conn(0x7f980406dd90 msgr2=0x7f9804158cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:01.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.330+0000 7f980a9d8700 1 -- 172.21.15.79:0/1595847151 shutdown_connections 2023-10-19T08:38:01.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.337+0000 7f980a9d8700 1 -- 172.21.15.79:0/1595847151 wait complete. 2023-10-19T08:38:01.347 INFO:teuthology.orchestra.run.smithi079.stderr:set pool 5 allow_ec_overwrites to true 2023-10-19T08:38:01.362 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-19T08:38:01.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.479+0000 7ff0c16ec700 1 Processor -- start 2023-10-19T08:38:01.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.479+0000 7ff0c16ec700 1 -- start start 2023-10-19T08:38:01.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.480+0000 7ff0c16ec700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0bc159550 0x7ff0bc065fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:01.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.480+0000 7ff0c16ec700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0bc06b110 con 0x7ff0bc0cb100 2023-10-19T08:38:01.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.480+0000 7ff0c16ec700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0bc06a220 con 0x7ff0bc06ed80 2023-10-19T08:38:01.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.480+0000 7ff0c16ec700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0bc06a500 con 0x7ff0bc159550 2023-10-19T08:38:01.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.480+0000 7ff0baffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0bc159550 0x7ff0bc065fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:01.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.480+0000 7ff0baffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0bc159550 0x7ff0bc065fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45708/0 (socket says 172.21.15.79:45708) 2023-10-19T08:38:01.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.480+0000 7ff0baffd700 1 -- 172.21.15.79:0/882365776 learned_addr learned my addr 172.21.15.79:0/882365776 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:01.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.480+0000 7ff0ba7fc700 1 --1- 172.21.15.79:0/882365776 >> v1:172.21.15.79:6789/0 conn(0x7ff0bc0cb100 0x7ff0bc06e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55780/0 (socket says 172.21.15.79:55780) 2023-10-19T08:38:01.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.481+0000 7ff0baffd700 1 -- 172.21.15.79:0/882365776 >> v1:172.21.15.89:6789/0 conn(0x7ff0bc06ed80 legacy=0x7ff0bc1643e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:01.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.481+0000 7ff0baffd700 1 -- 172.21.15.79:0/882365776 >> v1:172.21.15.79:6789/0 conn(0x7ff0bc0cb100 legacy=0x7ff0bc06e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:01.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.481+0000 7ff0baffd700 1 -- 172.21.15.79:0/882365776 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc06a7e0 con 0x7ff0bc159550 2023-10-19T08:38:01.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.481+0000 7ff0b9ffb700 1 -- 172.21.15.79:0/882365776 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2396488062 0 0) 0x7ff0bc06b110 con 0x7ff0bc0cb100 2023-10-19T08:38:01.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.481+0000 7ff0baffd700 1 --2- 172.21.15.79:0/882365776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0bc159550 0x7ff0bc065fe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00098f0 tx=0x7ff0b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ef20944acc7416 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:01.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.481+0000 7ff0b9ffb700 1 -- 172.21.15.79:0/882365776 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0004230 con 0x7ff0bc159550 2023-10-19T08:38:01.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.481+0000 7ff0b9ffb700 1 -- 172.21.15.79:0/882365776 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b0004390 con 0x7ff0bc159550 2023-10-19T08:38:01.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.481+0000 7ff0b9ffb700 1 -- 172.21.15.79:0/882365776 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b00036a0 con 0x7ff0bc159550 2023-10-19T08:38:01.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.481+0000 7ff0c16ec700 1 -- 172.21.15.79:0/882365776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0bc159550 msgr2=0x7ff0bc065fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:01.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.481+0000 7ff0c16ec700 1 --2- 172.21.15.79:0/882365776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0bc159550 0x7ff0bc065fe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff0b00098f0 tx=0x7ff0b0009c00 comp rx=0 tx=0).stop 2023-10-19T08:38:01.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.481+0000 7ff0c16ec700 1 -- 172.21.15.79:0/882365776 shutdown_connections 2023-10-19T08:38:01.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.481+0000 7ff0c16ec700 1 --2- 172.21.15.79:0/882365776 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0bc159550 0x7ff0bc065fe0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:01.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.481+0000 7ff0c16ec700 1 -- 172.21.15.79:0/882365776 >> 172.21.15.79:0/882365776 conn(0x7ff0bc06d020 msgr2=0x7ff0bc06d430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:01.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.482+0000 7ff0c16ec700 1 -- 172.21.15.79:0/882365776 shutdown_connections 2023-10-19T08:38:01.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.482+0000 7ff0c16ec700 1 -- 172.21.15.79:0/882365776 wait complete. 2023-10-19T08:38:01.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.483+0000 7ff0c16ec700 1 Processor -- start 2023-10-19T08:38:01.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.483+0000 7ff0c16ec700 1 -- start start 2023-10-19T08:38:01.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0c16ec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0bc06ed80 0x7ff0bc14d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:01.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0c16ec700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0bc0cb100 0x7ff0bc0afd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:01.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0c16ec700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0bc159550 0x7ff0bc0b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:01.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0c16ec700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc1e42c0 con 0x7ff0bc0cb100 2023-10-19T08:38:01.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0c16ec700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc14db70 con 0x7ff0bc159550 2023-10-19T08:38:01.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0c16ec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc1e1ef0 con 0x7ff0bc06ed80 2023-10-19T08:38:01.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0ba7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0bc0cb100 0x7ff0bc0afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:01.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0ba7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0bc0cb100 0x7ff0bc0afd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45714/0 (socket says 172.21.15.79:45714) 2023-10-19T08:38:01.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0ba7fc700 1 -- 172.21.15.79:0/1959143532 learned_addr learned my addr 172.21.15.79:0/1959143532 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:01.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0baffd700 1 --2- 172.21.15.79:0/1959143532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0bc06ed80 0x7ff0bc14d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:01.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0ba7fc700 1 -- 172.21.15.79:0/1959143532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0bc06ed80 msgr2=0x7ff0bc14d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:01.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0bb7fe700 1 --2- 172.21.15.79:0/1959143532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0bc159550 0x7ff0bc0b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:01.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0ba7fc700 1 --2- 172.21.15.79:0/1959143532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0bc06ed80 0x7ff0bc14d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:01.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0ba7fc700 1 -- 172.21.15.79:0/1959143532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0bc159550 msgr2=0x7ff0bc0b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:01.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0ba7fc700 1 --2- 172.21.15.79:0/1959143532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0bc159550 0x7ff0bc0b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:01.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0ba7fc700 1 -- 172.21.15.79:0/1959143532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b0009550 con 0x7ff0bc0cb100 2023-10-19T08:38:01.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0baffd700 1 --2- 172.21.15.79:0/1959143532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0bc06ed80 0x7ff0bc14d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:01.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0bb7fe700 1 --2- 172.21.15.79:0/1959143532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0bc159550 0x7ff0bc0b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:01.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0ba7fc700 1 --2- 172.21.15.79:0/1959143532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0bc0cb100 0x7ff0bc0afd90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0011e0 tx=0x7ff0ac00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:01.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0a37fe700 1 -- 172.21.15.79:0/1959143532 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac004c80 con 0x7ff0bc0cb100 2023-10-19T08:38:01.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0a37fe700 1 -- 172.21.15.79:0/1959143532 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac004e00 con 0x7ff0bc0cb100 2023-10-19T08:38:01.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0c16ec700 1 -- 172.21.15.79:0/1959143532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0bc0ad530 con 0x7ff0bc0cb100 2023-10-19T08:38:01.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0a37fe700 1 -- 172.21.15.79:0/1959143532 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac007310 con 0x7ff0bc0cb100 2023-10-19T08:38:01.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.484+0000 7ff0c16ec700 1 -- 172.21.15.79:0/1959143532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0bc1e1b80 con 0x7ff0bc0cb100 2023-10-19T08:38:01.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.485+0000 7ff0c16ec700 1 -- 172.21.15.79:0/1959143532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0bc06bd60 con 0x7ff0bc0cb100 2023-10-19T08:38:01.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.486+0000 7ff0a37fe700 1 -- 172.21.15.79:0/1959143532 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff0ac007470 con 0x7ff0bc0cb100 2023-10-19T08:38:01.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.486+0000 7ff0a37fe700 1 --2- 172.21.15.79:0/1959143532 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff0a806a0e0 0x7ff0a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:01.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.486+0000 7ff0a37fe700 1 -- 172.21.15.79:0/1959143532 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6781+0+0 (secure 0 0 0) 0x7ff0ac088630 con 0x7ff0bc0cb100 2023-10-19T08:38:01.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.486+0000 7ff0baffd700 1 --2- 172.21.15.79:0/1959143532 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff0a806a0e0 0x7ff0a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:01.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.486+0000 7ff0baffd700 1 --2- 172.21.15.79:0/1959143532 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff0a806a0e0 0x7ff0a806c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0ce850 tx=0x7ff0b0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:01.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.490+0000 7ff0a37fe700 1 -- 172.21.15.79:0/1959143532 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ff0ac0539d0 con 0x7ff0bc0cb100 2023-10-19T08:38:01.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:01.723+0000 7ff0c16ec700 1 -- 172.21.15.79:0/1959143532 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7ff0bc0cbfb0 con 0x7ff0bc0cb100 2023-10-19T08:38:02.258 INFO:tasks.ceph.mds.b.smithi089.stderr:2023-10-19T08:38:02.254+0000 7f95cd17f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-19T08:38:02.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.323+0000 7ff0a37fe700 1 -- 172.21.15.79:0/1959143532 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7ff0ac056ff0 con 0x7ff0bc0cb100 2023-10-19T08:38:02.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.326+0000 7ff0c16ec700 1 -- 172.21.15.79:0/1959143532 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff0a806a0e0 msgr2=0x7ff0a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:02.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.326+0000 7ff0c16ec700 1 --2- 172.21.15.79:0/1959143532 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff0a806a0e0 0x7ff0a806c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0ce850 tx=0x7ff0b0008030 comp rx=0 tx=0).stop 2023-10-19T08:38:02.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.326+0000 7ff0c16ec700 1 -- 172.21.15.79:0/1959143532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0bc0cb100 msgr2=0x7ff0bc0afd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:02.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.326+0000 7ff0c16ec700 1 --2- 172.21.15.79:0/1959143532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0bc0cb100 0x7ff0bc0afd90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0011e0 tx=0x7ff0ac00cae0 comp rx=0 tx=0).stop 2023-10-19T08:38:02.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.327+0000 7ff0c16ec700 1 -- 172.21.15.79:0/1959143532 shutdown_connections 2023-10-19T08:38:02.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.327+0000 7ff0c16ec700 1 --2- 172.21.15.79:0/1959143532 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0bc159550 0x7ff0bc0b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:02.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.327+0000 7ff0c16ec700 1 --2- 172.21.15.79:0/1959143532 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff0a806a0e0 0x7ff0a806c5a0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0ce850 tx=0x7ff0b0008030 comp rx=0 tx=0).stop 2023-10-19T08:38:02.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.327+0000 7ff0c16ec700 1 --2- 172.21.15.79:0/1959143532 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0bc06ed80 0x7ff0bc14d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:02.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.327+0000 7ff0c16ec700 1 --2- 172.21.15.79:0/1959143532 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0bc0cb100 0x7ff0bc0afd90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:02.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.327+0000 7ff0c16ec700 1 -- 172.21.15.79:0/1959143532 >> 172.21.15.79:0/1959143532 conn(0x7ff0bc06d020 msgr2=0x7ff0bc06f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:02.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.327+0000 7ff0c16ec700 1 -- 172.21.15.79:0/1959143532 shutdown_connections 2023-10-19T08:38:02.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.327+0000 7ff0c16ec700 1 -- 172.21.15.79:0/1959143532 wait complete. 2023-10-19T08:38:02.334 INFO:teuthology.orchestra.run.smithi079.stderr:added data pool 5 to fsmap 2023-10-19T08:38:02.347 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T08:38:02.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.467+0000 7fc7d5ea1700 1 Processor -- start 2023-10-19T08:38:02.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.467+0000 7fc7d5ea1700 1 -- start start 2023-10-19T08:38:02.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.467+0000 7fc7d5ea1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc7d00af170 0x7fc7d00cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:02.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.467+0000 7fc7d5ea1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc7d00b1de0 0x7fc7d00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:02.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.467+0000 7fc7d5ea1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d015de50 con 0x7fc7d00cd800 2023-10-19T08:38:02.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.467+0000 7fc7d5ea1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d00af550 con 0x7fc7d00b1de0 2023-10-19T08:38:02.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.467+0000 7fc7d5ea1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d00b16b0 con 0x7fc7d00af170 2023-10-19T08:38:02.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.468+0000 7fc7ceffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc7d00b1de0 0x7fc7d00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:02.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.468+0000 7fc7ceffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc7d00b1de0 0x7fc7d00b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45720/0 (socket says 172.21.15.79:45720) 2023-10-19T08:38:02.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.468+0000 7fc7ceffd700 1 -- 172.21.15.79:0/3866394010 learned_addr learned my addr 172.21.15.79:0/3866394010 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:02.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.468+0000 7fc7ceffd700 1 -- 172.21.15.79:0/3866394010 >> v2:172.21.15.89:3300/0 conn(0x7fc7d00af170 msgr2=0x7fc7d00cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:02.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.468+0000 7fc7cf7fe700 1 --2- 172.21.15.79:0/3866394010 >> v2:172.21.15.89:3300/0 conn(0x7fc7d00af170 0x7fc7d00cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:02.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.468+0000 7fc7ceffd700 1 --2- 172.21.15.79:0/3866394010 >> v2:172.21.15.89:3300/0 conn(0x7fc7d00af170 0x7fc7d00cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:02.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.468+0000 7fc7ceffd700 1 -- 172.21.15.79:0/3866394010 >> v1:172.21.15.79:6789/0 conn(0x7fc7d00cd800 legacy=0x7fc7d006a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:02.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.468+0000 7fc7ce7fc700 1 -- 172.21.15.79:0/3866394010 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088668284 0 0) 0x7fc7d015de50 con 0x7fc7d00cd800 2023-10-19T08:38:02.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.468+0000 7fc7ceffd700 1 -- 172.21.15.79:0/3866394010 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d015e130 con 0x7fc7d00b1de0 2023-10-19T08:38:02.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.468+0000 7fc7cf7fe700 1 --2- 172.21.15.79:0/3866394010 >> v2:172.21.15.89:3300/0 conn(0x7fc7d00af170 0x7fc7d00cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:02.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.468+0000 7fc7ceffd700 1 --2- 172.21.15.79:0/3866394010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7d00b1de0 0x7fc7d00b2270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40098f0 tx=0x7fc7c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5200cc231cb245d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:02.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.468+0000 7fc7ce7fc700 1 -- 172.21.15.79:0/3866394010 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c400b860 con 0x7fc7d00b1de0 2023-10-19T08:38:02.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.468+0000 7fc7ce7fc700 1 -- 172.21.15.79:0/3866394010 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c400b9c0 con 0x7fc7d00b1de0 2023-10-19T08:38:02.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.468+0000 7fc7ce7fc700 1 -- 172.21.15.79:0/3866394010 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c400bd50 con 0x7fc7d00b1de0 2023-10-19T08:38:02.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.469+0000 7fc7d5ea1700 1 -- 172.21.15.79:0/3866394010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7d00b1de0 msgr2=0x7fc7d00b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:02.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.469+0000 7fc7d5ea1700 1 --2- 172.21.15.79:0/3866394010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7d00b1de0 0x7fc7d00b2270 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40098f0 tx=0x7fc7c4009c00 comp rx=0 tx=0).stop 2023-10-19T08:38:02.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.469+0000 7fc7d5ea1700 1 -- 172.21.15.79:0/3866394010 shutdown_connections 2023-10-19T08:38:02.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.469+0000 7fc7d5ea1700 1 --2- 172.21.15.79:0/3866394010 >> v2:172.21.15.89:3300/0 conn(0x7fc7d00af170 0x7fc7d00cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:02.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.469+0000 7fc7d5ea1700 1 --2- 172.21.15.79:0/3866394010 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7d00b1de0 0x7fc7d00b2270 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:02.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.469+0000 7fc7d5ea1700 1 -- 172.21.15.79:0/3866394010 >> 172.21.15.79:0/3866394010 conn(0x7fc7d006dcc0 msgr2=0x7fc7d006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:02.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.469+0000 7fc7d5ea1700 1 -- 172.21.15.79:0/3866394010 shutdown_connections 2023-10-19T08:38:02.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.469+0000 7fc7d5ea1700 1 -- 172.21.15.79:0/3866394010 wait complete. 2023-10-19T08:38:02.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.470+0000 7fc7d5ea1700 1 Processor -- start 2023-10-19T08:38:02.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.470+0000 7fc7d5ea1700 1 -- start start 2023-10-19T08:38:02.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7d5ea1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7d00af170 0x7fc7d01543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:02.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7d5ea1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7d00b1de0 0x7fc7d00c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:02.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7d5ea1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7d00cd800 0x7fc7d00c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:02.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7d5ea1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d00c5c00 con 0x7fc7d00cd800 2023-10-19T08:38:02.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7d5ea1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d00ac4b0 con 0x7fc7d00b1de0 2023-10-19T08:38:02.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7d5ea1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d00c8ca0 con 0x7fc7d00af170 2023-10-19T08:38:02.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7cffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7d00cd800 0x7fc7d00c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:02.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7cffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7d00cd800 0x7fc7d00c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45730/0 (socket says 172.21.15.79:45730) 2023-10-19T08:38:02.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7cffff700 1 -- 172.21.15.79:0/2562601227 learned_addr learned my addr 172.21.15.79:0/2562601227 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:02.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7ceffd700 1 --2- 172.21.15.79:0/2562601227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7d00b1de0 0x7fc7d00c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:02.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7cffff700 1 -- 172.21.15.79:0/2562601227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7d00af170 msgr2=0x7fc7d01543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:02.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7cf7fe700 1 --2- 172.21.15.79:0/2562601227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7d00af170 0x7fc7d01543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:02.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7cffff700 1 --2- 172.21.15.79:0/2562601227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7d00af170 0x7fc7d01543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:02.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7cffff700 1 -- 172.21.15.79:0/2562601227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7d00b1de0 msgr2=0x7fc7d00c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:02.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7cffff700 1 --2- 172.21.15.79:0/2562601227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7d00b1de0 0x7fc7d00c56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:02.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7cffff700 1 -- 172.21.15.79:0/2562601227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c4009550 con 0x7fc7d00cd800 2023-10-19T08:38:02.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7ceffd700 1 --2- 172.21.15.79:0/2562601227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7d00b1de0 0x7fc7d00c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:02.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7cf7fe700 1 --2- 172.21.15.79:0/2562601227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7d00af170 0x7fc7d01543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:02.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7cffff700 1 --2- 172.21.15.79:0/2562601227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7d00cd800 0x7fc7d00c8760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800c7d0 tx=0x7fc7c800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:02.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.471+0000 7fc7b7fff700 1 -- 172.21.15.79:0/2562601227 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8003e30 con 0x7fc7d00cd800 2023-10-19T08:38:02.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.472+0000 7fc7b7fff700 1 -- 172.21.15.79:0/2562601227 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c8005070 con 0x7fc7d00cd800 2023-10-19T08:38:02.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.472+0000 7fc7d5ea1700 1 -- 172.21.15.79:0/2562601227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d00c8f20 con 0x7fc7d00cd800 2023-10-19T08:38:02.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.472+0000 7fc7b7fff700 1 -- 172.21.15.79:0/2562601227 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8005420 con 0x7fc7d00cd800 2023-10-19T08:38:02.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.472+0000 7fc7d5ea1700 1 -- 172.21.15.79:0/2562601227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d00c94e0 con 0x7fc7d00cd800 2023-10-19T08:38:02.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.472+0000 7fc7d5ea1700 1 -- 172.21.15.79:0/2562601227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d00c9700 con 0x7fc7d00cd800 2023-10-19T08:38:02.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.473+0000 7fc7b7fff700 1 -- 172.21.15.79:0/2562601227 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc7c8005580 con 0x7fc7d00cd800 2023-10-19T08:38:02.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.473+0000 7fc7b7fff700 1 --2- 172.21.15.79:0/2562601227 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc7bc06a0e0 0x7fc7bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:02.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.473+0000 7fc7cf7fe700 1 --2- 172.21.15.79:0/2562601227 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc7bc06a0e0 0x7fc7bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:02.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.474+0000 7fc7b7fff700 1 -- 172.21.15.79:0/2562601227 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc7c8087e80 con 0x7fc7d00cd800 2023-10-19T08:38:02.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.474+0000 7fc7cf7fe700 1 --2- 172.21.15.79:0/2562601227 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc7bc06a0e0 0x7fc7bc06c5a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc7d01f5e30 tx=0x7fc7c0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:02.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.478+0000 7fc7b7fff700 1 -- 172.21.15.79:0/2562601227 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc7c8053310 con 0x7fc7d00cd800 2023-10-19T08:38:02.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.712+0000 7fc7d5ea1700 1 -- 172.21.15.79:0/2562601227 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7d00ac660 con 0x7fc7d00cd800 2023-10-19T08:38:02.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.712+0000 7fc7b7fff700 1 -- 172.21.15.79:0/2562601227 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4865 (secure 0 0 0) 0x7fc7c8017070 con 0x7fc7d00cd800 2023-10-19T08:38:02.717 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:02.717 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3710906518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3710906518},{"type":"v1","addr":"172.21.15.89:6835","nonce":3710906518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3037310614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3037310614},{"type":"v1","addr":"172.21.15.79:6835","nonce":3037310614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/79656061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":79656061},{"type":"v1","addr":"172.21.15.79:6837","nonce":79656061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-19T08:37:56.667105+0000","modified":"2023-10-19T08:38:02.319488+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6833/3076620199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3076620199},{"type":"v1","addr":"172.21.15.89:6833","nonce":3076620199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-19T08:38:02.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.714+0000 7fc7d5ea1700 1 -- 172.21.15.79:0/2562601227 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc7bc06a0e0 msgr2=0x7fc7bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:02.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.714+0000 7fc7d5ea1700 1 --2- 172.21.15.79:0/2562601227 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc7bc06a0e0 0x7fc7bc06c5a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc7d01f5e30 tx=0x7fc7c0008040 comp rx=0 tx=0).stop 2023-10-19T08:38:02.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.714+0000 7fc7d5ea1700 1 -- 172.21.15.79:0/2562601227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7d00cd800 msgr2=0x7fc7d00c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:02.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.714+0000 7fc7d5ea1700 1 --2- 172.21.15.79:0/2562601227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7d00cd800 0x7fc7d00c8760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800c7d0 tx=0x7fc7c800cb90 comp rx=0 tx=0).stop 2023-10-19T08:38:02.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.714+0000 7fc7d5ea1700 1 -- 172.21.15.79:0/2562601227 shutdown_connections 2023-10-19T08:38:02.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.714+0000 7fc7d5ea1700 1 --2- 172.21.15.79:0/2562601227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7d00cd800 0x7fc7d00c8760 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:02.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.714+0000 7fc7d5ea1700 1 --2- 172.21.15.79:0/2562601227 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc7bc06a0e0 0x7fc7bc06c5a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:02.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.714+0000 7fc7d5ea1700 1 --2- 172.21.15.79:0/2562601227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7d00af170 0x7fc7d01543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:02.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.714+0000 7fc7d5ea1700 1 --2- 172.21.15.79:0/2562601227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7d00b1de0 0x7fc7d00c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:02.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.714+0000 7fc7d5ea1700 1 -- 172.21.15.79:0/2562601227 >> 172.21.15.79:0/2562601227 conn(0x7fc7d006dcc0 msgr2=0x7fc7d006e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:02.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.714+0000 7fc7d5ea1700 1 -- 172.21.15.79:0/2562601227 shutdown_connections 2023-10-19T08:38:02.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.714+0000 7fc7d5ea1700 1 -- 172.21.15.79:0/2562601227 wait complete. 2023-10-19T08:38:02.722 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 7 2023-10-19T08:38:02.730 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:02.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.846+0000 7f23f0a80700 1 Processor -- start 2023-10-19T08:38:02.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.846+0000 7f23f0a80700 1 -- start start 2023-10-19T08:38:02.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.847+0000 7f23f0a80700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23ec159f40 0x7f23ec15e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:02.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.847+0000 7f23f0a80700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23ec0b5610 0x7f23ec0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:02.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.847+0000 7f23f0a80700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ec0cc870 con 0x7f23ec0ce5c0 2023-10-19T08:38:02.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.847+0000 7f23f0a80700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ec15e870 con 0x7f23ec0b5610 2023-10-19T08:38:02.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.847+0000 7f23f0a80700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec0b5aa0 con 0x7f23ec159f40 2023-10-19T08:38:02.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.847+0000 7f23e9d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23ec0b5610 0x7f23ec0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:02.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.847+0000 7f23ead9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f23ec0ce5c0 0x7f23ec0b16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55808/0 (socket says 172.21.15.79:55808) 2023-10-19T08:38:02.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.847+0000 7f23e9d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23ec0b5610 0x7f23ec0cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45734/0 (socket says 172.21.15.79:45734) 2023-10-19T08:38:02.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.847+0000 7f23ead9d700 1 -- 172.21.15.79:0/3444094137 learned_addr learned my addr 172.21.15.79:0/3444094137 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:02.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.848+0000 7f23e9d9b700 1 -- 172.21.15.79:0/3444094137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23ec159f40 msgr2=0x7f23ec15e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:02.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.848+0000 7f23ea59c700 1 --2- 172.21.15.79:0/3444094137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23ec159f40 0x7f23ec15e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:02.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.848+0000 7f23e9d9b700 1 --2- 172.21.15.79:0/3444094137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23ec159f40 0x7f23ec15e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:02.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.848+0000 7f23e9d9b700 1 -- 172.21.15.79:0/3444094137 >> v1:172.21.15.79:6789/0 conn(0x7f23ec0ce5c0 legacy=0x7f23ec0b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:02.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.848+0000 7f23e959a700 1 -- 172.21.15.79:0/3444094137 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972364864 0 0) 0x7f23e4001490 con 0x7f23ec0ce5c0 2023-10-19T08:38:02.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.848+0000 7f23e9d9b700 1 -- 172.21.15.79:0/3444094137 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ec0cd800 con 0x7f23ec0b5610 2023-10-19T08:38:02.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.848+0000 7f23e9d9b700 1 --2- 172.21.15.79:0/3444094137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ec0b5610 0x7f23ec0cf000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009840 tx=0x7f23dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8cdd5d2c01510a server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:02.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.848+0000 7f23e959a700 1 -- 172.21.15.79:0/3444094137 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc011830 con 0x7f23ec0b5610 2023-10-19T08:38:02.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.848+0000 7f23e959a700 1 -- 172.21.15.79:0/3444094137 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc011990 con 0x7f23ec0b5610 2023-10-19T08:38:02.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.848+0000 7f23e959a700 1 -- 172.21.15.79:0/3444094137 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc011d20 con 0x7f23ec0b5610 2023-10-19T08:38:02.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.848+0000 7f23f0a80700 1 -- 172.21.15.79:0/3444094137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ec0b5610 msgr2=0x7f23ec0cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:02.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.848+0000 7f23f0a80700 1 --2- 172.21.15.79:0/3444094137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ec0b5610 0x7f23ec0cf000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009840 tx=0x7f23dc009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:02.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.849+0000 7f23f0a80700 1 -- 172.21.15.79:0/3444094137 shutdown_connections 2023-10-19T08:38:02.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.849+0000 7f23f0a80700 1 --2- 172.21.15.79:0/3444094137 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23ec159f40 0x7f23ec15e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:02.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.849+0000 7f23f0a80700 1 --2- 172.21.15.79:0/3444094137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ec0b5610 0x7f23ec0cf000 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:02.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.849+0000 7f23f0a80700 1 -- 172.21.15.79:0/3444094137 >> 172.21.15.79:0/3444094137 conn(0x7f23ec06dcc0 msgr2=0x7f23ec06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:02.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.849+0000 7f23f0a80700 1 -- 172.21.15.79:0/3444094137 shutdown_connections 2023-10-19T08:38:02.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.849+0000 7f23f0a80700 1 -- 172.21.15.79:0/3444094137 wait complete. 2023-10-19T08:38:02.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.850+0000 7f23f0a80700 1 Processor -- start 2023-10-19T08:38:02.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.850+0000 7f23f0a80700 1 -- start start 2023-10-19T08:38:02.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23f0a80700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23ec0ce5c0 0x7f23ec0c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:02.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23f0a80700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ec159f40 0x7f23ec0c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:02.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23f0a80700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23ec0c3f40 0x7f23ec0a7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:02.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23f0a80700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec0c4770 con 0x7f23ec159f40 2023-10-19T08:38:02.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23f0a80700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec0c4a50 con 0x7f23ec0c3f40 2023-10-19T08:38:02.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23f0a80700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec0c4d30 con 0x7f23ec0ce5c0 2023-10-19T08:38:02.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23e9d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ec159f40 0x7f23ec0c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:02.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23e9d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ec159f40 0x7f23ec0c3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45740/0 (socket says 172.21.15.79:45740) 2023-10-19T08:38:02.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23e9d9b700 1 -- 172.21.15.79:0/3350795288 learned_addr learned my addr 172.21.15.79:0/3350795288 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:02.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23ea59c700 1 --2- 172.21.15.79:0/3350795288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23ec0ce5c0 0x7f23ec0c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:02.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23ead9d700 1 --2- 172.21.15.79:0/3350795288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23ec0c3f40 0x7f23ec0a7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:02.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23e9d9b700 1 -- 172.21.15.79:0/3350795288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23ec0ce5c0 msgr2=0x7f23ec0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:02.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23e9d9b700 1 --2- 172.21.15.79:0/3350795288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23ec0ce5c0 0x7f23ec0c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:02.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23e9d9b700 1 -- 172.21.15.79:0/3350795288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23ec0c3f40 msgr2=0x7f23ec0a7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:02.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23e9d9b700 1 --2- 172.21.15.79:0/3350795288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23ec0c3f40 0x7f23ec0a7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:02.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23e9d9b700 1 -- 172.21.15.79:0/3350795288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc0094a0 con 0x7f23ec159f40 2023-10-19T08:38:02.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23e9d9b700 1 --2- 172.21.15.79:0/3350795288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ec159f40 0x7f23ec0c3a00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0090b0 tx=0x7f23dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:02.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23daffd700 1 -- 172.21.15.79:0/3350795288 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc0045f0 con 0x7f23ec159f40 2023-10-19T08:38:02.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23daffd700 1 -- 172.21.15.79:0/3350795288 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc01f070 con 0x7f23ec159f40 2023-10-19T08:38:02.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23f0a80700 1 -- 172.21.15.79:0/3350795288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ec0c5010 con 0x7f23ec159f40 2023-10-19T08:38:02.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23daffd700 1 -- 172.21.15.79:0/3350795288 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc003b00 con 0x7f23ec159f40 2023-10-19T08:38:02.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.851+0000 7f23f0a80700 1 -- 172.21.15.79:0/3350795288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ec0c43a0 con 0x7f23ec159f40 2023-10-19T08:38:02.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.852+0000 7f23f0a80700 1 -- 172.21.15.79:0/3350795288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ec0c5d50 con 0x7f23ec159f40 2023-10-19T08:38:02.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.853+0000 7f23daffd700 1 -- 172.21.15.79:0/3350795288 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f23dc003c60 con 0x7f23ec159f40 2023-10-19T08:38:02.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.853+0000 7f23daffd700 1 --2- 172.21.15.79:0/3350795288 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f23cc06a0e0 0x7f23cc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:02.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.853+0000 7f23daffd700 1 -- 172.21.15.79:0/3350795288 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f23dc021070 con 0x7f23ec159f40 2023-10-19T08:38:02.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.853+0000 7f23ea59c700 1 --2- 172.21.15.79:0/3350795288 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f23cc06a0e0 0x7f23cc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:02.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.853+0000 7f23ea59c700 1 --2- 172.21.15.79:0/3350795288 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f23cc06a0e0 0x7f23cc06c5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f23e000a950 tx=0x7f23e0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:02.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:02.857+0000 7f23daffd700 1 -- 172.21.15.79:0/3350795288 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f23dc0557a0 con 0x7f23ec159f40 2023-10-19T08:38:03.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.047+0000 7f23f0a80700 1 -- 172.21.15.79:0/3350795288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23ec0c4530 con 0x7f23ec159f40 2023-10-19T08:38:03.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.049+0000 7f23daffd700 1 -- 172.21.15.79:0/3350795288 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20060 (secure 0 0 0) 0x7f23ec0c4530 con 0x7f23ec159f40 2023-10-19T08:38:03.053 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:03.054 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":25,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:01.725914+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:03.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.051+0000 7f23f0a80700 1 -- 172.21.15.79:0/3350795288 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f23cc06a0e0 msgr2=0x7f23cc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:03.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.051+0000 7f23f0a80700 1 --2- 172.21.15.79:0/3350795288 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f23cc06a0e0 0x7f23cc06c5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f23e000a950 tx=0x7f23e0008040 comp rx=0 tx=0).stop 2023-10-19T08:38:03.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.051+0000 7f23f0a80700 1 -- 172.21.15.79:0/3350795288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ec159f40 msgr2=0x7f23ec0c3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:03.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.051+0000 7f23f0a80700 1 --2- 172.21.15.79:0/3350795288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ec159f40 0x7f23ec0c3a00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0090b0 tx=0x7f23dc004750 comp rx=0 tx=0).stop 2023-10-19T08:38:03.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.051+0000 7f23f0a80700 1 -- 172.21.15.79:0/3350795288 shutdown_connections 2023-10-19T08:38:03.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.051+0000 7f23f0a80700 1 --2- 172.21.15.79:0/3350795288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23ec0c3f40 0x7f23ec0a7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.051+0000 7f23f0a80700 1 --2- 172.21.15.79:0/3350795288 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f23cc06a0e0 0x7f23cc06c5a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.051+0000 7f23f0a80700 1 --2- 172.21.15.79:0/3350795288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23ec0ce5c0 0x7f23ec0c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.051+0000 7f23f0a80700 1 --2- 172.21.15.79:0/3350795288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23ec159f40 0x7f23ec0c3a00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.051+0000 7f23f0a80700 1 -- 172.21.15.79:0/3350795288 >> 172.21.15.79:0/3350795288 conn(0x7f23ec06dcc0 msgr2=0x7f23ec06e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:03.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.051+0000 7f23f0a80700 1 -- 172.21.15.79:0/3350795288 shutdown_connections 2023-10-19T08:38:03.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.051+0000 7f23f0a80700 1 -- 172.21.15.79:0/3350795288 wait complete. 2023-10-19T08:38:03.068 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:03.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.183+0000 7fd2311a6700 1 Processor -- start 2023-10-19T08:38:03.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.183+0000 7fd2311a6700 1 -- start start 2023-10-19T08:38:03.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.184+0000 7fd2311a6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd22c0af170 0x7fd22c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:03.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.184+0000 7fd2311a6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c15de50 con 0x7fd22c0b2270 2023-10-19T08:38:03.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.184+0000 7fd2311a6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c15e130 con 0x7fd22c0b1de0 2023-10-19T08:38:03.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.184+0000 7fd2311a6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22c0af550 con 0x7fd22c0af170 2023-10-19T08:38:03.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.184+0000 7fd22b59e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd22c0b2270 0x7fd22c06a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55822/0 (socket says 172.21.15.79:55822) 2023-10-19T08:38:03.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.184+0000 7fd22b59e700 1 -- 172.21.15.79:0/4039875191 learned_addr learned my addr 172.21.15.79:0/4039875191 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:03.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.184+0000 7fd22ad9d700 1 --2- 172.21.15.79:0/4039875191 >> v2:172.21.15.89:3300/0 conn(0x7fd22c0af170 0x7fd22c0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:03.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.185+0000 7fd229d9b700 1 -- 172.21.15.79:0/4039875191 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659988618 0 0) 0x7fd22c15de50 con 0x7fd22c0b2270 2023-10-19T08:38:03.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.185+0000 7fd229d9b700 1 -- 172.21.15.79:0/4039875191 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2140035b0 con 0x7fd22c0b2270 2023-10-19T08:38:03.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.185+0000 7fd22ad9d700 1 -- 172.21.15.79:0/4039875191 >> v1:172.21.15.89:6789/0 conn(0x7fd22c0b1de0 legacy=0x7fd22c0cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:03.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.185+0000 7fd22ad9d700 1 -- 172.21.15.79:0/4039875191 >> v1:172.21.15.79:6789/0 conn(0x7fd22c0b2270 legacy=0x7fd22c06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:03.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.185+0000 7fd22ad9d700 1 -- 172.21.15.79:0/4039875191 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c15e410 con 0x7fd22c0af170 2023-10-19T08:38:03.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.185+0000 7fd22ad9d700 1 --2- 172.21.15.79:0/4039875191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd22c0af170 0x7fd22c0cd0c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd220009870 tx=0x7fd220009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ed352038c102f9e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:03.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.185+0000 7fd229d9b700 1 -- 172.21.15.79:0/4039875191 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220011830 con 0x7fd22c0af170 2023-10-19T08:38:03.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.185+0000 7fd229d9b700 1 -- 172.21.15.79:0/4039875191 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd220011990 con 0x7fd22c0af170 2023-10-19T08:38:03.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.185+0000 7fd229d9b700 1 -- 172.21.15.79:0/4039875191 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220011d20 con 0x7fd22c0af170 2023-10-19T08:38:03.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.186+0000 7fd2311a6700 1 -- 172.21.15.79:0/4039875191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd22c0af170 msgr2=0x7fd22c0cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:03.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.186+0000 7fd2311a6700 1 --2- 172.21.15.79:0/4039875191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd22c0af170 0x7fd22c0cd0c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd220009870 tx=0x7fd220009b80 comp rx=0 tx=0).stop 2023-10-19T08:38:03.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.186+0000 7fd2311a6700 1 -- 172.21.15.79:0/4039875191 shutdown_connections 2023-10-19T08:38:03.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.186+0000 7fd2311a6700 1 --2- 172.21.15.79:0/4039875191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd22c0af170 0x7fd22c0cd0c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.186+0000 7fd2311a6700 1 -- 172.21.15.79:0/4039875191 >> 172.21.15.79:0/4039875191 conn(0x7fd22c06dcc0 msgr2=0x7fd22c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:03.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.186+0000 7fd2311a6700 1 -- 172.21.15.79:0/4039875191 shutdown_connections 2023-10-19T08:38:03.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.186+0000 7fd2311a6700 1 -- 172.21.15.79:0/4039875191 wait complete. 2023-10-19T08:38:03.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.187+0000 7fd2311a6700 1 Processor -- start 2023-10-19T08:38:03.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.187+0000 7fd2311a6700 1 -- start start 2023-10-19T08:38:03.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.188+0000 7fd2311a6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd22c0af170 0x7fd22c1f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:03.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.188+0000 7fd2311a6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd22c0b1de0 0x7fd22c0b4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:03.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.188+0000 7fd2311a6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd22c0b2270 0x7fd22c0b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:03.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.188+0000 7fd2311a6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c0b36e0 con 0x7fd22c0af170 2023-10-19T08:38:03.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.188+0000 7fd2311a6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c1f2f80 con 0x7fd22c0b2270 2023-10-19T08:38:03.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.188+0000 7fd2311a6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c0b2b60 con 0x7fd22c0b1de0 2023-10-19T08:38:03.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.188+0000 7fd22ad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd22c0af170 0x7fd22c1f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:03.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.188+0000 7fd22ad9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd22c0af170 0x7fd22c1f4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45752/0 (socket says 172.21.15.79:45752) 2023-10-19T08:38:03.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.188+0000 7fd22ad9d700 1 -- 172.21.15.79:0/2649117036 learned_addr learned my addr 172.21.15.79:0/2649117036 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:03.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.188+0000 7fd22b59e700 1 --2- 172.21.15.79:0/2649117036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd22c0b2270 0x7fd22c0b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:03.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.188+0000 7fd22a59c700 1 --2- 172.21.15.79:0/2649117036 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd22c0b1de0 0x7fd22c0b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:03.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.188+0000 7fd22ad9d700 1 -- 172.21.15.79:0/2649117036 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd22c0b1de0 msgr2=0x7fd22c0b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:03.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.188+0000 7fd22ad9d700 1 --2- 172.21.15.79:0/2649117036 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd22c0b1de0 0x7fd22c0b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.188+0000 7fd22ad9d700 1 -- 172.21.15.79:0/2649117036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd22c0b2270 msgr2=0x7fd22c0b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:03.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.188+0000 7fd22ad9d700 1 --2- 172.21.15.79:0/2649117036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd22c0b2270 0x7fd22c0b0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.188+0000 7fd22ad9d700 1 -- 172.21.15.79:0/2649117036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2200094a0 con 0x7fd22c0af170 2023-10-19T08:38:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.189+0000 7fd22ad9d700 1 --2- 172.21.15.79:0/2649117036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd22c0af170 0x7fd22c1f4440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd220000c00 tx=0x7fd220004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.189+0000 7fd2137fe700 1 -- 172.21.15.79:0/2649117036 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2200036a0 con 0x7fd22c0af170 2023-10-19T08:38:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.189+0000 7fd2137fe700 1 -- 172.21.15.79:0/2649117036 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22001f070 con 0x7fd22c0af170 2023-10-19T08:38:03.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.189+0000 7fd2137fe700 1 -- 172.21.15.79:0/2649117036 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220003a00 con 0x7fd22c0af170 2023-10-19T08:38:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.189+0000 7fd2311a6700 1 -- 172.21.15.79:0/2649117036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22c0b2e40 con 0x7fd22c0af170 2023-10-19T08:38:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.189+0000 7fd2311a6700 1 -- 172.21.15.79:0/2649117036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22c0b3400 con 0x7fd22c0af170 2023-10-19T08:38:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.190+0000 7fd2311a6700 1 -- 172.21.15.79:0/2649117036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22c1f3140 con 0x7fd22c0af170 2023-10-19T08:38:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.190+0000 7fd2137fe700 1 -- 172.21.15.79:0/2649117036 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd220003b60 con 0x7fd22c0af170 2023-10-19T08:38:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.190+0000 7fd2137fe700 1 --2- 172.21.15.79:0/2649117036 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd21806a110 0x7fd21806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:03.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.191+0000 7fd2137fe700 1 -- 172.21.15.79:0/2649117036 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd220021070 con 0x7fd22c0af170 2023-10-19T08:38:03.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.191+0000 7fd22a59c700 1 --2- 172.21.15.79:0/2649117036 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd21806a110 0x7fd21806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:03.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.191+0000 7fd22a59c700 1 --2- 172.21.15.79:0/2649117036 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd21806a110 0x7fd21806c5d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd22c06ace0 tx=0x7fd21c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:03.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.195+0000 7fd2137fe700 1 -- 172.21.15.79:0/2649117036 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd22c1f3140 con 0x7fd22c0af170 2023-10-19T08:38:03.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.389+0000 7fd2311a6700 1 -- 172.21.15.79:0/2649117036 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd22c1f3140 con 0x7fd22c0af170 2023-10-19T08:38:03.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.390+0000 7fd2137fe700 1 -- 172.21.15.79:0/2649117036 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20060 (secure 0 0 0) 0x7fd22c1f3140 con 0x7fd22c0af170 2023-10-19T08:38:03.395 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:03.395 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":25,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:01.725914+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:03.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.392+0000 7fd2311a6700 1 -- 172.21.15.79:0/2649117036 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd21806a110 msgr2=0x7fd21806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:03.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.392+0000 7fd2311a6700 1 --2- 172.21.15.79:0/2649117036 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd21806a110 0x7fd21806c5d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd22c06ace0 tx=0x7fd21c009040 comp rx=0 tx=0).stop 2023-10-19T08:38:03.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.392+0000 7fd2311a6700 1 -- 172.21.15.79:0/2649117036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd22c0af170 msgr2=0x7fd22c1f4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:03.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.392+0000 7fd2311a6700 1 --2- 172.21.15.79:0/2649117036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd22c0af170 0x7fd22c1f4440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd220000c00 tx=0x7fd220004750 comp rx=0 tx=0).stop 2023-10-19T08:38:03.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.392+0000 7fd2311a6700 1 -- 172.21.15.79:0/2649117036 shutdown_connections 2023-10-19T08:38:03.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.392+0000 7fd2311a6700 1 --2- 172.21.15.79:0/2649117036 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd22c0b2270 0x7fd22c0b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.392+0000 7fd2311a6700 1 --2- 172.21.15.79:0/2649117036 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd22c0af170 0x7fd22c1f4440 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.392+0000 7fd2311a6700 1 --2- 172.21.15.79:0/2649117036 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd21806a110 0x7fd21806c5d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.392+0000 7fd2311a6700 1 --2- 172.21.15.79:0/2649117036 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd22c0b1de0 0x7fd22c0b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.392+0000 7fd2311a6700 1 -- 172.21.15.79:0/2649117036 >> 172.21.15.79:0/2649117036 conn(0x7fd22c06dcc0 msgr2=0x7fd22c0cb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:03.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.392+0000 7fd2311a6700 1 -- 172.21.15.79:0/2649117036 shutdown_connections 2023-10-19T08:38:03.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.392+0000 7fd2311a6700 1 -- 172.21.15.79:0/2649117036 wait complete. 2023-10-19T08:38:03.540 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T08:38:03.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.656+0000 7f42b9dd9700 1 Processor -- start 2023-10-19T08:38:03.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.656+0000 7f42b9dd9700 1 -- start start 2023-10-19T08:38:03.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.657+0000 7f42b9dd9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f42b415af30 0x7f42b406a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:03.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.657+0000 7f42b9dd9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f42b415b310 0x7f42b406a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:03.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.657+0000 7f42b9dd9700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b40b2d90 con 0x7f42b406e7e0 2023-10-19T08:38:03.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.657+0000 7f42b9dd9700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b40ca630 con 0x7f42b415af30 2023-10-19T08:38:03.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.657+0000 7f42b9dd9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b40ca910 con 0x7f42b415b310 2023-10-19T08:38:03.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.657+0000 7f42b37fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f42b415af30 0x7f42b406a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:03.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.657+0000 7f42b3fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f42b406e7e0 0x7f42b40cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55836/0 (socket says 172.21.15.79:55836) 2023-10-19T08:38:03.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.657+0000 7f42b37fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f42b415af30 0x7f42b406a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45760/0 (socket says 172.21.15.79:45760) 2023-10-19T08:38:03.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.657+0000 7f42b3fff700 1 -- 172.21.15.79:0/397461766 learned_addr learned my addr 172.21.15.79:0/397461766 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:03.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.657+0000 7f42b2ffd700 1 --2- 172.21.15.79:0/397461766 >> v2:172.21.15.89:3300/0 conn(0x7f42b415b310 0x7f42b406a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:03.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.657+0000 7f42b37fe700 1 -- 172.21.15.79:0/397461766 >> v2:172.21.15.89:3300/0 conn(0x7f42b415b310 msgr2=0x7f42b406a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:03.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.657+0000 7f42b37fe700 1 --2- 172.21.15.79:0/397461766 >> v2:172.21.15.89:3300/0 conn(0x7f42b415b310 0x7f42b406a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.657+0000 7f42b37fe700 1 -- 172.21.15.79:0/397461766 >> v1:172.21.15.79:6789/0 conn(0x7f42b406e7e0 legacy=0x7f42b40cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:03.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.657+0000 7f42b37fe700 1 -- 172.21.15.79:0/397461766 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b40b20d0 con 0x7f42b415af30 2023-10-19T08:38:03.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.658+0000 7f42b37fe700 1 --2- 172.21.15.79:0/397461766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b415af30 0x7f42b406a220 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f42b40d0cd0 tx=0x7f429c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5feeb742e2fc71d server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:03.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.658+0000 7f42b27fc700 1 -- 172.21.15.79:0/397461766 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c011830 con 0x7f42b415af30 2023-10-19T08:38:03.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.658+0000 7f42b27fc700 1 -- 172.21.15.79:0/397461766 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c011990 con 0x7f42b415af30 2023-10-19T08:38:03.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.658+0000 7f42b27fc700 1 -- 172.21.15.79:0/397461766 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c011d20 con 0x7f42b415af30 2023-10-19T08:38:03.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.658+0000 7f42b9dd9700 1 -- 172.21.15.79:0/397461766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b415af30 msgr2=0x7f42b406a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:03.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.658+0000 7f42b9dd9700 1 --2- 172.21.15.79:0/397461766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b415af30 0x7f42b406a220 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f42b40d0cd0 tx=0x7f429c009b20 comp rx=0 tx=0).stop 2023-10-19T08:38:03.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.658+0000 7f42b9dd9700 1 -- 172.21.15.79:0/397461766 shutdown_connections 2023-10-19T08:38:03.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.658+0000 7f42b9dd9700 1 --2- 172.21.15.79:0/397461766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b415af30 0x7f42b406a220 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.658+0000 7f42b9dd9700 1 --2- 172.21.15.79:0/397461766 >> v2:172.21.15.89:3300/0 conn(0x7f42b415b310 0x7f42b406a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.658+0000 7f42b9dd9700 1 -- 172.21.15.79:0/397461766 >> 172.21.15.79:0/397461766 conn(0x7f42b406dcc0 msgr2=0x7f42b406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:03.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.658+0000 7f42b9dd9700 1 -- 172.21.15.79:0/397461766 shutdown_connections 2023-10-19T08:38:03.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.658+0000 7f42b9dd9700 1 -- 172.21.15.79:0/397461766 wait complete. 2023-10-19T08:38:03.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.659+0000 7f42b9dd9700 1 Processor -- start 2023-10-19T08:38:03.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.660+0000 7f42b9dd9700 1 -- start start 2023-10-19T08:38:03.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.660+0000 7f42b9dd9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42b406e7e0 0x7f42b40c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:03.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.660+0000 7f42b9dd9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42b415af30 0x7f42b41efe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:03.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.660+0000 7f42b9dd9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b414f0c0 0x7f42b40c4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:03.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.660+0000 7f42b9dd9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40c6da0 con 0x7f42b414f0c0 2023-10-19T08:38:03.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.660+0000 7f42b9dd9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b414f5f0 con 0x7f42b406e7e0 2023-10-19T08:38:03.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.660+0000 7f42b9dd9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b40c7010 con 0x7f42b415af30 2023-10-19T08:38:03.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.661+0000 7f42b3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b414f0c0 0x7f42b40c4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:03.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.661+0000 7f42b3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b414f0c0 0x7f42b40c4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45770/0 (socket says 172.21.15.79:45770) 2023-10-19T08:38:03.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.661+0000 7f42b3fff700 1 -- 172.21.15.79:0/967399157 learned_addr learned my addr 172.21.15.79:0/967399157 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:03.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.661+0000 7f42b37fe700 1 --2- 172.21.15.79:0/967399157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42b406e7e0 0x7f42b40c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:03.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.661+0000 7f42b2ffd700 1 --2- 172.21.15.79:0/967399157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42b415af30 0x7f42b41efe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:03.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.661+0000 7f42b3fff700 1 -- 172.21.15.79:0/967399157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42b415af30 msgr2=0x7f42b41efe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:03.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.661+0000 7f42b3fff700 1 --2- 172.21.15.79:0/967399157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42b415af30 0x7f42b41efe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.661+0000 7f42b3fff700 1 -- 172.21.15.79:0/967399157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42b406e7e0 msgr2=0x7f42b40c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.661+0000 7f42b3fff700 1 --2- 172.21.15.79:0/967399157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42b406e7e0 0x7f42b40c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.661+0000 7f42b3fff700 1 -- 172.21.15.79:0/967399157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c0094a0 con 0x7f42b414f0c0 2023-10-19T08:38:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.661+0000 7f42b3fff700 1 --2- 172.21.15.79:0/967399157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b414f0c0 0x7f42b40c4cc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00cbc0 tx=0x7f42ac00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.661+0000 7f42abfff700 1 -- 172.21.15.79:0/967399157 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac00a9e0 con 0x7f42b414f0c0 2023-10-19T08:38:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.661+0000 7f42abfff700 1 -- 172.21.15.79:0/967399157 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac00ab40 con 0x7f42b414f0c0 2023-10-19T08:38:03.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.661+0000 7f42b9dd9700 1 -- 172.21.15.79:0/967399157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b40c72f0 con 0x7f42b414f0c0 2023-10-19T08:38:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.661+0000 7f42abfff700 1 -- 172.21.15.79:0/967399157 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac012400 con 0x7f42b414f0c0 2023-10-19T08:38:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.661+0000 7f42b9dd9700 1 -- 172.21.15.79:0/967399157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b40c5f60 con 0x7f42b414f0c0 2023-10-19T08:38:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.662+0000 7f42b9dd9700 1 -- 172.21.15.79:0/967399157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b40c74e0 con 0x7f42b414f0c0 2023-10-19T08:38:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.662+0000 7f42abfff700 1 -- 172.21.15.79:0/967399157 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f42ac01b3b0 con 0x7f42b414f0c0 2023-10-19T08:38:03.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.663+0000 7f42abfff700 1 --2- 172.21.15.79:0/967399157 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f429406a110 0x7f429406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.663+0000 7f42b37fe700 1 --2- 172.21.15.79:0/967399157 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f429406a110 0x7f429406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.663+0000 7f42abfff700 1 -- 172.21.15.79:0/967399157 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f42ac088300 con 0x7f42b414f0c0 2023-10-19T08:38:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.663+0000 7f42b37fe700 1 --2- 172.21.15.79:0/967399157 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f429406a110 0x7f429406c5d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f429c0090b0 tx=0x7f429c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:03.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.667+0000 7f42abfff700 1 -- 172.21.15.79:0/967399157 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f42ac0537b0 con 0x7f42b414f0c0 2023-10-19T08:38:03.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.898+0000 7f42b9dd9700 1 -- 172.21.15.79:0/967399157 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42b40b2380 con 0x7f42b414f0c0 2023-10-19T08:38:03.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.899+0000 7f42abfff700 1 -- 172.21.15.79:0/967399157 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4865 (secure 0 0 0) 0x7f42ac056dd0 con 0x7f42b414f0c0 2023-10-19T08:38:03.904 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:03.904 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3710906518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3710906518},{"type":"v1","addr":"172.21.15.89:6835","nonce":3710906518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3037310614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3037310614},{"type":"v1","addr":"172.21.15.79:6835","nonce":3037310614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/79656061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":79656061},{"type":"v1","addr":"172.21.15.79:6837","nonce":79656061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-19T08:37:56.667105+0000","modified":"2023-10-19T08:38:02.319488+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6833/3076620199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3076620199},{"type":"v1","addr":"172.21.15.89:6833","nonce":3076620199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-19T08:38:03.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.901+0000 7f42b9dd9700 1 -- 172.21.15.79:0/967399157 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f429406a110 msgr2=0x7f429406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:03.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.901+0000 7f42b9dd9700 1 --2- 172.21.15.79:0/967399157 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f429406a110 0x7f429406c5d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f429c0090b0 tx=0x7f429c008030 comp rx=0 tx=0).stop 2023-10-19T08:38:03.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.901+0000 7f42b9dd9700 1 -- 172.21.15.79:0/967399157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b414f0c0 msgr2=0x7f42b40c4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:03.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.901+0000 7f42b9dd9700 1 --2- 172.21.15.79:0/967399157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b414f0c0 0x7f42b40c4cc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00cbc0 tx=0x7f42ac00ced0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.901+0000 7f42b9dd9700 1 -- 172.21.15.79:0/967399157 shutdown_connections 2023-10-19T08:38:03.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.901+0000 7f42b9dd9700 1 --2- 172.21.15.79:0/967399157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b414f0c0 0x7f42b40c4cc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.901+0000 7f42b9dd9700 1 --2- 172.21.15.79:0/967399157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42b406e7e0 0x7f42b40c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.901+0000 7f42b9dd9700 1 --2- 172.21.15.79:0/967399157 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f429406a110 0x7f429406c5d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.901+0000 7f42b9dd9700 1 --2- 172.21.15.79:0/967399157 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42b415af30 0x7f42b41efe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:03.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.901+0000 7f42b9dd9700 1 -- 172.21.15.79:0/967399157 >> 172.21.15.79:0/967399157 conn(0x7f42b406dcc0 msgr2=0x7f42b40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:03.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.901+0000 7f42b9dd9700 1 -- 172.21.15.79:0/967399157 shutdown_connections 2023-10-19T08:38:03.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:03.901+0000 7f42b9dd9700 1 -- 172.21.15.79:0/967399157 wait complete. 2023-10-19T08:38:03.909 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 7 2023-10-19T08:38:03.917 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:04.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.032+0000 7f0e8cd2c700 1 Processor -- start 2023-10-19T08:38:04.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.032+0000 7f0e8cd2c700 1 -- start start 2023-10-19T08:38:04.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.033+0000 7f0e8cd2c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0e88159f40 0x7f0e8815e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.033+0000 7f0e8cd2c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0e880cf710 0x7f0e880cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.033+0000 7f0e8cd2c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e8815e870 con 0x7f0e880b5610 2023-10-19T08:38:04.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.033+0000 7f0e8cd2c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e880b5aa0 con 0x7f0e880cf710 2023-10-19T08:38:04.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.034+0000 7f0e8cd2c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e880cd800 con 0x7f0e88159f40 2023-10-19T08:38:04.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.034+0000 7f0e86d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0e880cf710 0x7f0e880cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.034+0000 7f0e86d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0e880cf710 0x7f0e880cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45778/0 (socket says 172.21.15.79:45778) 2023-10-19T08:38:04.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.034+0000 7f0e86d9d700 1 -- 172.21.15.79:0/2477825840 learned_addr learned my addr 172.21.15.79:0/2477825840 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:04.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.034+0000 7f0e8659c700 1 --2- 172.21.15.79:0/2477825840 >> v2:172.21.15.89:3300/0 conn(0x7f0e88159f40 0x7f0e8815e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.034+0000 7f0e86d9d700 1 -- 172.21.15.79:0/2477825840 >> v2:172.21.15.89:3300/0 conn(0x7f0e88159f40 msgr2=0x7f0e8815e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:04.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.034+0000 7f0e86d9d700 1 --2- 172.21.15.79:0/2477825840 >> v2:172.21.15.89:3300/0 conn(0x7f0e88159f40 0x7f0e8815e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.034+0000 7f0e86d9d700 1 -- 172.21.15.79:0/2477825840 >> v1:172.21.15.89:6789/0 conn(0x7f0e880b5610 legacy=0x7f0e880cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:04.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.034+0000 7f0e86d9d700 1 -- 172.21.15.79:0/2477825840 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e880cdae0 con 0x7f0e880cf710 2023-10-19T08:38:04.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.034+0000 7f0e86d9d700 1 --2- 172.21.15.79:0/2477825840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e880cf710 0x7f0e880cb860 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0e8806d540 tx=0x7f0e8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba2b01e9d29e5af server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:04.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.034+0000 7f0e8559a700 1 -- 172.21.15.79:0/2477825840 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8000e070 con 0x7f0e880cf710 2023-10-19T08:38:04.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.034+0000 7f0e8559a700 1 -- 172.21.15.79:0/2477825840 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8000b910 con 0x7f0e880cf710 2023-10-19T08:38:04.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.034+0000 7f0e8559a700 1 -- 172.21.15.79:0/2477825840 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8000bcc0 con 0x7f0e880cf710 2023-10-19T08:38:04.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.035+0000 7f0e8cd2c700 1 -- 172.21.15.79:0/2477825840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e880cf710 msgr2=0x7f0e880cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:04.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.035+0000 7f0e8cd2c700 1 --2- 172.21.15.79:0/2477825840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e880cf710 0x7f0e880cb860 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0e8806d540 tx=0x7f0e8000b330 comp rx=0 tx=0).stop 2023-10-19T08:38:04.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.035+0000 7f0e8cd2c700 1 -- 172.21.15.79:0/2477825840 shutdown_connections 2023-10-19T08:38:04.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.035+0000 7f0e8cd2c700 1 --2- 172.21.15.79:0/2477825840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e880cf710 0x7f0e880cb860 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.035+0000 7f0e8cd2c700 1 --2- 172.21.15.79:0/2477825840 >> v2:172.21.15.89:3300/0 conn(0x7f0e88159f40 0x7f0e8815e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.035+0000 7f0e8cd2c700 1 -- 172.21.15.79:0/2477825840 >> 172.21.15.79:0/2477825840 conn(0x7f0e8806dcc0 msgr2=0x7f0e8806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:04.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.035+0000 7f0e8cd2c700 1 -- 172.21.15.79:0/2477825840 shutdown_connections 2023-10-19T08:38:04.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.035+0000 7f0e8cd2c700 1 -- 172.21.15.79:0/2477825840 wait complete. 2023-10-19T08:38:04.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.036+0000 7f0e8cd2c700 1 Processor -- start 2023-10-19T08:38:04.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.036+0000 7f0e8cd2c700 1 -- start start 2023-10-19T08:38:04.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.037+0000 7f0e8cd2c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e880cf710 0x7f0e880b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.037+0000 7f0e8cd2c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e88159f40 0x7f0e880b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.037+0000 7f0e8cd2c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e880c9110 0x7f0e88150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.037+0000 7f0e8cd2c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e881521f0 con 0x7f0e880cf710 2023-10-19T08:38:04.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.037+0000 7f0e8cd2c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e88151670 con 0x7f0e880c9110 2023-10-19T08:38:04.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.037+0000 7f0e8cd2c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e88151950 con 0x7f0e88159f40 2023-10-19T08:38:04.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.037+0000 7f0e8659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e880cf710 0x7f0e880b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.037+0000 7f0e8659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e880cf710 0x7f0e880b2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45780/0 (socket says 172.21.15.79:45780) 2023-10-19T08:38:04.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.037+0000 7f0e8659c700 1 -- 172.21.15.79:0/4100755068 learned_addr learned my addr 172.21.15.79:0/4100755068 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:04.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.037+0000 7f0e8659c700 1 -- 172.21.15.79:0/4100755068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e88159f40 msgr2=0x7f0e880b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:04.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.037+0000 7f0e85d9b700 1 --2- 172.21.15.79:0/4100755068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e88159f40 0x7f0e880b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.037+0000 7f0e86d9d700 1 --2- 172.21.15.79:0/4100755068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e880c9110 0x7f0e88150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.037+0000 7f0e8659c700 1 --2- 172.21.15.79:0/4100755068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e88159f40 0x7f0e880b2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.037+0000 7f0e8659c700 1 -- 172.21.15.79:0/4100755068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e880c9110 msgr2=0x7f0e88150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:04.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.037+0000 7f0e8659c700 1 --2- 172.21.15.79:0/4100755068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e880c9110 0x7f0e88150790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.037+0000 7f0e8659c700 1 -- 172.21.15.79:0/4100755068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e80009b30 con 0x7f0e880cf710 2023-10-19T08:38:04.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.037+0000 7f0e8659c700 1 --2- 172.21.15.79:0/4100755068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e880cf710 0x7f0e880b2880 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c00e9b0 tx=0x7f0e7c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:04.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.038+0000 7f0e76ffd700 1 -- 172.21.15.79:0/4100755068 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c009710 con 0x7f0e880cf710 2023-10-19T08:38:04.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.038+0000 7f0e76ffd700 1 -- 172.21.15.79:0/4100755068 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7c00c850 con 0x7f0e880cf710 2023-10-19T08:38:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.038+0000 7f0e8cd2c700 1 -- 172.21.15.79:0/4100755068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e88151c30 con 0x7f0e880cf710 2023-10-19T08:38:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.038+0000 7f0e76ffd700 1 -- 172.21.15.79:0/4100755068 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c00cbc0 con 0x7f0e880cf710 2023-10-19T08:38:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.038+0000 7f0e8cd2c700 1 -- 172.21.15.79:0/4100755068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e88150cd0 con 0x7f0e880cf710 2023-10-19T08:38:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.039+0000 7f0e8cd2c700 1 -- 172.21.15.79:0/4100755068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e880c6f70 con 0x7f0e880cf710 2023-10-19T08:38:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.039+0000 7f0e76ffd700 1 -- 172.21.15.79:0/4100755068 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0e7c00cd20 con 0x7f0e880cf710 2023-10-19T08:38:04.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.039+0000 7f0e76ffd700 1 --2- 172.21.15.79:0/4100755068 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0e6806a0e0 0x7f0e6806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.039+0000 7f0e76ffd700 1 -- 172.21.15.79:0/4100755068 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0e7c0889d0 con 0x7f0e880cf710 2023-10-19T08:38:04.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.039+0000 7f0e85d9b700 1 --2- 172.21.15.79:0/4100755068 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0e6806a0e0 0x7f0e6806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.040+0000 7f0e85d9b700 1 --2- 172.21.15.79:0/4100755068 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0e6806a0e0 0x7f0e6806c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0e88152b80 tx=0x7f0e78009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:04.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.044+0000 7f0e76ffd700 1 -- 172.21.15.79:0/4100755068 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f0e7c057860 con 0x7f0e880cf710 2023-10-19T08:38:04.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.237+0000 7f0e8cd2c700 1 -- 172.21.15.79:0/4100755068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e8804ee70 con 0x7f0e880cf710 2023-10-19T08:38:04.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.238+0000 7f0e76ffd700 1 -- 172.21.15.79:0/4100755068 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20060 (secure 0 0 0) 0x7f0e7c0573f0 con 0x7f0e880cf710 2023-10-19T08:38:04.243 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:04.243 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":25,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:01.725914+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:04.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.240+0000 7f0e8cd2c700 1 -- 172.21.15.79:0/4100755068 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0e6806a0e0 msgr2=0x7f0e6806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:04.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.240+0000 7f0e8cd2c700 1 --2- 172.21.15.79:0/4100755068 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0e6806a0e0 0x7f0e6806c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0e88152b80 tx=0x7f0e78009040 comp rx=0 tx=0).stop 2023-10-19T08:38:04.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.240+0000 7f0e8cd2c700 1 -- 172.21.15.79:0/4100755068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e880cf710 msgr2=0x7f0e880b2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:04.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.240+0000 7f0e8cd2c700 1 --2- 172.21.15.79:0/4100755068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e880cf710 0x7f0e880b2880 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c00e9b0 tx=0x7f0e7c00ed70 comp rx=0 tx=0).stop 2023-10-19T08:38:04.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.240+0000 7f0e8cd2c700 1 -- 172.21.15.79:0/4100755068 shutdown_connections 2023-10-19T08:38:04.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.240+0000 7f0e8cd2c700 1 --2- 172.21.15.79:0/4100755068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e880c9110 0x7f0e88150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.240+0000 7f0e8cd2c700 1 --2- 172.21.15.79:0/4100755068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e880cf710 0x7f0e880b2880 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.240+0000 7f0e8cd2c700 1 --2- 172.21.15.79:0/4100755068 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0e6806a0e0 0x7f0e6806c5a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.240+0000 7f0e8cd2c700 1 --2- 172.21.15.79:0/4100755068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0e88159f40 0x7f0e880b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.240+0000 7f0e8cd2c700 1 -- 172.21.15.79:0/4100755068 >> 172.21.15.79:0/4100755068 conn(0x7f0e8806dcc0 msgr2=0x7f0e880b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:04.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.240+0000 7f0e8cd2c700 1 -- 172.21.15.79:0/4100755068 shutdown_connections 2023-10-19T08:38:04.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.240+0000 7f0e8cd2c700 1 -- 172.21.15.79:0/4100755068 wait complete. 2023-10-19T08:38:04.659 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-19T08:37:56.667105+0000', 'modified': '2023-10-19T08:38:02.319488+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6833/3076620199', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6832', 'nonce': 3076620199}, {'type': 'v1', 'addr': '172.21.15.89:6833', 'nonce': 3076620199}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-10-19T08:38:04.660 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-19T08:38:04.660 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-19T08:38:04.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.780+0000 7f890134c700 1 Processor -- start 2023-10-19T08:38:04.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.780+0000 7f890134c700 1 -- start start 2023-10-19T08:38:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.781+0000 7f890134c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f88fc159f40 0x7f88fc15e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.781+0000 7f890134c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88fc15e870 con 0x7f88fc0b5610 2023-10-19T08:38:04.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.781+0000 7f890134c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88fc0b5aa0 con 0x7f88fc0cf710 2023-10-19T08:38:04.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.781+0000 7f890134c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88fc0cd800 con 0x7f88fc159f40 2023-10-19T08:38:04.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.781+0000 7f88fa7fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f88fc0b5610 0x7f88fc0cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55860/0 (socket says 172.21.15.79:55860) 2023-10-19T08:38:04.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.781+0000 7f88fa7fc700 1 -- 172.21.15.79:0/3754505679 learned_addr learned my addr 172.21.15.79:0/3754505679 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:04.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88f9ffb700 1 -- 172.21.15.79:0/3754505679 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015652046 0 0) 0x7f88fc15e870 con 0x7f88fc0b5610 2023-10-19T08:38:04.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88faffd700 1 --2- 172.21.15.79:0/3754505679 >> v2:172.21.15.89:3300/0 conn(0x7f88fc159f40 0x7f88fc15e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88f9ffb700 1 -- 172.21.15.79:0/3754505679 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88e40035b0 con 0x7f88fc0b5610 2023-10-19T08:38:04.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88f9ffb700 1 -- 172.21.15.79:0/3754505679 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 233728278 0 0) 0x7f88e40035b0 con 0x7f88fc0b5610 2023-10-19T08:38:04.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88f9ffb700 1 -- 172.21.15.79:0/3754505679 >> v2:172.21.15.89:3300/0 conn(0x7f88fc159f40 msgr2=0x7f88fc15e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:04.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88f9ffb700 1 --2- 172.21.15.79:0/3754505679 >> v2:172.21.15.89:3300/0 conn(0x7f88fc159f40 0x7f88fc15e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88f9ffb700 1 -- 172.21.15.79:0/3754505679 >> v1:172.21.15.89:6789/0 conn(0x7f88fc0cf710 legacy=0x7f88fc0cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:04.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88f9ffb700 1 -- 172.21.15.79:0/3754505679 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88fc0cdae0 con 0x7f88fc0b5610 2023-10-19T08:38:04.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88f9ffb700 1 -- 172.21.15.79:0/3754505679 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f88ec001670 con 0x7f88fc0b5610 2023-10-19T08:38:04.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88f9ffb700 1 -- 172.21.15.79:0/3754505679 >> v1:172.21.15.79:6789/0 conn(0x7f88fc0b5610 legacy=0x7f88fc0cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:04.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88f9ffb700 1 --2- 172.21.15.79:0/3754505679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88e4003a00 0x7f88e4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88f9ffb700 1 --2- 172.21.15.79:0/3754505679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88e4004850 0x7f88e4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88f9ffb700 1 --2- 172.21.15.79:0/3754505679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88e4005210 0x7f88e400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88f9ffb700 1 -- 172.21.15.79:0/3754505679 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc0cd800 con 0x7f88e4005210 2023-10-19T08:38:04.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88f9ffb700 1 -- 172.21.15.79:0/3754505679 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e400c0b0 con 0x7f88e4004850 2023-10-19T08:38:04.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88f9ffb700 1 -- 172.21.15.79:0/3754505679 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e400c270 con 0x7f88e4003a00 2023-10-19T08:38:04.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88fb7fe700 1 --2- 172.21.15.79:0/3754505679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88e4005210 0x7f88e400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88fa7fc700 1 --2- 172.21.15.79:0/3754505679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88e4004850 0x7f88e4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88faffd700 1 --2- 172.21.15.79:0/3754505679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88e4003a00 0x7f88e4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88fb7fe700 1 -- 172.21.15.79:0/3754505679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88e4003a00 msgr2=0x7f88e4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:04.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88fb7fe700 1 --2- 172.21.15.79:0/3754505679 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88e4003a00 0x7f88e4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88fb7fe700 1 -- 172.21.15.79:0/3754505679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88e4004850 msgr2=0x7f88e4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:04.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88fb7fe700 1 --2- 172.21.15.79:0/3754505679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88e4004850 0x7f88e4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88fb7fe700 1 -- 172.21.15.79:0/3754505679 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e40035b0 con 0x7f88e4005210 2023-10-19T08:38:04.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88fb7fe700 1 -- 172.21.15.79:0/3754505679 reap_dead start 2023-10-19T08:38:04.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.782+0000 7f88fb7fe700 1 --2- 172.21.15.79:0/3754505679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88e4005210 0x7f88e400ba10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f88f400c190 tx=0x7f88e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26aefdafba66ce35 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:04.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.783+0000 7f88f9ffb700 1 -- 172.21.15.79:0/3754505679 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f4001db0 con 0x7f88e4005210 2023-10-19T08:38:04.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.783+0000 7f88f9ffb700 1 -- 172.21.15.79:0/3754505679 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f400ccf0 con 0x7f88e4005210 2023-10-19T08:38:04.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.783+0000 7f88f9ffb700 1 -- 172.21.15.79:0/3754505679 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f4003c40 con 0x7f88e4005210 2023-10-19T08:38:04.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.783+0000 7f890134c700 1 -- 172.21.15.79:0/3754505679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88e4005210 msgr2=0x7f88e400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:04.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.783+0000 7f890134c700 1 --2- 172.21.15.79:0/3754505679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88e4005210 0x7f88e400ba10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f88f400c190 tx=0x7f88e4005880 comp rx=0 tx=0).stop 2023-10-19T08:38:04.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.783+0000 7f890134c700 1 -- 172.21.15.79:0/3754505679 shutdown_connections 2023-10-19T08:38:04.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.783+0000 7f890134c700 1 --2- 172.21.15.79:0/3754505679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88e4005210 0x7f88e400ba10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.783+0000 7f890134c700 1 -- 172.21.15.79:0/3754505679 >> 172.21.15.79:0/3754505679 conn(0x7f88fc06dcc0 msgr2=0x7f88fc06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:04.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.783+0000 7f890134c700 1 -- 172.21.15.79:0/3754505679 shutdown_connections 2023-10-19T08:38:04.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.783+0000 7f890134c700 1 -- 172.21.15.79:0/3754505679 wait complete. 2023-10-19T08:38:04.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.784+0000 7f890134c700 1 Processor -- start 2023-10-19T08:38:04.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.784+0000 7f890134c700 1 -- start start 2023-10-19T08:38:04.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.785+0000 7f890134c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88e4005210 0x7f88fc152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.785+0000 7f890134c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88fc153450 0x7f88fc1564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.785+0000 7f890134c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88fc0b0de0 0x7f88fc1569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.785+0000 7f890134c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc0afb00 con 0x7f88fc153450 2023-10-19T08:38:04.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.785+0000 7f890134c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc0b0950 con 0x7f88e4005210 2023-10-19T08:38:04.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.785+0000 7f890134c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc0b24d0 con 0x7f88fc0b0de0 2023-10-19T08:38:04.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.785+0000 7f88fa7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88fc153450 0x7f88fc1564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.785+0000 7f88fa7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88fc153450 0x7f88fc1564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45802/0 (socket says 172.21.15.79:45802) 2023-10-19T08:38:04.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.785+0000 7f88fa7fc700 1 -- 172.21.15.79:0/470372849 learned_addr learned my addr 172.21.15.79:0/470372849 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:04.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.785+0000 7f88fb7fe700 1 --2- 172.21.15.79:0/470372849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88fc0b0de0 0x7f88fc1569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.785+0000 7f88faffd700 1 --2- 172.21.15.79:0/470372849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88e4005210 0x7f88fc152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.786+0000 7f88fa7fc700 1 -- 172.21.15.79:0/470372849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88fc0b0de0 msgr2=0x7f88fc1569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:04.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.786+0000 7f88fa7fc700 1 --2- 172.21.15.79:0/470372849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88fc0b0de0 0x7f88fc1569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.786+0000 7f88fa7fc700 1 -- 172.21.15.79:0/470372849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88e4005210 msgr2=0x7f88fc152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:04.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.786+0000 7f88fa7fc700 1 --2- 172.21.15.79:0/470372849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88e4005210 0x7f88fc152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.786+0000 7f88fa7fc700 1 -- 172.21.15.79:0/470372849 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88fc0b1f10 con 0x7f88fc153450 2023-10-19T08:38:04.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.786+0000 7f88fa7fc700 1 --2- 172.21.15.79:0/470372849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88fc153450 0x7f88fc1564a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0072f0 tx=0x7f88ec007600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:04.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.786+0000 7f88e37fe700 1 -- 172.21.15.79:0/470372849 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec00f660 con 0x7f88fc153450 2023-10-19T08:38:04.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.786+0000 7f88e37fe700 1 -- 172.21.15.79:0/470372849 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec00f7e0 con 0x7f88fc153450 2023-10-19T08:38:04.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.786+0000 7f890134c700 1 -- 172.21.15.79:0/470372849 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88fc0b21f0 con 0x7f88fc153450 2023-10-19T08:38:04.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.786+0000 7f88e37fe700 1 -- 172.21.15.79:0/470372849 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec00fb90 con 0x7f88fc153450 2023-10-19T08:38:04.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.786+0000 7f890134c700 1 -- 172.21.15.79:0/470372849 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88fc0af690 con 0x7f88fc153450 2023-10-19T08:38:04.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.787+0000 7f88e37fe700 1 -- 172.21.15.79:0/470372849 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f88ec00fcf0 con 0x7f88fc153450 2023-10-19T08:38:04.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.788+0000 7f88e37fe700 1 --2- 172.21.15.79:0/470372849 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f88e806a0e0 0x7f88e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.788+0000 7f88e37fe700 1 -- 172.21.15.79:0/470372849 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f88ec0880a0 con 0x7f88fc153450 2023-10-19T08:38:04.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.788+0000 7f88faffd700 1 --2- 172.21.15.79:0/470372849 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f88e806a0e0 0x7f88e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.788+0000 7f88faffd700 1 --2- 172.21.15.79:0/470372849 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f88e806a0e0 0x7f88e806c5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f88fc0ca030 tx=0x7f88f0009210 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:04.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.790+0000 7f890d4e7b80 1 Processor -- start 2023-10-19T08:38:04.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.790+0000 7f890d4e7b80 1 -- start start 2023-10-19T08:38:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f890d4e7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20e8270 0x563fc2107a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f890d4e7b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20c1de0 0x563fc20e8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f890d4e7b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8b90 0x563fc20c08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f890d4e7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc20195e0 con 0x563fc20e8270 2023-10-19T08:38:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f890d4e7b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc2016f00 con 0x563fc20e8b90 2023-10-19T08:38:04.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f890d4e7b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fc20127f0 con 0x563fc20c1de0 2023-10-19T08:38:04.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f88faffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20e8270 0x563fc2107a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f88faffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20e8270 0x563fc2107a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45808/0 (socket says 172.21.15.79:45808) 2023-10-19T08:38:04.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f88faffd700 1 -- 172.21.15.79:0/2654361055 learned_addr learned my addr 172.21.15.79:0/2654361055 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:04.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f88fb7fe700 1 --2- 172.21.15.79:0/2654361055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8b90 0x563fc20c08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f88fa7fc700 1 --2- 172.21.15.79:0/2654361055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20c1de0 0x563fc20e8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f88faffd700 1 -- 172.21.15.79:0/2654361055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20c1de0 msgr2=0x563fc20e8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:04.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f88faffd700 1 --2- 172.21.15.79:0/2654361055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20c1de0 0x563fc20e8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f88faffd700 1 -- 172.21.15.79:0/2654361055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8b90 msgr2=0x563fc20c08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:04.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f88faffd700 1 --2- 172.21.15.79:0/2654361055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8b90 0x563fc20c08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f88faffd700 1 -- 172.21.15.79:0/2654361055 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fc1e925e0 con 0x563fc20e8270 2023-10-19T08:38:04.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f88fa7fc700 1 --2- 172.21.15.79:0/2654361055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20c1de0 0x563fc20e8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f88fb7fe700 1 --2- 172.21.15.79:0/2654361055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8b90 0x563fc20c08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f88faffd700 1 --2- 172.21.15.79:0/2654361055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20e8270 0x563fc2107a10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f88f0014bc0 tx=0x7f88f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3c6b91f4842300 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f88e0ff9700 1 -- 172.21.15.79:0/2654361055 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0004240 con 0x563fc20e8270 2023-10-19T08:38:04.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f88e0ff9700 1 -- 172.21.15.79:0/2654361055 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f0019070 con 0x563fc20e8270 2023-10-19T08:38:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.791+0000 7f88e0ff9700 1 -- 172.21.15.79:0/2654361055 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f00045a0 con 0x563fc20e8270 2023-10-19T08:38:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.792+0000 7f890d4e7b80 1 -- 172.21.15.79:0/2654361055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20e8270 msgr2=0x563fc2107a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.792+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/2654361055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20e8270 0x563fc2107a10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f88f0014bc0 tx=0x7f88f0017000 comp rx=0 tx=0).stop 2023-10-19T08:38:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.792+0000 7f890d4e7b80 1 -- 172.21.15.79:0/2654361055 shutdown_connections 2023-10-19T08:38:04.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.792+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/2654361055 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8b90 0x563fc20c08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.792+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/2654361055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20e8270 0x563fc2107a10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.792+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/2654361055 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20c1de0 0x563fc20e8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.792+0000 7f890d4e7b80 1 -- 172.21.15.79:0/2654361055 >> 172.21.15.79:0/2654361055 conn(0x563fc1fed900 msgr2=0x563fc2106590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:04.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.792+0000 7f890d4e7b80 1 -- 172.21.15.79:0/2654361055 shutdown_connections 2023-10-19T08:38:04.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.792+0000 7f890d4e7b80 1 -- 172.21.15.79:0/2654361055 wait complete. 2023-10-19T08:38:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.793+0000 7f890d4e7b80 1 -- start start 2023-10-19T08:38:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.793+0000 7f890d4e7b80 1 Processor -- start 2023-10-19T08:38:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.793+0000 7f890d4e7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 0x563fc20ff8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.793+0000 7f890d4e7b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20e8270 0x563fc2108670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.793+0000 7f890d4e7b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8b90 0x563fc2108bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.793+0000 7f890d4e7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc1fb0a70 con 0x563fc20c1de0 2023-10-19T08:38:04.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.793+0000 7f890d4e7b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc1fb0770 con 0x563fc20e8b90 2023-10-19T08:38:04.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.793+0000 7f890d4e7b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fc1e948d0 con 0x563fc20e8270 2023-10-19T08:38:04.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.793+0000 7f890d4e7b80 10 client.0 _ll_register_callbacks cb 0x563fc1efaa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T08:38:04.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.793+0000 7f88faffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 0x563fc20ff8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.793+0000 7f88faffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 0x563fc20ff8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45814/0 (socket says 172.21.15.79:45814) 2023-10-19T08:38:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.793+0000 7f88faffd700 1 -- 172.21.15.79:0/1875966066 learned_addr learned my addr 172.21.15.79:0/1875966066 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f88fa7fc700 1 --2- 172.21.15.79:0/1875966066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20e8270 0x563fc2108670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f88fb7fe700 1 --2- 172.21.15.79:0/1875966066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8b90 0x563fc2108bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f88faffd700 1 -- 172.21.15.79:0/1875966066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20e8270 msgr2=0x563fc2108670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f88faffd700 1 --2- 172.21.15.79:0/1875966066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20e8270 0x563fc2108670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f88faffd700 1 -- 172.21.15.79:0/1875966066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8b90 msgr2=0x563fc2108bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f88faffd700 1 --2- 172.21.15.79:0/1875966066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8b90 0x563fc2108bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f88faffd700 1 -- 172.21.15.79:0/1875966066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f00148a0 con 0x563fc20c1de0 2023-10-19T08:38:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f88fa7fc700 1 --2- 172.21.15.79:0/1875966066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20e8270 0x563fc2108670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f88faffd700 1 --2- 172.21.15.79:0/1875966066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 0x563fc20ff8c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009fd0 tx=0x7f88f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eadff3247e2bb91c server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f88d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-19T08:38:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f88d9ffb700 1 -- 172.21.15.79:0/1875966066 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f00156a0 con 0x563fc20c1de0 2023-10-19T08:38:04.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f88d9ffb700 1 -- 172.21.15.79:0/1875966066 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f88f0003e40 con 0x563fc20c1de0 2023-10-19T08:38:04.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f890d4e7b80 1 -- 172.21.15.79:0/1875966066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563fc20b3cb0 con 0x563fc20c1de0 2023-10-19T08:38:04.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f88d9ffb700 1 -- 172.21.15.79:0/1875966066 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88f0015800 con 0x563fc20c1de0 2023-10-19T08:38:04.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f890d4e7b80 10 client.4446 fetch_fsmap learned FSMap version 7 2023-10-19T08:38:04.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f890d4e7b80 1 -- 172.21.15.79:0/1875966066 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x563fc1e3ed90 con 0x563fc20c1de0 2023-10-19T08:38:04.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f88d9ffb700 1 -- 172.21.15.79:0/1875966066 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563fc20b3cb0 con 0x563fc20c1de0 2023-10-19T08:38:04.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f88d9ffb700 1 -- 172.21.15.79:0/1875966066 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f88f0015960 con 0x563fc20c1de0 2023-10-19T08:38:04.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f890d4e7b80 10 client.4446 fetch_fsmap finished waiting for FSMap version 7 2023-10-19T08:38:04.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f890d4e7b80 10 client.4446 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-19T08:38:04.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f890d4e7b80 20 client.4446 populate_metadata read hostname 'smithi079' 2023-10-19T08:38:04.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/1875966066 >> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] conn(0x563fc211a510 0x563fc211a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f890d4e7b80 4 client.4446 mds_command: new command op to 4275 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-19T08:38:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.794+0000 7f890d4e7b80 1 -- 172.21.15.79:0/1875966066 --> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563fc200b7d0 con 0x563fc211a510 2023-10-19T08:38:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.795+0000 7f88fa7fc700 1 --2- 172.21.15.79:0/1875966066 >> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] conn(0x563fc211a510 0x563fc211a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.795+0000 7f88d9ffb700 10 client.4446 ms_handle_connect on v2:172.21.15.89:6832/3076620199 2023-10-19T08:38:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.795+0000 7f88fa7fc700 1 --2- 172.21.15.79:0/1875966066 >> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] conn(0x563fc211a510 0x563fc211a8f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31c50748b5aeeace server_cookie=5589364c707435f3 in_seq=0 out_seq=0 2023-10-19T08:38:04.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.796+0000 7f88d9ffb700 1 -- 172.21.15.79:0/1875966066 <== mds.0 v2:172.21.15.89:6832/3076620199 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563fc200b7d0 con 0x563fc211a510 2023-10-19T08:38:04.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.796+0000 7f88d9ffb700 10 client.4446 handle_command_reply: tid=0 2023-10-19T08:38:04.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.796+0000 7f890d4e7b80 1 client.4446 shutdown 2023-10-19T08:38:04.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.796+0000 7f890d4e7b80 1 -- 172.21.15.79:0/1875966066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 msgr2=0x563fc20ff8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:04.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.796+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/1875966066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 0x563fc20ff8c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009fd0 tx=0x7f88f0004750 comp rx=0 tx=0).stop 2023-10-19T08:38:04.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.796+0000 7f890d4e7b80 1 -- 172.21.15.79:0/1875966066 shutdown_connections 2023-10-19T08:38:04.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.796+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/1875966066 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8b90 0x563fc2108bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.796+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/1875966066 >> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] conn(0x563fc211a510 0x563fc211a8f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.796+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/1875966066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 0x563fc20ff8c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.796+0000 7f88d9ffb700 0 client.4446 ms_handle_reset on v2:172.21.15.89:6832/3076620199 2023-10-19T08:38:04.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.796+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/1875966066 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20e8270 0x563fc2108670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.796+0000 7f890d4e7b80 1 -- 172.21.15.79:0/1875966066 >> 172.21.15.79:0/1875966066 conn(0x563fc1fed900 msgr2=0x563fc20ba4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:04.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.796+0000 7f890d4e7b80 1 -- 172.21.15.79:0/1875966066 shutdown_connections 2023-10-19T08:38:04.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.796+0000 7f890d4e7b80 1 -- 172.21.15.79:0/1875966066 wait complete. 2023-10-19T08:38:04.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.796+0000 7f890d4e7b80 20 client.4446 trim_cache size 0 max 16384 2023-10-19T08:38:04.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.813+0000 7f890d4e7b80 1 Processor -- start 2023-10-19T08:38:04.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.813+0000 7f890d4e7b80 1 -- start start 2023-10-19T08:38:04.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f890d4e7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 0x563fc20ba4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f890d4e7b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8270 0x563fc20bc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f890d4e7b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20e8b90 0x563fc20fe320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f890d4e7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc20ff800 con 0x563fc20c1de0 2023-10-19T08:38:04.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f890d4e7b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc2123560 con 0x563fc20e8270 2023-10-19T08:38:04.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f890d4e7b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fc20e6080 con 0x563fc20e8b90 2023-10-19T08:38:04.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f88faffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 0x563fc20ba4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f88faffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 0x563fc20ba4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45822/0 (socket says 172.21.15.79:45822) 2023-10-19T08:38:04.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f88faffd700 1 -- 172.21.15.79:0/891679072 learned_addr learned my addr 172.21.15.79:0/891679072 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:04.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f88fb7fe700 1 --2- 172.21.15.79:0/891679072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20e8b90 0x563fc20fe320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f88fa7fc700 1 --2- 172.21.15.79:0/891679072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8270 0x563fc20bc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f88faffd700 1 -- 172.21.15.79:0/891679072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20e8b90 msgr2=0x563fc20fe320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:04.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f88faffd700 1 --2- 172.21.15.79:0/891679072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20e8b90 0x563fc20fe320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f88faffd700 1 -- 172.21.15.79:0/891679072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8270 msgr2=0x563fc20bc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:04.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f88faffd700 1 --2- 172.21.15.79:0/891679072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8270 0x563fc20bc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f88faffd700 1 -- 172.21.15.79:0/891679072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fc1e27c10 con 0x563fc20c1de0 2023-10-19T08:38:04.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f88faffd700 1 --2- 172.21.15.79:0/891679072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 0x563fc20ba4c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f88f0014b70 tx=0x7f88f002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32714df40fa51b92 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:04.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f88e17fa700 1 -- 172.21.15.79:0/891679072 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0003e40 con 0x563fc20c1de0 2023-10-19T08:38:04.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f88e17fa700 1 -- 172.21.15.79:0/891679072 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f0005a20 con 0x563fc20c1de0 2023-10-19T08:38:04.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.814+0000 7f88e17fa700 1 -- 172.21.15.79:0/891679072 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0005d90 con 0x563fc20c1de0 2023-10-19T08:38:04.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.815+0000 7f890d4e7b80 1 -- 172.21.15.79:0/891679072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 msgr2=0x563fc20ba4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:04.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.815+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/891679072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 0x563fc20ba4c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f88f0014b70 tx=0x7f88f002e000 comp rx=0 tx=0).stop 2023-10-19T08:38:04.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.815+0000 7f890d4e7b80 1 -- 172.21.15.79:0/891679072 shutdown_connections 2023-10-19T08:38:04.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.815+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/891679072 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20e8b90 0x563fc20fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.815+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/891679072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 0x563fc20ba4c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.815+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/891679072 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8270 0x563fc20bc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.815+0000 7f890d4e7b80 1 -- 172.21.15.79:0/891679072 >> 172.21.15.79:0/891679072 conn(0x563fc1fed900 msgr2=0x563fc211a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:04.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.815+0000 7f890d4e7b80 1 -- 172.21.15.79:0/891679072 shutdown_connections 2023-10-19T08:38:04.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.815+0000 7f890d4e7b80 1 -- 172.21.15.79:0/891679072 wait complete. 2023-10-19T08:38:04.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.816+0000 7f890d4e7b80 1 -- start start 2023-10-19T08:38:04.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.816+0000 7f890d4e7b80 1 Processor -- start 2023-10-19T08:38:04.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.816+0000 7f890d4e7b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 0x563fc20eb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.816+0000 7f890d4e7b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8270 0x563fc20e6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.816+0000 7f890d4e7b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20e8b90 0x563fc20e74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.816+0000 7f890d4e7b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc20ebdc0 con 0x563fc20c1de0 2023-10-19T08:38:04.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.816+0000 7f890d4e7b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fc211bc00 con 0x563fc20e8270 2023-10-19T08:38:04.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.816+0000 7f890d4e7b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fc2107ec0 con 0x563fc20e8b90 2023-10-19T08:38:04.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.816+0000 7f890d4e7b80 10 client.0 _ll_register_callbacks cb 0x7f88f00045b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T08:38:04.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.816+0000 7f88faffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 0x563fc20eb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.816+0000 7f88faffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 0x563fc20eb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45828/0 (socket says 172.21.15.79:45828) 2023-10-19T08:38:04.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.816+0000 7f88faffd700 1 -- 172.21.15.79:0/2108651971 learned_addr learned my addr 172.21.15.79:0/2108651971 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:04.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f88fb7fe700 1 --2- 172.21.15.79:0/2108651971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20e8b90 0x563fc20e74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f88fa7fc700 1 --2- 172.21.15.79:0/2108651971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8270 0x563fc20e6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f88faffd700 1 -- 172.21.15.79:0/2108651971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20e8b90 msgr2=0x563fc20e74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:04.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f88faffd700 1 --2- 172.21.15.79:0/2108651971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20e8b90 0x563fc20e74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f88faffd700 1 -- 172.21.15.79:0/2108651971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8270 msgr2=0x563fc20e6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:04.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f88faffd700 1 --2- 172.21.15.79:0/2108651971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8270 0x563fc20e6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f88faffd700 1 -- 172.21.15.79:0/2108651971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563fc1e3ed90 con 0x563fc20c1de0 2023-10-19T08:38:04.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f88faffd700 1 --2- 172.21.15.79:0/2108651971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 0x563fc20eb880 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009fd0 tx=0x7f88f0023070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49059150f534c11 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:04.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f88d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-19T08:38:04.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f88d9ffb700 1 -- 172.21.15.79:0/2108651971 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0014690 con 0x563fc20c1de0 2023-10-19T08:38:04.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f88d9ffb700 1 -- 172.21.15.79:0/2108651971 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f88f0003e40 con 0x563fc20c1de0 2023-10-19T08:38:04.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f890d4e7b80 1 -- 172.21.15.79:0/2108651971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f88f0019070 con 0x563fc20c1de0 2023-10-19T08:38:04.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f88d9ffb700 1 -- 172.21.15.79:0/2108651971 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88f00382f0 con 0x563fc20c1de0 2023-10-19T08:38:04.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f890d4e7b80 10 client.4452 fetch_fsmap learned FSMap version 7 2023-10-19T08:38:04.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f890d4e7b80 1 -- 172.21.15.79:0/2108651971 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x563fc1e65200 con 0x563fc20c1de0 2023-10-19T08:38:04.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f88d9ffb700 1 -- 172.21.15.79:0/2108651971 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f0019070 con 0x563fc20c1de0 2023-10-19T08:38:04.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f88d9ffb700 1 -- 172.21.15.79:0/2108651971 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f88f0048070 con 0x563fc20c1de0 2023-10-19T08:38:04.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f890d4e7b80 10 client.4452 fetch_fsmap finished waiting for FSMap version 7 2023-10-19T08:38:04.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f890d4e7b80 10 client.4452 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-19T08:38:04.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f890d4e7b80 20 client.4452 populate_metadata read hostname 'smithi079' 2023-10-19T08:38:04.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/2108651971 >> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] conn(0x563fc211b470 0x563fc2109110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f890d4e7b80 4 client.4452 mds_command: new command op to 4275 tid=0[{"prefix": "status"}] 2023-10-19T08:38:04.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.817+0000 7f890d4e7b80 1 -- 172.21.15.79:0/2108651971 --> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563fc1fcc000 con 0x563fc211b470 2023-10-19T08:38:04.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.818+0000 7f88fa7fc700 1 --2- 172.21.15.79:0/2108651971 >> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] conn(0x563fc211b470 0x563fc2109110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.818+0000 7f88d9ffb700 10 client.4452 ms_handle_connect on v2:172.21.15.89:6832/3076620199 2023-10-19T08:38:04.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.818+0000 7f88fa7fc700 1 --2- 172.21.15.79:0/2108651971 >> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] conn(0x563fc211b470 0x563fc2109110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e647bfad47d6ad5a server_cookie=32184f5d6ba48036 in_seq=0 out_seq=0 2023-10-19T08:38:04.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.818+0000 7f88d9ffb700 1 -- 172.21.15.79:0/2108651971 <== mds.0 v2:172.21.15.89:6832/3076620199 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x563fc1fcc000 con 0x563fc211b470 2023-10-19T08:38:04.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.818+0000 7f88d9ffb700 10 client.4452 handle_command_reply: tid=0 2023-10-19T08:38:04.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.818+0000 7f890d4e7b80 1 client.4452 shutdown 2023-10-19T08:38:04.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.818+0000 7f890d4e7b80 1 -- 172.21.15.79:0/2108651971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 msgr2=0x563fc20eb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:04.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.818+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/2108651971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 0x563fc20eb880 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009fd0 tx=0x7f88f0023070 comp rx=0 tx=0).stop 2023-10-19T08:38:04.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.818+0000 7f890d4e7b80 1 -- 172.21.15.79:0/2108651971 shutdown_connections 2023-10-19T08:38:04.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.818+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/2108651971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x563fc20e8b90 0x563fc20e74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.818+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/2108651971 >> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] conn(0x563fc211b470 0x563fc2109110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.818+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/2108651971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fc20c1de0 0x563fc20eb880 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.818+0000 7f890d4e7b80 1 --2- 172.21.15.79:0/2108651971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x563fc20e8270 0x563fc20e6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.818+0000 7f88d9ffb700 0 client.4452 ms_handle_reset on v2:172.21.15.89:6832/3076620199 2023-10-19T08:38:04.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.818+0000 7f890d4e7b80 1 -- 172.21.15.79:0/2108651971 >> 172.21.15.79:0/2108651971 conn(0x563fc1fed900 msgr2=0x563fc211ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:04.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.818+0000 7f890d4e7b80 1 -- 172.21.15.79:0/2108651971 shutdown_connections 2023-10-19T08:38:04.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.818+0000 7f890d4e7b80 1 -- 172.21.15.79:0/2108651971 wait complete. 2023-10-19T08:38:04.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.818+0000 7f890d4e7b80 20 client.4452 trim_cache size 0 max 16384 2023-10-19T08:38:04.860 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-19T08:38:04.860 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "98eaa3c1-94c8-49a6-8b8d-caae2bee3a98", 2023-10-19T08:38:04.860 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2023-10-19T08:38:04.860 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4275, 2023-10-19T08:38:04.861 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2023-10-19T08:38:04.861 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2023-10-19T08:38:04.861 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2023-10-19T08:38:04.861 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 7.5435605639999999, 2023-10-19T08:38:04.861 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 7, 2023-10-19T08:38:04.861 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 25, 2023-10-19T08:38:04.862 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 25, 2023-10-19T08:38:04.862 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 13.579845116 2023-10-19T08:38:04.862 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-19T08:38:04.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.819+0000 7f890134c700 1 -- 172.21.15.79:0/470372849 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f88e806a0e0 msgr2=0x7f88e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:04.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.819+0000 7f890134c700 1 --2- 172.21.15.79:0/470372849 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f88e806a0e0 0x7f88e806c5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f88fc0ca030 tx=0x7f88f0009210 comp rx=0 tx=0).stop 2023-10-19T08:38:04.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.819+0000 7f890134c700 1 -- 172.21.15.79:0/470372849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88fc153450 msgr2=0x7f88fc1564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:04.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.819+0000 7f890134c700 1 --2- 172.21.15.79:0/470372849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88fc153450 0x7f88fc1564a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f88ec0072f0 tx=0x7f88ec007600 comp rx=0 tx=0).stop 2023-10-19T08:38:04.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.819+0000 7f890134c700 1 -- 172.21.15.79:0/470372849 shutdown_connections 2023-10-19T08:38:04.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.819+0000 7f890134c700 1 --2- 172.21.15.79:0/470372849 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f88e806a0e0 0x7f88e806c5a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.819+0000 7f890134c700 1 --2- 172.21.15.79:0/470372849 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88fc0b0de0 0x7f88fc1569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.819+0000 7f890134c700 1 --2- 172.21.15.79:0/470372849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88e4005210 0x7f88fc152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.819+0000 7f890134c700 1 --2- 172.21.15.79:0/470372849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88fc153450 0x7f88fc1564a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.819+0000 7f890134c700 1 -- 172.21.15.79:0/470372849 >> 172.21.15.79:0/470372849 conn(0x7f88fc06dcc0 msgr2=0x7f88fc06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:04.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.819+0000 7f890134c700 1 -- 172.21.15.79:0/470372849 shutdown_connections 2023-10-19T08:38:04.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.819+0000 7f890134c700 1 -- 172.21.15.79:0/470372849 wait complete. 2023-10-19T08:38:04.866 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-19T08:38:04.867 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-19T08:38:04.867 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-19T08:38:04.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.982+0000 7f39b00d8700 1 Processor -- start 2023-10-19T08:38:04.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.983+0000 7f39b00d8700 1 -- start start 2023-10-19T08:38:04.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.983+0000 7f39b00d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39a80cd0c0 0x7f39a80cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.983+0000 7f39b00d8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f39a80cdd40 0x7f39a806a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.983+0000 7f39b00d8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39a80cd520 con 0x7f39a80af170 2023-10-19T08:38:04.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.983+0000 7f39b00d8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a80af550 con 0x7f39a80cdd40 2023-10-19T08:38:04.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.983+0000 7f39b00d8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80b16b0 con 0x7f39a80cd0c0 2023-10-19T08:38:04.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.984+0000 7f39ae675700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f39a80cdd40 0x7f39a806a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.984+0000 7f39ade74700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f39a80af170 0x7f39a80b1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55908/0 (socket says 172.21.15.79:55908) 2023-10-19T08:38:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.984+0000 7f39ae675700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f39a80cdd40 0x7f39a806a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45840/0 (socket says 172.21.15.79:45840) 2023-10-19T08:38:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.984+0000 7f39ade74700 1 -- 172.21.15.79:0/3186642885 learned_addr learned my addr 172.21.15.79:0/3186642885 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.984+0000 7f39ad673700 1 --2- 172.21.15.79:0/3186642885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39a80cd0c0 0x7f39a80cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:04.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.984+0000 7f39ae675700 1 -- 172.21.15.79:0/3186642885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39a80cd0c0 msgr2=0x7f39a80cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.984+0000 7f39ae675700 1 --2- 172.21.15.79:0/3186642885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39a80cd0c0 0x7f39a80cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.984+0000 7f39ae675700 1 -- 172.21.15.79:0/3186642885 >> v1:172.21.15.79:6789/0 conn(0x7f39a80af170 legacy=0x7f39a80b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.984+0000 7f39ace72700 1 -- 172.21.15.79:0/3186642885 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4082105528 0 0) 0x7f39a80cd520 con 0x7f39a80af170 2023-10-19T08:38:04.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.984+0000 7f39ae675700 1 -- 172.21.15.79:0/3186642885 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a815de50 con 0x7f39a80cdd40 2023-10-19T08:38:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.984+0000 7f39ae675700 1 --2- 172.21.15.79:0/3186642885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39a80cdd40 0x7f39a806a220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009d90 tx=0x7f39a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fc5e7b6d4f96ff server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.984+0000 7f39ace72700 1 -- 172.21.15.79:0/3186642885 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a000e070 con 0x7f39a80cdd40 2023-10-19T08:38:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.984+0000 7f39ace72700 1 -- 172.21.15.79:0/3186642885 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a000bb20 con 0x7f39a80cdd40 2023-10-19T08:38:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.984+0000 7f39ace72700 1 -- 172.21.15.79:0/3186642885 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0012430 con 0x7f39a80cdd40 2023-10-19T08:38:04.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.985+0000 7f39b00d8700 1 -- 172.21.15.79:0/3186642885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39a80cdd40 msgr2=0x7f39a806a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.985+0000 7f39b00d8700 1 --2- 172.21.15.79:0/3186642885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39a80cdd40 0x7f39a806a220 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009d90 tx=0x7f39a000b330 comp rx=0 tx=0).stop 2023-10-19T08:38:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.985+0000 7f39b00d8700 1 -- 172.21.15.79:0/3186642885 shutdown_connections 2023-10-19T08:38:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.985+0000 7f39b00d8700 1 --2- 172.21.15.79:0/3186642885 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39a80cdd40 0x7f39a806a220 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.985+0000 7f39b00d8700 1 --2- 172.21.15.79:0/3186642885 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39a80cd0c0 0x7f39a80cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:04.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.985+0000 7f39b00d8700 1 -- 172.21.15.79:0/3186642885 >> 172.21.15.79:0/3186642885 conn(0x7f39a806dcc0 msgr2=0x7f39a806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.985+0000 7f39b00d8700 1 -- 172.21.15.79:0/3186642885 shutdown_connections 2023-10-19T08:38:04.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.985+0000 7f39b00d8700 1 -- 172.21.15.79:0/3186642885 wait complete. 2023-10-19T08:38:04.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.986+0000 7f39b00d8700 1 Processor -- start 2023-10-19T08:38:04.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.986+0000 7f39b00d8700 1 -- start start 2023-10-19T08:38:04.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39b00d8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39a80af170 0x7f39a80adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39b00d8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39a80cd0c0 0x7f39a80ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39b00d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39a80cdd40 0x7f39a8157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:04.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39b00d8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80b1f10 con 0x7f39a80cd0c0 2023-10-19T08:38:04.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39b00d8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80ac7e0 con 0x7f39a80af170 2023-10-19T08:38:04.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39b00d8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a80aca90 con 0x7f39a80cdd40 2023-10-19T08:38:05.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39ad673700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39a80cd0c0 0x7f39a80ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:05.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39ad673700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39a80cd0c0 0x7f39a80ac2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45844/0 (socket says 172.21.15.79:45844) 2023-10-19T08:38:05.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39ad673700 1 -- 172.21.15.79:0/1184762354 learned_addr learned my addr 172.21.15.79:0/1184762354 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:05.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39ade74700 1 --2- 172.21.15.79:0/1184762354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39a80af170 0x7f39a80adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:05.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39ae675700 1 --2- 172.21.15.79:0/1184762354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39a80cdd40 0x7f39a8157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:05.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39ad673700 1 -- 172.21.15.79:0/1184762354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39a80cdd40 msgr2=0x7f39a8157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:05.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39ad673700 1 --2- 172.21.15.79:0/1184762354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39a80cdd40 0x7f39a8157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:05.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39ad673700 1 -- 172.21.15.79:0/1184762354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39a80af170 msgr2=0x7f39a80adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:05.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39ad673700 1 --2- 172.21.15.79:0/1184762354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39a80af170 0x7f39a80adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39ad673700 1 -- 172.21.15.79:0/1184762354 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a0009a70 con 0x7f39a80cd0c0 2023-10-19T08:38:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39ae675700 1 --2- 172.21.15.79:0/1184762354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39a80cdd40 0x7f39a8157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39ade74700 1 --2- 172.21.15.79:0/1184762354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39a80af170 0x7f39a80adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39ad673700 1 --2- 172.21.15.79:0/1184762354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39a80cd0c0 0x7f39a80ac2a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f399800e9b0 tx=0x7f399800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:05.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f399e7fc700 1 -- 172.21.15.79:0/1184762354 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3998009710 con 0x7f39a80cd0c0 2023-10-19T08:38:05.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f399e7fc700 1 -- 172.21.15.79:0/1184762354 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399800c850 con 0x7f39a80cd0c0 2023-10-19T08:38:05.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39b00d8700 1 -- 172.21.15.79:0/1184762354 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a80acd70 con 0x7f39a80cd0c0 2023-10-19T08:38:05.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f399e7fc700 1 -- 172.21.15.79:0/1184762354 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399800cbc0 con 0x7f39a80cd0c0 2023-10-19T08:38:05.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.987+0000 7f39b00d8700 1 -- 172.21.15.79:0/1184762354 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a80ad330 con 0x7f39a80cd0c0 2023-10-19T08:38:05.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.988+0000 7f39b00d8700 1 -- 172.21.15.79:0/1184762354 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a80b2080 con 0x7f39a80cd0c0 2023-10-19T08:38:05.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.989+0000 7f399e7fc700 1 -- 172.21.15.79:0/1184762354 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f399800cd20 con 0x7f39a80cd0c0 2023-10-19T08:38:05.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.989+0000 7f399e7fc700 1 --2- 172.21.15.79:0/1184762354 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f398c06a110 0x7f398c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:05.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.989+0000 7f39ade74700 1 --2- 172.21.15.79:0/1184762354 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f398c06a110 0x7f398c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:05.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.989+0000 7f399e7fc700 1 -- 172.21.15.79:0/1184762354 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3998088a40 con 0x7f39a80cd0c0 2023-10-19T08:38:05.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.990+0000 7f39ade74700 1 --2- 172.21.15.79:0/1184762354 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f398c06a110 0x7f398c06c5d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f39a4000f60 tx=0x7f39a4007ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:05.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:04.994+0000 7f399e7fc700 1 -- 172.21.15.79:0/1184762354 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f39a80b2080 con 0x7f39a80cd0c0 2023-10-19T08:38:05.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:05.226+0000 7f39b00d8700 1 -- 172.21.15.79:0/1184762354 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f39a80b2050 con 0x7f39a80cd0c0 2023-10-19T08:38:05.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:05.226+0000 7f399e7fc700 1 -- 172.21.15.79:0/1184762354 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3998021070 con 0x7f39a80cd0c0 2023-10-19T08:38:05.231 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-19T08:38:05.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:05.228+0000 7f39b00d8700 1 -- 172.21.15.79:0/1184762354 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f398c06a110 msgr2=0x7f398c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:05.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:05.228+0000 7f39b00d8700 1 --2- 172.21.15.79:0/1184762354 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f398c06a110 0x7f398c06c5d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f39a4000f60 tx=0x7f39a4007ca0 comp rx=0 tx=0).stop 2023-10-19T08:38:05.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:05.228+0000 7f39b00d8700 1 -- 172.21.15.79:0/1184762354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39a80cd0c0 msgr2=0x7f39a80ac2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:05.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:05.228+0000 7f39b00d8700 1 --2- 172.21.15.79:0/1184762354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39a80cd0c0 0x7f39a80ac2a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f399800e9b0 tx=0x7f399800ed70 comp rx=0 tx=0).stop 2023-10-19T08:38:05.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:05.228+0000 7f39b00d8700 1 -- 172.21.15.79:0/1184762354 shutdown_connections 2023-10-19T08:38:05.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:05.228+0000 7f39b00d8700 1 --2- 172.21.15.79:0/1184762354 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f398c06a110 0x7f398c06c5d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:05.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:05.228+0000 7f39b00d8700 1 --2- 172.21.15.79:0/1184762354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39a80cdd40 0x7f39a8157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:05.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:05.228+0000 7f39b00d8700 1 --2- 172.21.15.79:0/1184762354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39a80af170 0x7f39a80adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:05.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:05.228+0000 7f39b00d8700 1 --2- 172.21.15.79:0/1184762354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f39a80cd0c0 0x7f39a80ac2a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:05.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:05.228+0000 7f39b00d8700 1 -- 172.21.15.79:0/1184762354 >> 172.21.15.79:0/1184762354 conn(0x7f39a806dcc0 msgr2=0x7f39a80cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:05.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:05.228+0000 7f39b00d8700 1 -- 172.21.15.79:0/1184762354 shutdown_connections 2023-10-19T08:38:05.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:05.228+0000 7f39b00d8700 1 -- 172.21.15.79:0/1184762354 wait complete. 2023-10-19T08:38:05.244 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-19T08:38:05.244 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-19T08:38:05.245 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-10-19T08:38:05.245 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-19T08:38:05.245 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-19T08:38:05.245 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-19T08:38:05.246 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-19T08:38:05.246 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-19T08:38:05.246 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-19T08:38:05.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:05.247 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-10-19T08:38:05.264 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-19T08:38:05.264 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-19T08:38:05.264 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-19T08:38:05.265 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:05.265 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-19T08:38:05.265 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:05.265 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:38:05.265 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:05.266 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:38:05.266 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:05.266 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:38:05.266 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:05.266 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-19T08:38:05.267 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:05.267 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-19T08:38:05.267 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42421sec preferred_lft 42421sec 2023-10-19T08:38:05.267 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::b457:4012:3867:53f6/64 scope link noprefixroute 2023-10-19T08:38:05.267 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:05.268 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-19T08:38:05.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:05.269 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-19T08:38:05.269 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-19T08:38:05.269 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add name ceph-brx type bridge 2023-10-19T08:38:05.270 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr flush dev ceph-brx 2023-10-19T08:38:05.270 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set ceph-brx up 2023-10-19T08:38:05.270 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-19T08:38:05.271 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-19T08:38:05.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:05.432 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-19T08:38:05.459 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-10-19T08:38:05.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:05.461 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-10-19T08:38:05.537 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-10-19T08:38:05.538 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-19T08:38:05.538 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-19T08:38:05.538 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-19T08:38:05.538 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-19T08:38:05.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:05.539 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-19T08:38:05.540 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-19T08:38:05.540 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-19T08:38:05.540 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-19T08:38:05.541 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-19T08:38:05.541 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-19T08:38:05.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:05.778 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-19T08:38:05.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:05.795 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list-id 2023-10-19T08:38:05.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:05.852 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-19T08:38:05.852 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-19T08:38:05.853 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-19T08:38:05.853 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-19T08:38:05.853 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-19T08:38:05.945 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-19T08:38:05.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:05.946 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-19T08:38:05.946 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-19T08:38:05.947 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-19T08:38:05.947 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-19T08:38:05.947 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-19T08:38:05.948 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-19T08:38:05.948 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-19T08:38:05.948 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-19T08:38:06.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:06.155 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-19T08:38:06.155 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-19T08:38:06.156 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-10-19T08:38:06.156 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set dev brx.0 master ceph-brx 2023-10-19T08:38:06.156 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-19T08:38:06.259 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-19T08:38:06.259 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-19T08:38:06.260 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-19T08:38:06.280 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-19T08:38:06.281 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-19T08:38:06.281 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-19T08:38:06.336 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2023-10-19T08:38:06.403 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-19T08:38:06.404 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-19T08:38:06.469 INFO:teuthology.orchestra.run.smithi079.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-19T08:38:06.470 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-19T08:38:06.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:06.471 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2023-10-19T08:38:06.528 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-19T08:38:06.528 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-19T08:38:06.571 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2023-10-19T08:38:06.596 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-19T08:38:06.596 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-19T08:38:06.663 INFO:teuthology.orchestra.run.smithi079.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-19T08:38:06.663 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-19T08:38:06.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:06.665 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2023-10-19T08:38:06.666 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi079.stderr:2023-10-19T08:38:06.662+0000 7f59c96275c0 -1 init, newargv = 0x55834ae31590 newargc=15 2023-10-19T08:38:06.667 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi079.stderr:ceph-fuse[112240]: starting ceph client 2023-10-19T08:38:06.672 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi079.stderr:ceph-fuse[112240]: starting fuse 2023-10-19T08:38:06.683 INFO:teuthology.orchestra.run.smithi079.stdout:46 2023-10-19T08:38:06.683 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-19T08:38:06.683 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2023-10-19T08:38:06.684 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2023-10-19T08:38:06.684 DEBUG:teuthology.orchestra.run.smithi079:> import re 2023-10-19T08:38:06.685 DEBUG:teuthology.orchestra.run.smithi079:> import os 2023-10-19T08:38:06.685 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2023-10-19T08:38:06.685 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-19T08:38:06.686 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2023-10-19T08:38:06.686 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-19T08:38:06.686 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2023-10-19T08:38:06.687 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-19T08:38:06.687 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-19T08:38:06.687 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2023-10-19T08:38:06.688 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2023-10-19T08:38:06.688 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2023-10-19T08:38:06.688 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2023-10-19T08:38:06.689 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-19T08:38:06.689 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2023-10-19T08:38:06.689 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-19T08:38:06.690 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-19T08:38:06.690 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-19T08:38:06.690 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2023-10-19T08:38:06.691 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2023-10-19T08:38:06.691 DEBUG:teuthology.orchestra.run.smithi079:> return f 2023-10-19T08:38:06.691 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-19T08:38:06.692 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-19T08:38:06.692 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.admin")) 2023-10-19T08:38:06.693 DEBUG:teuthology.orchestra.run.smithi079:> ' 2023-10-19T08:38:06.806 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.admin.112240.asok 2023-10-19T08:38:06.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-19T08:38:06.815 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.112240.asok 2023-10-19T08:38:06.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:06.815 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.112240.asok status 2023-10-19T08:38:06.970 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-19T08:38:06.970 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2023-10-19T08:38:06.971 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "6f3e6b48891b9b50415c0822b6b870797fcda16d", 2023-10-19T08:38:06.971 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 18.0.0-5610-g6f3e6b48 (6f3e6b48891b9b50415c0822b6b870797fcda16d) reef (dev)", 2023-10-19T08:38:06.971 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "admin", 2023-10-19T08:38:06.971 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2023-10-19T08:38:06.972 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-19T08:38:06.972 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "112240", 2023-10-19T08:38:06.972 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2023-10-19T08:38:06.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:38:06.972 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2023-10-19T08:38:06.973 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2023-10-19T08:38:06.973 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4470, 2023-10-19T08:38:06.973 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2023-10-19T08:38:06.973 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2023-10-19T08:38:06.973 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2023-10-19T08:38:06.973 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 4470 2023-10-19T08:38:06.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:38:06.974 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2023-10-19T08:38:06.974 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-19T08:38:06.974 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2023-10-19T08:38:06.974 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1538702985 2023-10-19T08:38:06.975 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:38:06.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:38:06.975 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2023-10-19T08:38:06.975 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-19T08:38:06.975 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2023-10-19T08:38:06.976 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1538702985 2023-10-19T08:38:06.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:38:06.976 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.4470 192.168.0.1:0/1538702985", 2023-10-19T08:38:06.976 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/1538702985", 2023-10-19T08:38:06.976 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2023-10-19T08:38:06.977 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 7, 2023-10-19T08:38:06.977 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 25, 2023-10-19T08:38:06.977 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2023-10-19T08:38:06.977 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2023-10-19T08:38:06.977 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2023-10-19T08:38:06.978 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-19T08:38:06.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:06.980 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2023-10-19T08:38:06.980 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-19T08:38:06.997 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2023-10-19T08:38:06.997 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-19T08:38:06.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:06.998 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-19T08:38:07.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:07.066 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-19T08:38:07.171 INFO:teuthology.orchestra.run.smithi079.stdout:# file: . 2023-10-19T08:38:07.171 INFO:teuthology.orchestra.run.smithi079.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-19T08:38:07.171 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:07.172 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:38:07.172 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T08:38:07.189 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:07.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.346+0000 7f017ba67700 1 Processor -- start 2023-10-19T08:38:07.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.346+0000 7f017ba67700 1 -- start start 2023-10-19T08:38:07.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.347+0000 7f017ba67700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01740b5610 0x7f01740cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:07.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.347+0000 7f017ba67700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f01740ce5c0 0x7f01740cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:07.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.347+0000 7f017ba67700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01740b5aa0 con 0x7f0174159f40 2023-10-19T08:38:07.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.347+0000 7f017ba67700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01740cc870 con 0x7f01740ce5c0 2023-10-19T08:38:07.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.347+0000 7f017ba67700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01740cd800 con 0x7f01740b5610 2023-10-19T08:38:07.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.347+0000 7f017a004700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f01740ce5c0 0x7f01740cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:07.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.347+0000 7f0179803700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0174159f40 0x7f017415e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:40778/0 (socket says 172.21.15.79:40778) 2023-10-19T08:38:07.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.347+0000 7f0179803700 1 -- 172.21.15.79:0/1938072478 learned_addr learned my addr 172.21.15.79:0/1938072478 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:07.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.347+0000 7f017a004700 1 --2- 172.21.15.79:0/1938072478 >> v2:172.21.15.79:3300/0 conn(0x7f01740ce5c0 0x7f01740cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45868/0 (socket says 172.21.15.79:45868) 2023-10-19T08:38:07.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.347+0000 7f0179002700 1 --2- 172.21.15.79:0/1938072478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01740b5610 0x7f01740cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:07.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.347+0000 7f017a004700 1 -- 172.21.15.79:0/1938072478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01740b5610 msgr2=0x7f01740cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:07.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.347+0000 7f017a004700 1 --2- 172.21.15.79:0/1938072478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01740b5610 0x7f01740cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:07.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.347+0000 7f017a004700 1 -- 172.21.15.79:0/1938072478 >> v1:172.21.15.89:6789/0 conn(0x7f0174159f40 legacy=0x7f017415e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:07.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.347+0000 7f017a004700 1 -- 172.21.15.79:0/1938072478 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01740cdae0 con 0x7f01740ce5c0 2023-10-19T08:38:07.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.348+0000 7f017a004700 1 --2- 172.21.15.79:0/1938072478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01740ce5c0 0x7f01740cf540 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f016c009d90 tx=0x7f016c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce62702287d975a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:07.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.347+0000 7f0178801700 1 -- 172.21.15.79:0/1938072478 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275043615 0 0) 0x7f01740b5aa0 con 0x7f0174159f40 2023-10-19T08:38:07.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.348+0000 7f0178801700 1 -- 172.21.15.79:0/1938072478 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c00e070 con 0x7f01740ce5c0 2023-10-19T08:38:07.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.348+0000 7f0178801700 1 -- 172.21.15.79:0/1938072478 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016c00bb20 con 0x7f01740ce5c0 2023-10-19T08:38:07.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.348+0000 7f0178801700 1 -- 172.21.15.79:0/1938072478 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c012430 con 0x7f01740ce5c0 2023-10-19T08:38:07.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.348+0000 7f017ba67700 1 -- 172.21.15.79:0/1938072478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01740ce5c0 msgr2=0x7f01740cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:07.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.348+0000 7f017ba67700 1 --2- 172.21.15.79:0/1938072478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01740ce5c0 0x7f01740cf540 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f016c009d90 tx=0x7f016c00b330 comp rx=0 tx=0).stop 2023-10-19T08:38:07.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.348+0000 7f017ba67700 1 -- 172.21.15.79:0/1938072478 shutdown_connections 2023-10-19T08:38:07.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.348+0000 7f017ba67700 1 --2- 172.21.15.79:0/1938072478 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01740ce5c0 0x7f01740cf540 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:07.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.348+0000 7f017ba67700 1 --2- 172.21.15.79:0/1938072478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f01740b5610 0x7f01740cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:07.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.348+0000 7f017ba67700 1 -- 172.21.15.79:0/1938072478 >> 172.21.15.79:0/1938072478 conn(0x7f017406dcc0 msgr2=0x7f017406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:07.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.349+0000 7f017ba67700 1 -- 172.21.15.79:0/1938072478 shutdown_connections 2023-10-19T08:38:07.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.349+0000 7f017ba67700 1 -- 172.21.15.79:0/1938072478 wait complete. 2023-10-19T08:38:07.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.350+0000 7f017ba67700 1 Processor -- start 2023-10-19T08:38:07.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.350+0000 7f017ba67700 1 -- start start 2023-10-19T08:38:07.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.350+0000 7f017ba67700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01740ce5c0 0x7f01740b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:07.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.350+0000 7f017ba67700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0174159f40 0x7f01740cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:07.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f017ba67700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f017414fd10 0x7f01741501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:07.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f017ba67700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01741506e0 con 0x7f017414fd10 2023-10-19T08:38:07.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f017ba67700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01740c4980 con 0x7f01740ce5c0 2023-10-19T08:38:07.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f017ba67700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01740c4c60 con 0x7f0174159f40 2023-10-19T08:38:07.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f017a004700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f017414fd10 0x7f01741501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:07.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f017a004700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f017414fd10 0x7f01741501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45874/0 (socket says 172.21.15.79:45874) 2023-10-19T08:38:07.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f017a004700 1 -- 172.21.15.79:0/1953566906 learned_addr learned my addr 172.21.15.79:0/1953566906 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:07.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f0179002700 1 --2- 172.21.15.79:0/1953566906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0174159f40 0x7f01740cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:07.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f0179803700 1 --2- 172.21.15.79:0/1953566906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01740ce5c0 0x7f01740b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:07.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f017a004700 1 -- 172.21.15.79:0/1953566906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0174159f40 msgr2=0x7f01740cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:07.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f017a004700 1 --2- 172.21.15.79:0/1953566906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0174159f40 0x7f01740cfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:07.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f017a004700 1 -- 172.21.15.79:0/1953566906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01740ce5c0 msgr2=0x7f01740b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:07.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f017a004700 1 --2- 172.21.15.79:0/1953566906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01740ce5c0 0x7f01740b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:07.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f017a004700 1 -- 172.21.15.79:0/1953566906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016c009a70 con 0x7f017414fd10 2023-10-19T08:38:07.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f017a004700 1 --2- 172.21.15.79:0/1953566906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f017414fd10 0x7f01741501a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f016c013000 tx=0x7f016c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:07.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f016a7fc700 1 -- 172.21.15.79:0/1953566906 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c012430 con 0x7f017414fd10 2023-10-19T08:38:07.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f016a7fc700 1 -- 172.21.15.79:0/1953566906 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016c020070 con 0x7f017414fd10 2023-10-19T08:38:07.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f017ba67700 1 -- 172.21.15.79:0/1953566906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01740c4f40 con 0x7f017414fd10 2023-10-19T08:38:07.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f016a7fc700 1 -- 172.21.15.79:0/1953566906 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c004280 con 0x7f017414fd10 2023-10-19T08:38:07.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.351+0000 7f017ba67700 1 -- 172.21.15.79:0/1953566906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01740c5500 con 0x7f017414fd10 2023-10-19T08:38:07.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.352+0000 7f017ba67700 1 -- 172.21.15.79:0/1953566906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017404ee70 con 0x7f017414fd10 2023-10-19T08:38:07.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.353+0000 7f016a7fc700 1 -- 172.21.15.79:0/1953566906 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f016c0043e0 con 0x7f017414fd10 2023-10-19T08:38:07.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.353+0000 7f016a7fc700 1 --2- 172.21.15.79:0/1953566906 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f015806a0e0 0x7f015806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:07.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.353+0000 7f016a7fc700 1 -- 172.21.15.79:0/1953566906 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f016c022070 con 0x7f017414fd10 2023-10-19T08:38:07.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.353+0000 7f0179803700 1 --2- 172.21.15.79:0/1953566906 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f015806a0e0 0x7f015806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:07.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.354+0000 7f0179803700 1 --2- 172.21.15.79:0/1953566906 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f015806a0e0 0x7f015806c5a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0170000f60 tx=0x7f0170007e70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:07.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.358+0000 7f016a7fc700 1 -- 172.21.15.79:0/1953566906 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f016c055c50 con 0x7f017414fd10 2023-10-19T08:38:07.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.549+0000 7f017ba67700 1 -- 172.21.15.79:0/1953566906 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01740668a0 con 0x7f017414fd10 2023-10-19T08:38:07.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.550+0000 7f016a7fc700 1 -- 172.21.15.79:0/1953566906 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20060 (secure 0 0 0) 0x7f016c059270 con 0x7f017414fd10 2023-10-19T08:38:07.555 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:07.555 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":25,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:01.725914+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:07.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.553+0000 7f017ba67700 1 -- 172.21.15.79:0/1953566906 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f015806a0e0 msgr2=0x7f015806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:07.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.553+0000 7f017ba67700 1 --2- 172.21.15.79:0/1953566906 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f015806a0e0 0x7f015806c5a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0170000f60 tx=0x7f0170007e70 comp rx=0 tx=0).stop 2023-10-19T08:38:07.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.553+0000 7f017ba67700 1 -- 172.21.15.79:0/1953566906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f017414fd10 msgr2=0x7f01741501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:07.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.553+0000 7f017ba67700 1 --2- 172.21.15.79:0/1953566906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f017414fd10 0x7f01741501a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f016c013000 tx=0x7f016c004ad0 comp rx=0 tx=0).stop 2023-10-19T08:38:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.553+0000 7f017ba67700 1 -- 172.21.15.79:0/1953566906 shutdown_connections 2023-10-19T08:38:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.553+0000 7f017ba67700 1 --2- 172.21.15.79:0/1953566906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f017414fd10 0x7f01741501a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.553+0000 7f017ba67700 1 --2- 172.21.15.79:0/1953566906 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f01740ce5c0 0x7f01740b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.553+0000 7f017ba67700 1 --2- 172.21.15.79:0/1953566906 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f015806a0e0 0x7f015806c5a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:07.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.553+0000 7f017ba67700 1 --2- 172.21.15.79:0/1953566906 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0174159f40 0x7f01740cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:07.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.553+0000 7f017ba67700 1 -- 172.21.15.79:0/1953566906 >> 172.21.15.79:0/1953566906 conn(0x7f017406dcc0 msgr2=0x7f01740cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:07.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.553+0000 7f017ba67700 1 -- 172.21.15.79:0/1953566906 shutdown_connections 2023-10-19T08:38:07.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.553+0000 7f017ba67700 1 -- 172.21.15.79:0/1953566906 wait complete. 2023-10-19T08:38:07.569 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T08:37:54.318159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T08:37:55.629862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T08:37:59.333062+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T08:38:07.570 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:38:07.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.689+0000 7f479001c700 1 Processor -- start 2023-10-19T08:38:07.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.689+0000 7f479001c700 1 -- start start 2023-10-19T08:38:07.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.690+0000 7f479001c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4788159db0 0x7f47880cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:07.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.690+0000 7f479001c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f478806fdc0 0x7f47880ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:07.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.690+0000 7f479001c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f478815d760 con 0x7f47880cc640 2023-10-19T08:38:07.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.690+0000 7f479001c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f478815da40 con 0x7f478806fdc0 2023-10-19T08:38:07.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.690+0000 7f479001c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478815dd20 con 0x7f4788159db0 2023-10-19T08:38:07.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.690+0000 7f478e5b9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f478806fdc0 0x7f47880ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:07.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.690+0000 7f478e5b9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f478806fdc0 0x7f47880ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45882/0 (socket says 172.21.15.79:45882) 2023-10-19T08:38:07.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.690+0000 7f478ddb8700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f47880cc640 0x7f47880cca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55950/0 (socket says 172.21.15.79:55950) 2023-10-19T08:38:07.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.690+0000 7f478e5b9700 1 -- 172.21.15.79:0/473977690 learned_addr learned my addr 172.21.15.79:0/473977690 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:07.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.691+0000 7f478d5b7700 1 --2- 172.21.15.79:0/473977690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4788159db0 0x7f47880cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:07.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.691+0000 7f478e5b9700 1 -- 172.21.15.79:0/473977690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4788159db0 msgr2=0x7f47880cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:07.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.691+0000 7f478e5b9700 1 --2- 172.21.15.79:0/473977690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4788159db0 0x7f47880cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:07.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.691+0000 7f478e5b9700 1 -- 172.21.15.79:0/473977690 >> v1:172.21.15.79:6789/0 conn(0x7f47880cc640 legacy=0x7f47880cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:07.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.691+0000 7f478e5b9700 1 -- 172.21.15.79:0/473977690 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478815e000 con 0x7f478806fdc0 2023-10-19T08:38:07.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.691+0000 7f478cdb6700 1 -- 172.21.15.79:0/473977690 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929686676 0 0) 0x7f478815d760 con 0x7f47880cc640 2023-10-19T08:38:07.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.691+0000 7f478e5b9700 1 --2- 172.21.15.79:0/473977690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f478806fdc0 0x7f47880ce020 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4780009e50 tx=0x7f478000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b7e5347973db91 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:07.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.691+0000 7f478cdb6700 1 -- 172.21.15.79:0/473977690 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478000e070 con 0x7f478806fdc0 2023-10-19T08:38:07.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.691+0000 7f478cdb6700 1 -- 172.21.15.79:0/473977690 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478000b9c0 con 0x7f478806fdc0 2023-10-19T08:38:07.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.691+0000 7f478cdb6700 1 -- 172.21.15.79:0/473977690 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478000bd70 con 0x7f478806fdc0 2023-10-19T08:38:07.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.691+0000 7f479001c700 1 -- 172.21.15.79:0/473977690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f478806fdc0 msgr2=0x7f47880ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:07.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.691+0000 7f479001c700 1 --2- 172.21.15.79:0/473977690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f478806fdc0 0x7f47880ce020 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4780009e50 tx=0x7f478000b330 comp rx=0 tx=0).stop 2023-10-19T08:38:07.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.691+0000 7f479001c700 1 -- 172.21.15.79:0/473977690 shutdown_connections 2023-10-19T08:38:07.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.691+0000 7f479001c700 1 --2- 172.21.15.79:0/473977690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f478806fdc0 0x7f47880ce020 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:07.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.691+0000 7f479001c700 1 --2- 172.21.15.79:0/473977690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4788159db0 0x7f47880cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:07.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.691+0000 7f479001c700 1 -- 172.21.15.79:0/473977690 >> 172.21.15.79:0/473977690 conn(0x7f478806dcc0 msgr2=0x7f478806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:07.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.692+0000 7f479001c700 1 -- 172.21.15.79:0/473977690 shutdown_connections 2023-10-19T08:38:07.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.692+0000 7f479001c700 1 -- 172.21.15.79:0/473977690 wait complete. 2023-10-19T08:38:07.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.693+0000 7f479001c700 1 Processor -- start 2023-10-19T08:38:07.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.693+0000 7f479001c700 1 -- start start 2023-10-19T08:38:07.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.693+0000 7f479001c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f478806fdc0 0x7f47881e3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:07.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.693+0000 7f479001c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47880cc640 0x7f47880c2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:07.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.693+0000 7f479001c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4788159db0 0x7f47881e5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:07.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.693+0000 7f479001c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47880c2dc0 con 0x7f47880cc640 2023-10-19T08:38:07.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.693+0000 7f479001c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47881e5f50 con 0x7f4788159db0 2023-10-19T08:38:07.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.693+0000 7f479001c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47881e6220 con 0x7f478806fdc0 2023-10-19T08:38:07.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.694+0000 7f478d5b7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47880cc640 0x7f47880c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:07.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.694+0000 7f478d5b7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47880cc640 0x7f47880c2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45886/0 (socket says 172.21.15.79:45886) 2023-10-19T08:38:07.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.694+0000 7f478d5b7700 1 -- 172.21.15.79:0/2228143614 learned_addr learned my addr 172.21.15.79:0/2228143614 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:07.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.694+0000 7f478ddb8700 1 --2- 172.21.15.79:0/2228143614 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f478806fdc0 0x7f47881e3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:07.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.694+0000 7f478e5b9700 1 --2- 172.21.15.79:0/2228143614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4788159db0 0x7f47881e5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:07.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.694+0000 7f478d5b7700 1 -- 172.21.15.79:0/2228143614 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f478806fdc0 msgr2=0x7f47881e3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:07.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.694+0000 7f478d5b7700 1 --2- 172.21.15.79:0/2228143614 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f478806fdc0 0x7f47881e3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:07.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.694+0000 7f478d5b7700 1 -- 172.21.15.79:0/2228143614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4788159db0 msgr2=0x7f47881e5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:07.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.694+0000 7f478d5b7700 1 --2- 172.21.15.79:0/2228143614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4788159db0 0x7f47881e5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:07.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.694+0000 7f478d5b7700 1 -- 172.21.15.79:0/2228143614 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4780009b30 con 0x7f47880cc640 2023-10-19T08:38:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.694+0000 7f478d5b7700 1 --2- 172.21.15.79:0/2228143614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47880cc640 0x7f47880c2880 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f478400c7f0 tx=0x7f478400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.694+0000 7f477e7fc700 1 -- 172.21.15.79:0/2228143614 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4784004220 con 0x7f47880cc640 2023-10-19T08:38:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.694+0000 7f477e7fc700 1 -- 172.21.15.79:0/2228143614 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4784004380 con 0x7f47880cc640 2023-10-19T08:38:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.694+0000 7f479001c700 1 -- 172.21.15.79:0/2228143614 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47881e6500 con 0x7f47880cc640 2023-10-19T08:38:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.694+0000 7f477e7fc700 1 -- 172.21.15.79:0/2228143614 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47840036c0 con 0x7f47880cc640 2023-10-19T08:38:07.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.694+0000 7f479001c700 1 -- 172.21.15.79:0/2228143614 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47881e6ac0 con 0x7f47880cc640 2023-10-19T08:38:07.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.695+0000 7f479001c700 1 -- 172.21.15.79:0/2228143614 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f478804ee70 con 0x7f47880cc640 2023-10-19T08:38:07.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.695+0000 7f477e7fc700 1 -- 172.21.15.79:0/2228143614 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4784003820 con 0x7f47880cc640 2023-10-19T08:38:07.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.696+0000 7f477e7fc700 1 --2- 172.21.15.79:0/2228143614 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f476c06a0e0 0x7f476c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:07.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.696+0000 7f477e7fc700 1 -- 172.21.15.79:0/2228143614 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4784088370 con 0x7f47880cc640 2023-10-19T08:38:07.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.696+0000 7f478ddb8700 1 --2- 172.21.15.79:0/2228143614 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f476c06a0e0 0x7f476c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:07.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.696+0000 7f478ddb8700 1 --2- 172.21.15.79:0/2228143614 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f476c06a0e0 0x7f476c06c5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4778000f60 tx=0x7f4778007e70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:07.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.700+0000 7f477e7fc700 1 -- 172.21.15.79:0/2228143614 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4784057200 con 0x7f47880cc640 2023-10-19T08:38:07.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.888+0000 7f479001c700 1 -- 172.21.15.79:0/2228143614 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f47880ca280 con 0x7f47880cc640 2023-10-19T08:38:07.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.889+0000 7f477e7fc700 1 -- 172.21.15.79:0/2228143614 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4784056d90 con 0x7f47880cc640 2023-10-19T08:38:07.894 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:38:07.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.891+0000 7f479001c700 1 -- 172.21.15.79:0/2228143614 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f476c06a0e0 msgr2=0x7f476c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:07.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.891+0000 7f479001c700 1 --2- 172.21.15.79:0/2228143614 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f476c06a0e0 0x7f476c06c5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4778000f60 tx=0x7f4778007e70 comp rx=0 tx=0).stop 2023-10-19T08:38:07.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.891+0000 7f479001c700 1 -- 172.21.15.79:0/2228143614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47880cc640 msgr2=0x7f47880c2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:07.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.891+0000 7f479001c700 1 --2- 172.21.15.79:0/2228143614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47880cc640 0x7f47880c2880 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f478400c7f0 tx=0x7f478400cb00 comp rx=0 tx=0).stop 2023-10-19T08:38:07.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.891+0000 7f479001c700 1 -- 172.21.15.79:0/2228143614 shutdown_connections 2023-10-19T08:38:07.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.891+0000 7f479001c700 1 --2- 172.21.15.79:0/2228143614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4788159db0 0x7f47881e5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:07.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.891+0000 7f479001c700 1 --2- 172.21.15.79:0/2228143614 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f476c06a0e0 0x7f476c06c5a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:07.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.891+0000 7f479001c700 1 --2- 172.21.15.79:0/2228143614 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f478806fdc0 0x7f47881e3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:07.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.891+0000 7f479001c700 1 --2- 172.21.15.79:0/2228143614 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47880cc640 0x7f47880c2880 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:07.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.891+0000 7f479001c700 1 -- 172.21.15.79:0/2228143614 >> 172.21.15.79:0/2228143614 conn(0x7f478806dcc0 msgr2=0x7f47880cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:07.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.891+0000 7f479001c700 1 -- 172.21.15.79:0/2228143614 shutdown_connections 2023-10-19T08:38:07.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:07.891+0000 7f479001c700 1 -- 172.21.15.79:0/2228143614 wait complete. 2023-10-19T08:38:07.907 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:38:08.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.025+0000 7fd826935700 1 Processor -- start 2023-10-19T08:38:08.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.025+0000 7fd826935700 1 -- start start 2023-10-19T08:38:08.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.026+0000 7fd826935700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd82006a930 0x7fd8200cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:08.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.026+0000 7fd826935700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd8200703b0 0x7fd8200cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:08.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.026+0000 7fd826935700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8200b1fe0 con 0x7fd8200cd270 2023-10-19T08:38:08.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.026+0000 7fd826935700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd820160a80 con 0x7fd82006a930 2023-10-19T08:38:08.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.026+0000 7fd826935700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8200ce2b0 con 0x7fd8200703b0 2023-10-19T08:38:08.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.026+0000 7fd81f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd82006a930 0x7fd8200cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:08.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.026+0000 7fd81ffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd8200cd270 0x7fd82006a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55964/0 (socket says 172.21.15.79:55964) 2023-10-19T08:38:08.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.026+0000 7fd81ffff700 1 -- 172.21.15.79:0/2460944774 learned_addr learned my addr 172.21.15.79:0/2460944774 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:08.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.026+0000 7fd824ed2700 1 --2- 172.21.15.79:0/2460944774 >> v2:172.21.15.89:3300/0 conn(0x7fd8200703b0 0x7fd8200cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:08.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.027+0000 7fd81f7fe700 1 -- 172.21.15.79:0/2460944774 >> v2:172.21.15.89:3300/0 conn(0x7fd8200703b0 msgr2=0x7fd8200cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:08.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.027+0000 7fd81f7fe700 1 --2- 172.21.15.79:0/2460944774 >> v2:172.21.15.89:3300/0 conn(0x7fd8200703b0 0x7fd8200cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.027+0000 7fd81f7fe700 1 -- 172.21.15.79:0/2460944774 >> v1:172.21.15.79:6789/0 conn(0x7fd8200cd270 legacy=0x7fd82006a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:08.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.027+0000 7fd81f7fe700 1 -- 172.21.15.79:0/2460944774 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8200ce550 con 0x7fd82006a930 2023-10-19T08:38:08.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.027+0000 7fd81f7fe700 1 --2- 172.21.15.79:0/2460944774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd82006a930 0x7fd8200cb290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd8200c3730 tx=0x7fd814009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c28c97b42e637cd server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:08.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.027+0000 7fd81effd700 1 -- 172.21.15.79:0/2460944774 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd814011830 con 0x7fd82006a930 2023-10-19T08:38:08.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.027+0000 7fd81effd700 1 -- 172.21.15.79:0/2460944774 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd814011990 con 0x7fd82006a930 2023-10-19T08:38:08.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.027+0000 7fd81effd700 1 -- 172.21.15.79:0/2460944774 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd814011d20 con 0x7fd82006a930 2023-10-19T08:38:08.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.027+0000 7fd826935700 1 -- 172.21.15.79:0/2460944774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd82006a930 msgr2=0x7fd8200cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:08.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.027+0000 7fd826935700 1 --2- 172.21.15.79:0/2460944774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd82006a930 0x7fd8200cb290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd8200c3730 tx=0x7fd814009b20 comp rx=0 tx=0).stop 2023-10-19T08:38:08.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.027+0000 7fd826935700 1 -- 172.21.15.79:0/2460944774 shutdown_connections 2023-10-19T08:38:08.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.028+0000 7fd826935700 1 --2- 172.21.15.79:0/2460944774 >> v2:172.21.15.89:3300/0 conn(0x7fd8200703b0 0x7fd8200cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.028+0000 7fd826935700 1 --2- 172.21.15.79:0/2460944774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd82006a930 0x7fd8200cb290 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.028+0000 7fd826935700 1 -- 172.21.15.79:0/2460944774 >> 172.21.15.79:0/2460944774 conn(0x7fd82006dcc0 msgr2=0x7fd82006e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:08.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.028+0000 7fd826935700 1 -- 172.21.15.79:0/2460944774 shutdown_connections 2023-10-19T08:38:08.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.028+0000 7fd826935700 1 -- 172.21.15.79:0/2460944774 wait complete. 2023-10-19T08:38:08.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.029+0000 7fd826935700 1 Processor -- start 2023-10-19T08:38:08.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.029+0000 7fd826935700 1 -- start start 2023-10-19T08:38:08.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.030+0000 7fd826935700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd82006a930 0x7fd8200b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:08.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.030+0000 7fd826935700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8200703b0 0x7fd8201f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:08.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.030+0000 7fd826935700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8200cd270 0x7fd8200af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:08.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.030+0000 7fd826935700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8201f2720 con 0x7fd8200703b0 2023-10-19T08:38:08.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.030+0000 7fd826935700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8201f6240 con 0x7fd82006a930 2023-10-19T08:38:08.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.030+0000 7fd826935700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8201f6520 con 0x7fd8200cd270 2023-10-19T08:38:08.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.030+0000 7fd81f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8200703b0 0x7fd8201f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:08.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.030+0000 7fd81f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8200703b0 0x7fd8201f21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45900/0 (socket says 172.21.15.79:45900) 2023-10-19T08:38:08.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.030+0000 7fd81f7fe700 1 -- 172.21.15.79:0/2296934370 learned_addr learned my addr 172.21.15.79:0/2296934370 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:08.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.030+0000 7fd81ffff700 1 --2- 172.21.15.79:0/2296934370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd82006a930 0x7fd8200b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:08.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.031+0000 7fd824ed2700 1 --2- 172.21.15.79:0/2296934370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8200cd270 0x7fd8200af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:08.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.031+0000 7fd81f7fe700 1 -- 172.21.15.79:0/2296934370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8200cd270 msgr2=0x7fd8200af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:08.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.031+0000 7fd81f7fe700 1 --2- 172.21.15.79:0/2296934370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8200cd270 0x7fd8200af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.031+0000 7fd81f7fe700 1 -- 172.21.15.79:0/2296934370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd82006a930 msgr2=0x7fd8200b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:08.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.031+0000 7fd81f7fe700 1 --2- 172.21.15.79:0/2296934370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd82006a930 0x7fd8200b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.031+0000 7fd81f7fe700 1 -- 172.21.15.79:0/2296934370 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8140094a0 con 0x7fd8200703b0 2023-10-19T08:38:08.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.031+0000 7fd824ed2700 1 --2- 172.21.15.79:0/2296934370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8200cd270 0x7fd8200af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:08.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.031+0000 7fd81f7fe700 1 --2- 172.21.15.79:0/2296934370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8200703b0 0x7fd8201f21e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd814009b60 tx=0x7fd814004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:08.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.031+0000 7fd81cff9700 1 -- 172.21.15.79:0/2296934370 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8140036a0 con 0x7fd8200703b0 2023-10-19T08:38:08.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.031+0000 7fd81cff9700 1 -- 172.21.15.79:0/2296934370 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81401e070 con 0x7fd8200703b0 2023-10-19T08:38:08.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.031+0000 7fd826935700 1 -- 172.21.15.79:0/2296934370 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8201f6800 con 0x7fd8200703b0 2023-10-19T08:38:08.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.031+0000 7fd81cff9700 1 -- 172.21.15.79:0/2296934370 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd814003a60 con 0x7fd8200703b0 2023-10-19T08:38:08.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.031+0000 7fd826935700 1 -- 172.21.15.79:0/2296934370 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8201551e0 con 0x7fd8200703b0 2023-10-19T08:38:08.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.032+0000 7fd826935700 1 -- 172.21.15.79:0/2296934370 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8201f6660 con 0x7fd8200703b0 2023-10-19T08:38:08.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.032+0000 7fd81cff9700 1 -- 172.21.15.79:0/2296934370 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd814003bc0 con 0x7fd8200703b0 2023-10-19T08:38:08.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.033+0000 7fd81cff9700 1 --2- 172.21.15.79:0/2296934370 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd80c06a0e0 0x7fd80c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:08.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.033+0000 7fd81cff9700 1 -- 172.21.15.79:0/2296934370 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd8140897c0 con 0x7fd8200703b0 2023-10-19T08:38:08.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.033+0000 7fd81ffff700 1 --2- 172.21.15.79:0/2296934370 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd80c06a0e0 0x7fd80c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:08.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.033+0000 7fd81ffff700 1 --2- 172.21.15.79:0/2296934370 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd80c06a0e0 0x7fd80c06c5a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd810005910 tx=0x7fd810009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:08.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.037+0000 7fd81cff9700 1 -- 172.21.15.79:0/2296934370 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd8201f6660 con 0x7fd8200703b0 2023-10-19T08:38:08.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.225+0000 7fd826935700 1 -- 172.21.15.79:0/2296934370 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd8201f6660 con 0x7fd8200703b0 2023-10-19T08:38:08.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.225+0000 7fd81cff9700 1 -- 172.21.15.79:0/2296934370 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd8201f6660 con 0x7fd8200703b0 2023-10-19T08:38:08.230 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:38:08.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.227+0000 7fd826935700 1 -- 172.21.15.79:0/2296934370 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd80c06a0e0 msgr2=0x7fd80c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:08.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.227+0000 7fd826935700 1 --2- 172.21.15.79:0/2296934370 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd80c06a0e0 0x7fd80c06c5a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd810005910 tx=0x7fd810009040 comp rx=0 tx=0).stop 2023-10-19T08:38:08.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.227+0000 7fd826935700 1 -- 172.21.15.79:0/2296934370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8200703b0 msgr2=0x7fd8201f21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.227+0000 7fd826935700 1 --2- 172.21.15.79:0/2296934370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8200703b0 0x7fd8201f21e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd814009b60 tx=0x7fd814004750 comp rx=0 tx=0).stop 2023-10-19T08:38:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.227+0000 7fd826935700 1 -- 172.21.15.79:0/2296934370 shutdown_connections 2023-10-19T08:38:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.227+0000 7fd826935700 1 --2- 172.21.15.79:0/2296934370 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd80c06a0e0 0x7fd80c06c5a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.227+0000 7fd826935700 1 --2- 172.21.15.79:0/2296934370 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8200cd270 0x7fd8200af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.227+0000 7fd826935700 1 --2- 172.21.15.79:0/2296934370 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd82006a930 0x7fd8200b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.227+0000 7fd826935700 1 --2- 172.21.15.79:0/2296934370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8200703b0 0x7fd8201f21e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.227+0000 7fd826935700 1 -- 172.21.15.79:0/2296934370 >> 172.21.15.79:0/2296934370 conn(0x7fd82006dcc0 msgr2=0x7fd8200b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:08.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.228+0000 7fd826935700 1 -- 172.21.15.79:0/2296934370 shutdown_connections 2023-10-19T08:38:08.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.228+0000 7fd826935700 1 -- 172.21.15.79:0/2296934370 wait complete. 2023-10-19T08:38:08.244 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T08:38:08.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.363+0000 7f7a97bf8700 1 Processor -- start 2023-10-19T08:38:08.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.363+0000 7f7a97bf8700 1 -- start start 2023-10-19T08:38:08.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.364+0000 7f7a97bf8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a9015e570 0x7f7a900d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:08.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.364+0000 7f7a97bf8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7a900cb6f0 0x7f7a900b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:08.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.364+0000 7f7a97bf8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a900afd60 con 0x7f7a900b0a30 2023-10-19T08:38:08.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.364+0000 7f7a97bf8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a900b0ec0 con 0x7f7a900cb6f0 2023-10-19T08:38:08.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.364+0000 7f7a97bf8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a900af810 con 0x7f7a9015e570 2023-10-19T08:38:08.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.364+0000 7f7a95193700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7a900cb6f0 0x7f7a900b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:08.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.364+0000 7f7a96195700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7a900b0a30 0x7f7a900b15e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55982/0 (socket says 172.21.15.79:55982) 2023-10-19T08:38:08.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.364+0000 7f7a96195700 1 -- 172.21.15.79:0/1944195856 learned_addr learned my addr 172.21.15.79:0/1944195856 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:08.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.364+0000 7f7a95994700 1 --2- 172.21.15.79:0/1944195856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a9015e570 0x7f7a900d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:08.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.364+0000 7f7a95193700 1 -- 172.21.15.79:0/1944195856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a9015e570 msgr2=0x7f7a900d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:08.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.364+0000 7f7a95193700 1 --2- 172.21.15.79:0/1944195856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a9015e570 0x7f7a900d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.364+0000 7f7a95193700 1 -- 172.21.15.79:0/1944195856 >> v1:172.21.15.79:6789/0 conn(0x7f7a900b0a30 legacy=0x7f7a900b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:08.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.364+0000 7f7a95193700 1 -- 172.21.15.79:0/1944195856 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a900aef70 con 0x7f7a900cb6f0 2023-10-19T08:38:08.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.364+0000 7f7a94992700 1 -- 172.21.15.79:0/1944195856 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 505138627 0 0) 0x7f7a900afd60 con 0x7f7a900b0a30 2023-10-19T08:38:08.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.364+0000 7f7a95193700 1 --2- 172.21.15.79:0/1944195856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a900cb6f0 0x7f7a900b04f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009840 tx=0x7f7a80009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872d88a26016bb07 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:08.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.364+0000 7f7a94992700 1 -- 172.21.15.79:0/1944195856 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80011830 con 0x7f7a900cb6f0 2023-10-19T08:38:08.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.364+0000 7f7a94992700 1 -- 172.21.15.79:0/1944195856 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a80011990 con 0x7f7a900cb6f0 2023-10-19T08:38:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.364+0000 7f7a94992700 1 -- 172.21.15.79:0/1944195856 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80011d20 con 0x7f7a900cb6f0 2023-10-19T08:38:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.365+0000 7f7a97bf8700 1 -- 172.21.15.79:0/1944195856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a900cb6f0 msgr2=0x7f7a900b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.365+0000 7f7a97bf8700 1 --2- 172.21.15.79:0/1944195856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a900cb6f0 0x7f7a900b04f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009840 tx=0x7f7a80009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:08.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.365+0000 7f7a97bf8700 1 -- 172.21.15.79:0/1944195856 shutdown_connections 2023-10-19T08:38:08.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.365+0000 7f7a97bf8700 1 --2- 172.21.15.79:0/1944195856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a9015e570 0x7f7a900d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.365+0000 7f7a97bf8700 1 --2- 172.21.15.79:0/1944195856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a900cb6f0 0x7f7a900b04f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.365+0000 7f7a97bf8700 1 -- 172.21.15.79:0/1944195856 >> 172.21.15.79:0/1944195856 conn(0x7f7a9009a0b0 msgr2=0x7f7a900d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:08.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.365+0000 7f7a97bf8700 1 -- 172.21.15.79:0/1944195856 shutdown_connections 2023-10-19T08:38:08.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.365+0000 7f7a97bf8700 1 -- 172.21.15.79:0/1944195856 wait complete. 2023-10-19T08:38:08.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.366+0000 7f7a97bf8700 1 Processor -- start 2023-10-19T08:38:08.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.366+0000 7f7a97bf8700 1 -- start start 2023-10-19T08:38:08.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.367+0000 7f7a97bf8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a900b0a30 0x7f7a901544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:08.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.367+0000 7f7a97bf8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a900cb6f0 0x7f7a90152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:08.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.367+0000 7f7a97bf8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a9015e570 0x7f7a900cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:08.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.367+0000 7f7a97bf8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a900cafd0 con 0x7f7a9015e570 2023-10-19T08:38:08.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.367+0000 7f7a97bf8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a90154b60 con 0x7f7a900cb6f0 2023-10-19T08:38:08.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.367+0000 7f7a97bf8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a90156540 con 0x7f7a900b0a30 2023-10-19T08:38:08.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.367+0000 7f7a96195700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a9015e570 0x7f7a900cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:08.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.367+0000 7f7a96195700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a9015e570 0x7f7a900cd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45916/0 (socket says 172.21.15.79:45916) 2023-10-19T08:38:08.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.367+0000 7f7a96195700 1 -- 172.21.15.79:0/1919616678 learned_addr learned my addr 172.21.15.79:0/1919616678 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:08.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.367+0000 7f7a95994700 1 --2- 172.21.15.79:0/1919616678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a900b0a30 0x7f7a901544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:08.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.367+0000 7f7a95193700 1 --2- 172.21.15.79:0/1919616678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a900cb6f0 0x7f7a90152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:08.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.367+0000 7f7a96195700 1 -- 172.21.15.79:0/1919616678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a900b0a30 msgr2=0x7f7a901544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:08.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.367+0000 7f7a96195700 1 --2- 172.21.15.79:0/1919616678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a900b0a30 0x7f7a901544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.367+0000 7f7a96195700 1 -- 172.21.15.79:0/1919616678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a900cb6f0 msgr2=0x7f7a90152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:08.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.367+0000 7f7a96195700 1 --2- 172.21.15.79:0/1919616678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a900cb6f0 0x7f7a90152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.367+0000 7f7a96195700 1 -- 172.21.15.79:0/1919616678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a800094a0 con 0x7f7a9015e570 2023-10-19T08:38:08.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.367+0000 7f7a95193700 1 --2- 172.21.15.79:0/1919616678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a900cb6f0 0x7f7a90152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:08.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.367+0000 7f7a95994700 1 --2- 172.21.15.79:0/1919616678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a900b0a30 0x7f7a901544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.367+0000 7f7a96195700 1 --2- 172.21.15.79:0/1919616678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a9015e570 0x7f7a900cd5e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7a88002230 tx=0x7f7a8800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.368+0000 7f7a867fc700 1 -- 172.21.15.79:0/1919616678 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8800ac20 con 0x7f7a9015e570 2023-10-19T08:38:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.368+0000 7f7a867fc700 1 -- 172.21.15.79:0/1919616678 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8800ada0 con 0x7f7a9015e570 2023-10-19T08:38:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.368+0000 7f7a867fc700 1 -- 172.21.15.79:0/1919616678 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88007310 con 0x7f7a9015e570 2023-10-19T08:38:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.368+0000 7f7a97bf8700 1 -- 172.21.15.79:0/1919616678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a90156820 con 0x7f7a9015e570 2023-10-19T08:38:08.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.368+0000 7f7a97bf8700 1 -- 172.21.15.79:0/1919616678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a90153d90 con 0x7f7a9015e570 2023-10-19T08:38:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.368+0000 7f7a97bf8700 1 -- 172.21.15.79:0/1919616678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a90156d40 con 0x7f7a9015e570 2023-10-19T08:38:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.369+0000 7f7a867fc700 1 -- 172.21.15.79:0/1919616678 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7a88007470 con 0x7f7a9015e570 2023-10-19T08:38:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.369+0000 7f7a867fc700 1 --2- 172.21.15.79:0/1919616678 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7a7406a0e0 0x7f7a7406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.369+0000 7f7a867fc700 1 -- 172.21.15.79:0/1919616678 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7a88088310 con 0x7f7a9015e570 2023-10-19T08:38:08.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.369+0000 7f7a95994700 1 --2- 172.21.15.79:0/1919616678 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7a7406a0e0 0x7f7a7406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.370+0000 7f7a95994700 1 --2- 172.21.15.79:0/1919616678 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7a7406a0e0 0x7f7a7406c5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c007a50 tx=0x7f7a8c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:08.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.374+0000 7f7a867fc700 1 -- 172.21.15.79:0/1919616678 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f7a90156d40 con 0x7f7a9015e570 2023-10-19T08:38:08.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.562+0000 7f7a97bf8700 1 -- 172.21.15.79:0/1919616678 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a90156d40 con 0x7f7a9015e570 2023-10-19T08:38:08.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.563+0000 7f7a867fc700 1 -- 172.21.15.79:0/1919616678 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a90156d40 con 0x7f7a9015e570 2023-10-19T08:38:08.568 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:08.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.565+0000 7f7a97bf8700 1 -- 172.21.15.79:0/1919616678 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7a7406a0e0 msgr2=0x7f7a7406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:08.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.565+0000 7f7a97bf8700 1 --2- 172.21.15.79:0/1919616678 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7a7406a0e0 0x7f7a7406c5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c007a50 tx=0x7f7a8c008040 comp rx=0 tx=0).stop 2023-10-19T08:38:08.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.565+0000 7f7a97bf8700 1 -- 172.21.15.79:0/1919616678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a9015e570 msgr2=0x7f7a900cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:08.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.565+0000 7f7a97bf8700 1 --2- 172.21.15.79:0/1919616678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a9015e570 0x7f7a900cd5e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7a88002230 tx=0x7f7a8800a060 comp rx=0 tx=0).stop 2023-10-19T08:38:08.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.565+0000 7f7a97bf8700 1 -- 172.21.15.79:0/1919616678 shutdown_connections 2023-10-19T08:38:08.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.565+0000 7f7a97bf8700 1 --2- 172.21.15.79:0/1919616678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a9015e570 0x7f7a900cd5e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.565+0000 7f7a97bf8700 1 --2- 172.21.15.79:0/1919616678 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7a7406a0e0 0x7f7a7406c5a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.565+0000 7f7a97bf8700 1 --2- 172.21.15.79:0/1919616678 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a900b0a30 0x7f7a901544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.565+0000 7f7a97bf8700 1 --2- 172.21.15.79:0/1919616678 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a900cb6f0 0x7f7a90152e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.565+0000 7f7a97bf8700 1 -- 172.21.15.79:0/1919616678 >> 172.21.15.79:0/1919616678 conn(0x7f7a9009a0b0 msgr2=0x7f7a900c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:08.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.565+0000 7f7a97bf8700 1 -- 172.21.15.79:0/1919616678 shutdown_connections 2023-10-19T08:38:08.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.565+0000 7f7a97bf8700 1 -- 172.21.15.79:0/1919616678 wait complete. 2023-10-19T08:38:08.581 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T08:38:08.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.699+0000 7fab65498700 1 Processor -- start 2023-10-19T08:38:08.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.699+0000 7fab65498700 1 -- start start 2023-10-19T08:38:08.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.700+0000 7fab65498700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fab600b0710 0x7fab600b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:08.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.700+0000 7fab65498700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fab600d14f0 0x7fab600ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:08.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.700+0000 7fab65498700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6006c5a0 con 0x7fab600adee0 2023-10-19T08:38:08.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.700+0000 7fab65498700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab60160cb0 con 0x7fab600d14f0 2023-10-19T08:38:08.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.700+0000 7fab65498700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6006bd40 con 0x7fab600b0710 2023-10-19T08:38:08.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.700+0000 7fab5e7fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fab600d14f0 0x7fab600ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:08.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.700+0000 7fab5f7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fab600adee0 0x7fab600b1d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:55996/0 (socket says 172.21.15.79:55996) 2023-10-19T08:38:08.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.700+0000 7fab5f7fe700 1 -- 172.21.15.79:0/4209149497 learned_addr learned my addr 172.21.15.79:0/4209149497 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:08.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.701+0000 7fab5effd700 1 --2- 172.21.15.79:0/4209149497 >> v2:172.21.15.89:3300/0 conn(0x7fab600b0710 0x7fab600b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:08.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.701+0000 7fab5e7fc700 1 -- 172.21.15.79:0/4209149497 >> v2:172.21.15.89:3300/0 conn(0x7fab600b0710 msgr2=0x7fab600b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:08.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.701+0000 7fab5e7fc700 1 --2- 172.21.15.79:0/4209149497 >> v2:172.21.15.89:3300/0 conn(0x7fab600b0710 0x7fab600b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.701+0000 7fab5e7fc700 1 -- 172.21.15.79:0/4209149497 >> v1:172.21.15.79:6789/0 conn(0x7fab600adee0 legacy=0x7fab600b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:08.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.701+0000 7fab5e7fc700 1 -- 172.21.15.79:0/4209149497 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab600b1030 con 0x7fab600d14f0 2023-10-19T08:38:08.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.701+0000 7fab5e7fc700 1 --2- 172.21.15.79:0/4209149497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab600d14f0 0x7fab600ad9a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fab6008b310 tx=0x7fab50009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e492e52b3ef37c server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:08.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.701+0000 7fab5dffb700 1 -- 172.21.15.79:0/4209149497 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab50004230 con 0x7fab600d14f0 2023-10-19T08:38:08.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.701+0000 7fab5dffb700 1 -- 172.21.15.79:0/4209149497 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab50004390 con 0x7fab600d14f0 2023-10-19T08:38:08.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.701+0000 7fab5dffb700 1 -- 172.21.15.79:0/4209149497 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab500036a0 con 0x7fab600d14f0 2023-10-19T08:38:08.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.701+0000 7fab65498700 1 -- 172.21.15.79:0/4209149497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab600d14f0 msgr2=0x7fab600ad9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:08.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.701+0000 7fab65498700 1 --2- 172.21.15.79:0/4209149497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab600d14f0 0x7fab600ad9a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fab6008b310 tx=0x7fab50009b20 comp rx=0 tx=0).stop 2023-10-19T08:38:08.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.701+0000 7fab65498700 1 -- 172.21.15.79:0/4209149497 shutdown_connections 2023-10-19T08:38:08.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.701+0000 7fab65498700 1 --2- 172.21.15.79:0/4209149497 >> v2:172.21.15.89:3300/0 conn(0x7fab600b0710 0x7fab600b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.701+0000 7fab65498700 1 --2- 172.21.15.79:0/4209149497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab600d14f0 0x7fab600ad9a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.701+0000 7fab65498700 1 -- 172.21.15.79:0/4209149497 >> 172.21.15.79:0/4209149497 conn(0x7fab6009a0b0 msgr2=0x7fab600d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:08.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.702+0000 7fab65498700 1 -- 172.21.15.79:0/4209149497 shutdown_connections 2023-10-19T08:38:08.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.702+0000 7fab65498700 1 -- 172.21.15.79:0/4209149497 wait complete. 2023-10-19T08:38:08.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.703+0000 7fab65498700 1 Processor -- start 2023-10-19T08:38:08.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.703+0000 7fab65498700 1 -- start start 2023-10-19T08:38:08.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab65498700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab600adee0 0x7fab60150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:08.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab65498700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab600b0710 0x7fab600ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:08.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab65498700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab600d14f0 0x7fab600ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:08.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab65498700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6009c320 con 0x7fab600adee0 2023-10-19T08:38:08.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab65498700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab60151750 con 0x7fab600b0710 2023-10-19T08:38:08.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab65498700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6009d840 con 0x7fab600d14f0 2023-10-19T08:38:08.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab5effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab600adee0 0x7fab60150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:08.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab5effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab600adee0 0x7fab60150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45926/0 (socket says 172.21.15.79:45926) 2023-10-19T08:38:08.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab5effd700 1 -- 172.21.15.79:0/1199390644 learned_addr learned my addr 172.21.15.79:0/1199390644 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:08.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab5e7fc700 1 --2- 172.21.15.79:0/1199390644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab600b0710 0x7fab600ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:08.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab5f7fe700 1 --2- 172.21.15.79:0/1199390644 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab600d14f0 0x7fab600ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:08.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab5effd700 1 -- 172.21.15.79:0/1199390644 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab600d14f0 msgr2=0x7fab600ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:08.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab5effd700 1 --2- 172.21.15.79:0/1199390644 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab600d14f0 0x7fab600ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab5effd700 1 -- 172.21.15.79:0/1199390644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab600b0710 msgr2=0x7fab600ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:08.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab5effd700 1 --2- 172.21.15.79:0/1199390644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab600b0710 0x7fab600ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab5effd700 1 -- 172.21.15.79:0/1199390644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab500094a0 con 0x7fab600adee0 2023-10-19T08:38:08.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab5effd700 1 --2- 172.21.15.79:0/1199390644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab600adee0 0x7fab60150c00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fab5400e810 tx=0x7fab5400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:08.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab477fe700 1 -- 172.21.15.79:0/1199390644 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab54013610 con 0x7fab600adee0 2023-10-19T08:38:08.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab477fe700 1 -- 172.21.15.79:0/1199390644 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab54013770 con 0x7fab600adee0 2023-10-19T08:38:08.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab65498700 1 -- 172.21.15.79:0/1199390644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab60151140 con 0x7fab600adee0 2023-10-19T08:38:08.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.704+0000 7fab477fe700 1 -- 172.21.15.79:0/1199390644 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab54013b20 con 0x7fab600adee0 2023-10-19T08:38:08.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.705+0000 7fab65498700 1 -- 172.21.15.79:0/1199390644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6009b980 con 0x7fab600adee0 2023-10-19T08:38:08.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.705+0000 7fab65498700 1 -- 172.21.15.79:0/1199390644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab600b26d0 con 0x7fab600adee0 2023-10-19T08:38:08.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.706+0000 7fab477fe700 1 -- 172.21.15.79:0/1199390644 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fab54013c80 con 0x7fab600adee0 2023-10-19T08:38:08.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.706+0000 7fab477fe700 1 --2- 172.21.15.79:0/1199390644 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fab4c06a0e0 0x7fab4c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:08.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.706+0000 7fab477fe700 1 -- 172.21.15.79:0/1199390644 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fab54088580 con 0x7fab600adee0 2023-10-19T08:38:08.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.706+0000 7fab5e7fc700 1 --2- 172.21.15.79:0/1199390644 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fab4c06a0e0 0x7fab4c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:08.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.707+0000 7fab5e7fc700 1 --2- 172.21.15.79:0/1199390644 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fab4c06a0e0 0x7fab4c06c5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fab6008b310 tx=0x7fab50013040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:08.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.711+0000 7fab477fe700 1 -- 172.21.15.79:0/1199390644 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fab54053990 con 0x7fab600adee0 2023-10-19T08:38:08.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.897+0000 7fab65498700 1 -- 172.21.15.79:0/1199390644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab6006c940 con 0x7fab600adee0 2023-10-19T08:38:08.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.898+0000 7fab477fe700 1 -- 172.21.15.79:0/1199390644 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fab54056fb0 con 0x7fab600adee0 2023-10-19T08:38:08.903 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-19T08:38:08.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.899+0000 7fab65498700 1 -- 172.21.15.79:0/1199390644 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fab4c06a0e0 msgr2=0x7fab4c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:08.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.899+0000 7fab65498700 1 --2- 172.21.15.79:0/1199390644 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fab4c06a0e0 0x7fab4c06c5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fab6008b310 tx=0x7fab50013040 comp rx=0 tx=0).stop 2023-10-19T08:38:08.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.899+0000 7fab65498700 1 -- 172.21.15.79:0/1199390644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab600adee0 msgr2=0x7fab60150c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:08.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.899+0000 7fab65498700 1 --2- 172.21.15.79:0/1199390644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab600adee0 0x7fab60150c00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fab5400e810 tx=0x7fab5400ebd0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.900+0000 7fab65498700 1 -- 172.21.15.79:0/1199390644 shutdown_connections 2023-10-19T08:38:08.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.900+0000 7fab65498700 1 --2- 172.21.15.79:0/1199390644 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fab4c06a0e0 0x7fab4c06c5a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.900+0000 7fab65498700 1 --2- 172.21.15.79:0/1199390644 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab600d14f0 0x7fab600ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.900+0000 7fab65498700 1 --2- 172.21.15.79:0/1199390644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fab600adee0 0x7fab60150c00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.900+0000 7fab65498700 1 --2- 172.21.15.79:0/1199390644 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab600b0710 0x7fab600ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:08.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.900+0000 7fab65498700 1 -- 172.21.15.79:0/1199390644 >> 172.21.15.79:0/1199390644 conn(0x7fab6009a0b0 msgr2=0x7fab600c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:08.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.900+0000 7fab65498700 1 -- 172.21.15.79:0/1199390644 shutdown_connections 2023-10-19T08:38:08.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:08.900+0000 7fab65498700 1 -- 172.21.15.79:0/1199390644 wait complete. 2023-10-19T08:38:08.916 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T08:38:09.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.034+0000 7f9685732700 1 Processor -- start 2023-10-19T08:38:09.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.034+0000 7f9685732700 1 -- start start 2023-10-19T08:38:09.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.035+0000 7f9685732700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f96800cc640 0x7f96800cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:09.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.035+0000 7f9685732700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96800b24d0 con 0x7f9680159db0 2023-10-19T08:38:09.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.035+0000 7f9685732700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96800ccf60 con 0x7f96800ceaf0 2023-10-19T08:38:09.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.035+0000 7f9685732700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968015d760 con 0x7f96800cc640 2023-10-19T08:38:09.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.035+0000 7f967effd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f96800cc640 0x7f96800cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:09.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.035+0000 7f967e7fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9680159db0 0x7f96800b16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56006/0 (socket says 172.21.15.79:56006) 2023-10-19T08:38:09.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.035+0000 7f967e7fc700 1 -- 172.21.15.79:0/436574181 learned_addr learned my addr 172.21.15.79:0/436574181 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:09.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.035+0000 7f967effd700 1 -- 172.21.15.79:0/436574181 >> v1:172.21.15.89:6789/0 conn(0x7f96800ceaf0 legacy=0x7f96800b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:09.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.035+0000 7f967effd700 1 -- 172.21.15.79:0/436574181 >> v1:172.21.15.79:6789/0 conn(0x7f9680159db0 legacy=0x7f96800b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:09.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.035+0000 7f967effd700 1 -- 172.21.15.79:0/436574181 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968015da40 con 0x7f96800cc640 2023-10-19T08:38:09.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.036+0000 7f967effd700 1 --2- 172.21.15.79:0/436574181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96800cc640 0x7f96800cca20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9674009840 tx=0x7f9674009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2213231da480e547 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:09.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.036+0000 7f967dffb700 1 -- 172.21.15.79:0/436574181 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9674011830 con 0x7f96800cc640 2023-10-19T08:38:09.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.036+0000 7f967dffb700 1 -- 172.21.15.79:0/436574181 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9674011990 con 0x7f96800cc640 2023-10-19T08:38:09.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.036+0000 7f967dffb700 1 -- 172.21.15.79:0/436574181 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9674011d20 con 0x7f96800cc640 2023-10-19T08:38:09.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.036+0000 7f9685732700 1 -- 172.21.15.79:0/436574181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96800cc640 msgr2=0x7f96800cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:09.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.036+0000 7f9685732700 1 --2- 172.21.15.79:0/436574181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96800cc640 0x7f96800cca20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9674009840 tx=0x7f9674009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:09.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.036+0000 7f9685732700 1 -- 172.21.15.79:0/436574181 shutdown_connections 2023-10-19T08:38:09.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.036+0000 7f9685732700 1 --2- 172.21.15.79:0/436574181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f96800cc640 0x7f96800cca20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.036+0000 7f9685732700 1 -- 172.21.15.79:0/436574181 >> 172.21.15.79:0/436574181 conn(0x7f968006dcc0 msgr2=0x7f968006e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:09.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.036+0000 7f9685732700 1 -- 172.21.15.79:0/436574181 shutdown_connections 2023-10-19T08:38:09.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.036+0000 7f9685732700 1 -- 172.21.15.79:0/436574181 wait complete. 2023-10-19T08:38:09.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.038+0000 7f9685732700 1 Processor -- start 2023-10-19T08:38:09.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.038+0000 7f9685732700 1 -- start start 2023-10-19T08:38:09.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.038+0000 7f9685732700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96800cc640 0x7f968015bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:09.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.038+0000 7f9685732700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96800ceaf0 0x7f96800c3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:09.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.038+0000 7f9685732700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9680159db0 0x7f96801527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:09.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.038+0000 7f9685732700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96800c5280 con 0x7f9680159db0 2023-10-19T08:38:09.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.038+0000 7f9685732700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96800c41e0 con 0x7f96800cc640 2023-10-19T08:38:09.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.038+0000 7f9685732700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96800c44c0 con 0x7f96800ceaf0 2023-10-19T08:38:09.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.038+0000 7f967f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9680159db0 0x7f96801527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:09.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.038+0000 7f967f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9680159db0 0x7f96801527f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45944/0 (socket says 172.21.15.79:45944) 2023-10-19T08:38:09.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.038+0000 7f967f7fe700 1 -- 172.21.15.79:0/1924338318 learned_addr learned my addr 172.21.15.79:0/1924338318 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:09.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.039+0000 7f967effd700 1 --2- 172.21.15.79:0/1924338318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96800cc640 0x7f968015bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:09.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.039+0000 7f967e7fc700 1 --2- 172.21.15.79:0/1924338318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96800ceaf0 0x7f96800c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:09.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.039+0000 7f967f7fe700 1 -- 172.21.15.79:0/1924338318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96800ceaf0 msgr2=0x7f96800c3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:09.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.039+0000 7f967f7fe700 1 --2- 172.21.15.79:0/1924338318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96800ceaf0 0x7f96800c3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.039+0000 7f967f7fe700 1 -- 172.21.15.79:0/1924338318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96800cc640 msgr2=0x7f968015bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:09.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.039+0000 7f967f7fe700 1 --2- 172.21.15.79:0/1924338318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96800cc640 0x7f968015bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.039+0000 7f967f7fe700 1 -- 172.21.15.79:0/1924338318 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96740094a0 con 0x7f9680159db0 2023-10-19T08:38:09.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.039+0000 7f967f7fe700 1 --2- 172.21.15.79:0/1924338318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9680159db0 0x7f96801527f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f967800cc50 tx=0x7f967800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:09.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.039+0000 7f96677fe700 1 -- 172.21.15.79:0/1924338318 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678003c00 con 0x7f9680159db0 2023-10-19T08:38:09.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.039+0000 7f96677fe700 1 -- 172.21.15.79:0/1924338318 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9678003d60 con 0x7f9680159db0 2023-10-19T08:38:09.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.039+0000 7f9685732700 1 -- 172.21.15.79:0/1924338318 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96800c47a0 con 0x7f9680159db0 2023-10-19T08:38:09.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.039+0000 7f96677fe700 1 -- 172.21.15.79:0/1924338318 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967800aab0 con 0x7f9680159db0 2023-10-19T08:38:09.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.039+0000 7f9685732700 1 -- 172.21.15.79:0/1924338318 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96800c4d60 con 0x7f9680159db0 2023-10-19T08:38:09.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.040+0000 7f9685732700 1 -- 172.21.15.79:0/1924338318 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968004ee70 con 0x7f9680159db0 2023-10-19T08:38:09.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.040+0000 7f96677fe700 1 -- 172.21.15.79:0/1924338318 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f967800ac10 con 0x7f9680159db0 2023-10-19T08:38:09.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.041+0000 7f96677fe700 1 --2- 172.21.15.79:0/1924338318 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f966c06a0e0 0x7f966c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:09.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.041+0000 7f96677fe700 1 -- 172.21.15.79:0/1924338318 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9678088760 con 0x7f9680159db0 2023-10-19T08:38:09.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.041+0000 7f967effd700 1 --2- 172.21.15.79:0/1924338318 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f966c06a0e0 0x7f966c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:09.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.041+0000 7f967effd700 1 --2- 172.21.15.79:0/1924338318 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f966c06a0e0 0x7f966c06c5a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f96740090b0 tx=0x7f967401c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:09.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.045+0000 7f96677fe700 1 -- 172.21.15.79:0/1924338318 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f9678053bf0 con 0x7f9680159db0 2023-10-19T08:38:09.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.239+0000 7f9685732700 1 -- 172.21.15.79:0/1924338318 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f968015dfd0 con 0x7f9680159db0 2023-10-19T08:38:09.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.239+0000 7f96677fe700 1 -- 172.21.15.79:0/1924338318 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9678057210 con 0x7f9680159db0 2023-10-19T08:38:09.244 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:09.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.241+0000 7f9685732700 1 -- 172.21.15.79:0/1924338318 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f966c06a0e0 msgr2=0x7f966c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:09.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.241+0000 7f9685732700 1 --2- 172.21.15.79:0/1924338318 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f966c06a0e0 0x7f966c06c5a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f96740090b0 tx=0x7f967401c040 comp rx=0 tx=0).stop 2023-10-19T08:38:09.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.241+0000 7f9685732700 1 -- 172.21.15.79:0/1924338318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9680159db0 msgr2=0x7f96801527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:09.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.241+0000 7f9685732700 1 --2- 172.21.15.79:0/1924338318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9680159db0 0x7f96801527f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f967800cc50 tx=0x7f967800cf60 comp rx=0 tx=0).stop 2023-10-19T08:38:09.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.241+0000 7f9685732700 1 -- 172.21.15.79:0/1924338318 shutdown_connections 2023-10-19T08:38:09.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.241+0000 7f9685732700 1 --2- 172.21.15.79:0/1924338318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9680159db0 0x7f96801527f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.241+0000 7f9685732700 1 --2- 172.21.15.79:0/1924338318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f96800cc640 0x7f968015bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.241+0000 7f9685732700 1 --2- 172.21.15.79:0/1924338318 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f966c06a0e0 0x7f966c06c5a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.241+0000 7f9685732700 1 --2- 172.21.15.79:0/1924338318 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96800ceaf0 0x7f96800c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.241+0000 7f9685732700 1 -- 172.21.15.79:0/1924338318 >> 172.21.15.79:0/1924338318 conn(0x7f968006dcc0 msgr2=0x7f96800b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:09.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.242+0000 7f9685732700 1 -- 172.21.15.79:0/1924338318 shutdown_connections 2023-10-19T08:38:09.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.242+0000 7f9685732700 1 -- 172.21.15.79:0/1924338318 wait complete. 2023-10-19T08:38:09.258 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-19T08:38:09.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.378+0000 7f83ada63700 1 Processor -- start 2023-10-19T08:38:09.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.378+0000 7f83ada63700 1 -- start start 2023-10-19T08:38:09.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.379+0000 7f83ada63700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83a80b0c00 0x7f83a80d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:09.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.379+0000 7f83ada63700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a80b25f0 con 0x7f83a80cb6f0 2023-10-19T08:38:09.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.379+0000 7f83ada63700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a80afd60 con 0x7f83a815e570 2023-10-19T08:38:09.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.379+0000 7f83ada63700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a80af810 con 0x7f83a80b0c00 2023-10-19T08:38:09.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.379+0000 7f83a6ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83a80b0c00 0x7f83a80d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:09.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.379+0000 7f83a7fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f83a80cb6f0 0x7f83a80ad9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56036/0 (socket says 172.21.15.79:56036) 2023-10-19T08:38:09.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.379+0000 7f83a7fff700 1 -- 172.21.15.79:0/2791081397 learned_addr learned my addr 172.21.15.79:0/2791081397 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:09.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.380+0000 7f83a6ffd700 1 -- 172.21.15.79:0/2791081397 >> v1:172.21.15.89:6789/0 conn(0x7f83a815e570 legacy=0x7f83a80b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:09.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.380+0000 7f83a6ffd700 1 -- 172.21.15.79:0/2791081397 >> v1:172.21.15.79:6789/0 conn(0x7f83a80cb6f0 legacy=0x7f83a80ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:09.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.380+0000 7f83a6ffd700 1 -- 172.21.15.79:0/2791081397 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a80aef70 con 0x7f83a80b0c00 2023-10-19T08:38:09.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.380+0000 7f83a67fc700 1 -- 172.21.15.79:0/2791081397 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973496128 0 0) 0x7f83a80b25f0 con 0x7f83a80cb6f0 2023-10-19T08:38:09.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.380+0000 7f83a6ffd700 1 --2- 172.21.15.79:0/2791081397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83a80b0c00 0x7f83a80d1990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8398009840 tx=0x7f8398009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a10567824fa6dc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:09.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.380+0000 7f83a67fc700 1 -- 172.21.15.79:0/2791081397 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8398004230 con 0x7f83a80b0c00 2023-10-19T08:38:09.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.380+0000 7f83a67fc700 1 -- 172.21.15.79:0/2791081397 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8398004390 con 0x7f83a80b0c00 2023-10-19T08:38:09.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.380+0000 7f83a67fc700 1 -- 172.21.15.79:0/2791081397 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83980036a0 con 0x7f83a80b0c00 2023-10-19T08:38:09.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.380+0000 7f83ada63700 1 -- 172.21.15.79:0/2791081397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83a80b0c00 msgr2=0x7f83a80d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:09.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.380+0000 7f83ada63700 1 --2- 172.21.15.79:0/2791081397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83a80b0c00 0x7f83a80d1990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8398009840 tx=0x7f8398009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:09.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.380+0000 7f83ada63700 1 -- 172.21.15.79:0/2791081397 shutdown_connections 2023-10-19T08:38:09.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.380+0000 7f83ada63700 1 --2- 172.21.15.79:0/2791081397 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83a80b0c00 0x7f83a80d1990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.380+0000 7f83ada63700 1 -- 172.21.15.79:0/2791081397 >> 172.21.15.79:0/2791081397 conn(0x7f83a809a0b0 msgr2=0x7f83a80d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:09.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.380+0000 7f83ada63700 1 -- 172.21.15.79:0/2791081397 shutdown_connections 2023-10-19T08:38:09.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.380+0000 7f83ada63700 1 -- 172.21.15.79:0/2791081397 wait complete. 2023-10-19T08:38:09.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.382+0000 7f83ada63700 1 Processor -- start 2023-10-19T08:38:09.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.382+0000 7f83ada63700 1 -- start start 2023-10-19T08:38:09.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.382+0000 7f83ada63700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83a80b0c00 0x7f83a80c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:09.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f83ada63700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83a80cb6f0 0x7f83a815a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:09.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f83ada63700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83a815e570 0x7f83a80c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:09.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f83ada63700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a80cad60 con 0x7f83a80cb6f0 2023-10-19T08:38:09.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f83ada63700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a80c9a60 con 0x7f83a80b0c00 2023-10-19T08:38:09.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f83ada63700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a80c9cc0 con 0x7f83a815e570 2023-10-19T08:38:09.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f83a6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83a80cb6f0 0x7f83a815a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:09.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f83a6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83a80cb6f0 0x7f83a815a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45968/0 (socket says 172.21.15.79:45968) 2023-10-19T08:38:09.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f83a6ffd700 1 -- 172.21.15.79:0/446474463 learned_addr learned my addr 172.21.15.79:0/446474463 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:09.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f83a77fe700 1 --2- 172.21.15.79:0/446474463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83a80b0c00 0x7f83a80c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:09.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f83a7fff700 1 --2- 172.21.15.79:0/446474463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83a815e570 0x7f83a80c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:09.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f83a6ffd700 1 -- 172.21.15.79:0/446474463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83a815e570 msgr2=0x7f83a80c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:09.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f83a6ffd700 1 --2- 172.21.15.79:0/446474463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83a815e570 0x7f83a80c9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f83a6ffd700 1 -- 172.21.15.79:0/446474463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83a80b0c00 msgr2=0x7f83a80c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:09.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f83a6ffd700 1 --2- 172.21.15.79:0/446474463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83a80b0c00 0x7f83a80c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f83a6ffd700 1 -- 172.21.15.79:0/446474463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83980094a0 con 0x7f83a80cb6f0 2023-10-19T08:38:09.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f83a77fe700 1 --2- 172.21.15.79:0/446474463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83a80b0c00 0x7f83a80c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:09.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f83a6ffd700 1 --2- 172.21.15.79:0/446474463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83a80cb6f0 0x7f83a815a5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8398009b90 tx=0x7f8398004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:09.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f839ffff700 1 -- 172.21.15.79:0/446474463 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8398011630 con 0x7f83a80cb6f0 2023-10-19T08:38:09.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f839ffff700 1 -- 172.21.15.79:0/446474463 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839801e070 con 0x7f83a80cb6f0 2023-10-19T08:38:09.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f839ffff700 1 -- 172.21.15.79:0/446474463 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83980119b0 con 0x7f83a80cb6f0 2023-10-19T08:38:09.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f83ada63700 1 -- 172.21.15.79:0/446474463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a80c9fa0 con 0x7f83a80cb6f0 2023-10-19T08:38:09.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.383+0000 7f83ada63700 1 -- 172.21.15.79:0/446474463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a80ca560 con 0x7f83a80cb6f0 2023-10-19T08:38:09.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.384+0000 7f83ada63700 1 -- 172.21.15.79:0/446474463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a804ee70 con 0x7f83a80cb6f0 2023-10-19T08:38:09.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.385+0000 7f839ffff700 1 -- 172.21.15.79:0/446474463 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8398011b10 con 0x7f83a80cb6f0 2023-10-19T08:38:09.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.385+0000 7f839ffff700 1 --2- 172.21.15.79:0/446474463 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f838806a0e0 0x7f838806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:09.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.385+0000 7f839ffff700 1 -- 172.21.15.79:0/446474463 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8398089c20 con 0x7f83a80cb6f0 2023-10-19T08:38:09.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.385+0000 7f83a77fe700 1 --2- 172.21.15.79:0/446474463 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f838806a0e0 0x7f838806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:09.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.385+0000 7f83a77fe700 1 --2- 172.21.15.79:0/446474463 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f838806a0e0 0x7f838806c5a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8390006fd0 tx=0x7f8390008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:09.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.389+0000 7f839ffff700 1 -- 172.21.15.79:0/446474463 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f83980550b0 con 0x7f83a80cb6f0 2023-10-19T08:38:09.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.593+0000 7f83ada63700 1 -- 172.21.15.79:0/446474463 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f83a806dde0 con 0x7f83a80cb6f0 2023-10-19T08:38:09.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.593+0000 7f839ffff700 1 -- 172.21.15.79:0/446474463 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f83980586d0 con 0x7f83a80cb6f0 2023-10-19T08:38:09.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.595+0000 7f83ada63700 1 -- 172.21.15.79:0/446474463 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f838806a0e0 msgr2=0x7f838806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:09.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.595+0000 7f83ada63700 1 --2- 172.21.15.79:0/446474463 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f838806a0e0 0x7f838806c5a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8390006fd0 tx=0x7f8390008040 comp rx=0 tx=0).stop 2023-10-19T08:38:09.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.595+0000 7f83ada63700 1 -- 172.21.15.79:0/446474463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83a80cb6f0 msgr2=0x7f83a815a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:09.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.595+0000 7f83ada63700 1 --2- 172.21.15.79:0/446474463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83a80cb6f0 0x7f83a815a5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8398009b90 tx=0x7f8398004750 comp rx=0 tx=0).stop 2023-10-19T08:38:09.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.595+0000 7f83ada63700 1 -- 172.21.15.79:0/446474463 shutdown_connections 2023-10-19T08:38:09.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.595+0000 7f83ada63700 1 --2- 172.21.15.79:0/446474463 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f838806a0e0 0x7f838806c5a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.595+0000 7f83ada63700 1 --2- 172.21.15.79:0/446474463 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83a815e570 0x7f83a80c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.595+0000 7f83ada63700 1 --2- 172.21.15.79:0/446474463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83a80b0c00 0x7f83a80c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.595+0000 7f83ada63700 1 --2- 172.21.15.79:0/446474463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83a80cb6f0 0x7f83a815a5a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.595+0000 7f83ada63700 1 -- 172.21.15.79:0/446474463 >> 172.21.15.79:0/446474463 conn(0x7f83a809a0b0 msgr2=0x7f83a80b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:09.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.595+0000 7f83ada63700 1 -- 172.21.15.79:0/446474463 shutdown_connections 2023-10-19T08:38:09.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.595+0000 7f83ada63700 1 -- 172.21.15.79:0/446474463 wait complete. 2023-10-19T08:38:09.602 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2023-10-19T08:38:09.611 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:38:09.612 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T08:38:09.629 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:09.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.783+0000 7fd7cf00c700 1 Processor -- start 2023-10-19T08:38:09.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.783+0000 7fd7cf00c700 1 -- start start 2023-10-19T08:38:09.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.784+0000 7fd7cf00c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd7c80af170 0x7fd7c80cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:09.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.784+0000 7fd7cf00c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd7c80b1de0 0x7fd7c80b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:09.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.784+0000 7fd7cf00c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7c80cd800 0x7fd7c80cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:09.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.784+0000 7fd7cf00c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c80af550 con 0x7fd7c80af170 2023-10-19T08:38:09.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.784+0000 7fd7cf00c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7c80b16b0 con 0x7fd7c80b1de0 2023-10-19T08:38:09.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.784+0000 7fd7cf00c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c815de50 con 0x7fd7c80cd800 2023-10-19T08:38:09.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.784+0000 7fd7ccda8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd7c80af170 0x7fd7c80cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:09.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.784+0000 7fd7ccda8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd7c80af170 0x7fd7c80cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45974/0 (socket says 172.21.15.79:45974) 2023-10-19T08:38:09.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.784+0000 7fd7ccda8700 1 -- 172.21.15.79:0/2628033751 learned_addr learned my addr 172.21.15.79:0/2628033751 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:09.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.785+0000 7fd7c7fff700 1 --2- 172.21.15.79:0/2628033751 >> v2:172.21.15.89:3300/0 conn(0x7fd7c80b1de0 0x7fd7c80b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:09.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.785+0000 7fd7cd5a9700 1 --2- 172.21.15.79:0/2628033751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7c80cd800 0x7fd7c80cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:09.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.785+0000 7fd7ccda8700 1 -- 172.21.15.79:0/2628033751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7c80cd800 msgr2=0x7fd7c80cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:09.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.785+0000 7fd7ccda8700 1 --2- 172.21.15.79:0/2628033751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7c80cd800 0x7fd7c80cdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.785+0000 7fd7ccda8700 1 -- 172.21.15.79:0/2628033751 >> v2:172.21.15.89:3300/0 conn(0x7fd7c80b1de0 msgr2=0x7fd7c80b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:09.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.785+0000 7fd7ccda8700 1 --2- 172.21.15.79:0/2628033751 >> v2:172.21.15.89:3300/0 conn(0x7fd7c80b1de0 0x7fd7c80b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.785+0000 7fd7ccda8700 1 -- 172.21.15.79:0/2628033751 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c815e130 con 0x7fd7c80af170 2023-10-19T08:38:09.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.785+0000 7fd7ccda8700 1 --2- 172.21.15.79:0/2628033751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c80af170 0x7fd7c80cd0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0098f0 tx=0x7fd7bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e64cb553d309c94 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:09.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.785+0000 7fd7c77fe700 1 -- 172.21.15.79:0/2628033751 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc00b860 con 0x7fd7c80af170 2023-10-19T08:38:09.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.785+0000 7fd7c77fe700 1 -- 172.21.15.79:0/2628033751 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc00b9c0 con 0x7fd7c80af170 2023-10-19T08:38:09.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.785+0000 7fd7c77fe700 1 -- 172.21.15.79:0/2628033751 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc00bd50 con 0x7fd7c80af170 2023-10-19T08:38:09.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.785+0000 7fd7cf00c700 1 -- 172.21.15.79:0/2628033751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c80af170 msgr2=0x7fd7c80cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:09.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.786+0000 7fd7cf00c700 1 --2- 172.21.15.79:0/2628033751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c80af170 0x7fd7c80cd0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc0098f0 tx=0x7fd7bc009c00 comp rx=0 tx=0).stop 2023-10-19T08:38:09.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.786+0000 7fd7cf00c700 1 -- 172.21.15.79:0/2628033751 shutdown_connections 2023-10-19T08:38:09.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.786+0000 7fd7cf00c700 1 --2- 172.21.15.79:0/2628033751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7c80cd800 0x7fd7c80cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.786+0000 7fd7cf00c700 1 --2- 172.21.15.79:0/2628033751 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c80af170 0x7fd7c80cd0c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.786+0000 7fd7cf00c700 1 --2- 172.21.15.79:0/2628033751 >> v2:172.21.15.89:3300/0 conn(0x7fd7c80b1de0 0x7fd7c80b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.786+0000 7fd7cf00c700 1 -- 172.21.15.79:0/2628033751 >> 172.21.15.79:0/2628033751 conn(0x7fd7c806dcc0 msgr2=0x7fd7c806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:09.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.786+0000 7fd7cf00c700 1 -- 172.21.15.79:0/2628033751 shutdown_connections 2023-10-19T08:38:09.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.786+0000 7fd7cf00c700 1 -- 172.21.15.79:0/2628033751 wait complete. 2023-10-19T08:38:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.787+0000 7fd7cf00c700 1 Processor -- start 2023-10-19T08:38:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.787+0000 7fd7cf00c700 1 -- start start 2023-10-19T08:38:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.788+0000 7fd7cf00c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c80af170 0x7fd7c81571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:09.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.788+0000 7fd7cf00c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7c80b1de0 0x7fd7c80b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:09.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.788+0000 7fd7cf00c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c80cd800 0x7fd7c80b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:09.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.788+0000 7fd7cf00c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c81e6ae0 con 0x7fd7c80af170 2023-10-19T08:38:09.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.788+0000 7fd7cf00c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c81e6dc0 con 0x7fd7c80cd800 2023-10-19T08:38:09.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.788+0000 7fd7cf00c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c81e70a0 con 0x7fd7c80b1de0 2023-10-19T08:38:09.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.788+0000 7fd7ccda8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c80af170 0x7fd7c81571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:09.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.788+0000 7fd7ccda8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c80af170 0x7fd7c81571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45980/0 (socket says 172.21.15.79:45980) 2023-10-19T08:38:09.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.788+0000 7fd7ccda8700 1 -- 172.21.15.79:0/1829909874 learned_addr learned my addr 172.21.15.79:0/1829909874 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:09.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.789+0000 7fd7cd5a9700 1 --2- 172.21.15.79:0/1829909874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c80cd800 0x7fd7c80b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:09.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.789+0000 7fd7c7fff700 1 --2- 172.21.15.79:0/1829909874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7c80b1de0 0x7fd7c80b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:09.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.789+0000 7fd7ccda8700 1 -- 172.21.15.79:0/1829909874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7c80b1de0 msgr2=0x7fd7c80b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:09.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.789+0000 7fd7ccda8700 1 --2- 172.21.15.79:0/1829909874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7c80b1de0 0x7fd7c80b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.789+0000 7fd7ccda8700 1 -- 172.21.15.79:0/1829909874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c80cd800 msgr2=0x7fd7c80b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:09.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.789+0000 7fd7ccda8700 1 --2- 172.21.15.79:0/1829909874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c80cd800 0x7fd7c80b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.789+0000 7fd7ccda8700 1 -- 172.21.15.79:0/1829909874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7bc009550 con 0x7fd7c80af170 2023-10-19T08:38:09.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.789+0000 7fd7ccda8700 1 --2- 172.21.15.79:0/1829909874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c80af170 0x7fd7c81571d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009c40 tx=0x7fd7bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:09.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.789+0000 7fd7c57fa700 1 -- 172.21.15.79:0/1829909874 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc004380 con 0x7fd7c80af170 2023-10-19T08:38:09.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.789+0000 7fd7c57fa700 1 -- 172.21.15.79:0/1829909874 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc01f070 con 0x7fd7c80af170 2023-10-19T08:38:09.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.789+0000 7fd7cf00c700 1 -- 172.21.15.79:0/1829909874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c81e7380 con 0x7fd7c80af170 2023-10-19T08:38:09.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.789+0000 7fd7c57fa700 1 -- 172.21.15.79:0/1829909874 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc0036a0 con 0x7fd7c80af170 2023-10-19T08:38:09.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.789+0000 7fd7cf00c700 1 -- 172.21.15.79:0/1829909874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c81e88b0 con 0x7fd7c80af170 2023-10-19T08:38:09.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.790+0000 7fd7cf00c700 1 -- 172.21.15.79:0/1829909874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c81e76b0 con 0x7fd7c80af170 2023-10-19T08:38:09.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.790+0000 7fd7c57fa700 1 -- 172.21.15.79:0/1829909874 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd7bc021030 con 0x7fd7c80af170 2023-10-19T08:38:09.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.791+0000 7fd7c57fa700 1 --2- 172.21.15.79:0/1829909874 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd7ac06a0e0 0x7fd7ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:09.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.791+0000 7fd7c57fa700 1 -- 172.21.15.79:0/1829909874 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd7bc089be0 con 0x7fd7c80af170 2023-10-19T08:38:09.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.791+0000 7fd7c7fff700 1 --2- 172.21.15.79:0/1829909874 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd7ac06a0e0 0x7fd7ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:09.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.791+0000 7fd7c7fff700 1 --2- 172.21.15.79:0/1829909874 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd7ac06a0e0 0x7fd7ac06c5a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd7c80b5640 tx=0x7fd7b4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:09.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.796+0000 7fd7c57fa700 1 -- 172.21.15.79:0/1829909874 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd7bc055190 con 0x7fd7c80af170 2023-10-19T08:38:09.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.983+0000 7fd7cf00c700 1 -- 172.21.15.79:0/1829909874 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7c804ee70 con 0x7fd7c80af170 2023-10-19T08:38:09.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.986+0000 7fd7c57fa700 1 -- 172.21.15.79:0/1829909874 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20060 (secure 0 0 0) 0x7fd7bc015090 con 0x7fd7c80af170 2023-10-19T08:38:09.990 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:09.990 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":25,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:01.725914+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:09.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.987+0000 7fd7cf00c700 1 -- 172.21.15.79:0/1829909874 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd7ac06a0e0 msgr2=0x7fd7ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:09.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.987+0000 7fd7cf00c700 1 --2- 172.21.15.79:0/1829909874 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd7ac06a0e0 0x7fd7ac06c5a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd7c80b5640 tx=0x7fd7b4008040 comp rx=0 tx=0).stop 2023-10-19T08:38:09.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.987+0000 7fd7cf00c700 1 -- 172.21.15.79:0/1829909874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c80af170 msgr2=0x7fd7c81571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:09.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.987+0000 7fd7cf00c700 1 --2- 172.21.15.79:0/1829909874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c80af170 0x7fd7c81571d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009c40 tx=0x7fd7bc004750 comp rx=0 tx=0).stop 2023-10-19T08:38:09.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.987+0000 7fd7cf00c700 1 -- 172.21.15.79:0/1829909874 shutdown_connections 2023-10-19T08:38:09.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.987+0000 7fd7cf00c700 1 --2- 172.21.15.79:0/1829909874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7c80cd800 0x7fd7c80b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.987+0000 7fd7cf00c700 1 --2- 172.21.15.79:0/1829909874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c80af170 0x7fd7c81571d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.987+0000 7fd7cf00c700 1 --2- 172.21.15.79:0/1829909874 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd7ac06a0e0 0x7fd7ac06c5a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.987+0000 7fd7cf00c700 1 --2- 172.21.15.79:0/1829909874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd7c80b1de0 0x7fd7c80b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:09.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.987+0000 7fd7cf00c700 1 -- 172.21.15.79:0/1829909874 >> 172.21.15.79:0/1829909874 conn(0x7fd7c806dcc0 msgr2=0x7fd7c80af970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:09.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.987+0000 7fd7cf00c700 1 -- 172.21.15.79:0/1829909874 shutdown_connections 2023-10-19T08:38:09.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:09.987+0000 7fd7cf00c700 1 -- 172.21.15.79:0/1829909874 wait complete. 2023-10-19T08:38:10.003 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T08:37:54.318159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T08:37:55.629862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T08:37:59.333062+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T08:38:10.004 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:38:10.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.123+0000 7f12a1946700 1 Processor -- start 2023-10-19T08:38:10.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.123+0000 7f12a1946700 1 -- start start 2023-10-19T08:38:10.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.123+0000 7f12a1946700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c0ccae0 0x7f129c15db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:10.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.123+0000 7f12a1946700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c15b230 con 0x7f129c0cd7c0 2023-10-19T08:38:10.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.123+0000 7f12a1946700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c0b5b90 con 0x7f129c0cf500 2023-10-19T08:38:10.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.123+0000 7f12a1946700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0cdc50 con 0x7f129c0ccae0 2023-10-19T08:38:10.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.124+0000 7f129a7fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f129c0cd7c0 0x7f129c0cc3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56062/0 (socket says 172.21.15.79:56062) 2023-10-19T08:38:10.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.124+0000 7f129a7fc700 1 -- 172.21.15.79:0/1728356447 learned_addr learned my addr 172.21.15.79:0/1728356447 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:10.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.124+0000 7f129b7fe700 1 --2- 172.21.15.79:0/1728356447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c0ccae0 0x7f129c15db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:10.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.124+0000 7f1299ffb700 1 -- 172.21.15.79:0/1728356447 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019746825 0 0) 0x7f129c15b230 con 0x7f129c0cd7c0 2023-10-19T08:38:10.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.124+0000 7f1299ffb700 1 -- 172.21.15.79:0/1728356447 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12840035b0 con 0x7f129c0cd7c0 2023-10-19T08:38:10.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.124+0000 7f1299ffb700 1 -- 172.21.15.79:0/1728356447 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899290184 0 0) 0x7f129c0b5b90 con 0x7f129c0cf500 2023-10-19T08:38:10.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.124+0000 7f1299ffb700 1 -- 172.21.15.79:0/1728356447 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f129c15b230 con 0x7f129c0cf500 2023-10-19T08:38:10.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.124+0000 7f129b7fe700 1 -- 172.21.15.79:0/1728356447 >> v1:172.21.15.89:6789/0 conn(0x7f129c0cf500 legacy=0x7f129c0b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:10.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.124+0000 7f129b7fe700 1 -- 172.21.15.79:0/1728356447 >> v1:172.21.15.79:6789/0 conn(0x7f129c0cd7c0 legacy=0x7f129c0cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:10.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.124+0000 7f129b7fe700 1 -- 172.21.15.79:0/1728356447 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c0cf8e0 con 0x7f129c0ccae0 2023-10-19T08:38:10.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.124+0000 7f129b7fe700 1 --2- 172.21.15.79:0/1728356447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c0ccae0 0x7f129c15db30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1294009dc0 tx=0x7f129400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3db990deccc6c013 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:10.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.124+0000 7f1299ffb700 1 -- 172.21.15.79:0/1728356447 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129400e070 con 0x7f129c0ccae0 2023-10-19T08:38:10.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.124+0000 7f1299ffb700 1 -- 172.21.15.79:0/1728356447 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129400bb20 con 0x7f129c0ccae0 2023-10-19T08:38:10.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.124+0000 7f1299ffb700 1 -- 172.21.15.79:0/1728356447 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129400be90 con 0x7f129c0ccae0 2023-10-19T08:38:10.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.125+0000 7f12a1946700 1 -- 172.21.15.79:0/1728356447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c0ccae0 msgr2=0x7f129c15db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:10.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.125+0000 7f12a1946700 1 --2- 172.21.15.79:0/1728356447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c0ccae0 0x7f129c15db30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1294009dc0 tx=0x7f129400b330 comp rx=0 tx=0).stop 2023-10-19T08:38:10.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.125+0000 7f12a1946700 1 -- 172.21.15.79:0/1728356447 shutdown_connections 2023-10-19T08:38:10.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.125+0000 7f12a1946700 1 --2- 172.21.15.79:0/1728356447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c0ccae0 0x7f129c15db30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:10.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.125+0000 7f12a1946700 1 -- 172.21.15.79:0/1728356447 >> 172.21.15.79:0/1728356447 conn(0x7f129c06dcb0 msgr2=0x7f129c06e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:10.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.125+0000 7f12a1946700 1 -- 172.21.15.79:0/1728356447 shutdown_connections 2023-10-19T08:38:10.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.125+0000 7f12a1946700 1 -- 172.21.15.79:0/1728356447 wait complete. 2023-10-19T08:38:10.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.126+0000 7f12a1946700 1 Processor -- start 2023-10-19T08:38:10.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.126+0000 7f12a1946700 1 -- start start 2023-10-19T08:38:10.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.127+0000 7f12a1946700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c0ccae0 0x7f129c1540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:10.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.127+0000 7f12a1946700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f129c0cd7c0 0x7f129c15bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:10.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.127+0000 7f12a1946700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f129c0cf500 0x7f129c15c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:10.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.127+0000 7f12a1946700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c1f3d90 con 0x7f129c0cd7c0 2023-10-19T08:38:10.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.127+0000 7f12a1946700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c1f4070 con 0x7f129c0cf500 2023-10-19T08:38:10.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.127+0000 7f12a1946700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c1f4350 con 0x7f129c0ccae0 2023-10-19T08:38:10.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.127+0000 7f129a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f129c0cd7c0 0x7f129c15bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:10.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.127+0000 7f129a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f129c0cd7c0 0x7f129c15bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:45996/0 (socket says 172.21.15.79:45996) 2023-10-19T08:38:10.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.127+0000 7f129a7fc700 1 -- 172.21.15.79:0/483766358 learned_addr learned my addr 172.21.15.79:0/483766358 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:10.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.127+0000 7f129affd700 1 --2- 172.21.15.79:0/483766358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c0ccae0 0x7f129c1540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:10.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.127+0000 7f129b7fe700 1 --2- 172.21.15.79:0/483766358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f129c0cf500 0x7f129c15c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:10.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.127+0000 7f129a7fc700 1 -- 172.21.15.79:0/483766358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c0ccae0 msgr2=0x7f129c1540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:10.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.127+0000 7f129a7fc700 1 --2- 172.21.15.79:0/483766358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c0ccae0 0x7f129c1540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:10.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.127+0000 7f129a7fc700 1 -- 172.21.15.79:0/483766358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f129c0cf500 msgr2=0x7f129c15c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:10.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.127+0000 7f129a7fc700 1 --2- 172.21.15.79:0/483766358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f129c0cf500 0x7f129c15c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:10.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.127+0000 7f129a7fc700 1 -- 172.21.15.79:0/483766358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1294009a70 con 0x7f129c0cd7c0 2023-10-19T08:38:10.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.127+0000 7f129b7fe700 1 --2- 172.21.15.79:0/483766358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f129c0cf500 0x7f129c15c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:10.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.127+0000 7f129affd700 1 --2- 172.21.15.79:0/483766358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c0ccae0 0x7f129c1540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:10.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.128+0000 7f129a7fc700 1 --2- 172.21.15.79:0/483766358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f129c0cd7c0 0x7f129c15bc00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f128c00c4d0 tx=0x7f128c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:10.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.128+0000 7f1283fff700 1 -- 172.21.15.79:0/483766358 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c005d70 con 0x7f129c0cd7c0 2023-10-19T08:38:10.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.128+0000 7f1283fff700 1 -- 172.21.15.79:0/483766358 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c0070d0 con 0x7f129c0cd7c0 2023-10-19T08:38:10.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.128+0000 7f12a1946700 1 -- 172.21.15.79:0/483766358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129c1f4630 con 0x7f129c0cd7c0 2023-10-19T08:38:10.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.128+0000 7f1283fff700 1 -- 172.21.15.79:0/483766358 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c007480 con 0x7f129c0cd7c0 2023-10-19T08:38:10.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.128+0000 7f12a1946700 1 -- 172.21.15.79:0/483766358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129c1545f0 con 0x7f129c0cd7c0 2023-10-19T08:38:10.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.129+0000 7f12a1946700 1 -- 172.21.15.79:0/483766358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129c067470 con 0x7f129c0cd7c0 2023-10-19T08:38:10.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.129+0000 7f1283fff700 1 -- 172.21.15.79:0/483766358 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f128c0075e0 con 0x7f129c0cd7c0 2023-10-19T08:38:10.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.129+0000 7f1283fff700 1 --2- 172.21.15.79:0/483766358 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f128806a0e0 0x7f128806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:10.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.130+0000 7f129affd700 1 --2- 172.21.15.79:0/483766358 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f128806a0e0 0x7f128806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:10.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.130+0000 7f1283fff700 1 -- 172.21.15.79:0/483766358 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f128c087da0 con 0x7f129c0cd7c0 2023-10-19T08:38:10.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.130+0000 7f129affd700 1 --2- 172.21.15.79:0/483766358 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f128806a0e0 0x7f128806c5a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f12900016b0 tx=0x7f1290009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:10.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.135+0000 7f1283fff700 1 -- 172.21.15.79:0/483766358 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f128c0531b0 con 0x7f129c0cd7c0 2023-10-19T08:38:10.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.322+0000 7f12a1946700 1 -- 172.21.15.79:0/483766358 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f129c1f4b50 con 0x7f129c0cd7c0 2023-10-19T08:38:10.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.322+0000 7f1283fff700 1 -- 172.21.15.79:0/483766358 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f129c1f4b50 con 0x7f129c0cd7c0 2023-10-19T08:38:10.327 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:38:10.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.324+0000 7f12a1946700 1 -- 172.21.15.79:0/483766358 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f128806a0e0 msgr2=0x7f128806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:10.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.324+0000 7f12a1946700 1 --2- 172.21.15.79:0/483766358 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f128806a0e0 0x7f128806c5a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f12900016b0 tx=0x7f1290009040 comp rx=0 tx=0).stop 2023-10-19T08:38:10.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.324+0000 7f12a1946700 1 -- 172.21.15.79:0/483766358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f129c0cd7c0 msgr2=0x7f129c15bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:10.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.324+0000 7f12a1946700 1 --2- 172.21.15.79:0/483766358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f129c0cd7c0 0x7f129c15bc00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f128c00c4d0 tx=0x7f128c00c890 comp rx=0 tx=0).stop 2023-10-19T08:38:10.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.325+0000 7f12a1946700 1 -- 172.21.15.79:0/483766358 shutdown_connections 2023-10-19T08:38:10.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.325+0000 7f12a1946700 1 --2- 172.21.15.79:0/483766358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f129c0cf500 0x7f129c15c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:10.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.325+0000 7f12a1946700 1 --2- 172.21.15.79:0/483766358 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f128806a0e0 0x7f128806c5a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:10.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.325+0000 7f12a1946700 1 --2- 172.21.15.79:0/483766358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f129c0ccae0 0x7f129c1540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:10.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.325+0000 7f12a1946700 1 --2- 172.21.15.79:0/483766358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f129c0cd7c0 0x7f129c15bc00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:10.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.325+0000 7f12a1946700 1 -- 172.21.15.79:0/483766358 >> 172.21.15.79:0/483766358 conn(0x7f129c06dcb0 msgr2=0x7f129c158820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:10.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.325+0000 7f12a1946700 1 -- 172.21.15.79:0/483766358 shutdown_connections 2023-10-19T08:38:10.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.325+0000 7f12a1946700 1 -- 172.21.15.79:0/483766358 wait complete. 2023-10-19T08:38:10.341 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:38:10.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.460+0000 7f1269694700 1 Processor -- start 2023-10-19T08:38:10.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.460+0000 7f1269694700 1 -- start start 2023-10-19T08:38:10.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.461+0000 7f1269694700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f126415af90 0x7f12640d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:10.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.461+0000 7f1269694700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12640cedf0 0x7f12640d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:10.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.461+0000 7f1269694700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12640cfd90 con 0x7f12640d06c0 2023-10-19T08:38:10.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.461+0000 7f1269694700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12640d0b50 con 0x7f126415af90 2023-10-19T08:38:10.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.461+0000 7f1269694700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12640b3f20 con 0x7f12640cedf0 2023-10-19T08:38:10.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.461+0000 7f1262ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f126415af90 0x7f12640d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:10.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.461+0000 7f12637fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f12640d06c0 0x7f12640cd790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56078/0 (socket says 172.21.15.79:56078) 2023-10-19T08:38:10.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.461+0000 7f12637fe700 1 -- 172.21.15.79:0/2794906979 learned_addr learned my addr 172.21.15.79:0/2794906979 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:10.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.461+0000 7f12627fc700 1 --2- 172.21.15.79:0/2794906979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12640cedf0 0x7f12640d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:10.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.461+0000 7f1262ffd700 1 -- 172.21.15.79:0/2794906979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12640cedf0 msgr2=0x7f12640d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:10.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.461+0000 7f1262ffd700 1 --2- 172.21.15.79:0/2794906979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12640cedf0 0x7f12640d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:10.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.461+0000 7f1262ffd700 1 -- 172.21.15.79:0/2794906979 >> v1:172.21.15.79:6789/0 conn(0x7f12640d06c0 legacy=0x7f12640cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:10.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.461+0000 7f1261ffb700 1 -- 172.21.15.79:0/2794906979 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2402476307 0 0) 0x7f12640cfd90 con 0x7f12640d06c0 2023-10-19T08:38:10.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.461+0000 7f1262ffd700 1 -- 172.21.15.79:0/2794906979 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12640cf270 con 0x7f126415af90 2023-10-19T08:38:10.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.462+0000 7f1262ffd700 1 --2- 172.21.15.79:0/2794906979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f126415af90 0x7f12640d1680 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1258009840 tx=0x7f1258009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866754f6ba5b0829 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:10.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.462+0000 7f1261ffb700 1 -- 172.21.15.79:0/2794906979 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1258011830 con 0x7f126415af90 2023-10-19T08:38:10.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.462+0000 7f1261ffb700 1 -- 172.21.15.79:0/2794906979 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1258011990 con 0x7f126415af90 2023-10-19T08:38:10.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.462+0000 7f1261ffb700 1 -- 172.21.15.79:0/2794906979 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1258011d20 con 0x7f126415af90 2023-10-19T08:38:10.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.462+0000 7f1269694700 1 -- 172.21.15.79:0/2794906979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f126415af90 msgr2=0x7f12640d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:10.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.462+0000 7f1269694700 1 --2- 172.21.15.79:0/2794906979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f126415af90 0x7f12640d1680 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1258009840 tx=0x7f1258009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:10.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.462+0000 7f1269694700 1 -- 172.21.15.79:0/2794906979 shutdown_connections 2023-10-19T08:38:10.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.462+0000 7f1269694700 1 --2- 172.21.15.79:0/2794906979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f126415af90 0x7f12640d1680 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.462+0000 7f1269694700 1 --2- 172.21.15.79:0/2794906979 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f12640cedf0 0x7f12640d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.462+0000 7f1269694700 1 -- 172.21.15.79:0/2794906979 >> 172.21.15.79:0/2794906979 conn(0x7f126406a400 msgr2=0x7f126406a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.462+0000 7f1269694700 1 -- 172.21.15.79:0/2794906979 shutdown_connections 2023-10-19T08:38:10.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.462+0000 7f1269694700 1 -- 172.21.15.79:0/2794906979 wait complete. 2023-10-19T08:38:10.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.464+0000 7f1269694700 1 Processor -- start 2023-10-19T08:38:10.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.464+0000 7f1269694700 1 -- start start 2023-10-19T08:38:10.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.464+0000 7f1269694700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12640cedf0 0x7f12641f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:10.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.464+0000 7f1269694700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12640d06c0 0x7f12640affc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:10.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.464+0000 7f1269694700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f126415af90 0x7f12640b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:10.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.464+0000 7f1269694700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12641f3210 con 0x7f12640d06c0 2023-10-19T08:38:10.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.464+0000 7f1269694700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12640c71e0 con 0x7f12640cedf0 2023-10-19T08:38:10.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.464+0000 7f1269694700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12641f2f30 con 0x7f126415af90 2023-10-19T08:38:10.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.465+0000 7f12627fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12640d06c0 0x7f12640affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:10.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.465+0000 7f12627fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12640d06c0 0x7f12640affc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46010/0 (socket says 172.21.15.79:46010) 2023-10-19T08:38:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.465+0000 7f12627fc700 1 -- 172.21.15.79:0/3996963830 learned_addr learned my addr 172.21.15.79:0/3996963830 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.465+0000 7f1262ffd700 1 --2- 172.21.15.79:0/3996963830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12640cedf0 0x7f12641f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.465+0000 7f12637fe700 1 --2- 172.21.15.79:0/3996963830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f126415af90 0x7f12640b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:10.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.465+0000 7f12627fc700 1 -- 172.21.15.79:0/3996963830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f126415af90 msgr2=0x7f12640b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.465+0000 7f12627fc700 1 --2- 172.21.15.79:0/3996963830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f126415af90 0x7f12640b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.465+0000 7f12627fc700 1 -- 172.21.15.79:0/3996963830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12640cedf0 msgr2=0x7f12641f64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.465+0000 7f12627fc700 1 --2- 172.21.15.79:0/3996963830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12640cedf0 0x7f12641f64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.465+0000 7f12627fc700 1 -- 172.21.15.79:0/3996963830 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12580094a0 con 0x7f12640d06c0 2023-10-19T08:38:10.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.465+0000 7f12627fc700 1 --2- 172.21.15.79:0/3996963830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12640d06c0 0x7f12640affc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f125400e810 tx=0x7f125400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.465+0000 7f124b7fe700 1 -- 172.21.15.79:0/3996963830 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125400c070 con 0x7f12640d06c0 2023-10-19T08:38:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.465+0000 7f124b7fe700 1 -- 172.21.15.79:0/3996963830 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1254013610 con 0x7f12640d06c0 2023-10-19T08:38:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.465+0000 7f1269694700 1 -- 172.21.15.79:0/3996963830 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12641f59e0 con 0x7f12640d06c0 2023-10-19T08:38:10.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.465+0000 7f124b7fe700 1 -- 172.21.15.79:0/3996963830 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12540139c0 con 0x7f12640d06c0 2023-10-19T08:38:10.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.465+0000 7f1269694700 1 -- 172.21.15.79:0/3996963830 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12641f5fa0 con 0x7f12640d06c0 2023-10-19T08:38:10.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.466+0000 7f1269694700 1 -- 172.21.15.79:0/3996963830 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126404ee70 con 0x7f12640d06c0 2023-10-19T08:38:10.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.467+0000 7f124b7fe700 1 -- 172.21.15.79:0/3996963830 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1254013b20 con 0x7f12640d06c0 2023-10-19T08:38:10.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.467+0000 7f124b7fe700 1 --2- 172.21.15.79:0/3996963830 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f125006a0e0 0x7f125006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:10.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.467+0000 7f124b7fe700 1 -- 172.21.15.79:0/3996963830 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1254088600 con 0x7f12640d06c0 2023-10-19T08:38:10.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.467+0000 7f1262ffd700 1 --2- 172.21.15.79:0/3996963830 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f125006a0e0 0x7f125006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:10.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.467+0000 7f1262ffd700 1 --2- 172.21.15.79:0/3996963830 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f125006a0e0 0x7f125006c5a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f12580090b0 tx=0x7f125801c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:10.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.471+0000 7f124b7fe700 1 -- 172.21.15.79:0/3996963830 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f12540574a0 con 0x7f12640d06c0 2023-10-19T08:38:10.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.660+0000 7f1269694700 1 -- 172.21.15.79:0/3996963830 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f12640ca460 con 0x7f12640d06c0 2023-10-19T08:38:10.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.660+0000 7f124b7fe700 1 -- 172.21.15.79:0/3996963830 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1254057030 con 0x7f12640d06c0 2023-10-19T08:38:10.664 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:38:10.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.662+0000 7f1269694700 1 -- 172.21.15.79:0/3996963830 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f125006a0e0 msgr2=0x7f125006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:10.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.662+0000 7f1269694700 1 --2- 172.21.15.79:0/3996963830 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f125006a0e0 0x7f125006c5a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f12580090b0 tx=0x7f125801c040 comp rx=0 tx=0).stop 2023-10-19T08:38:10.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.662+0000 7f1269694700 1 -- 172.21.15.79:0/3996963830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12640d06c0 msgr2=0x7f12640affc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:10.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.662+0000 7f1269694700 1 --2- 172.21.15.79:0/3996963830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12640d06c0 0x7f12640affc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f125400e810 tx=0x7f125400eb20 comp rx=0 tx=0).stop 2023-10-19T08:38:10.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.662+0000 7f1269694700 1 -- 172.21.15.79:0/3996963830 shutdown_connections 2023-10-19T08:38:10.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.662+0000 7f1269694700 1 --2- 172.21.15.79:0/3996963830 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f125006a0e0 0x7f125006c5a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.662+0000 7f1269694700 1 --2- 172.21.15.79:0/3996963830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f126415af90 0x7f12640b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.662+0000 7f1269694700 1 --2- 172.21.15.79:0/3996963830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12640cedf0 0x7f12641f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.662+0000 7f1269694700 1 --2- 172.21.15.79:0/3996963830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f12640d06c0 0x7f12640affc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.662+0000 7f1269694700 1 -- 172.21.15.79:0/3996963830 >> 172.21.15.79:0/3996963830 conn(0x7f126406a400 msgr2=0x7f12640b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:10.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.662+0000 7f1269694700 1 -- 172.21.15.79:0/3996963830 shutdown_connections 2023-10-19T08:38:10.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.662+0000 7f1269694700 1 -- 172.21.15.79:0/3996963830 wait complete. 2023-10-19T08:38:10.678 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T08:38:10.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.798+0000 7f15d542b700 1 Processor -- start 2023-10-19T08:38:10.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.798+0000 7f15d542b700 1 -- start start 2023-10-19T08:38:10.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.799+0000 7f15d542b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f15d00cfcf0 0x7f15d00d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:10.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.799+0000 7f15d542b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d00d0610 con 0x7f15d00b2180 2023-10-19T08:38:10.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.799+0000 7f15d542b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d00d1120 con 0x7f15d00b5f20 2023-10-19T08:38:10.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.799+0000 7f15d542b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d00d2b20 con 0x7f15d00cfcf0 2023-10-19T08:38:10.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.799+0000 7f15ce7fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f15d00b2180 0x7f15d00d2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56088/0 (socket says 172.21.15.79:56088) 2023-10-19T08:38:10.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.799+0000 7f15ce7fc700 1 -- 172.21.15.79:0/2219119922 learned_addr learned my addr 172.21.15.79:0/2219119922 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:10.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.799+0000 7f15ceffd700 1 --2- 172.21.15.79:0/2219119922 >> v2:172.21.15.89:3300/0 conn(0x7f15d00cfcf0 0x7f15d00d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:10.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.799+0000 7f15cdffb700 1 -- 172.21.15.79:0/2219119922 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839577623 0 0) 0x7f15d00d0610 con 0x7f15d00b2180 2023-10-19T08:38:10.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.799+0000 7f15cdffb700 1 -- 172.21.15.79:0/2219119922 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15b80035b0 con 0x7f15d00b2180 2023-10-19T08:38:10.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.800+0000 7f15ceffd700 1 -- 172.21.15.79:0/2219119922 >> v1:172.21.15.89:6789/0 conn(0x7f15d00b5f20 legacy=0x7f15d00b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:10.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.800+0000 7f15cdffb700 1 -- 172.21.15.79:0/2219119922 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 649528335 0 0) 0x7f15b80035b0 con 0x7f15d00b2180 2023-10-19T08:38:10.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.800+0000 7f15ceffd700 1 -- 172.21.15.79:0/2219119922 >> v1:172.21.15.79:6789/0 conn(0x7f15d00b2180 legacy=0x7f15d00d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:10.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.800+0000 7f15ceffd700 1 -- 172.21.15.79:0/2219119922 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d00d1400 con 0x7f15d00cfcf0 2023-10-19T08:38:10.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.800+0000 7f15ceffd700 1 --2- 172.21.15.79:0/2219119922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15d00cfcf0 0x7f15d00d00d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009840 tx=0x7f15c4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=631f63b23718955f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:10.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.800+0000 7f15cdffb700 1 -- 172.21.15.79:0/2219119922 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0001670 con 0x7f15d00cfcf0 2023-10-19T08:38:10.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.800+0000 7f15cdffb700 1 -- 172.21.15.79:0/2219119922 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c4004030 con 0x7f15d00cfcf0 2023-10-19T08:38:10.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.800+0000 7f15cdffb700 1 -- 172.21.15.79:0/2219119922 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c40043c0 con 0x7f15d00cfcf0 2023-10-19T08:38:10.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.800+0000 7f15d542b700 1 -- 172.21.15.79:0/2219119922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15d00cfcf0 msgr2=0x7f15d00d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:10.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.800+0000 7f15d542b700 1 --2- 172.21.15.79:0/2219119922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15d00cfcf0 0x7f15d00d00d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009840 tx=0x7f15c4009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:10.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.800+0000 7f15d542b700 1 -- 172.21.15.79:0/2219119922 shutdown_connections 2023-10-19T08:38:10.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.800+0000 7f15d542b700 1 --2- 172.21.15.79:0/2219119922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15d00cfcf0 0x7f15d00d00d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:10.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.800+0000 7f15d542b700 1 -- 172.21.15.79:0/2219119922 >> 172.21.15.79:0/2219119922 conn(0x7f15d0071b30 msgr2=0x7f15d0071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:10.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.801+0000 7f15d542b700 1 -- 172.21.15.79:0/2219119922 shutdown_connections 2023-10-19T08:38:10.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.801+0000 7f15d542b700 1 -- 172.21.15.79:0/2219119922 wait complete. 2023-10-19T08:38:10.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.802+0000 7f15d542b700 1 Processor -- start 2023-10-19T08:38:10.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.802+0000 7f15d542b700 1 -- start start 2023-10-19T08:38:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15d542b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15d00b2180 0x7f15d00b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15d542b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15d00b5f20 0x7f15d01f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15d542b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15d00cfcf0 0x7f15d00cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15d542b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00aa360 con 0x7f15d00b5f20 2023-10-19T08:38:10.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15d542b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d01f37a0 con 0x7f15d00b2180 2023-10-19T08:38:10.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15d542b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d00a9a30 con 0x7f15d00cfcf0 2023-10-19T08:38:10.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15ce7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15d00b5f20 0x7f15d01f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:10.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15ce7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15d00b5f20 0x7f15d01f3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46024/0 (socket says 172.21.15.79:46024) 2023-10-19T08:38:10.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15ce7fc700 1 -- 172.21.15.79:0/827663901 learned_addr learned my addr 172.21.15.79:0/827663901 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:10.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15cf7fe700 1 --2- 172.21.15.79:0/827663901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15d00cfcf0 0x7f15d00cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:10.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15ceffd700 1 --2- 172.21.15.79:0/827663901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15d00b2180 0x7f15d00b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:10.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15ce7fc700 1 -- 172.21.15.79:0/827663901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15d00cfcf0 msgr2=0x7f15d00cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:10.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15ce7fc700 1 --2- 172.21.15.79:0/827663901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15d00cfcf0 0x7f15d00cb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:10.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15ce7fc700 1 -- 172.21.15.79:0/827663901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15d00b2180 msgr2=0x7f15d00b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:10.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15ce7fc700 1 --2- 172.21.15.79:0/827663901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15d00b2180 0x7f15d00b1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15ce7fc700 1 -- 172.21.15.79:0/827663901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c40094a0 con 0x7f15d00b5f20 2023-10-19T08:38:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15ce7fc700 1 --2- 172.21.15.79:0/827663901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15d00b5f20 0x7f15d01f3990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f15c000c780 tx=0x7f15c000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15b77fe700 1 -- 172.21.15.79:0/827663901 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0004c80 con 0x7f15d00b5f20 2023-10-19T08:38:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15b77fe700 1 -- 172.21.15.79:0/827663901 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c0004de0 con 0x7f15d00b5f20 2023-10-19T08:38:10.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15d542b700 1 -- 172.21.15.79:0/827663901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d00a9d10 con 0x7f15d00b5f20 2023-10-19T08:38:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15b77fe700 1 -- 172.21.15.79:0/827663901 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c0007310 con 0x7f15d00b5f20 2023-10-19T08:38:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.803+0000 7f15d542b700 1 -- 172.21.15.79:0/827663901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d01f3ed0 con 0x7f15d00b5f20 2023-10-19T08:38:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.804+0000 7f15d542b700 1 -- 172.21.15.79:0/827663901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d00aa510 con 0x7f15d00b5f20 2023-10-19T08:38:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.805+0000 7f15b77fe700 1 -- 172.21.15.79:0/827663901 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f15c0007470 con 0x7f15d00b5f20 2023-10-19T08:38:10.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.805+0000 7f15b77fe700 1 --2- 172.21.15.79:0/827663901 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f15bc06a0e0 0x7f15bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:10.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.805+0000 7f15b77fe700 1 -- 172.21.15.79:0/827663901 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f15c0087db0 con 0x7f15d00b5f20 2023-10-19T08:38:10.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.805+0000 7f15ceffd700 1 --2- 172.21.15.79:0/827663901 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f15bc06a0e0 0x7f15bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:10.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.805+0000 7f15ceffd700 1 --2- 172.21.15.79:0/827663901 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f15bc06a0e0 0x7f15bc06c5a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f15d00cc2f0 tx=0x7f15c4008000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:10.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.809+0000 7f15b77fe700 1 -- 172.21.15.79:0/827663901 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f15d00aa510 con 0x7f15d00b5f20 2023-10-19T08:38:10.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.996+0000 7f15d542b700 1 -- 172.21.15.79:0/827663901 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15d00aa510 con 0x7f15d00b5f20 2023-10-19T08:38:11.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.996+0000 7f15b77fe700 1 -- 172.21.15.79:0/827663901 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f15c0018020 con 0x7f15d00b5f20 2023-10-19T08:38:11.001 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:11.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.998+0000 7f15d542b700 1 -- 172.21.15.79:0/827663901 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f15bc06a0e0 msgr2=0x7f15bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:11.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.999+0000 7f15d542b700 1 --2- 172.21.15.79:0/827663901 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f15bc06a0e0 0x7f15bc06c5a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f15d00cc2f0 tx=0x7f15c4008000 comp rx=0 tx=0).stop 2023-10-19T08:38:11.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.999+0000 7f15d542b700 1 -- 172.21.15.79:0/827663901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15d00b5f20 msgr2=0x7f15d01f3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:11.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.999+0000 7f15d542b700 1 --2- 172.21.15.79:0/827663901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15d00b5f20 0x7f15d01f3990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f15c000c780 tx=0x7f15c000cb40 comp rx=0 tx=0).stop 2023-10-19T08:38:11.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.999+0000 7f15d542b700 1 -- 172.21.15.79:0/827663901 shutdown_connections 2023-10-19T08:38:11.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.999+0000 7f15d542b700 1 --2- 172.21.15.79:0/827663901 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f15bc06a0e0 0x7f15bc06c5a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.999+0000 7f15d542b700 1 --2- 172.21.15.79:0/827663901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f15d00cfcf0 0x7f15d00cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.999+0000 7f15d542b700 1 --2- 172.21.15.79:0/827663901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15d00b2180 0x7f15d00b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.999+0000 7f15d542b700 1 --2- 172.21.15.79:0/827663901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15d00b5f20 0x7f15d01f3990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.999+0000 7f15d542b700 1 -- 172.21.15.79:0/827663901 >> 172.21.15.79:0/827663901 conn(0x7f15d0071b30 msgr2=0x7f15d0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:11.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.999+0000 7f15d542b700 1 -- 172.21.15.79:0/827663901 shutdown_connections 2023-10-19T08:38:11.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:10.999+0000 7f15d542b700 1 -- 172.21.15.79:0/827663901 wait complete. 2023-10-19T08:38:11.014 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T08:38:11.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.134+0000 7f0c43fcb700 1 Processor -- start 2023-10-19T08:38:11.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.135+0000 7f0c43fcb700 1 -- start start 2023-10-19T08:38:11.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.135+0000 7f0c43fcb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0c3c159db0 0x7f0c3c0cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:11.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.135+0000 7f0c43fcb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c3c06fdc0 0x7f0c3c0ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:11.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.135+0000 7f0c43fcb700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3c15d760 con 0x7f0c3c0cc640 2023-10-19T08:38:11.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.135+0000 7f0c43fcb700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3c15da40 con 0x7f0c3c159db0 2023-10-19T08:38:11.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.135+0000 7f0c43fcb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c15dd20 con 0x7f0c3c06fdc0 2023-10-19T08:38:11.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.135+0000 7f0c41566700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0c3c159db0 0x7f0c3c0cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:11.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.135+0000 7f0c41d67700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0c3c0cc640 0x7f0c3c0cca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56102/0 (socket says 172.21.15.79:56102) 2023-10-19T08:38:11.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.135+0000 7f0c41d67700 1 -- 172.21.15.79:0/248906736 learned_addr learned my addr 172.21.15.79:0/248906736 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:11.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.136+0000 7f0c42568700 1 --2- 172.21.15.79:0/248906736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c3c06fdc0 0x7f0c3c0ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:11.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.136+0000 7f0c41566700 1 -- 172.21.15.79:0/248906736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c3c06fdc0 msgr2=0x7f0c3c0ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:11.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.136+0000 7f0c41566700 1 --2- 172.21.15.79:0/248906736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c3c06fdc0 0x7f0c3c0ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.136+0000 7f0c41566700 1 -- 172.21.15.79:0/248906736 >> v1:172.21.15.79:6789/0 conn(0x7f0c3c0cc640 legacy=0x7f0c3c0cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:11.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.136+0000 7f0c41566700 1 -- 172.21.15.79:0/248906736 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c15e000 con 0x7f0c3c159db0 2023-10-19T08:38:11.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.136+0000 7f0c40d65700 1 -- 172.21.15.79:0/248906736 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3344911942 0 0) 0x7f0c3c15d760 con 0x7f0c3c0cc640 2023-10-19T08:38:11.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.136+0000 7f0c41566700 1 --2- 172.21.15.79:0/248906736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c3c159db0 0x7f0c3c0cdae0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009840 tx=0x7f0c38009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf97bd7a27d598b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:11.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.136+0000 7f0c40d65700 1 -- 172.21.15.79:0/248906736 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38011830 con 0x7f0c3c159db0 2023-10-19T08:38:11.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.136+0000 7f0c40d65700 1 -- 172.21.15.79:0/248906736 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c38011990 con 0x7f0c3c159db0 2023-10-19T08:38:11.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.136+0000 7f0c40d65700 1 -- 172.21.15.79:0/248906736 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38011d20 con 0x7f0c3c159db0 2023-10-19T08:38:11.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.137+0000 7f0c43fcb700 1 -- 172.21.15.79:0/248906736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c3c159db0 msgr2=0x7f0c3c0cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:11.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.137+0000 7f0c43fcb700 1 --2- 172.21.15.79:0/248906736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c3c159db0 0x7f0c3c0cdae0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009840 tx=0x7f0c38009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:11.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.137+0000 7f0c43fcb700 1 -- 172.21.15.79:0/248906736 shutdown_connections 2023-10-19T08:38:11.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.137+0000 7f0c43fcb700 1 --2- 172.21.15.79:0/248906736 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c3c06fdc0 0x7f0c3c0ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.137+0000 7f0c43fcb700 1 --2- 172.21.15.79:0/248906736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c3c159db0 0x7f0c3c0cdae0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.137+0000 7f0c43fcb700 1 -- 172.21.15.79:0/248906736 >> 172.21.15.79:0/248906736 conn(0x7f0c3c06dcc0 msgr2=0x7f0c3c06e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:11.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.137+0000 7f0c43fcb700 1 -- 172.21.15.79:0/248906736 shutdown_connections 2023-10-19T08:38:11.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.137+0000 7f0c43fcb700 1 -- 172.21.15.79:0/248906736 wait complete. 2023-10-19T08:38:11.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.138+0000 7f0c43fcb700 1 Processor -- start 2023-10-19T08:38:11.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.138+0000 7f0c43fcb700 1 -- start start 2023-10-19T08:38:11.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c43fcb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3c06fdc0 0x7f0c3c1edb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:11.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c43fcb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c3c0cc640 0x7f0c3c1f3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:11.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c43fcb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c3c159db0 0x7f0c3c1f0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:11.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c43fcb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c1f0a10 con 0x7f0c3c0cc640 2023-10-19T08:38:11.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c43fcb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c1ee060 con 0x7f0c3c06fdc0 2023-10-19T08:38:11.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c43fcb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c1f4450 con 0x7f0c3c159db0 2023-10-19T08:38:11.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c41566700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c3c0cc640 0x7f0c3c1f3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:11.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c41566700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c3c0cc640 0x7f0c3c1f3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46036/0 (socket says 172.21.15.79:46036) 2023-10-19T08:38:11.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c41566700 1 -- 172.21.15.79:0/1971738202 learned_addr learned my addr 172.21.15.79:0/1971738202 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:11.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c41d67700 1 --2- 172.21.15.79:0/1971738202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3c06fdc0 0x7f0c3c1edb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:11.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c42568700 1 --2- 172.21.15.79:0/1971738202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c3c159db0 0x7f0c3c1f0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:11.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c41566700 1 -- 172.21.15.79:0/1971738202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c3c159db0 msgr2=0x7f0c3c1f0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:11.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c41566700 1 --2- 172.21.15.79:0/1971738202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c3c159db0 0x7f0c3c1f0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c41566700 1 -- 172.21.15.79:0/1971738202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3c06fdc0 msgr2=0x7f0c3c1edb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:11.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c41566700 1 --2- 172.21.15.79:0/1971738202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3c06fdc0 0x7f0c3c1edb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c41566700 1 -- 172.21.15.79:0/1971738202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c380094a0 con 0x7f0c3c0cc640 2023-10-19T08:38:11.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c41566700 1 --2- 172.21.15.79:0/1971738202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c3c0cc640 0x7f0c3c1f3c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0c380090b0 tx=0x7f0c38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:11.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c327fc700 1 -- 172.21.15.79:0/1971738202 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c380038a0 con 0x7f0c3c0cc640 2023-10-19T08:38:11.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c327fc700 1 -- 172.21.15.79:0/1971738202 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c38003a20 con 0x7f0c3c0cc640 2023-10-19T08:38:11.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c43fcb700 1 -- 172.21.15.79:0/1971738202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3c1f4730 con 0x7f0c3c0cc640 2023-10-19T08:38:11.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c327fc700 1 -- 172.21.15.79:0/1971738202 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c38003dd0 con 0x7f0c3c0cc640 2023-10-19T08:38:11.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.139+0000 7f0c43fcb700 1 -- 172.21.15.79:0/1971738202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3c1f4160 con 0x7f0c3c0cc640 2023-10-19T08:38:11.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.140+0000 7f0c43fcb700 1 -- 172.21.15.79:0/1971738202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3c1f0b80 con 0x7f0c3c0cc640 2023-10-19T08:38:11.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.141+0000 7f0c327fc700 1 -- 172.21.15.79:0/1971738202 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0c3801a420 con 0x7f0c3c0cc640 2023-10-19T08:38:11.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.141+0000 7f0c327fc700 1 --2- 172.21.15.79:0/1971738202 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0c2006a0e0 0x7f0c2006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:11.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.141+0000 7f0c41d67700 1 --2- 172.21.15.79:0/1971738202 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0c2006a0e0 0x7f0c2006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:11.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.141+0000 7f0c327fc700 1 -- 172.21.15.79:0/1971738202 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0c38089da0 con 0x7f0c3c0cc640 2023-10-19T08:38:11.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.141+0000 7f0c41d67700 1 --2- 172.21.15.79:0/1971738202 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0c2006a0e0 0x7f0c2006c5a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c000f60 tx=0x7f0c2c007be0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:11.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.146+0000 7f0c327fc700 1 -- 172.21.15.79:0/1971738202 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f0c38055230 con 0x7f0c3c0cc640 2023-10-19T08:38:11.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.336+0000 7f0c43fcb700 1 -- 172.21.15.79:0/1971738202 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0c3c04ee70 con 0x7f0c3c0cc640 2023-10-19T08:38:11.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.337+0000 7f0c327fc700 1 -- 172.21.15.79:0/1971738202 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0c380150a0 con 0x7f0c3c0cc640 2023-10-19T08:38:11.345 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-19T08:38:11.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.339+0000 7f0c43fcb700 1 -- 172.21.15.79:0/1971738202 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0c2006a0e0 msgr2=0x7f0c2006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:11.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.339+0000 7f0c43fcb700 1 --2- 172.21.15.79:0/1971738202 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0c2006a0e0 0x7f0c2006c5a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c000f60 tx=0x7f0c2c007be0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.339+0000 7f0c43fcb700 1 -- 172.21.15.79:0/1971738202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c3c0cc640 msgr2=0x7f0c3c1f3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:11.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.339+0000 7f0c43fcb700 1 --2- 172.21.15.79:0/1971738202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c3c0cc640 0x7f0c3c1f3c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0c380090b0 tx=0x7f0c38004750 comp rx=0 tx=0).stop 2023-10-19T08:38:11.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.339+0000 7f0c43fcb700 1 -- 172.21.15.79:0/1971738202 shutdown_connections 2023-10-19T08:38:11.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.339+0000 7f0c43fcb700 1 --2- 172.21.15.79:0/1971738202 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0c2006a0e0 0x7f0c2006c5a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.339+0000 7f0c43fcb700 1 --2- 172.21.15.79:0/1971738202 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c3c159db0 0x7f0c3c1f0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.339+0000 7f0c43fcb700 1 --2- 172.21.15.79:0/1971738202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3c06fdc0 0x7f0c3c1edb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.339+0000 7f0c43fcb700 1 --2- 172.21.15.79:0/1971738202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0c3c0cc640 0x7f0c3c1f3c20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.339+0000 7f0c43fcb700 1 -- 172.21.15.79:0/1971738202 >> 172.21.15.79:0/1971738202 conn(0x7f0c3c06dcc0 msgr2=0x7f0c3c0b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:11.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.339+0000 7f0c43fcb700 1 -- 172.21.15.79:0/1971738202 shutdown_connections 2023-10-19T08:38:11.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.339+0000 7f0c43fcb700 1 -- 172.21.15.79:0/1971738202 wait complete. 2023-10-19T08:38:11.354 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T08:38:11.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.474+0000 7fb1d2e8a700 1 Processor -- start 2023-10-19T08:38:11.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.474+0000 7fb1d2e8a700 1 -- start start 2023-10-19T08:38:11.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.475+0000 7fb1d2e8a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb1cc0cc640 0x7fb1cc0cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:11.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.475+0000 7fb1d2e8a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc0b24d0 con 0x7fb1cc159db0 2023-10-19T08:38:11.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.475+0000 7fb1d2e8a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc0ccf60 con 0x7fb1cc0ceaf0 2023-10-19T08:38:11.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.475+0000 7fb1d2e8a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc15d760 con 0x7fb1cc0cc640 2023-10-19T08:38:11.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.475+0000 7fb1d0c26700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb1cc0cc640 0x7fb1cc0cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:11.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.475+0000 7fb1cbfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb1cc159db0 0x7fb1cc0b16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56116/0 (socket says 172.21.15.79:56116) 2023-10-19T08:38:11.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.475+0000 7fb1cbfff700 1 -- 172.21.15.79:0/4188393452 learned_addr learned my addr 172.21.15.79:0/4188393452 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:11.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.475+0000 7fb1d0c26700 1 -- 172.21.15.79:0/4188393452 >> v1:172.21.15.89:6789/0 conn(0x7fb1cc0ceaf0 legacy=0x7fb1cc0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:11.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.475+0000 7fb1d0c26700 1 -- 172.21.15.79:0/4188393452 >> v1:172.21.15.79:6789/0 conn(0x7fb1cc159db0 legacy=0x7fb1cc0b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:11.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.475+0000 7fb1d0c26700 1 -- 172.21.15.79:0/4188393452 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc15da40 con 0x7fb1cc0cc640 2023-10-19T08:38:11.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.475+0000 7fb1cb7fe700 1 -- 172.21.15.79:0/4188393452 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512942209 0 0) 0x7fb1cc0b24d0 con 0x7fb1cc159db0 2023-10-19T08:38:11.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.476+0000 7fb1d0c26700 1 --2- 172.21.15.79:0/4188393452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1cc0cc640 0x7fb1cc0cca20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0009840 tx=0x7fb1c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3fe8de3ca38d86 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:11.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.476+0000 7fb1cb7fe700 1 -- 172.21.15.79:0/4188393452 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0004230 con 0x7fb1cc0cc640 2023-10-19T08:38:11.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.476+0000 7fb1cb7fe700 1 -- 172.21.15.79:0/4188393452 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c0004390 con 0x7fb1cc0cc640 2023-10-19T08:38:11.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.476+0000 7fb1cb7fe700 1 -- 172.21.15.79:0/4188393452 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00036a0 con 0x7fb1cc0cc640 2023-10-19T08:38:11.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.476+0000 7fb1d2e8a700 1 -- 172.21.15.79:0/4188393452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1cc0cc640 msgr2=0x7fb1cc0cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:11.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.476+0000 7fb1d2e8a700 1 --2- 172.21.15.79:0/4188393452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1cc0cc640 0x7fb1cc0cca20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0009840 tx=0x7fb1c0009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:11.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.476+0000 7fb1d2e8a700 1 -- 172.21.15.79:0/4188393452 shutdown_connections 2023-10-19T08:38:11.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.476+0000 7fb1d2e8a700 1 --2- 172.21.15.79:0/4188393452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1cc0cc640 0x7fb1cc0cca20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.476+0000 7fb1d2e8a700 1 -- 172.21.15.79:0/4188393452 >> 172.21.15.79:0/4188393452 conn(0x7fb1cc06dcc0 msgr2=0x7fb1cc06e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:11.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.476+0000 7fb1d2e8a700 1 -- 172.21.15.79:0/4188393452 shutdown_connections 2023-10-19T08:38:11.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.476+0000 7fb1d2e8a700 1 -- 172.21.15.79:0/4188393452 wait complete. 2023-10-19T08:38:11.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.477+0000 7fb1d2e8a700 1 Processor -- start 2023-10-19T08:38:11.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.477+0000 7fb1d2e8a700 1 -- start start 2023-10-19T08:38:11.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.478+0000 7fb1d2e8a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1cc0cc640 0x7fb1cc14f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:11.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.478+0000 7fb1d2e8a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1cc0ceaf0 0x7fb1cc0c5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:11.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.478+0000 7fb1d2e8a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1cc159db0 0x7fb1cc1f6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:11.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.478+0000 7fb1d2e8a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc0c4270 con 0x7fb1cc0ceaf0 2023-10-19T08:38:11.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.478+0000 7fb1d2e8a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc0c4550 con 0x7fb1cc159db0 2023-10-19T08:38:11.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.478+0000 7fb1d2e8a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc0c4830 con 0x7fb1cc0cc640 2023-10-19T08:38:11.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.478+0000 7fb1cbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1cc0ceaf0 0x7fb1cc0c5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:11.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.479+0000 7fb1cbfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1cc0ceaf0 0x7fb1cc0c5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46052/0 (socket says 172.21.15.79:46052) 2023-10-19T08:38:11.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.479+0000 7fb1cbfff700 1 -- 172.21.15.79:0/2119815339 learned_addr learned my addr 172.21.15.79:0/2119815339 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:11.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.479+0000 7fb1d1427700 1 --2- 172.21.15.79:0/2119815339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1cc159db0 0x7fb1cc1f6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:11.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.479+0000 7fb1d0c26700 1 --2- 172.21.15.79:0/2119815339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1cc0cc640 0x7fb1cc14f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:11.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.479+0000 7fb1cbfff700 1 -- 172.21.15.79:0/2119815339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1cc0cc640 msgr2=0x7fb1cc14f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:11.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.479+0000 7fb1cbfff700 1 --2- 172.21.15.79:0/2119815339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1cc0cc640 0x7fb1cc14f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.479+0000 7fb1cbfff700 1 -- 172.21.15.79:0/2119815339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1cc159db0 msgr2=0x7fb1cc1f6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:11.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.479+0000 7fb1cbfff700 1 --2- 172.21.15.79:0/2119815339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1cc159db0 0x7fb1cc1f6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.479+0000 7fb1cbfff700 1 -- 172.21.15.79:0/2119815339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c00094a0 con 0x7fb1cc0ceaf0 2023-10-19T08:38:11.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.479+0000 7fb1cbfff700 1 --2- 172.21.15.79:0/2119815339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1cc0ceaf0 0x7fb1cc0c5fa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80011e0 tx=0x7fb1b800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:11.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.479+0000 7fb1c97fa700 1 -- 172.21.15.79:0/2119815339 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8004c80 con 0x7fb1cc0ceaf0 2023-10-19T08:38:11.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.479+0000 7fb1c97fa700 1 -- 172.21.15.79:0/2119815339 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b8004e00 con 0x7fb1cc0ceaf0 2023-10-19T08:38:11.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.479+0000 7fb1d2e8a700 1 -- 172.21.15.79:0/2119815339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1cc1f6090 con 0x7fb1cc0ceaf0 2023-10-19T08:38:11.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.479+0000 7fb1c97fa700 1 -- 172.21.15.79:0/2119815339 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b8007310 con 0x7fb1cc0ceaf0 2023-10-19T08:38:11.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.479+0000 7fb1d2e8a700 1 -- 172.21.15.79:0/2119815339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1cc14f790 con 0x7fb1cc0ceaf0 2023-10-19T08:38:11.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.480+0000 7fb1d2e8a700 1 -- 172.21.15.79:0/2119815339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1cc04ee70 con 0x7fb1cc0ceaf0 2023-10-19T08:38:11.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.481+0000 7fb1c97fa700 1 -- 172.21.15.79:0/2119815339 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb1b8007470 con 0x7fb1cc0ceaf0 2023-10-19T08:38:11.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.481+0000 7fb1c97fa700 1 --2- 172.21.15.79:0/2119815339 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fb1b006a0e0 0x7fb1b006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:11.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.481+0000 7fb1c97fa700 1 -- 172.21.15.79:0/2119815339 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb1b80884a0 con 0x7fb1cc0ceaf0 2023-10-19T08:38:11.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.481+0000 7fb1d0c26700 1 --2- 172.21.15.79:0/2119815339 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fb1b006a0e0 0x7fb1b006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:11.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.481+0000 7fb1d0c26700 1 --2- 172.21.15.79:0/2119815339 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fb1b006a0e0 0x7fb1b006c5a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00090b0 tx=0x7fb1c0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:11.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.485+0000 7fb1c97fa700 1 -- 172.21.15.79:0/2119815339 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fb1b80538a0 con 0x7fb1cc0ceaf0 2023-10-19T08:38:11.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.677+0000 7fb1d2e8a700 1 -- 172.21.15.79:0/2119815339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb1cc0ca280 con 0x7fb1cc0ceaf0 2023-10-19T08:38:11.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.677+0000 7fb1c97fa700 1 -- 172.21.15.79:0/2119815339 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb1b8056ec0 con 0x7fb1cc0ceaf0 2023-10-19T08:38:11.681 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:11.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.680+0000 7fb1d2e8a700 1 -- 172.21.15.79:0/2119815339 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fb1b006a0e0 msgr2=0x7fb1b006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:11.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.680+0000 7fb1d2e8a700 1 --2- 172.21.15.79:0/2119815339 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fb1b006a0e0 0x7fb1b006c5a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00090b0 tx=0x7fb1c0008030 comp rx=0 tx=0).stop 2023-10-19T08:38:11.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.680+0000 7fb1d2e8a700 1 -- 172.21.15.79:0/2119815339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1cc0ceaf0 msgr2=0x7fb1cc0c5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:11.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.680+0000 7fb1d2e8a700 1 --2- 172.21.15.79:0/2119815339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1cc0ceaf0 0x7fb1cc0c5fa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80011e0 tx=0x7fb1b800ca30 comp rx=0 tx=0).stop 2023-10-19T08:38:11.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.680+0000 7fb1d2e8a700 1 -- 172.21.15.79:0/2119815339 shutdown_connections 2023-10-19T08:38:11.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.680+0000 7fb1d2e8a700 1 --2- 172.21.15.79:0/2119815339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1cc159db0 0x7fb1cc1f6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.680+0000 7fb1d2e8a700 1 --2- 172.21.15.79:0/2119815339 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fb1b006a0e0 0x7fb1b006c5a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.680+0000 7fb1d2e8a700 1 --2- 172.21.15.79:0/2119815339 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1cc0cc640 0x7fb1cc14f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.680+0000 7fb1d2e8a700 1 --2- 172.21.15.79:0/2119815339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1cc0ceaf0 0x7fb1cc0c5fa0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.680+0000 7fb1d2e8a700 1 -- 172.21.15.79:0/2119815339 >> 172.21.15.79:0/2119815339 conn(0x7fb1cc06dcc0 msgr2=0x7fb1cc0cef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:11.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.680+0000 7fb1d2e8a700 1 -- 172.21.15.79:0/2119815339 shutdown_connections 2023-10-19T08:38:11.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.680+0000 7fb1d2e8a700 1 -- 172.21.15.79:0/2119815339 wait complete. 2023-10-19T08:38:11.695 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-19T08:38:11.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.813+0000 7fd3bee37700 1 Processor -- start 2023-10-19T08:38:11.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.813+0000 7fd3bee37700 1 -- start start 2023-10-19T08:38:11.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.814+0000 7fd3bee37700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd3b80cd0c0 0x7fd3b80cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:11.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.814+0000 7fd3bee37700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80cdd40 0x7fd3b806a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:11.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.814+0000 7fd3bee37700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b80cd550 con 0x7fd3b80af170 2023-10-19T08:38:11.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.814+0000 7fd3bee37700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b80af550 con 0x7fd3b80cd0c0 2023-10-19T08:38:11.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.814+0000 7fd3bee37700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80b16b0 con 0x7fd3b80cdd40 2023-10-19T08:38:11.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.814+0000 7fd3b7fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd3b80cd0c0 0x7fd3b80cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:11.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.814+0000 7fd3bcbd3700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd3b80af170 0x7fd3b80b1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56130/0 (socket says 172.21.15.79:56130) 2023-10-19T08:38:11.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.814+0000 7fd3bcbd3700 1 -- 172.21.15.79:0/2105789569 learned_addr learned my addr 172.21.15.79:0/2105789569 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:11.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.814+0000 7fd3bd3d4700 1 --2- 172.21.15.79:0/2105789569 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80cdd40 0x7fd3b806a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:11.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.814+0000 7fd3b7fff700 1 -- 172.21.15.79:0/2105789569 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80cdd40 msgr2=0x7fd3b806a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:11.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.814+0000 7fd3b7fff700 1 --2- 172.21.15.79:0/2105789569 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80cdd40 0x7fd3b806a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.814+0000 7fd3b7fff700 1 -- 172.21.15.79:0/2105789569 >> v1:172.21.15.79:6789/0 conn(0x7fd3b80af170 legacy=0x7fd3b80b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:11.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.814+0000 7fd3b77fe700 1 -- 172.21.15.79:0/2105789569 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032831543 0 0) 0x7fd3ac001110 con 0x7fd3b80af170 2023-10-19T08:38:11.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.814+0000 7fd3b7fff700 1 -- 172.21.15.79:0/2105789569 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b815de50 con 0x7fd3b80cd0c0 2023-10-19T08:38:11.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.814+0000 7fd3b7fff700 1 --2- 172.21.15.79:0/2105789569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b80cd0c0 0x7fd3b80cd800 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009870 tx=0x7fd3a4009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940eedbceffad30c server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:11.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.815+0000 7fd3b77fe700 1 -- 172.21.15.79:0/2105789569 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4011830 con 0x7fd3b80cd0c0 2023-10-19T08:38:11.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.815+0000 7fd3b77fe700 1 -- 172.21.15.79:0/2105789569 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a4011990 con 0x7fd3b80cd0c0 2023-10-19T08:38:11.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.815+0000 7fd3b77fe700 1 -- 172.21.15.79:0/2105789569 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4011d20 con 0x7fd3b80cd0c0 2023-10-19T08:38:11.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.815+0000 7fd3bee37700 1 -- 172.21.15.79:0/2105789569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b80cd0c0 msgr2=0x7fd3b80cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:11.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.815+0000 7fd3bee37700 1 --2- 172.21.15.79:0/2105789569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b80cd0c0 0x7fd3b80cd800 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009870 tx=0x7fd3a4009b80 comp rx=0 tx=0).stop 2023-10-19T08:38:11.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.815+0000 7fd3bee37700 1 -- 172.21.15.79:0/2105789569 shutdown_connections 2023-10-19T08:38:11.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.815+0000 7fd3bee37700 1 --2- 172.21.15.79:0/2105789569 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80cdd40 0x7fd3b806a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.815+0000 7fd3bee37700 1 --2- 172.21.15.79:0/2105789569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b80cd0c0 0x7fd3b80cd800 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.815+0000 7fd3bee37700 1 -- 172.21.15.79:0/2105789569 >> 172.21.15.79:0/2105789569 conn(0x7fd3b806dcc0 msgr2=0x7fd3b806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:11.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.815+0000 7fd3bee37700 1 -- 172.21.15.79:0/2105789569 shutdown_connections 2023-10-19T08:38:11.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.815+0000 7fd3bee37700 1 -- 172.21.15.79:0/2105789569 wait complete. 2023-10-19T08:38:11.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.816+0000 7fd3bee37700 1 Processor -- start 2023-10-19T08:38:11.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.816+0000 7fd3bee37700 1 -- start start 2023-10-19T08:38:11.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.817+0000 7fd3bee37700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b80af170 0x7fd3b815cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:11.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.817+0000 7fd3bee37700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b80cd0c0 0x7fd3b80c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:11.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.817+0000 7fd3bee37700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80cdd40 0x7fd3b80ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:11.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.817+0000 7fd3bee37700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80c7710 con 0x7fd3b80cd0c0 2023-10-19T08:38:11.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.817+0000 7fd3bee37700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80c79f0 con 0x7fd3b80af170 2023-10-19T08:38:11.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.817+0000 7fd3bee37700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80c7cd0 con 0x7fd3b80cdd40 2023-10-19T08:38:11.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.817+0000 7fd3b7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b80cd0c0 0x7fd3b80c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:11.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.817+0000 7fd3b7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b80cd0c0 0x7fd3b80c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46066/0 (socket says 172.21.15.79:46066) 2023-10-19T08:38:11.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.817+0000 7fd3b7fff700 1 -- 172.21.15.79:0/2680004857 learned_addr learned my addr 172.21.15.79:0/2680004857 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:11.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.817+0000 7fd3bd3d4700 1 --2- 172.21.15.79:0/2680004857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80cdd40 0x7fd3b80ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:11.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.818+0000 7fd3bcbd3700 1 --2- 172.21.15.79:0/2680004857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b80af170 0x7fd3b815cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:11.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.818+0000 7fd3b7fff700 1 -- 172.21.15.79:0/2680004857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80cdd40 msgr2=0x7fd3b80ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:11.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.818+0000 7fd3b7fff700 1 --2- 172.21.15.79:0/2680004857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80cdd40 0x7fd3b80ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.818+0000 7fd3b7fff700 1 -- 172.21.15.79:0/2680004857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b80af170 msgr2=0x7fd3b815cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:11.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.818+0000 7fd3b7fff700 1 --2- 172.21.15.79:0/2680004857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b80af170 0x7fd3b815cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:11.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.818+0000 7fd3b7fff700 1 -- 172.21.15.79:0/2680004857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a40094a0 con 0x7fd3b80cd0c0 2023-10-19T08:38:11.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.818+0000 7fd3bd3d4700 1 --2- 172.21.15.79:0/2680004857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80cdd40 0x7fd3b80ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:11.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.818+0000 7fd3bcbd3700 1 --2- 172.21.15.79:0/2680004857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b80af170 0x7fd3b815cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:11.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.818+0000 7fd3b7fff700 1 --2- 172.21.15.79:0/2680004857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b80cd0c0 0x7fd3b80c87b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009840 tx=0x7fd3a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:11.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.818+0000 7fd3b57fa700 1 -- 172.21.15.79:0/2680004857 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40036a0 con 0x7fd3b80cd0c0 2023-10-19T08:38:11.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.818+0000 7fd3b57fa700 1 -- 172.21.15.79:0/2680004857 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a401f070 con 0x7fd3b80cd0c0 2023-10-19T08:38:11.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.818+0000 7fd3bee37700 1 -- 172.21.15.79:0/2680004857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b80c7fb0 con 0x7fd3b80cd0c0 2023-10-19T08:38:11.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.818+0000 7fd3b57fa700 1 -- 172.21.15.79:0/2680004857 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4003a60 con 0x7fd3b80cd0c0 2023-10-19T08:38:11.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.818+0000 7fd3bee37700 1 -- 172.21.15.79:0/2680004857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b80ae750 con 0x7fd3b80cd0c0 2023-10-19T08:38:11.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.819+0000 7fd3bee37700 1 -- 172.21.15.79:0/2680004857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b815e3f0 con 0x7fd3b80cd0c0 2023-10-19T08:38:11.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.819+0000 7fd3b57fa700 1 -- 172.21.15.79:0/2680004857 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd3a4003bc0 con 0x7fd3b80cd0c0 2023-10-19T08:38:11.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.820+0000 7fd3b57fa700 1 --2- 172.21.15.79:0/2680004857 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd39c06a0e0 0x7fd39c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:11.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.820+0000 7fd3b57fa700 1 -- 172.21.15.79:0/2680004857 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd3a4021070 con 0x7fd3b80cd0c0 2023-10-19T08:38:11.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.820+0000 7fd3bcbd3700 1 --2- 172.21.15.79:0/2680004857 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd39c06a0e0 0x7fd39c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:11.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.820+0000 7fd3bcbd3700 1 --2- 172.21.15.79:0/2680004857 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd39c06a0e0 0x7fd39c06c5a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac007fd0 tx=0x7fd3ac009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:11.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:11.824+0000 7fd3b57fa700 1 -- 172.21.15.79:0/2680004857 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd3b815e3f0 con 0x7fd3b80cd0c0 2023-10-19T08:38:12.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:12.027+0000 7fd3bee37700 1 -- 172.21.15.79:0/2680004857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd3b815e3f0 con 0x7fd3b80cd0c0 2023-10-19T08:38:12.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:12.028+0000 7fd3b57fa700 1 -- 172.21.15.79:0/2680004857 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd3b815e3f0 con 0x7fd3b80cd0c0 2023-10-19T08:38:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:12.030+0000 7fd3bee37700 1 -- 172.21.15.79:0/2680004857 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd39c06a0e0 msgr2=0x7fd39c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:12.030+0000 7fd3bee37700 1 --2- 172.21.15.79:0/2680004857 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd39c06a0e0 0x7fd39c06c5a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac007fd0 tx=0x7fd3ac009040 comp rx=0 tx=0).stop 2023-10-19T08:38:12.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:12.030+0000 7fd3bee37700 1 -- 172.21.15.79:0/2680004857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b80cd0c0 msgr2=0x7fd3b80c87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:12.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:12.030+0000 7fd3bee37700 1 --2- 172.21.15.79:0/2680004857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b80cd0c0 0x7fd3b80c87b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009840 tx=0x7fd3a4004750 comp rx=0 tx=0).stop 2023-10-19T08:38:12.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:12.030+0000 7fd3bee37700 1 -- 172.21.15.79:0/2680004857 shutdown_connections 2023-10-19T08:38:12.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:12.030+0000 7fd3bee37700 1 --2- 172.21.15.79:0/2680004857 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd39c06a0e0 0x7fd39c06c5a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:12.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:12.030+0000 7fd3bee37700 1 --2- 172.21.15.79:0/2680004857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd3b80cdd40 0x7fd3b80ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:12.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:12.030+0000 7fd3bee37700 1 --2- 172.21.15.79:0/2680004857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3b80af170 0x7fd3b815cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:12.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:12.030+0000 7fd3bee37700 1 --2- 172.21.15.79:0/2680004857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd3b80cd0c0 0x7fd3b80c87b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:12.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:12.030+0000 7fd3bee37700 1 -- 172.21.15.79:0/2680004857 >> 172.21.15.79:0/2680004857 conn(0x7fd3b806dcc0 msgr2=0x7fd3b80cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:12.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:12.030+0000 7fd3bee37700 1 -- 172.21.15.79:0/2680004857 shutdown_connections 2023-10-19T08:38:12.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:12.030+0000 7fd3bee37700 1 -- 172.21.15.79:0/2680004857 wait complete. 2023-10-19T08:38:12.036 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2023-10-19T08:38:12.046 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2023-10-19T08:38:12.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:12.047 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-19T08:38:12.087 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi079.stderr:ceph-fuse[112240]: fuse finished with error 0 and tester_r 0 2023-10-19T08:38:12.089 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:38:18.191 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-10-19T08:38:18.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:18.192 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-19T08:38:18.220 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:18.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.390+0000 7f45fa11d700 1 Processor -- start 2023-10-19T08:38:18.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.391+0000 7f45fa11d700 1 -- start start 2023-10-19T08:38:18.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.391+0000 7f45fa11d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45f4159f40 0x7f45f415e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:18.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.391+0000 7f45fa11d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f45f40b5610 0x7f45f40cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:18.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.391+0000 7f45fa11d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f40cc870 con 0x7f45f40ce5c0 2023-10-19T08:38:18.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.391+0000 7f45fa11d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f415e870 con 0x7f45f40b5610 2023-10-19T08:38:18.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.391+0000 7f45fa11d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40b5aa0 con 0x7f45f4159f40 2023-10-19T08:38:18.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.392+0000 7f45f2ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f45f40b5610 0x7f45f40cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:18.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.392+0000 7f45f3fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f45f40ce5c0 0x7f45f40b16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56144/0 (socket says 172.21.15.79:56144) 2023-10-19T08:38:18.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.392+0000 7f45f2ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f45f40b5610 0x7f45f40cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46072/0 (socket says 172.21.15.79:46072) 2023-10-19T08:38:18.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.392+0000 7f45f3fff700 1 -- 172.21.15.79:0/162071221 learned_addr learned my addr 172.21.15.79:0/162071221 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:18.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.392+0000 7f45f37fe700 1 --2- 172.21.15.79:0/162071221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45f4159f40 0x7f45f415e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:18.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.392+0000 7f45f2ffd700 1 -- 172.21.15.79:0/162071221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45f4159f40 msgr2=0x7f45f415e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:18.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.392+0000 7f45f2ffd700 1 --2- 172.21.15.79:0/162071221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45f4159f40 0x7f45f415e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:18.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.392+0000 7f45f2ffd700 1 -- 172.21.15.79:0/162071221 >> v1:172.21.15.79:6789/0 conn(0x7f45f40ce5c0 legacy=0x7f45f40b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:18.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.392+0000 7f45f2ffd700 1 -- 172.21.15.79:0/162071221 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f40cd800 con 0x7f45f40b5610 2023-10-19T08:38:18.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.392+0000 7f45f27fc700 1 -- 172.21.15.79:0/162071221 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791297142 0 0) 0x7f45ec001490 con 0x7f45f40ce5c0 2023-10-19T08:38:18.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.392+0000 7f45f2ffd700 1 --2- 172.21.15.79:0/162071221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45f40b5610 0x7f45f40cf000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009840 tx=0x7f45e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06cc81509d746d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:18.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.392+0000 7f45f27fc700 1 -- 172.21.15.79:0/162071221 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4011830 con 0x7f45f40b5610 2023-10-19T08:38:18.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.392+0000 7f45f27fc700 1 -- 172.21.15.79:0/162071221 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e4011990 con 0x7f45f40b5610 2023-10-19T08:38:18.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.392+0000 7f45f27fc700 1 -- 172.21.15.79:0/162071221 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4011d20 con 0x7f45f40b5610 2023-10-19T08:38:18.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.393+0000 7f45fa11d700 1 -- 172.21.15.79:0/162071221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45f40b5610 msgr2=0x7f45f40cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:18.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.393+0000 7f45fa11d700 1 --2- 172.21.15.79:0/162071221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45f40b5610 0x7f45f40cf000 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009840 tx=0x7f45e4009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:18.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.393+0000 7f45fa11d700 1 -- 172.21.15.79:0/162071221 shutdown_connections 2023-10-19T08:38:18.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.393+0000 7f45fa11d700 1 --2- 172.21.15.79:0/162071221 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45f4159f40 0x7f45f415e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:18.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.393+0000 7f45fa11d700 1 --2- 172.21.15.79:0/162071221 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45f40b5610 0x7f45f40cf000 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:18.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.393+0000 7f45fa11d700 1 -- 172.21.15.79:0/162071221 >> 172.21.15.79:0/162071221 conn(0x7f45f406dcc0 msgr2=0x7f45f406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:18.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.393+0000 7f45fa11d700 1 -- 172.21.15.79:0/162071221 shutdown_connections 2023-10-19T08:38:18.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.393+0000 7f45fa11d700 1 -- 172.21.15.79:0/162071221 wait complete. 2023-10-19T08:38:18.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.394+0000 7f45fa11d700 1 Processor -- start 2023-10-19T08:38:18.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.395+0000 7f45fa11d700 1 -- start start 2023-10-19T08:38:18.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.395+0000 7f45fa11d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45f40ce5c0 0x7f45f40c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:18.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.395+0000 7f45fa11d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45f4159f40 0x7f45f4156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:18.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.395+0000 7f45fa11d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45f40c4bc0 0x7f45f40cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:18.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.395+0000 7f45fa11d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40c5c80 con 0x7f45f40c4bc0 2023-10-19T08:38:18.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.395+0000 7f45fa11d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40c3b20 con 0x7f45f4159f40 2023-10-19T08:38:18.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.395+0000 7f45fa11d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f40c3e00 con 0x7f45f40ce5c0 2023-10-19T08:38:18.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.395+0000 7f45f3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45f40c4bc0 0x7f45f40cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:18.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.395+0000 7f45f3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45f40c4bc0 0x7f45f40cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46080/0 (socket says 172.21.15.79:46080) 2023-10-19T08:38:18.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.395+0000 7f45f3fff700 1 -- 172.21.15.79:0/776958591 learned_addr learned my addr 172.21.15.79:0/776958591 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:18.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.396+0000 7f45f2ffd700 1 --2- 172.21.15.79:0/776958591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45f4159f40 0x7f45f4156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:18.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.396+0000 7f45f37fe700 1 --2- 172.21.15.79:0/776958591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45f40ce5c0 0x7f45f40c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:18.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.396+0000 7f45f3fff700 1 -- 172.21.15.79:0/776958591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45f40ce5c0 msgr2=0x7f45f40c5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:18.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.396+0000 7f45f3fff700 1 --2- 172.21.15.79:0/776958591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45f40ce5c0 0x7f45f40c5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:18.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.396+0000 7f45f3fff700 1 -- 172.21.15.79:0/776958591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45f4159f40 msgr2=0x7f45f4156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:18.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.396+0000 7f45f3fff700 1 --2- 172.21.15.79:0/776958591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45f4159f40 0x7f45f4156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:18.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.396+0000 7f45f3fff700 1 -- 172.21.15.79:0/776958591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e40094a0 con 0x7f45f40c4bc0 2023-10-19T08:38:18.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.396+0000 7f45f3fff700 1 --2- 172.21.15.79:0/776958591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45f40c4bc0 0x7f45f40cf0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00cba0 tx=0x7f45ec00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:18.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.396+0000 7f45dbfff700 1 -- 172.21.15.79:0/776958591 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec00ab80 con 0x7f45f40c4bc0 2023-10-19T08:38:18.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.396+0000 7f45dbfff700 1 -- 172.21.15.79:0/776958591 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ec00ace0 con 0x7f45f40c4bc0 2023-10-19T08:38:18.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.396+0000 7f45fa11d700 1 -- 172.21.15.79:0/776958591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f40c40e0 con 0x7f45f40c4bc0 2023-10-19T08:38:18.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.396+0000 7f45dbfff700 1 -- 172.21.15.79:0/776958591 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec007310 con 0x7f45f40c4bc0 2023-10-19T08:38:18.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.396+0000 7f45fa11d700 1 -- 172.21.15.79:0/776958591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f40c46a0 con 0x7f45f40c4bc0 2023-10-19T08:38:18.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.397+0000 7f45fa11d700 1 -- 172.21.15.79:0/776958591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f404ee70 con 0x7f45f40c4bc0 2023-10-19T08:38:18.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.398+0000 7f45dbfff700 1 -- 172.21.15.79:0/776958591 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f45ec007470 con 0x7f45f40c4bc0 2023-10-19T08:38:18.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.398+0000 7f45dbfff700 1 --2- 172.21.15.79:0/776958591 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f45e006a0e0 0x7f45e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:18.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.398+0000 7f45dbfff700 1 -- 172.21.15.79:0/776958591 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f45ec088770 con 0x7f45f40c4bc0 2023-10-19T08:38:18.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.398+0000 7f45f37fe700 1 --2- 172.21.15.79:0/776958591 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f45e006a0e0 0x7f45e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:18.410 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.399+0000 7f45f37fe700 1 --2- 172.21.15.79:0/776958591 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f45e006a0e0 0x7f45e006c5a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f45e8009ad0 tx=0x7f45e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:18.411 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.402+0000 7f45dbfff700 1 -- 172.21.15.79:0/776958591 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f45ec053c50 con 0x7f45f40c4bc0 2023-10-19T08:38:18.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.592+0000 7f45fa11d700 1 -- 172.21.15.79:0/776958591 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45f40cc870 con 0x7f45f40c4bc0 2023-10-19T08:38:18.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.593+0000 7f45dbfff700 1 -- 172.21.15.79:0/776958591 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20060 (secure 0 0 0) 0x7f45f40cc870 con 0x7f45f40c4bc0 2023-10-19T08:38:18.599 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:18.599 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":25,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:01.725914+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.595+0000 7f45fa11d700 1 -- 172.21.15.79:0/776958591 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f45e006a0e0 msgr2=0x7f45e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.595+0000 7f45fa11d700 1 --2- 172.21.15.79:0/776958591 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f45e006a0e0 0x7f45e006c5a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f45e8009ad0 tx=0x7f45e8008040 comp rx=0 tx=0).stop 2023-10-19T08:38:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.595+0000 7f45fa11d700 1 -- 172.21.15.79:0/776958591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45f40c4bc0 msgr2=0x7f45f40cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.595+0000 7f45fa11d700 1 --2- 172.21.15.79:0/776958591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45f40c4bc0 0x7f45f40cf0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f45ec00cba0 tx=0x7f45ec00cf60 comp rx=0 tx=0).stop 2023-10-19T08:38:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.595+0000 7f45fa11d700 1 -- 172.21.15.79:0/776958591 shutdown_connections 2023-10-19T08:38:18.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.595+0000 7f45fa11d700 1 --2- 172.21.15.79:0/776958591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f45f40c4bc0 0x7f45f40cf0c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:18.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.595+0000 7f45fa11d700 1 --2- 172.21.15.79:0/776958591 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f45e006a0e0 0x7f45e006c5a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:18.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.595+0000 7f45fa11d700 1 --2- 172.21.15.79:0/776958591 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45f40ce5c0 0x7f45f40c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:18.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.595+0000 7f45fa11d700 1 --2- 172.21.15.79:0/776958591 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45f4159f40 0x7f45f4156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.595+0000 7f45fa11d700 1 -- 172.21.15.79:0/776958591 >> 172.21.15.79:0/776958591 conn(0x7f45f406dcc0 msgr2=0x7f45f40b4750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.595+0000 7f45fa11d700 1 -- 172.21.15.79:0/776958591 shutdown_connections 2023-10-19T08:38:18.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.595+0000 7f45fa11d700 1 -- 172.21.15.79:0/776958591 wait complete. 2023-10-19T08:38:18.611 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:18.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.728+0000 7fd090cc6700 1 Processor -- start 2023-10-19T08:38:18.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.728+0000 7fd090cc6700 1 -- start start 2023-10-19T08:38:18.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.728+0000 7fd090cc6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd08c0cbaa0 0x7fd08c0b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:18.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.729+0000 7fd090cc6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08c0b1f00 con 0x7fd08c15d250 2023-10-19T08:38:18.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.729+0000 7fd090cc6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd08c0caf00 con 0x7fd08c0b1560 2023-10-19T08:38:18.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.729+0000 7fd090cc6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08c0cbef0 con 0x7fd08c0cbaa0 2023-10-19T08:38:18.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.729+0000 7fd08a59c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd08c15d250 0x7fd08c06a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56156/0 (socket says 172.21.15.79:56156) 2023-10-19T08:38:18.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.729+0000 7fd08a59c700 1 -- 172.21.15.79:0/2462058608 learned_addr learned my addr 172.21.15.79:0/2462058608 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:18.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.729+0000 7fd08ad9d700 1 --2- 172.21.15.79:0/2462058608 >> v2:172.21.15.89:3300/0 conn(0x7fd08c0cbaa0 0x7fd08c0b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:18.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.729+0000 7fd08959a700 1 -- 172.21.15.79:0/2462058608 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620040918 0 0) 0x7fd08c0b1f00 con 0x7fd08c15d250 2023-10-19T08:38:18.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.729+0000 7fd08959a700 1 -- 172.21.15.79:0/2462058608 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0740035b0 con 0x7fd08c15d250 2023-10-19T08:38:18.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.729+0000 7fd08ad9d700 1 -- 172.21.15.79:0/2462058608 >> v1:172.21.15.89:6789/0 conn(0x7fd08c0b1560 legacy=0x7fd08c0cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:18.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.729+0000 7fd08ad9d700 1 -- 172.21.15.79:0/2462058608 >> v1:172.21.15.79:6789/0 conn(0x7fd08c15d250 legacy=0x7fd08c06a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:18.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.729+0000 7fd08ad9d700 1 -- 172.21.15.79:0/2462058608 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c0ce840 con 0x7fd08c0cbaa0 2023-10-19T08:38:18.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.729+0000 7fd08ad9d700 1 --2- 172.21.15.79:0/2462058608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd08c0cbaa0 0x7fd08c0b19c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd084009d90 tx=0x7fd08400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8074ec5d76c23930 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:18.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.729+0000 7fd08959a700 1 -- 172.21.15.79:0/2462058608 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08400e070 con 0x7fd08c0cbaa0 2023-10-19T08:38:18.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.730+0000 7fd08959a700 1 -- 172.21.15.79:0/2462058608 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08400bb20 con 0x7fd08c0cbaa0 2023-10-19T08:38:18.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.730+0000 7fd08959a700 1 -- 172.21.15.79:0/2462058608 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084012430 con 0x7fd08c0cbaa0 2023-10-19T08:38:18.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.730+0000 7fd090cc6700 1 -- 172.21.15.79:0/2462058608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd08c0cbaa0 msgr2=0x7fd08c0b19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:18.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.730+0000 7fd090cc6700 1 --2- 172.21.15.79:0/2462058608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd08c0cbaa0 0x7fd08c0b19c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd084009d90 tx=0x7fd08400b330 comp rx=0 tx=0).stop 2023-10-19T08:38:18.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.730+0000 7fd090cc6700 1 -- 172.21.15.79:0/2462058608 shutdown_connections 2023-10-19T08:38:18.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.730+0000 7fd090cc6700 1 --2- 172.21.15.79:0/2462058608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd08c0cbaa0 0x7fd08c0b19c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:18.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.730+0000 7fd090cc6700 1 -- 172.21.15.79:0/2462058608 >> 172.21.15.79:0/2462058608 conn(0x7fd08c0cc560 msgr2=0x7fd08c0cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:18.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.730+0000 7fd090cc6700 1 -- 172.21.15.79:0/2462058608 shutdown_connections 2023-10-19T08:38:18.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.730+0000 7fd090cc6700 1 -- 172.21.15.79:0/2462058608 wait complete. 2023-10-19T08:38:18.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.731+0000 7fd090cc6700 1 Processor -- start 2023-10-19T08:38:18.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.731+0000 7fd090cc6700 1 -- start start 2023-10-19T08:38:18.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.732+0000 7fd090cc6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08c0b1560 0x7fd08c1f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:18.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.732+0000 7fd090cc6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd08c0cbaa0 0x7fd08c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:18.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.732+0000 7fd090cc6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd08c15d250 0x7fd08c0c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:18.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.732+0000 7fd090cc6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c159d40 con 0x7fd08c0b1560 2023-10-19T08:38:18.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.732+0000 7fd090cc6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c159130 con 0x7fd08c15d250 2023-10-19T08:38:18.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.732+0000 7fd090cc6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c159410 con 0x7fd08c0cbaa0 2023-10-19T08:38:18.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.732+0000 7fd08a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08c0b1560 0x7fd08c1f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:18.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.732+0000 7fd08a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08c0b1560 0x7fd08c1f2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46090/0 (socket says 172.21.15.79:46090) 2023-10-19T08:38:18.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.732+0000 7fd08a59c700 1 -- 172.21.15.79:0/964727982 learned_addr learned my addr 172.21.15.79:0/964727982 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:18.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.732+0000 7fd089d9b700 1 --2- 172.21.15.79:0/964727982 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd08c0cbaa0 0x7fd08c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:18.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.732+0000 7fd08ad9d700 1 --2- 172.21.15.79:0/964727982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd08c15d250 0x7fd08c0c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:18.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.733+0000 7fd08a59c700 1 -- 172.21.15.79:0/964727982 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd08c0cbaa0 msgr2=0x7fd08c15ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:18.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.733+0000 7fd08a59c700 1 --2- 172.21.15.79:0/964727982 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd08c0cbaa0 0x7fd08c15ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:18.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.733+0000 7fd08a59c700 1 -- 172.21.15.79:0/964727982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd08c15d250 msgr2=0x7fd08c0c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:18.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.733+0000 7fd08a59c700 1 --2- 172.21.15.79:0/964727982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd08c15d250 0x7fd08c0c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:18.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.733+0000 7fd08a59c700 1 -- 172.21.15.79:0/964727982 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd084009a70 con 0x7fd08c0b1560 2023-10-19T08:38:18.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.733+0000 7fd08a59c700 1 --2- 172.21.15.79:0/964727982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08c0b1560 0x7fd08c1f2410 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd07c001eb0 tx=0x7fd07c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:18.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.733+0000 7fd07affd700 1 -- 172.21.15.79:0/964727982 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c005d70 con 0x7fd08c0b1560 2023-10-19T08:38:18.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.733+0000 7fd07affd700 1 -- 172.21.15.79:0/964727982 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07c0070d0 con 0x7fd08c0b1560 2023-10-19T08:38:18.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.733+0000 7fd07affd700 1 -- 172.21.15.79:0/964727982 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07c007460 con 0x7fd08c0b1560 2023-10-19T08:38:18.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.733+0000 7fd090cc6700 1 -- 172.21.15.79:0/964727982 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08c1596f0 con 0x7fd08c0b1560 2023-10-19T08:38:18.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.733+0000 7fd090cc6700 1 -- 172.21.15.79:0/964727982 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08c15b090 con 0x7fd08c0b1560 2023-10-19T08:38:18.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.734+0000 7fd090cc6700 1 -- 172.21.15.79:0/964727982 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08c15a0b0 con 0x7fd08c0b1560 2023-10-19T08:38:18.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.734+0000 7fd07affd700 1 -- 172.21.15.79:0/964727982 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd07c0075c0 con 0x7fd08c0b1560 2023-10-19T08:38:18.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.734+0000 7fd07affd700 1 --2- 172.21.15.79:0/964727982 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd06c06a0e0 0x7fd06c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:18.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.735+0000 7fd07affd700 1 -- 172.21.15.79:0/964727982 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd07c087d20 con 0x7fd08c0b1560 2023-10-19T08:38:18.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.735+0000 7fd089d9b700 1 --2- 172.21.15.79:0/964727982 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd06c06a0e0 0x7fd06c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:18.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.735+0000 7fd089d9b700 1 --2- 172.21.15.79:0/964727982 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd06c06a0e0 0x7fd06c06c5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0b0f90 tx=0x7fd080009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:18.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.739+0000 7fd07affd700 1 -- 172.21.15.79:0/964727982 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd07c0531b0 con 0x7fd08c0b1560 2023-10-19T08:38:18.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.927+0000 7fd090cc6700 1 -- 172.21.15.79:0/964727982 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd08c04ee70 con 0x7fd08c0b1560 2023-10-19T08:38:18.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.928+0000 7fd07affd700 1 -- 172.21.15.79:0/964727982 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20060 (secure 0 0 0) 0x7fd07c0567d0 con 0x7fd08c0b1560 2023-10-19T08:38:18.932 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:18.933 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":25,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:01.725914+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:18.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.930+0000 7fd090cc6700 1 -- 172.21.15.79:0/964727982 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd06c06a0e0 msgr2=0x7fd06c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:18.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.930+0000 7fd090cc6700 1 --2- 172.21.15.79:0/964727982 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd06c06a0e0 0x7fd06c06c5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0b0f90 tx=0x7fd080009040 comp rx=0 tx=0).stop 2023-10-19T08:38:18.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.930+0000 7fd090cc6700 1 -- 172.21.15.79:0/964727982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08c0b1560 msgr2=0x7fd08c1f2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:18.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.930+0000 7fd090cc6700 1 --2- 172.21.15.79:0/964727982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08c0b1560 0x7fd08c1f2410 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd07c001eb0 tx=0x7fd07c00c860 comp rx=0 tx=0).stop 2023-10-19T08:38:18.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.930+0000 7fd090cc6700 1 -- 172.21.15.79:0/964727982 shutdown_connections 2023-10-19T08:38:18.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.930+0000 7fd090cc6700 1 --2- 172.21.15.79:0/964727982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd08c15d250 0x7fd08c0c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:18.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.930+0000 7fd090cc6700 1 --2- 172.21.15.79:0/964727982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08c0b1560 0x7fd08c1f2410 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:18.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.930+0000 7fd090cc6700 1 --2- 172.21.15.79:0/964727982 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd06c06a0e0 0x7fd06c06c5a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:18.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.930+0000 7fd090cc6700 1 --2- 172.21.15.79:0/964727982 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd08c0cbaa0 0x7fd08c15ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:18.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.930+0000 7fd090cc6700 1 -- 172.21.15.79:0/964727982 >> 172.21.15.79:0/964727982 conn(0x7fd08c0cc560 msgr2=0x7fd08c0719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:18.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.931+0000 7fd090cc6700 1 -- 172.21.15.79:0/964727982 shutdown_connections 2023-10-19T08:38:18.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:18.931+0000 7fd090cc6700 1 -- 172.21.15.79:0/964727982 wait complete. 2023-10-19T08:38:18.946 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-19T08:38:19.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.066+0000 7fb9e0225700 1 Processor -- start 2023-10-19T08:38:19.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.066+0000 7fb9e0225700 1 -- start start 2023-10-19T08:38:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.067+0000 7fb9e0225700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d80cd270 0x7fb9d806a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.067+0000 7fb9e0225700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb9d80703b0 0x7fb9d806a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.067+0000 7fb9e0225700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d80b1fe0 con 0x7fb9d806f910 2023-10-19T08:38:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.067+0000 7fb9e0225700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d8160a80 con 0x7fb9d80703b0 2023-10-19T08:38:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.067+0000 7fb9e0225700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d80ce2b0 con 0x7fb9d80cd270 2023-10-19T08:38:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.067+0000 7fb9de7c2700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb9d806f910 0x7fb9d8160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56174/0 (socket says 172.21.15.79:56174) 2023-10-19T08:38:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.067+0000 7fb9de7c2700 1 -- 172.21.15.79:0/3231429942 learned_addr learned my addr 172.21.15.79:0/3231429942 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.067+0000 7fb9ddfc1700 1 --2- 172.21.15.79:0/3231429942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d80cd270 0x7fb9d806a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.067+0000 7fb9dd7c0700 1 --2- 172.21.15.79:0/3231429942 >> v2:172.21.15.89:3300/0 conn(0x7fb9d80703b0 0x7fb9d806a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:19.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.067+0000 7fb9dcfbf700 1 -- 172.21.15.79:0/3231429942 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535678148 0 0) 0x7fb9d80b1fe0 con 0x7fb9d806f910 2023-10-19T08:38:19.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.067+0000 7fb9dcfbf700 1 -- 172.21.15.79:0/3231429942 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9c40035b0 con 0x7fb9d806f910 2023-10-19T08:38:19.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dcfbf700 1 -- 172.21.15.79:0/3231429942 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2621599854 0 0) 0x7fb9c40035b0 con 0x7fb9d806f910 2023-10-19T08:38:19.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dcfbf700 1 -- 172.21.15.79:0/3231429942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d80cd270 msgr2=0x7fb9d806a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:19.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dcfbf700 1 --2- 172.21.15.79:0/3231429942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d80cd270 0x7fb9d806a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:19.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dcfbf700 1 -- 172.21.15.79:0/3231429942 >> v2:172.21.15.89:3300/0 conn(0x7fb9d80703b0 msgr2=0x7fb9d806a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:19.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dcfbf700 1 --2- 172.21.15.79:0/3231429942 >> v2:172.21.15.89:3300/0 conn(0x7fb9d80703b0 0x7fb9d806a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:19.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dcfbf700 1 -- 172.21.15.79:0/3231429942 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d80ce550 con 0x7fb9d806f910 2023-10-19T08:38:19.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dcfbf700 1 -- 172.21.15.79:0/3231429942 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7fb9d00019f0 con 0x7fb9d806f910 2023-10-19T08:38:19.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dcfbf700 1 -- 172.21.15.79:0/3231429942 >> v1:172.21.15.79:6789/0 conn(0x7fb9d806f910 legacy=0x7fb9d8160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:19.077 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dcfbf700 1 --2- 172.21.15.79:0/3231429942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9c4003a70 0x7fb9c4003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:19.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dcfbf700 1 --2- 172.21.15.79:0/3231429942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c4004850 0x7fb9c4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:19.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dcfbf700 1 --2- 172.21.15.79:0/3231429942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d80cd270 0x7fb9c4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:19.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dcfbf700 1 -- 172.21.15.79:0/3231429942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d8160a80 con 0x7fb9c4004850 2023-10-19T08:38:19.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dcfbf700 1 -- 172.21.15.79:0/3231429942 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d80ce2b0 con 0x7fb9c4003a70 2023-10-19T08:38:19.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dcfbf700 1 -- 172.21.15.79:0/3231429942 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c400ba10 con 0x7fb9d80cd270 2023-10-19T08:38:19.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dd7c0700 1 --2- 172.21.15.79:0/3231429942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c4004850 0x7fb9c4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:19.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9ddfc1700 1 --2- 172.21.15.79:0/3231429942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9c4003a70 0x7fb9c4003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:19.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9de7c2700 1 --2- 172.21.15.79:0/3231429942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d80cd270 0x7fb9c4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:19.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dd7c0700 1 -- 172.21.15.79:0/3231429942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d80cd270 msgr2=0x7fb9c4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:19.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dd7c0700 1 --2- 172.21.15.79:0/3231429942 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d80cd270 0x7fb9c4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:19.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dd7c0700 1 -- 172.21.15.79:0/3231429942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9c4003a70 msgr2=0x7fb9c4003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:19.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dd7c0700 1 --2- 172.21.15.79:0/3231429942 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9c4003a70 0x7fb9c4003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:19.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dd7c0700 1 -- 172.21.15.79:0/3231429942 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c40035b0 con 0x7fb9c4004850 2023-10-19T08:38:19.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dd7c0700 1 --2- 172.21.15.79:0/3231429942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c4004850 0x7fb9c4004cd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009b90 tx=0x7fb9c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44bb34efaa387e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:19.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dcfbf700 1 -- 172.21.15.79:0/3231429942 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d400e6c0 con 0x7fb9c4004850 2023-10-19T08:38:19.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dcfbf700 1 -- 172.21.15.79:0/3231429942 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d400e820 con 0x7fb9c4004850 2023-10-19T08:38:19.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.068+0000 7fb9dcfbf700 1 -- 172.21.15.79:0/3231429942 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d400eb90 con 0x7fb9c4004850 2023-10-19T08:38:19.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.069+0000 7fb9e0225700 1 -- 172.21.15.79:0/3231429942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c4004850 msgr2=0x7fb9c4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:19.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.069+0000 7fb9e0225700 1 --2- 172.21.15.79:0/3231429942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c4004850 0x7fb9c4004cd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009b90 tx=0x7fb9c4005880 comp rx=0 tx=0).stop 2023-10-19T08:38:19.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.069+0000 7fb9de7c2700 1 -- 172.21.15.79:0/3231429942 reap_dead start 2023-10-19T08:38:19.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.069+0000 7fb9e0225700 1 -- 172.21.15.79:0/3231429942 shutdown_connections 2023-10-19T08:38:19.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.069+0000 7fb9e0225700 1 -- 172.21.15.79:0/3231429942 >> 172.21.15.79:0/3231429942 conn(0x7fb9d806dcc0 msgr2=0x7fb9d806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:19.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.069+0000 7fb9e0225700 1 -- 172.21.15.79:0/3231429942 shutdown_connections 2023-10-19T08:38:19.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.069+0000 7fb9e0225700 1 -- 172.21.15.79:0/3231429942 wait complete. 2023-10-19T08:38:19.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.070+0000 7fb9e0225700 1 Processor -- start 2023-10-19T08:38:19.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.070+0000 7fb9e0225700 1 -- start start 2023-10-19T08:38:19.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.071+0000 7fb9e0225700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c4004850 0x7fb9d80b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:19.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.071+0000 7fb9e0225700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9d8152fb0 0x7fb9d806e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:19.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.071+0000 7fb9e0225700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d8153430 0x7fb9d806e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:19.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.071+0000 7fb9e0225700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d80c4630 con 0x7fb9c4004850 2023-10-19T08:38:19.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.071+0000 7fb9e0225700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d80c3760 con 0x7fb9d8152fb0 2023-10-19T08:38:19.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.071+0000 7fb9e0225700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d80b3120 con 0x7fb9d8153430 2023-10-19T08:38:19.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.071+0000 7fb9ddfc1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c4004850 0x7fb9d80b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:19.086 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.071+0000 7fb9ddfc1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c4004850 0x7fb9d80b2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46110/0 (socket says 172.21.15.79:46110) 2023-10-19T08:38:19.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.071+0000 7fb9ddfc1700 1 -- 172.21.15.79:0/303885480 learned_addr learned my addr 172.21.15.79:0/303885480 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:19.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.071+0000 7fb9dd7c0700 1 --2- 172.21.15.79:0/303885480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9d8152fb0 0x7fb9d806e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:19.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.071+0000 7fb9de7c2700 1 --2- 172.21.15.79:0/303885480 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d8153430 0x7fb9d806e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:19.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.071+0000 7fb9ddfc1700 1 -- 172.21.15.79:0/303885480 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d8153430 msgr2=0x7fb9d806e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:19.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.071+0000 7fb9ddfc1700 1 --2- 172.21.15.79:0/303885480 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d8153430 0x7fb9d806e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:19.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.071+0000 7fb9ddfc1700 1 -- 172.21.15.79:0/303885480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9d8152fb0 msgr2=0x7fb9d806e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:19.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.071+0000 7fb9ddfc1700 1 --2- 172.21.15.79:0/303885480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9d8152fb0 0x7fb9d806e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:19.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.071+0000 7fb9ddfc1700 1 -- 172.21.15.79:0/303885480 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d80c39b0 con 0x7fb9c4004850 2023-10-19T08:38:19.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.071+0000 7fb9de7c2700 1 --2- 172.21.15.79:0/303885480 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d8153430 0x7fb9d806e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:19.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.071+0000 7fb9ddfc1700 1 --2- 172.21.15.79:0/303885480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c4004850 0x7fb9d80b2be0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80119a0 tx=0x7fb9c8011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:19.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.072+0000 7fb9ce7fc700 1 -- 172.21.15.79:0/303885480 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c800f940 con 0x7fb9c4004850 2023-10-19T08:38:19.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.072+0000 7fb9ce7fc700 1 -- 172.21.15.79:0/303885480 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c800faa0 con 0x7fb9c4004850 2023-10-19T08:38:19.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.072+0000 7fb9e0225700 1 -- 172.21.15.79:0/303885480 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d80c3c90 con 0x7fb9c4004850 2023-10-19T08:38:19.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.072+0000 7fb9ce7fc700 1 -- 172.21.15.79:0/303885480 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c800fe30 con 0x7fb9c4004850 2023-10-19T08:38:19.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.072+0000 7fb9e0225700 1 -- 172.21.15.79:0/303885480 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d80c4250 con 0x7fb9c4004850 2023-10-19T08:38:19.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.073+0000 7fb9e0225700 1 -- 172.21.15.79:0/303885480 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d804ee70 con 0x7fb9c4004850 2023-10-19T08:38:19.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.073+0000 7fb9ce7fc700 1 -- 172.21.15.79:0/303885480 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb9c8014440 con 0x7fb9c4004850 2023-10-19T08:38:19.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.073+0000 7fb9ce7fc700 1 --2- 172.21.15.79:0/303885480 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fb9bc06a0e0 0x7fb9bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:19.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.073+0000 7fb9ce7fc700 1 -- 172.21.15.79:0/303885480 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb9c8088e70 con 0x7fb9c4004850 2023-10-19T08:38:19.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.073+0000 7fb9dd7c0700 1 --2- 172.21.15.79:0/303885480 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fb9bc06a0e0 0x7fb9bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:19.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.074+0000 7fb9dd7c0700 1 --2- 172.21.15.79:0/303885480 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fb9bc06a0e0 0x7fb9bc06c5a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40090b0 tx=0x7fb9d4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:19.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.078+0000 7fb9ce7fc700 1 -- 172.21.15.79:0/303885480 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fb9c8054300 con 0x7fb9c4004850 2023-10-19T08:38:19.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.315+0000 7fb9e0225700 1 -- 172.21.15.79:0/303885480 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb9d80c48a0 con 0x7fb9c4004850 2023-10-19T08:38:19.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.382+0000 7fb9ce7fc700 1 -- 172.21.15.79:0/303885480 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb9c8057920 con 0x7fb9c4004850 2023-10-19T08:38:19.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.384+0000 7fb9e0225700 1 -- 172.21.15.79:0/303885480 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fb9bc06a0e0 msgr2=0x7fb9bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:19.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.384+0000 7fb9e0225700 1 --2- 172.21.15.79:0/303885480 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fb9bc06a0e0 0x7fb9bc06c5a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40090b0 tx=0x7fb9d4008030 comp rx=0 tx=0).stop 2023-10-19T08:38:19.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.384+0000 7fb9e0225700 1 -- 172.21.15.79:0/303885480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c4004850 msgr2=0x7fb9d80b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:19.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.384+0000 7fb9e0225700 1 --2- 172.21.15.79:0/303885480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c4004850 0x7fb9d80b2be0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb9c80119a0 tx=0x7fb9c8011d60 comp rx=0 tx=0).stop 2023-10-19T08:38:19.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.384+0000 7fb9e0225700 1 -- 172.21.15.79:0/303885480 shutdown_connections 2023-10-19T08:38:19.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.384+0000 7fb9e0225700 1 --2- 172.21.15.79:0/303885480 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fb9bc06a0e0 0x7fb9bc06c5a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:19.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.384+0000 7fb9e0225700 1 --2- 172.21.15.79:0/303885480 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb9d8153430 0x7fb9d806e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:19.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.384+0000 7fb9e0225700 1 --2- 172.21.15.79:0/303885480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c4004850 0x7fb9d80b2be0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:19.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.384+0000 7fb9e0225700 1 --2- 172.21.15.79:0/303885480 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9d8152fb0 0x7fb9d806e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:19.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.384+0000 7fb9e0225700 1 -- 172.21.15.79:0/303885480 >> 172.21.15.79:0/303885480 conn(0x7fb9d806dcc0 msgr2=0x7fb9d80afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:19.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.384+0000 7fb9e0225700 1 -- 172.21.15.79:0/303885480 shutdown_connections 2023-10-19T08:38:19.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.384+0000 7fb9e0225700 1 -- 172.21.15.79:0/303885480 wait complete. 2023-10-19T08:38:19.399 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-10-19T08:38:19.400 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-19T08:38:19.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.519+0000 7f1712221700 1 Processor -- start 2023-10-19T08:38:19.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.519+0000 7f1712221700 1 -- start start 2023-10-19T08:38:19.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.520+0000 7f1712221700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f170c0cd270 0x7f170c06a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:19.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.520+0000 7f1712221700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f170c0703b0 0x7f170c06a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:19.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.520+0000 7f1712221700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170c0b1fe0 con 0x7f170c06f910 2023-10-19T08:38:19.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.520+0000 7f1712221700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170c160a80 con 0x7f170c0703b0 2023-10-19T08:38:19.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.520+0000 7f1712221700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170c0ce2b0 con 0x7f170c0cd270 2023-10-19T08:38:19.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.520+0000 7f170affd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f170c0703b0 0x7f170c06a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:19.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.520+0000 7f170bfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f170c06f910 0x7f170c160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56192/0 (socket says 172.21.15.79:56192) 2023-10-19T08:38:19.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.520+0000 7f170bfff700 1 -- 172.21.15.79:0/521751525 learned_addr learned my addr 172.21.15.79:0/521751525 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:19.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.520+0000 7f170b7fe700 1 --2- 172.21.15.79:0/521751525 >> v2:172.21.15.89:3300/0 conn(0x7f170c0cd270 0x7f170c06a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:19.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.520+0000 7f170affd700 1 -- 172.21.15.79:0/521751525 >> v2:172.21.15.89:3300/0 conn(0x7f170c0cd270 msgr2=0x7f170c06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:19.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.520+0000 7f170affd700 1 --2- 172.21.15.79:0/521751525 >> v2:172.21.15.89:3300/0 conn(0x7f170c0cd270 0x7f170c06a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:19.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.520+0000 7f170affd700 1 -- 172.21.15.79:0/521751525 >> v1:172.21.15.79:6789/0 conn(0x7f170c06f910 legacy=0x7f170c160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:19.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.520+0000 7f170a7fc700 1 -- 172.21.15.79:0/521751525 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1268163082 0 0) 0x7f170c0b1fe0 con 0x7f170c06f910 2023-10-19T08:38:19.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.520+0000 7f170affd700 1 -- 172.21.15.79:0/521751525 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170c0ce550 con 0x7f170c0703b0 2023-10-19T08:38:19.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.521+0000 7f170affd700 1 --2- 172.21.15.79:0/521751525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c0703b0 0x7f170c06a760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f170c0717c0 tx=0x7f16fc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c8539370b00bd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:19.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.521+0000 7f170a7fc700 1 -- 172.21.15.79:0/521751525 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc011830 con 0x7f170c0703b0 2023-10-19T08:38:19.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.521+0000 7f170a7fc700 1 -- 172.21.15.79:0/521751525 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16fc011990 con 0x7f170c0703b0 2023-10-19T08:38:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.521+0000 7f170a7fc700 1 -- 172.21.15.79:0/521751525 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc011d20 con 0x7f170c0703b0 2023-10-19T08:38:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.521+0000 7f1712221700 1 -- 172.21.15.79:0/521751525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c0703b0 msgr2=0x7f170c06a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.521+0000 7f1712221700 1 --2- 172.21.15.79:0/521751525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c0703b0 0x7f170c06a760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f170c0717c0 tx=0x7f16fc009b20 comp rx=0 tx=0).stop 2023-10-19T08:38:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.521+0000 7f1712221700 1 -- 172.21.15.79:0/521751525 shutdown_connections 2023-10-19T08:38:19.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.521+0000 7f1712221700 1 --2- 172.21.15.79:0/521751525 >> v2:172.21.15.89:3300/0 conn(0x7f170c0cd270 0x7f170c06a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:19.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.521+0000 7f1712221700 1 --2- 172.21.15.79:0/521751525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c0703b0 0x7f170c06a760 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:19.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.521+0000 7f1712221700 1 -- 172.21.15.79:0/521751525 >> 172.21.15.79:0/521751525 conn(0x7f170c06dcc0 msgr2=0x7f170c06e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:19.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.521+0000 7f1712221700 1 -- 172.21.15.79:0/521751525 shutdown_connections 2023-10-19T08:38:19.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.521+0000 7f1712221700 1 -- 172.21.15.79:0/521751525 wait complete. 2023-10-19T08:38:19.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.522+0000 7f1712221700 1 Processor -- start 2023-10-19T08:38:19.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.523+0000 7f1712221700 1 -- start start 2023-10-19T08:38:19.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.523+0000 7f1712221700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c06f910 0x7f170c14d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:19.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.523+0000 7f1712221700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c0703b0 0x7f170c0ad340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:19.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.523+0000 7f1712221700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f170c0cd270 0x7f170c14eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:19.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.523+0000 7f1712221700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c14de30 con 0x7f170c06f910 2023-10-19T08:38:19.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.523+0000 7f1712221700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c14e110 con 0x7f170c0703b0 2023-10-19T08:38:19.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.523+0000 7f1712221700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170c14e3f0 con 0x7f170c0cd270 2023-10-19T08:38:19.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.523+0000 7f170b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c06f910 0x7f170c14d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:19.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.523+0000 7f170b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c06f910 0x7f170c14d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46124/0 (socket says 172.21.15.79:46124) 2023-10-19T08:38:19.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.523+0000 7f170b7fe700 1 -- 172.21.15.79:0/2991944922 learned_addr learned my addr 172.21.15.79:0/2991944922 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:19.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.524+0000 7f170affd700 1 --2- 172.21.15.79:0/2991944922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c0703b0 0x7f170c0ad340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:19.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.524+0000 7f170bfff700 1 --2- 172.21.15.79:0/2991944922 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f170c0cd270 0x7f170c14eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:19.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.524+0000 7f170b7fe700 1 -- 172.21.15.79:0/2991944922 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f170c0cd270 msgr2=0x7f170c14eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:19.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.524+0000 7f170b7fe700 1 --2- 172.21.15.79:0/2991944922 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f170c0cd270 0x7f170c14eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:19.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.524+0000 7f170b7fe700 1 -- 172.21.15.79:0/2991944922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c0703b0 msgr2=0x7f170c0ad340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:19.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.524+0000 7f170b7fe700 1 --2- 172.21.15.79:0/2991944922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c0703b0 0x7f170c0ad340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:19.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.524+0000 7f170b7fe700 1 -- 172.21.15.79:0/2991944922 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc0094a0 con 0x7f170c06f910 2023-10-19T08:38:19.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.524+0000 7f170b7fe700 1 --2- 172.21.15.79:0/2991944922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c06f910 0x7f170c14d230 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f16f400e810 tx=0x7f16f400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:19.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.524+0000 7f1703fff700 1 -- 172.21.15.79:0/2991944922 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4013610 con 0x7f170c06f910 2023-10-19T08:38:19.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.524+0000 7f1703fff700 1 -- 172.21.15.79:0/2991944922 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f4013770 con 0x7f170c06f910 2023-10-19T08:38:19.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.524+0000 7f1703fff700 1 -- 172.21.15.79:0/2991944922 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f4013b20 con 0x7f170c06f910 2023-10-19T08:38:19.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.524+0000 7f1712221700 1 -- 172.21.15.79:0/2991944922 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170c14e6d0 con 0x7f170c06f910 2023-10-19T08:38:19.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.524+0000 7f1712221700 1 -- 172.21.15.79:0/2991944922 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170c0ad880 con 0x7f170c06f910 2023-10-19T08:38:19.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.525+0000 7f1712221700 1 -- 172.21.15.79:0/2991944922 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170c14ed20 con 0x7f170c06f910 2023-10-19T08:38:19.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.525+0000 7f1703fff700 1 -- 172.21.15.79:0/2991944922 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f16f4013c80 con 0x7f170c06f910 2023-10-19T08:38:19.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.526+0000 7f1703fff700 1 --2- 172.21.15.79:0/2991944922 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f16ec06a0e0 0x7f16ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:19.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.526+0000 7f1703fff700 1 -- 172.21.15.79:0/2991944922 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f16f40885a0 con 0x7f170c06f910 2023-10-19T08:38:19.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.526+0000 7f170affd700 1 --2- 172.21.15.79:0/2991944922 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f16ec06a0e0 0x7f16ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:19.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.526+0000 7f170affd700 1 --2- 172.21.15.79:0/2991944922 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f16ec06a0e0 0x7f16ec06c5a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0090b0 tx=0x7f16fc01c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:19.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.530+0000 7f1703fff700 1 -- 172.21.15.79:0/2991944922 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f16f4053910 con 0x7f170c06f910 2023-10-19T08:38:19.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:19.766+0000 7f1712221700 1 -- 172.21.15.79:0/2991944922 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f170c0cf870 con 0x7f170c06f910 2023-10-19T08:38:20.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.389+0000 7f1703fff700 1 -- 172.21.15.79:0/2991944922 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f16f4056f30 con 0x7f170c06f910 2023-10-19T08:38:20.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.391+0000 7f1712221700 1 -- 172.21.15.79:0/2991944922 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f16ec06a0e0 msgr2=0x7f16ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:20.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.391+0000 7f1712221700 1 --2- 172.21.15.79:0/2991944922 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f16ec06a0e0 0x7f16ec06c5a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0090b0 tx=0x7f16fc01c040 comp rx=0 tx=0).stop 2023-10-19T08:38:20.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.391+0000 7f1712221700 1 -- 172.21.15.79:0/2991944922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c06f910 msgr2=0x7f170c14d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:20.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.391+0000 7f1712221700 1 --2- 172.21.15.79:0/2991944922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c06f910 0x7f170c14d230 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f16f400e810 tx=0x7f16f400ebd0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.392+0000 7f1712221700 1 -- 172.21.15.79:0/2991944922 shutdown_connections 2023-10-19T08:38:20.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.392+0000 7f1712221700 1 --2- 172.21.15.79:0/2991944922 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f16ec06a0e0 0x7f16ec06c5a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.392+0000 7f1712221700 1 --2- 172.21.15.79:0/2991944922 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f170c0cd270 0x7f170c14eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.392+0000 7f1712221700 1 --2- 172.21.15.79:0/2991944922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f170c06f910 0x7f170c14d230 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.392+0000 7f1712221700 1 --2- 172.21.15.79:0/2991944922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170c0703b0 0x7f170c0ad340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.392+0000 7f1712221700 1 -- 172.21.15.79:0/2991944922 >> 172.21.15.79:0/2991944922 conn(0x7f170c06dcc0 msgr2=0x7f170c0cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:20.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.392+0000 7f1712221700 1 -- 172.21.15.79:0/2991944922 shutdown_connections 2023-10-19T08:38:20.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.392+0000 7f1712221700 1 -- 172.21.15.79:0/2991944922 wait complete. 2023-10-19T08:38:20.410 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-19T08:38:20.410 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T08:38:20.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.532+0000 7f4d12c2e700 1 Processor -- start 2023-10-19T08:38:20.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.532+0000 7f4d12c2e700 1 -- start start 2023-10-19T08:38:20.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.533+0000 7f4d12c2e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d0c0b0c00 0x7f4d0c0d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:20.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.533+0000 7f4d12c2e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4d0c0cb6f0 0x7f4d0c0ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.533+0000 7f4d12c2e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0c0b25f0 con 0x7f4d0c15e570 2023-10-19T08:38:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.533+0000 7f4d12c2e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0c0afd60 con 0x7f4d0c0cb6f0 2023-10-19T08:38:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.533+0000 7f4d12c2e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c0af810 con 0x7f4d0c0b0c00 2023-10-19T08:38:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.533+0000 7f4d109ca700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4d0c15e570 0x7f4d0c0b04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56204/0 (socket says 172.21.15.79:56204) 2023-10-19T08:38:20.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.533+0000 7f4d109ca700 1 -- 172.21.15.79:0/486872239 learned_addr learned my addr 172.21.15.79:0/486872239 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d0bfff700 1 --2- 172.21.15.79:0/486872239 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d0c0b0c00 0x7f4d0c0d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d111cb700 1 --2- 172.21.15.79:0/486872239 >> v2:172.21.15.89:3300/0 conn(0x7f4d0c0cb6f0 0x7f4d0c0ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d0b7fe700 1 -- 172.21.15.79:0/486872239 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136207598 0 0) 0x7f4d0c0b25f0 con 0x7f4d0c15e570 2023-10-19T08:38:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d0b7fe700 1 -- 172.21.15.79:0/486872239 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cfc0035b0 con 0x7f4d0c15e570 2023-10-19T08:38:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d0b7fe700 1 -- 172.21.15.79:0/486872239 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1819062681 0 0) 0x7f4cfc0035b0 con 0x7f4d0c15e570 2023-10-19T08:38:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d0b7fe700 1 -- 172.21.15.79:0/486872239 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d0c0b0c00 msgr2=0x7f4d0c0d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d0b7fe700 1 --2- 172.21.15.79:0/486872239 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d0c0b0c00 0x7f4d0c0d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d0b7fe700 1 -- 172.21.15.79:0/486872239 >> v2:172.21.15.89:3300/0 conn(0x7f4d0c0cb6f0 msgr2=0x7f4d0c0ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d0b7fe700 1 --2- 172.21.15.79:0/486872239 >> v2:172.21.15.89:3300/0 conn(0x7f4d0c0cb6f0 0x7f4d0c0ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d0b7fe700 1 -- 172.21.15.79:0/486872239 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c0aef70 con 0x7f4d0c15e570 2023-10-19T08:38:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d0b7fe700 1 -- 172.21.15.79:0/486872239 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f4d00001670 con 0x7f4d0c15e570 2023-10-19T08:38:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d0b7fe700 1 -- 172.21.15.79:0/486872239 >> v1:172.21.15.79:6789/0 conn(0x7f4d0c15e570 legacy=0x7f4d0c0b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d0b7fe700 1 --2- 172.21.15.79:0/486872239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cfc003a00 0x7f4cfc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d0b7fe700 1 --2- 172.21.15.79:0/486872239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cfc004850 0x7f4cfc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:20.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d0b7fe700 1 --2- 172.21.15.79:0/486872239 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d0c0b0c00 0x7f4cfc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:20.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d0b7fe700 1 -- 172.21.15.79:0/486872239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c0afd60 con 0x7f4cfc003a00 2023-10-19T08:38:20.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d0b7fe700 1 -- 172.21.15.79:0/486872239 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c0af810 con 0x7f4cfc004850 2023-10-19T08:38:20.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d0b7fe700 1 -- 172.21.15.79:0/486872239 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc00ba10 con 0x7f4d0c0b0c00 2023-10-19T08:38:20.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d109ca700 1 --2- 172.21.15.79:0/486872239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cfc003a00 0x7f4cfc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:20.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d0bfff700 1 --2- 172.21.15.79:0/486872239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cfc004850 0x7f4cfc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:20.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d111cb700 1 --2- 172.21.15.79:0/486872239 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d0c0b0c00 0x7f4cfc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:20.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d109ca700 1 -- 172.21.15.79:0/486872239 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d0c0b0c00 msgr2=0x7f4cfc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:20.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d109ca700 1 --2- 172.21.15.79:0/486872239 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d0c0b0c00 0x7f4cfc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d109ca700 1 -- 172.21.15.79:0/486872239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cfc004850 msgr2=0x7f4cfc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:20.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d109ca700 1 --2- 172.21.15.79:0/486872239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cfc004850 0x7f4cfc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.534+0000 7f4d109ca700 1 -- 172.21.15.79:0/486872239 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc0035b0 con 0x7f4cfc003a00 2023-10-19T08:38:20.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.535+0000 7f4d109ca700 1 --2- 172.21.15.79:0/486872239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cfc003a00 0x7f4cfc003e20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000c320 tx=0x7f4cfc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59690aca98e5ebf server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:20.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.535+0000 7f4d0b7fe700 1 -- 172.21.15.79:0/486872239 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0000ce60 con 0x7f4cfc003a00 2023-10-19T08:38:20.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.535+0000 7f4d0b7fe700 1 -- 172.21.15.79:0/486872239 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d00005960 con 0x7f4cfc003a00 2023-10-19T08:38:20.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.535+0000 7f4d0b7fe700 1 -- 172.21.15.79:0/486872239 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00005d10 con 0x7f4cfc003a00 2023-10-19T08:38:20.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.535+0000 7f4d12c2e700 1 -- 172.21.15.79:0/486872239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cfc003a00 msgr2=0x7f4cfc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:20.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.535+0000 7f4d12c2e700 1 --2- 172.21.15.79:0/486872239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cfc003a00 0x7f4cfc003e20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000c320 tx=0x7f4cfc005880 comp rx=0 tx=0).stop 2023-10-19T08:38:20.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.535+0000 7f4d111cb700 1 -- 172.21.15.79:0/486872239 reap_dead start 2023-10-19T08:38:20.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.535+0000 7f4d12c2e700 1 -- 172.21.15.79:0/486872239 shutdown_connections 2023-10-19T08:38:20.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.535+0000 7f4d12c2e700 1 -- 172.21.15.79:0/486872239 >> 172.21.15.79:0/486872239 conn(0x7f4d0c09a0b0 msgr2=0x7f4d0c0d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:20.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.535+0000 7f4d12c2e700 1 -- 172.21.15.79:0/486872239 shutdown_connections 2023-10-19T08:38:20.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.535+0000 7f4d12c2e700 1 -- 172.21.15.79:0/486872239 wait complete. 2023-10-19T08:38:20.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.537+0000 7f4d12c2e700 1 Processor -- start 2023-10-19T08:38:20.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.537+0000 7f4d12c2e700 1 -- start start 2023-10-19T08:38:20.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.538+0000 7f4d12c2e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cfc003a00 0x7f4d0c0c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:20.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.538+0000 7f4d12c2e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0c0c83f0 0x7f4d0c150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:20.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.538+0000 7f4d12c2e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d0c150ed0 0x7f4d0c0b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:20.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.538+0000 7f4d12c2e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c151330 con 0x7f4d0c0c83f0 2023-10-19T08:38:20.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.538+0000 7f4d12c2e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c15a880 con 0x7f4cfc003a00 2023-10-19T08:38:20.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.538+0000 7f4d12c2e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c1517a0 con 0x7f4d0c150ed0 2023-10-19T08:38:20.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.538+0000 7f4d0bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0c0c83f0 0x7f4d0c150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:20.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.538+0000 7f4d0bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0c0c83f0 0x7f4d0c150990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46146/0 (socket says 172.21.15.79:46146) 2023-10-19T08:38:20.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.538+0000 7f4d0bfff700 1 -- 172.21.15.79:0/2661560336 learned_addr learned my addr 172.21.15.79:0/2661560336 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:20.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.538+0000 7f4d109ca700 1 --2- 172.21.15.79:0/2661560336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cfc003a00 0x7f4d0c0c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:20.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.538+0000 7f4d0bfff700 1 -- 172.21.15.79:0/2661560336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d0c150ed0 msgr2=0x7f4d0c0b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:20.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.538+0000 7f4d111cb700 1 --2- 172.21.15.79:0/2661560336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d0c150ed0 0x7f4d0c0b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:20.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.538+0000 7f4d0bfff700 1 --2- 172.21.15.79:0/2661560336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d0c150ed0 0x7f4d0c0b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.538+0000 7f4d0bfff700 1 -- 172.21.15.79:0/2661560336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cfc003a00 msgr2=0x7f4d0c0c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:20.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.538+0000 7f4d0bfff700 1 --2- 172.21.15.79:0/2661560336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cfc003a00 0x7f4d0c0c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.538+0000 7f4d0bfff700 1 -- 172.21.15.79:0/2661560336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c0c8a20 con 0x7f4d0c0c83f0 2023-10-19T08:38:20.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.538+0000 7f4d109ca700 1 --2- 172.21.15.79:0/2661560336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cfc003a00 0x7f4d0c0c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:20.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.538+0000 7f4d111cb700 1 --2- 172.21.15.79:0/2661560336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d0c150ed0 0x7f4d0c0b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:20.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.539+0000 7f4d0bfff700 1 --2- 172.21.15.79:0/2661560336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0c0c83f0 0x7f4d0c150990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80119d0 tx=0x7f4cf8011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:20.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.539+0000 7f4d097fa700 1 -- 172.21.15.79:0/2661560336 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf800f940 con 0x7f4d0c0c83f0 2023-10-19T08:38:20.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.539+0000 7f4d097fa700 1 -- 172.21.15.79:0/2661560336 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf800faa0 con 0x7f4d0c0c83f0 2023-10-19T08:38:20.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.539+0000 7f4d12c2e700 1 -- 172.21.15.79:0/2661560336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0c0c8d00 con 0x7f4d0c0c83f0 2023-10-19T08:38:20.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.539+0000 7f4d097fa700 1 -- 172.21.15.79:0/2661560336 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf800fe30 con 0x7f4d0c0c83f0 2023-10-19T08:38:20.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.539+0000 7f4d12c2e700 1 -- 172.21.15.79:0/2661560336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0c15aad0 con 0x7f4d0c0c83f0 2023-10-19T08:38:20.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.540+0000 7f4d12c2e700 1 -- 172.21.15.79:0/2661560336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0c04ee70 con 0x7f4d0c0c83f0 2023-10-19T08:38:20.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.540+0000 7f4d097fa700 1 -- 172.21.15.79:0/2661560336 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4cf8014440 con 0x7f4d0c0c83f0 2023-10-19T08:38:20.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.540+0000 7f4d097fa700 1 --2- 172.21.15.79:0/2661560336 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4cf006a0e0 0x7f4cf006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:20.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.541+0000 7f4d097fa700 1 -- 172.21.15.79:0/2661560336 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4cf8088f80 con 0x7f4d0c0c83f0 2023-10-19T08:38:20.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.541+0000 7f4d109ca700 1 --2- 172.21.15.79:0/2661560336 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4cf006a0e0 0x7f4cf006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:20.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.541+0000 7f4d109ca700 1 --2- 172.21.15.79:0/2661560336 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4cf006a0e0 0x7f4cf006c5a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4d00015040 tx=0x7f4d0000a000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:20.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.545+0000 7f4d097fa700 1 -- 172.21.15.79:0/2661560336 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4cf80bb940 con 0x7f4d0c0c83f0 2023-10-19T08:38:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.777+0000 7f4d12c2e700 1 -- 172.21.15.79:0/2661560336 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d0c0cc6c0 con 0x7f4d0c0c83f0 2023-10-19T08:38:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.778+0000 7f4d097fa700 1 -- 172.21.15.79:0/2661560336 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4865 (secure 0 0 0) 0x7f4cf8057e10 con 0x7f4d0c0c83f0 2023-10-19T08:38:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:20.782 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3710906518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3710906518},{"type":"v1","addr":"172.21.15.89:6835","nonce":3710906518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3037310614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3037310614},{"type":"v1","addr":"172.21.15.79:6835","nonce":3037310614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/79656061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":79656061},{"type":"v1","addr":"172.21.15.79:6837","nonce":79656061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-19T08:37:56.667105+0000","modified":"2023-10-19T08:38:20.379674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6833/3076620199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3076620199},{"type":"v1","addr":"172.21.15.89:6833","nonce":3076620199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-19T08:38:20.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.780+0000 7f4d12c2e700 1 -- 172.21.15.79:0/2661560336 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4cf006a0e0 msgr2=0x7f4cf006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:20.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.780+0000 7f4d12c2e700 1 --2- 172.21.15.79:0/2661560336 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4cf006a0e0 0x7f4cf006c5a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4d00015040 tx=0x7f4d0000a000 comp rx=0 tx=0).stop 2023-10-19T08:38:20.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.780+0000 7f4d12c2e700 1 -- 172.21.15.79:0/2661560336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0c0c83f0 msgr2=0x7f4d0c150990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:20.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.780+0000 7f4d12c2e700 1 --2- 172.21.15.79:0/2661560336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0c0c83f0 0x7f4d0c150990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4cf80119d0 tx=0x7f4cf8011d90 comp rx=0 tx=0).stop 2023-10-19T08:38:20.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.780+0000 7f4d12c2e700 1 -- 172.21.15.79:0/2661560336 shutdown_connections 2023-10-19T08:38:20.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.780+0000 7f4d12c2e700 1 --2- 172.21.15.79:0/2661560336 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4cf006a0e0 0x7f4cf006c5a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.780+0000 7f4d12c2e700 1 --2- 172.21.15.79:0/2661560336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4d0c150ed0 0x7f4d0c0b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.780+0000 7f4d12c2e700 1 --2- 172.21.15.79:0/2661560336 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4cfc003a00 0x7f4d0c0c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.780+0000 7f4d12c2e700 1 --2- 172.21.15.79:0/2661560336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d0c0c83f0 0x7f4d0c150990 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.780+0000 7f4d12c2e700 1 -- 172.21.15.79:0/2661560336 >> 172.21.15.79:0/2661560336 conn(0x7f4d0c09a0b0 msgr2=0x7f4d0c0cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:20.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.780+0000 7f4d12c2e700 1 -- 172.21.15.79:0/2661560336 shutdown_connections 2023-10-19T08:38:20.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.780+0000 7f4d12c2e700 1 -- 172.21.15.79:0/2661560336 wait complete. 2023-10-19T08:38:20.787 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 9 2023-10-19T08:38:20.795 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:20.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.911+0000 7f7135abc700 1 Processor -- start 2023-10-19T08:38:20.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.911+0000 7f7135abc700 1 -- start start 2023-10-19T08:38:20.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.912+0000 7f7135abc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f71300af170 0x7f71300cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:20.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.912+0000 7f7135abc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f71300b2270 0x7f713006a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:20.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.912+0000 7f7135abc700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713015de50 con 0x7f71300b1de0 2023-10-19T08:38:20.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.912+0000 7f7135abc700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71300af550 con 0x7f71300af170 2023-10-19T08:38:20.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.912+0000 7f7135abc700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71300b26c0 con 0x7f71300b2270 2023-10-19T08:38:20.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.912+0000 7f712f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f71300af170 0x7f71300cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:20.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.912+0000 7f712f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f71300af170 0x7f71300cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46152/0 (socket says 172.21.15.79:46152) 2023-10-19T08:38:20.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.912+0000 7f712f7fe700 1 -- 172.21.15.79:0/1953139324 learned_addr learned my addr 172.21.15.79:0/1953139324 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:20.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.912+0000 7f712ffff700 1 --2- 172.21.15.79:0/1953139324 >> v2:172.21.15.89:3300/0 conn(0x7f71300b2270 0x7f713006a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:20.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.912+0000 7f712f7fe700 1 -- 172.21.15.79:0/1953139324 >> v2:172.21.15.89:3300/0 conn(0x7f71300b2270 msgr2=0x7f713006a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:20.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.912+0000 7f712f7fe700 1 --2- 172.21.15.79:0/1953139324 >> v2:172.21.15.89:3300/0 conn(0x7f71300b2270 0x7f713006a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.912+0000 7f712f7fe700 1 -- 172.21.15.79:0/1953139324 >> v1:172.21.15.79:6789/0 conn(0x7f71300b1de0 legacy=0x7f71300cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:20.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.912+0000 7f712f7fe700 1 -- 172.21.15.79:0/1953139324 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713015e130 con 0x7f71300af170 2023-10-19T08:38:20.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.912+0000 7f712e7fc700 1 -- 172.21.15.79:0/1953139324 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3929689944 0 0) 0x7f713015de50 con 0x7f71300b1de0 2023-10-19T08:38:20.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.913+0000 7f712ffff700 1 --2- 172.21.15.79:0/1953139324 >> v2:172.21.15.89:3300/0 conn(0x7f71300b2270 0x7f713006a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:20.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.913+0000 7f712f7fe700 1 --2- 172.21.15.79:0/1953139324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71300af170 0x7f71300cd0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f71240098f0 tx=0x7f7124009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9325101cfff7e1dc server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:20.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.913+0000 7f712e7fc700 1 -- 172.21.15.79:0/1953139324 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712400b860 con 0x7f71300af170 2023-10-19T08:38:20.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.913+0000 7f712e7fc700 1 -- 172.21.15.79:0/1953139324 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712400b9c0 con 0x7f71300af170 2023-10-19T08:38:20.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.913+0000 7f712e7fc700 1 -- 172.21.15.79:0/1953139324 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712400bd50 con 0x7f71300af170 2023-10-19T08:38:20.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.913+0000 7f7135abc700 1 -- 172.21.15.79:0/1953139324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71300af170 msgr2=0x7f71300cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:20.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.913+0000 7f7135abc700 1 --2- 172.21.15.79:0/1953139324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71300af170 0x7f71300cd0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f71240098f0 tx=0x7f7124009c00 comp rx=0 tx=0).stop 2023-10-19T08:38:20.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.913+0000 7f7135abc700 1 -- 172.21.15.79:0/1953139324 shutdown_connections 2023-10-19T08:38:20.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.913+0000 7f7135abc700 1 --2- 172.21.15.79:0/1953139324 >> v2:172.21.15.89:3300/0 conn(0x7f71300b2270 0x7f713006a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.913+0000 7f7135abc700 1 --2- 172.21.15.79:0/1953139324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71300af170 0x7f71300cd0c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.913+0000 7f7135abc700 1 -- 172.21.15.79:0/1953139324 >> 172.21.15.79:0/1953139324 conn(0x7f713006dcc0 msgr2=0x7f713006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:20.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.913+0000 7f7135abc700 1 -- 172.21.15.79:0/1953139324 shutdown_connections 2023-10-19T08:38:20.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.913+0000 7f7135abc700 1 -- 172.21.15.79:0/1953139324 wait complete. 2023-10-19T08:38:20.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.914+0000 7f7135abc700 1 Processor -- start 2023-10-19T08:38:20.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.915+0000 7f7135abc700 1 -- start start 2023-10-19T08:38:20.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.915+0000 7f7135abc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71300af170 0x7f71300c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:20.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.915+0000 7f7135abc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71300b1de0 0x7f713015f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:20.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.915+0000 7f7135abc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71300b2270 0x7f713015fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:20.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.915+0000 7f7135abc700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71300c6e80 con 0x7f71300b2270 2023-10-19T08:38:20.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.915+0000 7f7135abc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71300c7160 con 0x7f71300b1de0 2023-10-19T08:38:20.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.915+0000 7f7135abc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71300c7440 con 0x7f71300af170 2023-10-19T08:38:20.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.916+0000 7f712ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71300b2270 0x7f713015fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:20.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.916+0000 7f712ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71300b2270 0x7f713015fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46160/0 (socket says 172.21.15.79:46160) 2023-10-19T08:38:20.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.916+0000 7f712ffff700 1 -- 172.21.15.79:0/1437047656 learned_addr learned my addr 172.21.15.79:0/1437047656 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:20.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.916+0000 7f712f7fe700 1 --2- 172.21.15.79:0/1437047656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71300af170 0x7f71300c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:20.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.916+0000 7f712effd700 1 --2- 172.21.15.79:0/1437047656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71300b1de0 0x7f713015f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:20.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.916+0000 7f712ffff700 1 -- 172.21.15.79:0/1437047656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71300af170 msgr2=0x7f71300c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:20.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.916+0000 7f712ffff700 1 --2- 172.21.15.79:0/1437047656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71300af170 0x7f71300c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.916+0000 7f712ffff700 1 -- 172.21.15.79:0/1437047656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71300b1de0 msgr2=0x7f713015f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:20.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.916+0000 7f712ffff700 1 --2- 172.21.15.79:0/1437047656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71300b1de0 0x7f713015f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:20.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.916+0000 7f712ffff700 1 -- 172.21.15.79:0/1437047656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7124009550 con 0x7f71300b2270 2023-10-19T08:38:20.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.916+0000 7f712ffff700 1 --2- 172.21.15.79:0/1437047656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71300b2270 0x7f713015fd10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f712800cd50 tx=0x7f712800a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:20.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.916+0000 7f7117fff700 1 -- 172.21.15.79:0/1437047656 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712800cea0 con 0x7f71300b2270 2023-10-19T08:38:20.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.916+0000 7f7117fff700 1 -- 172.21.15.79:0/1437047656 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712800f480 con 0x7f71300b2270 2023-10-19T08:38:20.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.916+0000 7f7117fff700 1 -- 172.21.15.79:0/1437047656 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712800f830 con 0x7f71300b2270 2023-10-19T08:38:20.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.916+0000 7f7135abc700 1 -- 172.21.15.79:0/1437047656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71300c7720 con 0x7f71300b2270 2023-10-19T08:38:20.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.916+0000 7f7135abc700 1 -- 172.21.15.79:0/1437047656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71300c65c0 con 0x7f71300b2270 2023-10-19T08:38:20.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.917+0000 7f7135abc700 1 -- 172.21.15.79:0/1437047656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71300c7940 con 0x7f71300b2270 2023-10-19T08:38:20.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.918+0000 7f7117fff700 1 -- 172.21.15.79:0/1437047656 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f712800b040 con 0x7f71300b2270 2023-10-19T08:38:20.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.918+0000 7f7117fff700 1 --2- 172.21.15.79:0/1437047656 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f711c06a0e0 0x7f711c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:20.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.918+0000 7f7117fff700 1 -- 172.21.15.79:0/1437047656 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7128088f70 con 0x7f71300b2270 2023-10-19T08:38:20.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.918+0000 7f712f7fe700 1 --2- 172.21.15.79:0/1437047656 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f711c06a0e0 0x7f711c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:20.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.918+0000 7f712f7fe700 1 --2- 172.21.15.79:0/1437047656 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f711c06a0e0 0x7f711c06c5a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7124000c00 tx=0x7f7124008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:20.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:20.922+0000 7f7117fff700 1 -- 172.21.15.79:0/1437047656 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f71280bb940 con 0x7f71300b2270 2023-10-19T08:38:21.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.113+0000 7f7135abc700 1 -- 172.21.15.79:0/1437047656 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71300c6fc0 con 0x7f71300b2270 2023-10-19T08:38:21.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.114+0000 7f7117fff700 1 -- 172.21.15.79:0/1437047656 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20060 (secure 0 0 0) 0x7f71300c6fc0 con 0x7f71300b2270 2023-10-19T08:38:21.118 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:21.118 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":25,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:01.725914+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:21.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.116+0000 7f7135abc700 1 -- 172.21.15.79:0/1437047656 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f711c06a0e0 msgr2=0x7f711c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:21.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.116+0000 7f7135abc700 1 --2- 172.21.15.79:0/1437047656 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f711c06a0e0 0x7f711c06c5a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7124000c00 tx=0x7f7124008030 comp rx=0 tx=0).stop 2023-10-19T08:38:21.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.116+0000 7f7135abc700 1 -- 172.21.15.79:0/1437047656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71300b2270 msgr2=0x7f713015fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:21.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.116+0000 7f7135abc700 1 --2- 172.21.15.79:0/1437047656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71300b2270 0x7f713015fd10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f712800cd50 tx=0x7f712800a560 comp rx=0 tx=0).stop 2023-10-19T08:38:21.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.116+0000 7f7135abc700 1 -- 172.21.15.79:0/1437047656 shutdown_connections 2023-10-19T08:38:21.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.116+0000 7f7135abc700 1 --2- 172.21.15.79:0/1437047656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71300b2270 0x7f713015fd10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.116+0000 7f7135abc700 1 --2- 172.21.15.79:0/1437047656 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f711c06a0e0 0x7f711c06c5a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.116+0000 7f7135abc700 1 --2- 172.21.15.79:0/1437047656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f71300af170 0x7f71300c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.116+0000 7f7135abc700 1 --2- 172.21.15.79:0/1437047656 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f71300b1de0 0x7f713015f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.116+0000 7f7135abc700 1 -- 172.21.15.79:0/1437047656 >> 172.21.15.79:0/1437047656 conn(0x7f713006dcc0 msgr2=0x7f71300cabe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:21.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.116+0000 7f7135abc700 1 -- 172.21.15.79:0/1437047656 shutdown_connections 2023-10-19T08:38:21.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.116+0000 7f7135abc700 1 -- 172.21.15.79:0/1437047656 wait complete. 2023-10-19T08:38:21.132 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-19T08:38:21.133 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-19T08:38:21.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.249+0000 7facd46fd700 1 Processor -- start 2023-10-19T08:38:21.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.249+0000 7facd46fd700 1 -- start start 2023-10-19T08:38:21.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.250+0000 7facd46fd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faccc15d8c0 0x7faccc06a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:21.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.250+0000 7facd46fd700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faccc0cd550 con 0x7faccc0af170 2023-10-19T08:38:21.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.250+0000 7facd46fd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faccc15de50 con 0x7faccc0cd0c0 2023-10-19T08:38:21.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.250+0000 7facd46fd700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faccc0af550 con 0x7faccc15d8c0 2023-10-19T08:38:21.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.250+0000 7facd2c9a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faccc15d8c0 0x7faccc06a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:21.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.250+0000 7facd2499700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7faccc0af170 0x7faccc0b1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56236/0 (socket says 172.21.15.79:56236) 2023-10-19T08:38:21.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.250+0000 7facd2c9a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faccc15d8c0 0x7faccc06a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46166/0 (socket says 172.21.15.79:46166) 2023-10-19T08:38:21.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.251+0000 7facd2499700 1 -- 172.21.15.79:0/3224330775 learned_addr learned my addr 172.21.15.79:0/3224330775 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:21.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.251+0000 7facd2c9a700 1 -- 172.21.15.79:0/3224330775 >> v1:172.21.15.89:6789/0 conn(0x7faccc0cd0c0 legacy=0x7faccc0cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:21.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.251+0000 7facd2c9a700 1 -- 172.21.15.79:0/3224330775 >> v1:172.21.15.79:6789/0 conn(0x7faccc0af170 legacy=0x7faccc0b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:21.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.251+0000 7facd2c9a700 1 -- 172.21.15.79:0/3224330775 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc15e130 con 0x7faccc15d8c0 2023-10-19T08:38:21.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.251+0000 7facd1497700 1 -- 172.21.15.79:0/3224330775 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906467228 0 0) 0x7facbc001110 con 0x7faccc0af170 2023-10-19T08:38:21.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.251+0000 7facd2c9a700 1 --2- 172.21.15.79:0/3224330775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc15d8c0 0x7faccc06a220 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7facc4009dc0 tx=0x7facc400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20450e1caa30967 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.251+0000 7facd1497700 1 -- 172.21.15.79:0/3224330775 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc400e070 con 0x7faccc15d8c0 2023-10-19T08:38:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.251+0000 7facd1497700 1 -- 172.21.15.79:0/3224330775 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc400bb90 con 0x7faccc15d8c0 2023-10-19T08:38:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.251+0000 7facd1497700 1 -- 172.21.15.79:0/3224330775 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc4012430 con 0x7faccc15d8c0 2023-10-19T08:38:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.252+0000 7facd46fd700 1 -- 172.21.15.79:0/3224330775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc15d8c0 msgr2=0x7faccc06a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:21.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.252+0000 7facd46fd700 1 --2- 172.21.15.79:0/3224330775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc15d8c0 0x7faccc06a220 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7facc4009dc0 tx=0x7facc400b330 comp rx=0 tx=0).stop 2023-10-19T08:38:21.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.252+0000 7facd46fd700 1 -- 172.21.15.79:0/3224330775 shutdown_connections 2023-10-19T08:38:21.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.252+0000 7facd46fd700 1 --2- 172.21.15.79:0/3224330775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc15d8c0 0x7faccc06a220 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.252+0000 7facd46fd700 1 -- 172.21.15.79:0/3224330775 >> 172.21.15.79:0/3224330775 conn(0x7faccc06dcc0 msgr2=0x7faccc06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:21.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.252+0000 7facd46fd700 1 -- 172.21.15.79:0/3224330775 shutdown_connections 2023-10-19T08:38:21.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.252+0000 7facd46fd700 1 -- 172.21.15.79:0/3224330775 wait complete. 2023-10-19T08:38:21.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.253+0000 7facd46fd700 1 Processor -- start 2023-10-19T08:38:21.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.253+0000 7facd46fd700 1 -- start start 2023-10-19T08:38:21.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facd46fd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faccc0af170 0x7faccc0c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:21.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facd46fd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc0cd0c0 0x7faccc159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:21.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facd46fd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faccc15d8c0 0x7faccc0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:21.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facd46fd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0c86a0 con 0x7faccc0cd0c0 2023-10-19T08:38:21.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facd46fd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0c8940 con 0x7faccc0af170 2023-10-19T08:38:21.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facd46fd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0c8c20 con 0x7faccc15d8c0 2023-10-19T08:38:21.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facd1c98700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc0cd0c0 0x7faccc159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:21.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facd1c98700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc0cd0c0 0x7faccc159360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46170/0 (socket says 172.21.15.79:46170) 2023-10-19T08:38:21.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facd1c98700 1 -- 172.21.15.79:0/1804788681 learned_addr learned my addr 172.21.15.79:0/1804788681 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:21.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facd2c9a700 1 --2- 172.21.15.79:0/1804788681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faccc15d8c0 0x7faccc0af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:21.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facd2499700 1 --2- 172.21.15.79:0/1804788681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faccc0af170 0x7faccc0c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:21.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facd1c98700 1 -- 172.21.15.79:0/1804788681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faccc15d8c0 msgr2=0x7faccc0af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:21.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facd1c98700 1 --2- 172.21.15.79:0/1804788681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faccc15d8c0 0x7faccc0af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facd1c98700 1 -- 172.21.15.79:0/1804788681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faccc0af170 msgr2=0x7faccc0c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:21.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facd1c98700 1 --2- 172.21.15.79:0/1804788681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faccc0af170 0x7faccc0c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facd1c98700 1 -- 172.21.15.79:0/1804788681 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc4009a70 con 0x7faccc0cd0c0 2023-10-19T08:38:21.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facd1c98700 1 --2- 172.21.15.79:0/1804788681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc0cd0c0 0x7faccc159360 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7facc800c450 tx=0x7facc800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:21.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facc2ffd700 1 -- 172.21.15.79:0/1804788681 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc80052d0 con 0x7faccc0cd0c0 2023-10-19T08:38:21.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facc2ffd700 1 -- 172.21.15.79:0/1804788681 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc8005430 con 0x7faccc0cd0c0 2023-10-19T08:38:21.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facc2ffd700 1 -- 172.21.15.79:0/1804788681 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc80038c0 con 0x7faccc0cd0c0 2023-10-19T08:38:21.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facd46fd700 1 -- 172.21.15.79:0/1804788681 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faccc0c8f00 con 0x7faccc0cd0c0 2023-10-19T08:38:21.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.254+0000 7facd46fd700 1 -- 172.21.15.79:0/1804788681 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faccc0c94c0 con 0x7faccc0cd0c0 2023-10-19T08:38:21.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.255+0000 7facd46fd700 1 -- 172.21.15.79:0/1804788681 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faccc04ee70 con 0x7faccc0cd0c0 2023-10-19T08:38:21.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.256+0000 7facc2ffd700 1 -- 172.21.15.79:0/1804788681 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7facc8003a20 con 0x7faccc0cd0c0 2023-10-19T08:38:21.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.256+0000 7facc2ffd700 1 --2- 172.21.15.79:0/1804788681 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7facb006a0e0 0x7facb006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:21.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.256+0000 7facc2ffd700 1 -- 172.21.15.79:0/1804788681 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7facc8087ac0 con 0x7faccc0cd0c0 2023-10-19T08:38:21.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.256+0000 7facd2499700 1 --2- 172.21.15.79:0/1804788681 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7facb006a0e0 0x7facb006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:21.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.257+0000 7facd2499700 1 --2- 172.21.15.79:0/1804788681 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7facb006a0e0 0x7facb006c5a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7facbc007c40 tx=0x7facbc007b90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:21.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.261+0000 7facc2ffd700 1 -- 172.21.15.79:0/1804788681 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7facc8052f50 con 0x7faccc0cd0c0 2023-10-19T08:38:21.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.451+0000 7facd46fd700 1 -- 172.21.15.79:0/1804788681 --> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faccc0b18c0 con 0x7facb006a0e0 2023-10-19T08:38:21.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.461+0000 7facc2ffd700 1 -- 172.21.15.79:0/1804788681 <== mgr.4113 v2:172.21.15.79:6832/316135984 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367292 (secure 0 0 0) 0x7facbc001280 con 0x7facb006a0e0 2023-10-19T08:38:21.470 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:21.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.465+0000 7facd46fd700 1 -- 172.21.15.79:0/1804788681 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7facb006a0e0 msgr2=0x7facb006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:21.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.465+0000 7facd46fd700 1 --2- 172.21.15.79:0/1804788681 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7facb006a0e0 0x7facb006c5a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7facbc007c40 tx=0x7facbc007b90 comp rx=0 tx=0).stop 2023-10-19T08:38:21.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.465+0000 7facd46fd700 1 -- 172.21.15.79:0/1804788681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc0cd0c0 msgr2=0x7faccc159360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:21.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.465+0000 7facd46fd700 1 --2- 172.21.15.79:0/1804788681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc0cd0c0 0x7faccc159360 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7facc800c450 tx=0x7facc800c760 comp rx=0 tx=0).stop 2023-10-19T08:38:21.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.465+0000 7facd46fd700 1 -- 172.21.15.79:0/1804788681 shutdown_connections 2023-10-19T08:38:21.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.465+0000 7facd46fd700 1 --2- 172.21.15.79:0/1804788681 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7facb006a0e0 0x7facb006c5a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.465+0000 7facd46fd700 1 --2- 172.21.15.79:0/1804788681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faccc15d8c0 0x7faccc0af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.465+0000 7facd46fd700 1 --2- 172.21.15.79:0/1804788681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faccc0af170 0x7faccc0c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.465+0000 7facd46fd700 1 --2- 172.21.15.79:0/1804788681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faccc0cd0c0 0x7faccc159360 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.465+0000 7facd46fd700 1 -- 172.21.15.79:0/1804788681 >> 172.21.15.79:0/1804788681 conn(0x7faccc06dcc0 msgr2=0x7faccc0cd740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:21.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.465+0000 7facd46fd700 1 -- 172.21.15.79:0/1804788681 shutdown_connections 2023-10-19T08:38:21.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.465+0000 7facd46fd700 1 -- 172.21.15.79:0/1804788681 wait complete. 2023-10-19T08:38:21.475 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-19T08:38:21.481 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-10-19T08:38:21.099415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219444,"kb_used_data":3292,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755276,"statfs":{"total":773094113280,"available":772869402624,"internally_reserved":0,"allocated":3371008,"data_stored":2067366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002951"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336361+0000","last_change":"2023-10-19T08:37:57.298197+0000","last_active":"2023-10-19T08:38:02.336361+0000","last_peered":"2023-10-19T08:38:02.336361+0000","last_clean":"2023-10-19T08:38:02.336361+0000","last_became_active":"2023-10-19T08:37:57.297874+0000","last_became_peered":"2023-10-19T08:37:57.297874+0000","last_unstale":"2023-10-19T08:38:02.336361+0000","last_undegraded":"2023-10-19T08:38:02.336361+0000","last_fullsized":"2023-10-19T08:38:02.336361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:29:22.588510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303213+0000","last_change":"2023-10-19T08:37:57.272011+0000","last_active":"2023-10-19T08:38:02.303213+0000","last_peered":"2023-10-19T08:38:02.303213+0000","last_clean":"2023-10-19T08:38:02.303213+0000","last_became_active":"2023-10-19T08:37:57.271773+0000","last_became_peered":"2023-10-19T08:37:57.271773+0000","last_unstale":"2023-10-19T08:38:02.303213+0000","last_undegraded":"2023-10-19T08:38:02.303213+0000","last_fullsized":"2023-10-19T08:38:02.303213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:04.184252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338528+0000","last_change":"2023-10-19T08:37:57.286551+0000","last_active":"2023-10-19T08:38:02.338528+0000","last_peered":"2023-10-19T08:38:02.338528+0000","last_clean":"2023-10-19T08:38:02.338528+0000","last_became_active":"2023-10-19T08:37:57.286151+0000","last_became_peered":"2023-10-19T08:37:57.286151+0000","last_unstale":"2023-10-19T08:38:02.338528+0000","last_undegraded":"2023-10-19T08:38:02.338528+0000","last_fullsized":"2023-10-19T08:38:02.338528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:06:59.905183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336888+0000","last_change":"2023-10-19T08:37:57.279635+0000","last_active":"2023-10-19T08:38:02.336888+0000","last_peered":"2023-10-19T08:38:02.336888+0000","last_clean":"2023-10-19T08:38:02.336888+0000","last_became_active":"2023-10-19T08:37:57.279358+0000","last_became_peered":"2023-10-19T08:37:57.279358+0000","last_unstale":"2023-10-19T08:38:02.336888+0000","last_undegraded":"2023-10-19T08:38:02.336888+0000","last_fullsized":"2023-10-19T08:38:02.336888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:11:03.215012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327987+0000","last_change":"2023-10-19T08:37:57.291593+0000","last_active":"2023-10-19T08:38:02.327987+0000","last_peered":"2023-10-19T08:38:02.327987+0000","last_clean":"2023-10-19T08:38:02.327987+0000","last_became_active":"2023-10-19T08:37:57.291321+0000","last_became_peered":"2023-10-19T08:37:57.291321+0000","last_unstale":"2023-10-19T08:38:02.327987+0000","last_undegraded":"2023-10-19T08:38:02.327987+0000","last_fullsized":"2023-10-19T08:38:02.327987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:52.465054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337282+0000","last_change":"2023-10-19T08:37:57.285508+0000","last_active":"2023-10-19T08:38:02.337282+0000","last_peered":"2023-10-19T08:38:02.337282+0000","last_clean":"2023-10-19T08:38:02.337282+0000","last_became_active":"2023-10-19T08:37:57.285110+0000","last_became_peered":"2023-10-19T08:37:57.285110+0000","last_unstale":"2023-10-19T08:38:02.337282+0000","last_undegraded":"2023-10-19T08:38:02.337282+0000","last_fullsized":"2023-10-19T08:38:02.337282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:36:45.197928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337337+0000","last_change":"2023-10-19T08:37:57.284428+0000","last_active":"2023-10-19T08:38:02.337337+0000","last_peered":"2023-10-19T08:38:02.337337+0000","last_clean":"2023-10-19T08:38:02.337337+0000","last_became_active":"2023-10-19T08:37:57.283626+0000","last_became_peered":"2023-10-19T08:37:57.283626+0000","last_unstale":"2023-10-19T08:38:02.337337+0000","last_undegraded":"2023-10-19T08:38:02.337337+0000","last_fullsized":"2023-10-19T08:38:02.337337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:43.028422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302532+0000","last_change":"2023-10-19T08:37:57.281050+0000","last_active":"2023-10-19T08:38:02.302532+0000","last_peered":"2023-10-19T08:38:02.302532+0000","last_clean":"2023-10-19T08:38:02.302532+0000","last_became_active":"2023-10-19T08:37:57.280763+0000","last_became_peered":"2023-10-19T08:37:57.280763+0000","last_unstale":"2023-10-19T08:38:02.302532+0000","last_undegraded":"2023-10-19T08:38:02.302532+0000","last_fullsized":"2023-10-19T08:38:02.302532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:23.560291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328470+0000","last_change":"2023-10-19T08:37:57.295958+0000","last_active":"2023-10-19T08:38:02.328470+0000","last_peered":"2023-10-19T08:38:02.328470+0000","last_clean":"2023-10-19T08:38:02.328470+0000","last_became_active":"2023-10-19T08:37:57.295552+0000","last_became_peered":"2023-10-19T08:37:57.295552+0000","last_unstale":"2023-10-19T08:38:02.328470+0000","last_undegraded":"2023-10-19T08:38:02.328470+0000","last_fullsized":"2023-10-19T08:38:02.328470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:09.106701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303592+0000","last_change":"2023-10-19T08:37:57.281702+0000","last_active":"2023-10-19T08:38:02.303592+0000","last_peered":"2023-10-19T08:38:02.303592+0000","last_clean":"2023-10-19T08:38:02.303592+0000","last_became_active":"2023-10-19T08:37:57.281458+0000","last_became_peered":"2023-10-19T08:37:57.281458+0000","last_unstale":"2023-10-19T08:38:02.303592+0000","last_undegraded":"2023-10-19T08:38:02.303592+0000","last_fullsized":"2023-10-19T08:38:02.303592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:50.116408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338336+0000","last_change":"2023-10-19T08:37:57.287060+0000","last_active":"2023-10-19T08:38:02.338336+0000","last_peered":"2023-10-19T08:38:02.338336+0000","last_clean":"2023-10-19T08:38:02.338336+0000","last_became_active":"2023-10-19T08:37:57.286457+0000","last_became_peered":"2023-10-19T08:37:57.286457+0000","last_unstale":"2023-10-19T08:38:02.338336+0000","last_undegraded":"2023-10-19T08:38:02.338336+0000","last_fullsized":"2023-10-19T08:38:02.338336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:42:12.580615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336291+0000","last_change":"2023-10-19T08:37:57.287153+0000","last_active":"2023-10-19T08:38:02.336291+0000","last_peered":"2023-10-19T08:38:02.336291+0000","last_clean":"2023-10-19T08:38:02.336291+0000","last_became_active":"2023-10-19T08:37:57.286892+0000","last_became_peered":"2023-10-19T08:37:57.286892+0000","last_unstale":"2023-10-19T08:38:02.336291+0000","last_undegraded":"2023-10-19T08:38:02.336291+0000","last_fullsized":"2023-10-19T08:38:02.336291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:15:28.529966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336795+0000","last_change":"2023-10-19T08:37:57.295506+0000","last_active":"2023-10-19T08:38:02.336795+0000","last_peered":"2023-10-19T08:38:02.336795+0000","last_clean":"2023-10-19T08:38:02.336795+0000","last_became_active":"2023-10-19T08:37:57.295228+0000","last_became_peered":"2023-10-19T08:37:57.295228+0000","last_unstale":"2023-10-19T08:38:02.336795+0000","last_undegraded":"2023-10-19T08:38:02.336795+0000","last_fullsized":"2023-10-19T08:38:02.336795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:50:11.458306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302667+0000","last_change":"2023-10-19T08:37:57.281958+0000","last_active":"2023-10-19T08:38:02.302667+0000","last_peered":"2023-10-19T08:38:02.302667+0000","last_clean":"2023-10-19T08:38:02.302667+0000","last_became_active":"2023-10-19T08:37:57.280798+0000","last_became_peered":"2023-10-19T08:37:57.280798+0000","last_unstale":"2023-10-19T08:38:02.302667+0000","last_undegraded":"2023-10-19T08:38:02.302667+0000","last_fullsized":"2023-10-19T08:38:02.302667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:52.465054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337080+0000","last_change":"2023-10-19T08:37:57.284152+0000","last_active":"2023-10-19T08:38:02.337080+0000","last_peered":"2023-10-19T08:38:02.337080+0000","last_clean":"2023-10-19T08:38:02.337080+0000","last_became_active":"2023-10-19T08:37:57.283958+0000","last_became_peered":"2023-10-19T08:37:57.283958+0000","last_unstale":"2023-10-19T08:38:02.337080+0000","last_undegraded":"2023-10-19T08:38:02.337080+0000","last_fullsized":"2023-10-19T08:38:02.337080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:21.864097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336495+0000","last_change":"2023-10-19T08:37:57.282193+0000","last_active":"2023-10-19T08:38:02.336495+0000","last_peered":"2023-10-19T08:38:02.336495+0000","last_clean":"2023-10-19T08:38:02.336495+0000","last_became_active":"2023-10-19T08:37:57.281902+0000","last_became_peered":"2023-10-19T08:37:57.281902+0000","last_unstale":"2023-10-19T08:38:02.336495+0000","last_undegraded":"2023-10-19T08:38:02.336495+0000","last_fullsized":"2023-10-19T08:38:02.336495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:28:55.738875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328478+0000","last_change":"2023-10-19T08:37:57.295795+0000","last_active":"2023-10-19T08:38:02.328478+0000","last_peered":"2023-10-19T08:38:02.328478+0000","last_clean":"2023-10-19T08:38:02.328478+0000","last_became_active":"2023-10-19T08:37:57.295248+0000","last_became_peered":"2023-10-19T08:37:57.295248+0000","last_unstale":"2023-10-19T08:38:02.328478+0000","last_undegraded":"2023-10-19T08:38:02.328478+0000","last_fullsized":"2023-10-19T08:38:02.328478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:30.738229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338681+0000","last_change":"2023-10-19T08:37:57.285995+0000","last_active":"2023-10-19T08:38:02.338681+0000","last_peered":"2023-10-19T08:38:02.338681+0000","last_clean":"2023-10-19T08:38:02.338681+0000","last_became_active":"2023-10-19T08:37:57.285508+0000","last_became_peered":"2023-10-19T08:37:57.285508+0000","last_unstale":"2023-10-19T08:38:02.338681+0000","last_undegraded":"2023-10-19T08:38:02.338681+0000","last_fullsized":"2023-10-19T08:38:02.338681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:47:25.178769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336266+0000","last_change":"2023-10-19T08:37:57.287058+0000","last_active":"2023-10-19T08:38:02.336266+0000","last_peered":"2023-10-19T08:38:02.336266+0000","last_clean":"2023-10-19T08:38:02.336266+0000","last_became_active":"2023-10-19T08:37:57.286444+0000","last_became_peered":"2023-10-19T08:37:57.286444+0000","last_unstale":"2023-10-19T08:38:02.336266+0000","last_undegraded":"2023-10-19T08:38:02.336266+0000","last_fullsized":"2023-10-19T08:38:02.336266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:00:25.346262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337609+0000","last_change":"2023-10-19T08:37:57.286561+0000","last_active":"2023-10-19T08:38:02.337609+0000","last_peered":"2023-10-19T08:38:02.337609+0000","last_clean":"2023-10-19T08:38:02.337609+0000","last_became_active":"2023-10-19T08:37:57.286258+0000","last_became_peered":"2023-10-19T08:37:57.286258+0000","last_unstale":"2023-10-19T08:38:02.337609+0000","last_undegraded":"2023-10-19T08:38:02.337609+0000","last_fullsized":"2023-10-19T08:38:02.337609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:36:37.342175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338298+0000","last_change":"2023-10-19T08:37:57.298841+0000","last_active":"2023-10-19T08:38:02.338298+0000","last_peered":"2023-10-19T08:38:02.338298+0000","last_clean":"2023-10-19T08:38:02.338298+0000","last_became_active":"2023-10-19T08:37:57.297120+0000","last_became_peered":"2023-10-19T08:37:57.297120+0000","last_unstale":"2023-10-19T08:38:02.338298+0000","last_undegraded":"2023-10-19T08:38:02.338298+0000","last_fullsized":"2023-10-19T08:38:02.338298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:45:25.612225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327349+0000","last_change":"2023-10-19T08:37:57.278547+0000","last_active":"2023-10-19T08:38:02.327349+0000","last_peered":"2023-10-19T08:38:02.327349+0000","last_clean":"2023-10-19T08:38:02.327349+0000","last_became_active":"2023-10-19T08:37:57.278248+0000","last_became_peered":"2023-10-19T08:37:57.278248+0000","last_unstale":"2023-10-19T08:38:02.327349+0000","last_undegraded":"2023-10-19T08:38:02.327349+0000","last_fullsized":"2023-10-19T08:38:02.327349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:57:26.558851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302205+0000","last_change":"2023-10-19T08:37:57.292075+0000","last_active":"2023-10-19T08:38:02.302205+0000","last_peered":"2023-10-19T08:38:02.302205+0000","last_clean":"2023-10-19T08:38:02.302205+0000","last_became_active":"2023-10-19T08:37:57.291577+0000","last_became_peered":"2023-10-19T08:37:57.291577+0000","last_unstale":"2023-10-19T08:38:02.302205+0000","last_undegraded":"2023-10-19T08:38:02.302205+0000","last_fullsized":"2023-10-19T08:38:02.302205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:02.310273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336592+0000","last_change":"2023-10-19T08:37:57.297303+0000","last_active":"2023-10-19T08:38:02.336592+0000","last_peered":"2023-10-19T08:38:02.336592+0000","last_clean":"2023-10-19T08:38:02.336592+0000","last_became_active":"2023-10-19T08:37:57.297038+0000","last_became_peered":"2023-10-19T08:37:57.297038+0000","last_unstale":"2023-10-19T08:38:02.336592+0000","last_undegraded":"2023-10-19T08:38:02.336592+0000","last_fullsized":"2023-10-19T08:38:02.336592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:52.465054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337263+0000","last_change":"2023-10-19T08:37:57.283306+0000","last_active":"2023-10-19T08:38:02.337263+0000","last_peered":"2023-10-19T08:38:02.337263+0000","last_clean":"2023-10-19T08:38:02.337263+0000","last_became_active":"2023-10-19T08:37:57.282978+0000","last_became_peered":"2023-10-19T08:37:57.282978+0000","last_unstale":"2023-10-19T08:38:02.337263+0000","last_undegraded":"2023-10-19T08:38:02.337263+0000","last_fullsized":"2023-10-19T08:38:02.337263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:30.738229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337108+0000","last_change":"2023-10-19T08:37:57.280269+0000","last_active":"2023-10-19T08:38:02.337108+0000","last_peered":"2023-10-19T08:38:02.337108+0000","last_clean":"2023-10-19T08:38:02.337108+0000","last_became_active":"2023-10-19T08:37:57.279940+0000","last_became_peered":"2023-10-19T08:37:57.279940+0000","last_unstale":"2023-10-19T08:38:02.337108+0000","last_undegraded":"2023-10-19T08:38:02.337108+0000","last_fullsized":"2023-10-19T08:38:02.337108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:40.165807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303297+0000","last_change":"2023-10-19T08:37:57.285132+0000","last_active":"2023-10-19T08:38:02.303297+0000","last_peered":"2023-10-19T08:38:02.303297+0000","last_clean":"2023-10-19T08:38:02.303297+0000","last_became_active":"2023-10-19T08:37:57.284701+0000","last_became_peered":"2023-10-19T08:37:57.284701+0000","last_unstale":"2023-10-19T08:38:02.303297+0000","last_undegraded":"2023-10-19T08:38:02.303297+0000","last_fullsized":"2023-10-19T08:38:02.303297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:16.370875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337879+0000","last_change":"2023-10-19T08:38:01.340490+0000","last_active":"2023-10-19T08:38:02.337879+0000","last_peered":"2023-10-19T08:38:02.337879+0000","last_clean":"2023-10-19T08:38:02.337879+0000","last_became_active":"2023-10-19T08:38:01.340119+0000","last_became_peered":"2023-10-19T08:38:01.340119+0000","last_unstale":"2023-10-19T08:38:02.337879+0000","last_undegraded":"2023-10-19T08:38:02.337879+0000","last_fullsized":"2023-10-19T08:38:02.337879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:28:51.111704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336413+0000","last_change":"2023-10-19T08:37:56.283885+0000","last_active":"2023-10-19T08:38:02.336413+0000","last_peered":"2023-10-19T08:38:02.336413+0000","last_clean":"2023-10-19T08:38:02.336413+0000","last_became_active":"2023-10-19T08:37:56.283591+0000","last_became_peered":"2023-10-19T08:37:56.283591+0000","last_unstale":"2023-10-19T08:38:02.336413+0000","last_undegraded":"2023-10-19T08:38:02.336413+0000","last_fullsized":"2023-10-19T08:38:02.336413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:15:58.663548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303063+0000","last_change":"2023-10-19T08:37:57.291292+0000","last_active":"2023-10-19T08:38:02.303063+0000","last_peered":"2023-10-19T08:38:02.303063+0000","last_clean":"2023-10-19T08:38:02.303063+0000","last_became_active":"2023-10-19T08:37:57.291007+0000","last_became_peered":"2023-10-19T08:37:57.291007+0000","last_unstale":"2023-10-19T08:38:02.303063+0000","last_undegraded":"2023-10-19T08:38:02.303063+0000","last_fullsized":"2023-10-19T08:38:02.303063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:48.642240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337486+0000","last_change":"2023-10-19T08:38:01.346131+0000","last_active":"2023-10-19T08:38:02.337486+0000","last_peered":"2023-10-19T08:38:02.337486+0000","last_clean":"2023-10-19T08:38:02.337486+0000","last_became_active":"2023-10-19T08:38:01.345770+0000","last_became_peered":"2023-10-19T08:38:01.345770+0000","last_unstale":"2023-10-19T08:38:02.337486+0000","last_undegraded":"2023-10-19T08:38:02.337486+0000","last_fullsized":"2023-10-19T08:38:02.337486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:36:36.064644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336120+0000","last_change":"2023-10-19T08:37:56.285233+0000","last_active":"2023-10-19T08:38:02.336120+0000","last_peered":"2023-10-19T08:38:02.336120+0000","last_clean":"2023-10-19T08:38:02.336120+0000","last_became_active":"2023-10-19T08:37:56.284954+0000","last_became_peered":"2023-10-19T08:37:56.284954+0000","last_unstale":"2023-10-19T08:38:02.336120+0000","last_undegraded":"2023-10-19T08:38:02.336120+0000","last_fullsized":"2023-10-19T08:38:02.336120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:40.083342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328472+0000","last_change":"2023-10-19T08:37:57.285760+0000","last_active":"2023-10-19T08:38:02.328472+0000","last_peered":"2023-10-19T08:38:02.328472+0000","last_clean":"2023-10-19T08:38:02.328472+0000","last_became_active":"2023-10-19T08:37:57.285420+0000","last_became_peered":"2023-10-19T08:37:57.285420+0000","last_unstale":"2023-10-19T08:38:02.328472+0000","last_undegraded":"2023-10-19T08:38:02.328472+0000","last_fullsized":"2023-10-19T08:38:02.328472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:43.028422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328649+0000","last_change":"2023-10-19T08:38:01.343224+0000","last_active":"2023-10-19T08:38:02.328649+0000","last_peered":"2023-10-19T08:38:02.328649+0000","last_clean":"2023-10-19T08:38:02.328649+0000","last_became_active":"2023-10-19T08:38:01.341932+0000","last_became_peered":"2023-10-19T08:38:01.341932+0000","last_unstale":"2023-10-19T08:38:02.328649+0000","last_undegraded":"2023-10-19T08:38:02.328649+0000","last_fullsized":"2023-10-19T08:38:02.328649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:08.237484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302526+0000","last_change":"2023-10-19T08:37:56.279221+0000","last_active":"2023-10-19T08:38:02.302526+0000","last_peered":"2023-10-19T08:38:02.302526+0000","last_clean":"2023-10-19T08:38:02.302526+0000","last_became_active":"2023-10-19T08:37:56.278945+0000","last_became_peered":"2023-10-19T08:37:56.278945+0000","last_unstale":"2023-10-19T08:38:02.302526+0000","last_undegraded":"2023-10-19T08:38:02.302526+0000","last_fullsized":"2023-10-19T08:38:02.302526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:15.152471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337264+0000","last_change":"2023-10-19T08:37:57.286458+0000","last_active":"2023-10-19T08:38:02.337264+0000","last_peered":"2023-10-19T08:38:02.337264+0000","last_clean":"2023-10-19T08:38:02.337264+0000","last_became_active":"2023-10-19T08:37:57.286202+0000","last_became_peered":"2023-10-19T08:37:57.286202+0000","last_unstale":"2023-10-19T08:38:02.337264+0000","last_undegraded":"2023-10-19T08:38:02.337264+0000","last_fullsized":"2023-10-19T08:38:02.337264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:03:17.001375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336640+0000","last_change":"2023-10-19T08:38:01.345314+0000","last_active":"2023-10-19T08:38:02.336640+0000","last_peered":"2023-10-19T08:38:02.336640+0000","last_clean":"2023-10-19T08:38:02.336640+0000","last_became_active":"2023-10-19T08:38:01.344867+0000","last_became_peered":"2023-10-19T08:38:01.344867+0000","last_unstale":"2023-10-19T08:38:02.336640+0000","last_undegraded":"2023-10-19T08:38:02.336640+0000","last_fullsized":"2023-10-19T08:38:02.336640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:14:55.301418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328589+0000","last_change":"2023-10-19T08:37:56.284935+0000","last_active":"2023-10-19T08:38:02.328589+0000","last_peered":"2023-10-19T08:38:02.328589+0000","last_clean":"2023-10-19T08:38:02.328589+0000","last_became_active":"2023-10-19T08:37:56.284622+0000","last_became_peered":"2023-10-19T08:37:56.284622+0000","last_unstale":"2023-10-19T08:38:02.328589+0000","last_undegraded":"2023-10-19T08:38:02.328589+0000","last_fullsized":"2023-10-19T08:38:02.328589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:43:07.850875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302488+0000","last_change":"2023-10-19T08:37:57.291320+0000","last_active":"2023-10-19T08:38:02.302488+0000","last_peered":"2023-10-19T08:38:02.302488+0000","last_clean":"2023-10-19T08:38:02.302488+0000","last_became_active":"2023-10-19T08:37:57.290894+0000","last_became_peered":"2023-10-19T08:37:57.290894+0000","last_unstale":"2023-10-19T08:38:02.302488+0000","last_undegraded":"2023-10-19T08:38:02.302488+0000","last_fullsized":"2023-10-19T08:38:02.302488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:30.738229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336048+0000","last_change":"2023-10-19T08:38:01.340374+0000","last_active":"2023-10-19T08:38:02.336048+0000","last_peered":"2023-10-19T08:38:02.336048+0000","last_clean":"2023-10-19T08:38:02.336048+0000","last_became_active":"2023-10-19T08:38:01.339982+0000","last_became_peered":"2023-10-19T08:38:01.339982+0000","last_unstale":"2023-10-19T08:38:02.336048+0000","last_undegraded":"2023-10-19T08:38:02.336048+0000","last_fullsized":"2023-10-19T08:38:02.336048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:06.363506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303440+0000","last_change":"2023-10-19T08:37:56.286352+0000","last_active":"2023-10-19T08:38:02.303440+0000","last_peered":"2023-10-19T08:38:02.303440+0000","last_clean":"2023-10-19T08:38:02.303440+0000","last_became_active":"2023-10-19T08:37:56.286038+0000","last_became_peered":"2023-10-19T08:37:56.286038+0000","last_unstale":"2023-10-19T08:38:02.303440+0000","last_undegraded":"2023-10-19T08:38:02.303440+0000","last_fullsized":"2023-10-19T08:38:02.303440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:47.634992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302226+0000","last_change":"2023-10-19T08:37:57.291702+0000","last_active":"2023-10-19T08:38:02.302226+0000","last_peered":"2023-10-19T08:38:02.302226+0000","last_clean":"2023-10-19T08:38:02.302226+0000","last_became_active":"2023-10-19T08:37:57.290849+0000","last_became_peered":"2023-10-19T08:37:57.290849+0000","last_unstale":"2023-10-19T08:38:02.302226+0000","last_undegraded":"2023-10-19T08:38:02.302226+0000","last_fullsized":"2023-10-19T08:38:02.302226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:43:08.858123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302757+0000","last_change":"2023-10-19T08:38:01.345973+0000","last_active":"2023-10-19T08:38:02.302757+0000","last_peered":"2023-10-19T08:38:02.302757+0000","last_clean":"2023-10-19T08:38:02.302757+0000","last_became_active":"2023-10-19T08:38:01.345569+0000","last_became_peered":"2023-10-19T08:38:01.345569+0000","last_unstale":"2023-10-19T08:38:02.302757+0000","last_undegraded":"2023-10-19T08:38:02.302757+0000","last_fullsized":"2023-10-19T08:38:02.302757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:20.424108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338312+0000","last_change":"2023-10-19T08:37:56.284648+0000","last_active":"2023-10-19T08:38:02.338312+0000","last_peered":"2023-10-19T08:38:02.338312+0000","last_clean":"2023-10-19T08:38:02.338312+0000","last_became_active":"2023-10-19T08:37:56.284377+0000","last_became_peered":"2023-10-19T08:37:56.284377+0000","last_unstale":"2023-10-19T08:38:02.338312+0000","last_undegraded":"2023-10-19T08:38:02.338312+0000","last_fullsized":"2023-10-19T08:38:02.338312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:03.177003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336475+0000","last_change":"2023-10-19T08:37:57.283545+0000","last_active":"2023-10-19T08:38:02.336475+0000","last_peered":"2023-10-19T08:38:02.336475+0000","last_clean":"2023-10-19T08:38:02.336475+0000","last_became_active":"2023-10-19T08:37:57.283287+0000","last_became_peered":"2023-10-19T08:37:57.283287+0000","last_unstale":"2023-10-19T08:38:02.336475+0000","last_undegraded":"2023-10-19T08:38:02.336475+0000","last_fullsized":"2023-10-19T08:38:02.336475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:13.404733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336264+0000","last_change":"2023-10-19T08:38:01.353317+0000","last_active":"2023-10-19T08:38:02.336264+0000","last_peered":"2023-10-19T08:38:02.336264+0000","last_clean":"2023-10-19T08:38:02.336264+0000","last_became_active":"2023-10-19T08:38:01.352964+0000","last_became_peered":"2023-10-19T08:38:01.352964+0000","last_unstale":"2023-10-19T08:38:02.336264+0000","last_undegraded":"2023-10-19T08:38:02.336264+0000","last_fullsized":"2023-10-19T08:38:02.336264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:29:16.804794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:07.165443+0000","last_change":"2023-10-19T08:37:56.285044+0000","last_active":"2023-10-19T08:38:07.165443+0000","last_peered":"2023-10-19T08:38:07.165443+0000","last_clean":"2023-10-19T08:38:07.165443+0000","last_became_active":"2023-10-19T08:37:56.284729+0000","last_became_peered":"2023-10-19T08:37:56.284729+0000","last_unstale":"2023-10-19T08:38:07.165443+0000","last_undegraded":"2023-10-19T08:38:07.165443+0000","last_fullsized":"2023-10-19T08:38:07.165443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:55:11.490980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337780+0000","last_change":"2023-10-19T08:37:57.289683+0000","last_active":"2023-10-19T08:38:02.337780+0000","last_peered":"2023-10-19T08:38:02.337780+0000","last_clean":"2023-10-19T08:38:02.337780+0000","last_became_active":"2023-10-19T08:37:57.289339+0000","last_became_peered":"2023-10-19T08:37:57.289339+0000","last_unstale":"2023-10-19T08:38:02.337780+0000","last_undegraded":"2023-10-19T08:38:02.337780+0000","last_fullsized":"2023-10-19T08:38:02.337780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:57:38.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303603+0000","last_change":"2023-10-19T08:38:01.344790+0000","last_active":"2023-10-19T08:38:02.303603+0000","last_peered":"2023-10-19T08:38:02.303603+0000","last_clean":"2023-10-19T08:38:02.303603+0000","last_became_active":"2023-10-19T08:38:01.344405+0000","last_became_peered":"2023-10-19T08:38:01.344405+0000","last_unstale":"2023-10-19T08:38:02.303603+0000","last_undegraded":"2023-10-19T08:38:02.303603+0000","last_fullsized":"2023-10-19T08:38:02.303603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:22:22.893691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338184+0000","last_change":"2023-10-19T08:37:56.286506+0000","last_active":"2023-10-19T08:38:02.338184+0000","last_peered":"2023-10-19T08:38:02.338184+0000","last_clean":"2023-10-19T08:38:02.338184+0000","last_became_active":"2023-10-19T08:37:56.286246+0000","last_became_peered":"2023-10-19T08:37:56.286246+0000","last_unstale":"2023-10-19T08:38:02.338184+0000","last_undegraded":"2023-10-19T08:38:02.338184+0000","last_fullsized":"2023-10-19T08:38:02.338184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:43:07.850875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302485+0000","last_change":"2023-10-19T08:37:57.291345+0000","last_active":"2023-10-19T08:38:02.302485+0000","last_peered":"2023-10-19T08:38:02.302485+0000","last_clean":"2023-10-19T08:38:02.302485+0000","last_became_active":"2023-10-19T08:37:57.291061+0000","last_became_peered":"2023-10-19T08:37:57.291061+0000","last_unstale":"2023-10-19T08:38:02.302485+0000","last_undegraded":"2023-10-19T08:38:02.302485+0000","last_fullsized":"2023-10-19T08:38:02.302485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:43.028422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302758+0000","last_change":"2023-10-19T08:38:01.347178+0000","last_active":"2023-10-19T08:38:02.302758+0000","last_peered":"2023-10-19T08:38:02.302758+0000","last_clean":"2023-10-19T08:38:02.302758+0000","last_became_active":"2023-10-19T08:38:01.346237+0000","last_became_peered":"2023-10-19T08:38:01.346237+0000","last_unstale":"2023-10-19T08:38:02.302758+0000","last_undegraded":"2023-10-19T08:38:02.302758+0000","last_fullsized":"2023-10-19T08:38:02.302758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:25.917329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327204+0000","last_change":"2023-10-19T08:37:56.284660+0000","last_active":"2023-10-19T08:38:02.327204+0000","last_peered":"2023-10-19T08:38:02.327204+0000","last_clean":"2023-10-19T08:38:02.327204+0000","last_became_active":"2023-10-19T08:37:56.284426+0000","last_became_peered":"2023-10-19T08:37:56.284426+0000","last_unstale":"2023-10-19T08:38:02.327204+0000","last_undegraded":"2023-10-19T08:38:02.327204+0000","last_fullsized":"2023-10-19T08:38:02.327204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:12.397484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303242+0000","last_change":"2023-10-19T08:37:57.284960+0000","last_active":"2023-10-19T08:38:02.303242+0000","last_peered":"2023-10-19T08:38:02.303242+0000","last_clean":"2023-10-19T08:38:02.303242+0000","last_became_active":"2023-10-19T08:37:57.284360+0000","last_became_peered":"2023-10-19T08:37:57.284360+0000","last_unstale":"2023-10-19T08:38:02.303242+0000","last_undegraded":"2023-10-19T08:38:02.303242+0000","last_fullsized":"2023-10-19T08:38:02.303242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:45:25.612225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303233+0000","last_change":"2023-10-19T08:38:01.346877+0000","last_active":"2023-10-19T08:38:02.303233+0000","last_peered":"2023-10-19T08:38:02.303233+0000","last_clean":"2023-10-19T08:38:02.303233+0000","last_became_active":"2023-10-19T08:38:01.346460+0000","last_became_peered":"2023-10-19T08:38:01.346460+0000","last_unstale":"2023-10-19T08:38:02.303233+0000","last_undegraded":"2023-10-19T08:38:02.303233+0000","last_fullsized":"2023-10-19T08:38:02.303233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:24:52.905240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337215+0000","last_change":"2023-10-19T08:37:56.285689+0000","last_active":"2023-10-19T08:38:02.337215+0000","last_peered":"2023-10-19T08:38:02.337215+0000","last_clean":"2023-10-19T08:38:02.337215+0000","last_became_active":"2023-10-19T08:37:56.285284+0000","last_became_peered":"2023-10-19T08:37:56.285284+0000","last_unstale":"2023-10-19T08:38:02.337215+0000","last_undegraded":"2023-10-19T08:38:02.337215+0000","last_fullsized":"2023-10-19T08:38:02.337215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:39.158559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328527+0000","last_change":"2023-10-19T08:37:57.293680+0000","last_active":"2023-10-19T08:38:02.328527+0000","last_peered":"2023-10-19T08:38:02.328527+0000","last_clean":"2023-10-19T08:38:02.328527+0000","last_became_active":"2023-10-19T08:37:57.293401+0000","last_became_peered":"2023-10-19T08:37:57.293401+0000","last_unstale":"2023-10-19T08:38:02.328527+0000","last_undegraded":"2023-10-19T08:38:02.328527+0000","last_fullsized":"2023-10-19T08:38:02.328527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:16.159720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303448+0000","last_change":"2023-10-19T08:38:01.342623+0000","last_active":"2023-10-19T08:38:02.303448+0000","last_peered":"2023-10-19T08:38:02.303448+0000","last_clean":"2023-10-19T08:38:02.303448+0000","last_became_active":"2023-10-19T08:38:01.342009+0000","last_became_peered":"2023-10-19T08:38:01.342009+0000","last_unstale":"2023-10-19T08:38:02.303448+0000","last_undegraded":"2023-10-19T08:38:02.303448+0000","last_fullsized":"2023-10-19T08:38:02.303448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:24:52.905240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336100+0000","last_change":"2023-10-19T08:37:56.281800+0000","last_active":"2023-10-19T08:38:02.336100+0000","last_peered":"2023-10-19T08:38:02.336100+0000","last_clean":"2023-10-19T08:38:02.336100+0000","last_became_active":"2023-10-19T08:37:56.281533+0000","last_became_peered":"2023-10-19T08:37:56.281533+0000","last_unstale":"2023-10-19T08:38:02.336100+0000","last_undegraded":"2023-10-19T08:38:02.336100+0000","last_fullsized":"2023-10-19T08:38:02.336100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:08:05.598870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303187+0000","last_change":"2023-10-19T08:37:57.295506+0000","last_active":"2023-10-19T08:38:02.303187+0000","last_peered":"2023-10-19T08:38:02.303187+0000","last_clean":"2023-10-19T08:38:02.303187+0000","last_became_active":"2023-10-19T08:37:57.295267+0000","last_became_peered":"2023-10-19T08:37:57.295267+0000","last_unstale":"2023-10-19T08:38:02.303187+0000","last_undegraded":"2023-10-19T08:38:02.303187+0000","last_fullsized":"2023-10-19T08:38:02.303187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:22:18.840459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337512+0000","last_change":"2023-10-19T08:38:01.349967+0000","last_active":"2023-10-19T08:38:02.337512+0000","last_peered":"2023-10-19T08:38:02.337512+0000","last_clean":"2023-10-19T08:38:02.337512+0000","last_became_active":"2023-10-19T08:38:01.349632+0000","last_became_peered":"2023-10-19T08:38:01.349632+0000","last_unstale":"2023-10-19T08:38:02.337512+0000","last_undegraded":"2023-10-19T08:38:02.337512+0000","last_fullsized":"2023-10-19T08:38:02.337512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:34.791461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338637+0000","last_change":"2023-10-19T08:37:56.287543+0000","last_active":"2023-10-19T08:38:02.338637+0000","last_peered":"2023-10-19T08:38:02.338637+0000","last_clean":"2023-10-19T08:38:02.338637+0000","last_became_active":"2023-10-19T08:37:56.287018+0000","last_became_peered":"2023-10-19T08:37:56.287018+0000","last_unstale":"2023-10-19T08:38:02.338637+0000","last_undegraded":"2023-10-19T08:38:02.338637+0000","last_fullsized":"2023-10-19T08:38:02.338637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:47.634992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302382+0000","last_change":"2023-10-19T08:37:57.289156+0000","last_active":"2023-10-19T08:38:02.302382+0000","last_peered":"2023-10-19T08:38:02.302382+0000","last_clean":"2023-10-19T08:38:02.302382+0000","last_became_active":"2023-10-19T08:37:57.288736+0000","last_became_peered":"2023-10-19T08:37:57.288736+0000","last_unstale":"2023-10-19T08:38:02.302382+0000","last_undegraded":"2023-10-19T08:38:02.302382+0000","last_fullsized":"2023-10-19T08:38:02.302382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:02.310273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.335829+0000","last_change":"2023-10-19T08:38:01.332463+0000","last_active":"2023-10-19T08:38:02.335829+0000","last_peered":"2023-10-19T08:38:02.335829+0000","last_clean":"2023-10-19T08:38:02.335829+0000","last_became_active":"2023-10-19T08:38:01.330857+0000","last_became_peered":"2023-10-19T08:38:01.330857+0000","last_unstale":"2023-10-19T08:38:02.335829+0000","last_undegraded":"2023-10-19T08:38:02.335829+0000","last_fullsized":"2023-10-19T08:38:02.335829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:27:27.393059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338367+0000","last_change":"2023-10-19T08:37:56.285623+0000","last_active":"2023-10-19T08:38:02.338367+0000","last_peered":"2023-10-19T08:38:02.338367+0000","last_clean":"2023-10-19T08:38:02.338367+0000","last_became_active":"2023-10-19T08:37:56.285324+0000","last_became_peered":"2023-10-19T08:37:56.285324+0000","last_unstale":"2023-10-19T08:38:02.338367+0000","last_undegraded":"2023-10-19T08:38:02.338367+0000","last_fullsized":"2023-10-19T08:38:02.338367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:58:27.340847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336799+0000","last_change":"2023-10-19T08:37:57.283094+0000","last_active":"2023-10-19T08:38:02.336799+0000","last_peered":"2023-10-19T08:38:02.336799+0000","last_clean":"2023-10-19T08:38:02.336799+0000","last_became_active":"2023-10-19T08:37:57.282824+0000","last_became_peered":"2023-10-19T08:37:57.282824+0000","last_unstale":"2023-10-19T08:38:02.336799+0000","last_undegraded":"2023-10-19T08:38:02.336799+0000","last_fullsized":"2023-10-19T08:38:02.336799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:23:48.860817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336247+0000","last_change":"2023-10-19T08:38:01.331969+0000","last_active":"2023-10-19T08:38:02.336247+0000","last_peered":"2023-10-19T08:38:02.336247+0000","last_clean":"2023-10-19T08:38:02.336247+0000","last_became_active":"2023-10-19T08:38:01.331538+0000","last_became_peered":"2023-10-19T08:38:01.331538+0000","last_unstale":"2023-10-19T08:38:02.336247+0000","last_undegraded":"2023-10-19T08:38:02.336247+0000","last_fullsized":"2023-10-19T08:38:02.336247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:19:38.947409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338570+0000","last_change":"2023-10-19T08:37:56.287547+0000","last_active":"2023-10-19T08:38:02.338570+0000","last_peered":"2023-10-19T08:38:02.338570+0000","last_clean":"2023-10-19T08:38:02.338570+0000","last_became_active":"2023-10-19T08:37:56.287249+0000","last_became_peered":"2023-10-19T08:37:56.287249+0000","last_unstale":"2023-10-19T08:38:02.338570+0000","last_undegraded":"2023-10-19T08:38:02.338570+0000","last_fullsized":"2023-10-19T08:38:02.338570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:24:47.844759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336329+0000","last_change":"2023-10-19T08:37:57.282999+0000","last_active":"2023-10-19T08:38:02.336329+0000","last_peered":"2023-10-19T08:38:02.336329+0000","last_clean":"2023-10-19T08:38:02.336329+0000","last_became_active":"2023-10-19T08:37:57.282689+0000","last_became_peered":"2023-10-19T08:37:57.282689+0000","last_unstale":"2023-10-19T08:38:02.336329+0000","last_undegraded":"2023-10-19T08:38:02.336329+0000","last_fullsized":"2023-10-19T08:38:02.336329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:07:15.629005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336395+0000","last_change":"2023-10-19T08:38:01.346058+0000","last_active":"2023-10-19T08:38:02.336395+0000","last_peered":"2023-10-19T08:38:02.336395+0000","last_clean":"2023-10-19T08:38:02.336395+0000","last_became_active":"2023-10-19T08:38:01.345734+0000","last_became_peered":"2023-10-19T08:38:01.345734+0000","last_unstale":"2023-10-19T08:38:02.336395+0000","last_undegraded":"2023-10-19T08:38:02.336395+0000","last_fullsized":"2023-10-19T08:38:02.336395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:24:06.589136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302825+0000","last_change":"2023-10-19T08:37:56.281540+0000","last_active":"2023-10-19T08:38:02.302825+0000","last_peered":"2023-10-19T08:38:02.302825+0000","last_clean":"2023-10-19T08:38:02.302825+0000","last_became_active":"2023-10-19T08:37:56.281201+0000","last_became_peered":"2023-10-19T08:37:56.281201+0000","last_unstale":"2023-10-19T08:38:02.302825+0000","last_undegraded":"2023-10-19T08:38:02.302825+0000","last_fullsized":"2023-10-19T08:38:02.302825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:40.083342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328158+0000","last_change":"2023-10-19T08:37:57.281817+0000","last_active":"2023-10-19T08:38:02.328158+0000","last_peered":"2023-10-19T08:38:02.328158+0000","last_clean":"2023-10-19T08:38:02.328158+0000","last_became_active":"2023-10-19T08:37:57.281565+0000","last_became_peered":"2023-10-19T08:37:57.281565+0000","last_unstale":"2023-10-19T08:38:02.328158+0000","last_undegraded":"2023-10-19T08:38:02.328158+0000","last_fullsized":"2023-10-19T08:38:02.328158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:41.090590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336532+0000","last_change":"2023-10-19T08:38:01.334333+0000","last_active":"2023-10-19T08:38:02.336532+0000","last_peered":"2023-10-19T08:38:02.336532+0000","last_clean":"2023-10-19T08:38:02.336532+0000","last_became_active":"2023-10-19T08:38:01.333865+0000","last_became_peered":"2023-10-19T08:38:01.333865+0000","last_unstale":"2023-10-19T08:38:02.336532+0000","last_undegraded":"2023-10-19T08:38:02.336532+0000","last_fullsized":"2023-10-19T08:38:02.336532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:34:35.198286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302576+0000","last_change":"2023-10-19T08:37:56.281808+0000","last_active":"2023-10-19T08:38:02.302576+0000","last_peered":"2023-10-19T08:38:02.302576+0000","last_clean":"2023-10-19T08:38:02.302576+0000","last_became_active":"2023-10-19T08:37:56.281530+0000","last_became_peered":"2023-10-19T08:37:56.281530+0000","last_unstale":"2023-10-19T08:38:02.302576+0000","last_undegraded":"2023-10-19T08:38:02.302576+0000","last_fullsized":"2023-10-19T08:38:02.302576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:03.177003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337444+0000","last_change":"2023-10-19T08:37:57.291709+0000","last_active":"2023-10-19T08:38:02.337444+0000","last_peered":"2023-10-19T08:38:02.337444+0000","last_clean":"2023-10-19T08:38:02.337444+0000","last_became_active":"2023-10-19T08:37:57.291449+0000","last_became_peered":"2023-10-19T08:37:57.291449+0000","last_unstale":"2023-10-19T08:38:02.337444+0000","last_undegraded":"2023-10-19T08:38:02.337444+0000","last_fullsized":"2023-10-19T08:38:02.337444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:44:52.511554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336558+0000","last_change":"2023-10-19T08:38:01.347589+0000","last_active":"2023-10-19T08:38:02.336558+0000","last_peered":"2023-10-19T08:38:02.336558+0000","last_clean":"2023-10-19T08:38:02.336558+0000","last_became_active":"2023-10-19T08:38:01.347219+0000","last_became_peered":"2023-10-19T08:38:01.347219+0000","last_unstale":"2023-10-19T08:38:02.336558+0000","last_undegraded":"2023-10-19T08:38:02.336558+0000","last_fullsized":"2023-10-19T08:38:02.336558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:57:30.612083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336383+0000","last_change":"2023-10-19T08:37:56.280035+0000","last_active":"2023-10-19T08:38:02.336383+0000","last_peered":"2023-10-19T08:38:02.336383+0000","last_clean":"2023-10-19T08:38:02.336383+0000","last_became_active":"2023-10-19T08:37:56.279742+0000","last_became_peered":"2023-10-19T08:37:56.279742+0000","last_unstale":"2023-10-19T08:38:02.336383+0000","last_undegraded":"2023-10-19T08:38:02.336383+0000","last_fullsized":"2023-10-19T08:38:02.336383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:21:53.831892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338051+0000","last_change":"2023-10-19T08:37:57.286021+0000","last_active":"2023-10-19T08:38:02.338051+0000","last_peered":"2023-10-19T08:38:02.338051+0000","last_clean":"2023-10-19T08:38:02.338051+0000","last_became_active":"2023-10-19T08:37:57.285166+0000","last_became_peered":"2023-10-19T08:37:57.285166+0000","last_unstale":"2023-10-19T08:38:02.338051+0000","last_undegraded":"2023-10-19T08:38:02.338051+0000","last_fullsized":"2023-10-19T08:38:02.338051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:59:24.110607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303417+0000","last_change":"2023-10-19T08:38:01.342875+0000","last_active":"2023-10-19T08:38:02.303417+0000","last_peered":"2023-10-19T08:38:02.303417+0000","last_clean":"2023-10-19T08:38:02.303417+0000","last_became_active":"2023-10-19T08:38:01.341788+0000","last_became_peered":"2023-10-19T08:38:01.341788+0000","last_unstale":"2023-10-19T08:38:02.303417+0000","last_undegraded":"2023-10-19T08:38:02.303417+0000","last_fullsized":"2023-10-19T08:38:02.303417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:58:32.401327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336598+0000","last_change":"2023-10-19T08:37:56.283990+0000","last_active":"2023-10-19T08:38:02.336598+0000","last_peered":"2023-10-19T08:38:02.336598+0000","last_clean":"2023-10-19T08:38:02.336598+0000","last_became_active":"2023-10-19T08:37:56.283678+0000","last_became_peered":"2023-10-19T08:37:56.283678+0000","last_unstale":"2023-10-19T08:38:02.336598+0000","last_undegraded":"2023-10-19T08:38:02.336598+0000","last_fullsized":"2023-10-19T08:38:02.336598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:33:10.909410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338725+0000","last_change":"2023-10-19T08:37:57.289730+0000","last_active":"2023-10-19T08:38:02.338725+0000","last_peered":"2023-10-19T08:38:02.338725+0000","last_clean":"2023-10-19T08:38:02.338725+0000","last_became_active":"2023-10-19T08:37:57.289411+0000","last_became_peered":"2023-10-19T08:37:57.289411+0000","last_unstale":"2023-10-19T08:38:02.338725+0000","last_undegraded":"2023-10-19T08:38:02.338725+0000","last_fullsized":"2023-10-19T08:38:02.338725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:55:07.829465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338629+0000","last_change":"2023-10-19T08:38:01.341111+0000","last_active":"2023-10-19T08:38:02.338629+0000","last_peered":"2023-10-19T08:38:02.338629+0000","last_clean":"2023-10-19T08:38:02.338629+0000","last_became_active":"2023-10-19T08:38:01.340717+0000","last_became_peered":"2023-10-19T08:38:01.340717+0000","last_unstale":"2023-10-19T08:38:02.338629+0000","last_undegraded":"2023-10-19T08:38:02.338629+0000","last_fullsized":"2023-10-19T08:38:02.338629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:04:48.063590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302334+0000","last_change":"2023-10-19T08:37:56.286850+0000","last_active":"2023-10-19T08:38:02.302334+0000","last_peered":"2023-10-19T08:38:02.302334+0000","last_clean":"2023-10-19T08:38:02.302334+0000","last_became_active":"2023-10-19T08:37:56.286593+0000","last_became_peered":"2023-10-19T08:37:56.286593+0000","last_unstale":"2023-10-19T08:38:02.302334+0000","last_undegraded":"2023-10-19T08:38:02.302334+0000","last_fullsized":"2023-10-19T08:38:02.302334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:22.553042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337352+0000","last_change":"2023-10-19T08:37:57.296081+0000","last_active":"2023-10-19T08:38:02.337352+0000","last_peered":"2023-10-19T08:38:02.337352+0000","last_clean":"2023-10-19T08:38:02.337352+0000","last_became_active":"2023-10-19T08:37:57.295834+0000","last_became_peered":"2023-10-19T08:37:57.295834+0000","last_unstale":"2023-10-19T08:38:02.337352+0000","last_undegraded":"2023-10-19T08:38:02.337352+0000","last_fullsized":"2023-10-19T08:38:02.337352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:16.159720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327643+0000","last_change":"2023-10-19T08:38:01.344908+0000","last_active":"2023-10-19T08:38:02.327643+0000","last_peered":"2023-10-19T08:38:02.327643+0000","last_clean":"2023-10-19T08:38:02.327643+0000","last_became_active":"2023-10-19T08:38:01.342061+0000","last_became_peered":"2023-10-19T08:38:01.342061+0000","last_unstale":"2023-10-19T08:38:02.327643+0000","last_undegraded":"2023-10-19T08:38:02.327643+0000","last_fullsized":"2023-10-19T08:38:02.327643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:58:38.199370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336703+0000","last_change":"2023-10-19T08:37:51.153209+0000","last_active":"2023-10-19T08:38:02.336703+0000","last_peered":"2023-10-19T08:38:02.336703+0000","last_clean":"2023-10-19T08:38:02.336703+0000","last_became_active":"2023-10-19T08:37:51.152844+0000","last_became_peered":"2023-10-19T08:37:51.152844+0000","last_unstale":"2023-10-19T08:38:02.336703+0000","last_undegraded":"2023-10-19T08:38:02.336703+0000","last_fullsized":"2023-10-19T08:38:02.336703+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:58:27.990585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303140+0000","last_change":"2023-10-19T08:37:56.283202+0000","last_active":"2023-10-19T08:38:02.303140+0000","last_peered":"2023-10-19T08:38:02.303140+0000","last_clean":"2023-10-19T08:38:02.303140+0000","last_became_active":"2023-10-19T08:37:56.282930+0000","last_became_peered":"2023-10-19T08:37:56.282930+0000","last_unstale":"2023-10-19T08:38:02.303140+0000","last_undegraded":"2023-10-19T08:38:02.303140+0000","last_fullsized":"2023-10-19T08:38:02.303140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:43:07.850875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336384+0000","last_change":"2023-10-19T08:37:57.273005+0000","last_active":"2023-10-19T08:38:02.336384+0000","last_peered":"2023-10-19T08:38:02.336384+0000","last_clean":"2023-10-19T08:38:02.336384+0000","last_became_active":"2023-10-19T08:37:57.272159+0000","last_became_peered":"2023-10-19T08:37:57.272159+0000","last_unstale":"2023-10-19T08:38:02.336384+0000","last_undegraded":"2023-10-19T08:38:02.336384+0000","last_fullsized":"2023-10-19T08:38:02.336384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:49.381912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327478+0000","last_change":"2023-10-19T08:38:01.342853+0000","last_active":"2023-10-19T08:38:02.327478+0000","last_peered":"2023-10-19T08:38:02.327478+0000","last_clean":"2023-10-19T08:38:02.327478+0000","last_became_active":"2023-10-19T08:38:01.342166+0000","last_became_peered":"2023-10-19T08:38:01.342166+0000","last_unstale":"2023-10-19T08:38:02.327478+0000","last_undegraded":"2023-10-19T08:38:02.327478+0000","last_fullsized":"2023-10-19T08:38:02.327478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:50:56.650312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302902+0000","last_change":"2023-10-19T08:37:51.116743+0000","last_active":"2023-10-19T08:38:02.302902+0000","last_peered":"2023-10-19T08:38:02.302902+0000","last_clean":"2023-10-19T08:38:02.302902+0000","last_became_active":"2023-10-19T08:37:51.116511+0000","last_became_peered":"2023-10-19T08:37:51.116511+0000","last_unstale":"2023-10-19T08:38:02.302902+0000","last_undegraded":"2023-10-19T08:38:02.302902+0000","last_fullsized":"2023-10-19T08:38:02.302902+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:36.872869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337533+0000","last_change":"2023-10-19T08:37:56.280470+0000","last_active":"2023-10-19T08:38:02.337533+0000","last_peered":"2023-10-19T08:38:02.337533+0000","last_clean":"2023-10-19T08:38:02.337533+0000","last_became_active":"2023-10-19T08:37:56.280178+0000","last_became_peered":"2023-10-19T08:37:56.280178+0000","last_unstale":"2023-10-19T08:38:02.337533+0000","last_undegraded":"2023-10-19T08:38:02.337533+0000","last_fullsized":"2023-10-19T08:38:02.337533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:58:02.145386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336644+0000","last_change":"2023-10-19T08:37:57.283444+0000","last_active":"2023-10-19T08:38:02.336644+0000","last_peered":"2023-10-19T08:38:02.336644+0000","last_clean":"2023-10-19T08:38:02.336644+0000","last_became_active":"2023-10-19T08:37:57.283153+0000","last_became_peered":"2023-10-19T08:37:57.283153+0000","last_unstale":"2023-10-19T08:38:02.336644+0000","last_undegraded":"2023-10-19T08:38:02.336644+0000","last_fullsized":"2023-10-19T08:38:02.336644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:50:52.597080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336583+0000","last_change":"2023-10-19T08:38:01.342565+0000","last_active":"2023-10-19T08:38:02.336583+0000","last_peered":"2023-10-19T08:38:02.336583+0000","last_clean":"2023-10-19T08:38:02.336583+0000","last_became_active":"2023-10-19T08:38:01.341889+0000","last_became_peered":"2023-10-19T08:38:01.341889+0000","last_unstale":"2023-10-19T08:38:02.336583+0000","last_undegraded":"2023-10-19T08:38:02.336583+0000","last_fullsized":"2023-10-19T08:38:02.336583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:02:48.585528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336488+0000","last_change":"2023-10-19T08:37:51.114782+0000","last_active":"2023-10-19T08:38:02.336488+0000","last_peered":"2023-10-19T08:38:02.336488+0000","last_clean":"2023-10-19T08:38:02.336488+0000","last_became_active":"2023-10-19T08:37:51.114388+0000","last_became_peered":"2023-10-19T08:37:51.114388+0000","last_unstale":"2023-10-19T08:38:02.336488+0000","last_undegraded":"2023-10-19T08:38:02.336488+0000","last_fullsized":"2023-10-19T08:38:02.336488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:36:18.887665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.335983+0000","last_change":"2023-10-19T08:37:56.283345+0000","last_active":"2023-10-19T08:38:02.335983+0000","last_peered":"2023-10-19T08:38:02.335983+0000","last_clean":"2023-10-19T08:38:02.335983+0000","last_became_active":"2023-10-19T08:37:56.283066+0000","last_became_peered":"2023-10-19T08:37:56.283066+0000","last_unstale":"2023-10-19T08:38:02.335983+0000","last_undegraded":"2023-10-19T08:38:02.335983+0000","last_fullsized":"2023-10-19T08:38:02.335983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:00:05.442442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337299+0000","last_change":"2023-10-19T08:37:57.272609+0000","last_active":"2023-10-19T08:38:02.337299+0000","last_peered":"2023-10-19T08:38:02.337299+0000","last_clean":"2023-10-19T08:38:02.337299+0000","last_became_active":"2023-10-19T08:37:57.272328+0000","last_became_peered":"2023-10-19T08:37:57.272328+0000","last_unstale":"2023-10-19T08:38:02.337299+0000","last_undegraded":"2023-10-19T08:38:02.337299+0000","last_fullsized":"2023-10-19T08:38:02.337299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:09.106701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338110+0000","last_change":"2023-10-19T08:38:01.350479+0000","last_active":"2023-10-19T08:38:02.338110+0000","last_peered":"2023-10-19T08:38:02.338110+0000","last_clean":"2023-10-19T08:38:02.338110+0000","last_became_active":"2023-10-19T08:38:01.350030+0000","last_became_peered":"2023-10-19T08:38:01.350030+0000","last_unstale":"2023-10-19T08:38:02.338110+0000","last_undegraded":"2023-10-19T08:38:02.338110+0000","last_fullsized":"2023-10-19T08:38:02.338110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:20.212952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302863+0000","last_change":"2023-10-19T08:37:51.115141+0000","last_active":"2023-10-19T08:38:02.302863+0000","last_peered":"2023-10-19T08:38:02.302863+0000","last_clean":"2023-10-19T08:38:02.302863+0000","last_became_active":"2023-10-19T08:37:51.114829+0000","last_became_peered":"2023-10-19T08:37:51.114829+0000","last_unstale":"2023-10-19T08:38:02.302863+0000","last_undegraded":"2023-10-19T08:38:02.302863+0000","last_fullsized":"2023-10-19T08:38:02.302863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:34.010255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336533+0000","last_change":"2023-10-19T08:37:51.153453+0000","last_active":"2023-10-19T08:38:02.336533+0000","last_peered":"2023-10-19T08:38:02.336533+0000","last_clean":"2023-10-19T08:38:02.336533+0000","last_became_active":"2023-10-19T08:37:51.153093+0000","last_became_peered":"2023-10-19T08:37:51.153093+0000","last_unstale":"2023-10-19T08:38:02.336533+0000","last_undegraded":"2023-10-19T08:38:02.336533+0000","last_fullsized":"2023-10-19T08:38:02.336533+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:17.404738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302485+0000","last_change":"2023-10-19T08:37:56.285142+0000","last_active":"2023-10-19T08:38:02.302485+0000","last_peered":"2023-10-19T08:38:02.302485+0000","last_clean":"2023-10-19T08:38:02.302485+0000","last_became_active":"2023-10-19T08:37:56.284717+0000","last_became_peered":"2023-10-19T08:37:56.284717+0000","last_unstale":"2023-10-19T08:38:02.302485+0000","last_undegraded":"2023-10-19T08:38:02.302485+0000","last_fullsized":"2023-10-19T08:38:02.302485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:08.099452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337159+0000","last_change":"2023-10-19T08:37:57.287714+0000","last_active":"2023-10-19T08:38:02.337159+0000","last_peered":"2023-10-19T08:38:02.337159+0000","last_clean":"2023-10-19T08:38:02.337159+0000","last_became_active":"2023-10-19T08:37:57.287427+0000","last_became_peered":"2023-10-19T08:37:57.287427+0000","last_unstale":"2023-10-19T08:38:02.337159+0000","last_undegraded":"2023-10-19T08:38:02.337159+0000","last_fullsized":"2023-10-19T08:38:02.337159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:55:59.475158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303093+0000","last_change":"2023-10-19T08:38:01.343223+0000","last_active":"2023-10-19T08:38:02.303093+0000","last_peered":"2023-10-19T08:38:02.303093+0000","last_clean":"2023-10-19T08:38:02.303093+0000","last_became_active":"2023-10-19T08:38:01.342425+0000","last_became_peered":"2023-10-19T08:38:01.342425+0000","last_unstale":"2023-10-19T08:38:02.303093+0000","last_undegraded":"2023-10-19T08:38:02.303093+0000","last_fullsized":"2023-10-19T08:38:02.303093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:13.159933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336674+0000","last_change":"2023-10-19T08:37:51.118439+0000","last_active":"2023-10-19T08:38:02.336674+0000","last_peered":"2023-10-19T08:38:02.336674+0000","last_clean":"2023-10-19T08:38:02.336674+0000","last_became_active":"2023-10-19T08:37:51.118146+0000","last_became_peered":"2023-10-19T08:37:51.118146+0000","last_unstale":"2023-10-19T08:38:02.336674+0000","last_undegraded":"2023-10-19T08:38:02.336674+0000","last_fullsized":"2023-10-19T08:38:02.336674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:34.935038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327100+0000","last_change":"2023-10-19T08:37:56.275735+0000","last_active":"2023-10-19T08:38:02.327100+0000","last_peered":"2023-10-19T08:38:02.327100+0000","last_clean":"2023-10-19T08:38:02.327100+0000","last_became_active":"2023-10-19T08:37:56.275386+0000","last_became_peered":"2023-10-19T08:37:56.275386+0000","last_unstale":"2023-10-19T08:38:02.327100+0000","last_undegraded":"2023-10-19T08:38:02.327100+0000","last_fullsized":"2023-10-19T08:38:02.327100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:48.374663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328345+0000","last_change":"2023-10-19T08:37:57.280800+0000","last_active":"2023-10-19T08:38:02.328345+0000","last_peered":"2023-10-19T08:38:02.328345+0000","last_clean":"2023-10-19T08:38:02.328345+0000","last_became_active":"2023-10-19T08:37:57.280464+0000","last_became_peered":"2023-10-19T08:37:57.280464+0000","last_unstale":"2023-10-19T08:38:02.328345+0000","last_undegraded":"2023-10-19T08:38:02.328345+0000","last_fullsized":"2023-10-19T08:38:02.328345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:21.864097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336567+0000","last_change":"2023-10-19T08:38:01.335275+0000","last_active":"2023-10-19T08:38:02.336567+0000","last_peered":"2023-10-19T08:38:02.336567+0000","last_clean":"2023-10-19T08:38:02.336567+0000","last_became_active":"2023-10-19T08:38:01.334707+0000","last_became_peered":"2023-10-19T08:38:01.334707+0000","last_unstale":"2023-10-19T08:38:02.336567+0000","last_undegraded":"2023-10-19T08:38:02.336567+0000","last_fullsized":"2023-10-19T08:38:02.336567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:03.691358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338327+0000","last_change":"2023-10-19T08:37:51.153416+0000","last_active":"2023-10-19T08:38:02.338327+0000","last_peered":"2023-10-19T08:38:02.338327+0000","last_clean":"2023-10-19T08:38:02.338327+0000","last_became_active":"2023-10-19T08:37:51.152844+0000","last_became_peered":"2023-10-19T08:37:51.152844+0000","last_unstale":"2023-10-19T08:38:02.338327+0000","last_undegraded":"2023-10-19T08:38:02.338327+0000","last_fullsized":"2023-10-19T08:38:02.338327+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:10.215323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336833+0000","last_change":"2023-10-19T08:37:56.284323+0000","last_active":"2023-10-19T08:38:02.336833+0000","last_peered":"2023-10-19T08:38:02.336833+0000","last_clean":"2023-10-19T08:38:02.336833+0000","last_became_active":"2023-10-19T08:37:56.283556+0000","last_became_peered":"2023-10-19T08:37:56.283556+0000","last_unstale":"2023-10-19T08:38:02.336833+0000","last_undegraded":"2023-10-19T08:38:02.336833+0000","last_fullsized":"2023-10-19T08:38:02.336833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:22.553042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327868+0000","last_change":"2023-10-19T08:37:57.283892+0000","last_active":"2023-10-19T08:38:02.327868+0000","last_peered":"2023-10-19T08:38:02.327868+0000","last_clean":"2023-10-19T08:38:02.327868+0000","last_became_active":"2023-10-19T08:37:57.283605+0000","last_became_peered":"2023-10-19T08:37:57.283605+0000","last_unstale":"2023-10-19T08:38:02.327868+0000","last_undegraded":"2023-10-19T08:38:02.327868+0000","last_fullsized":"2023-10-19T08:38:02.327868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:23.560291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336875+0000","last_change":"2023-10-19T08:38:01.348839+0000","last_active":"2023-10-19T08:38:02.336875+0000","last_peered":"2023-10-19T08:38:02.336875+0000","last_clean":"2023-10-19T08:38:02.336875+0000","last_became_active":"2023-10-19T08:38:01.348383+0000","last_became_peered":"2023-10-19T08:38:01.348383+0000","last_unstale":"2023-10-19T08:38:02.336875+0000","last_undegraded":"2023-10-19T08:38:02.336875+0000","last_fullsized":"2023-10-19T08:38:02.336875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:28:33.114633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303327+0000","last_change":"2023-10-19T08:37:56.285043+0000","last_active":"2023-10-19T08:38:02.303327+0000","last_peered":"2023-10-19T08:38:02.303327+0000","last_clean":"2023-10-19T08:38:02.303327+0000","last_became_active":"2023-10-19T08:37:56.284744+0000","last_became_peered":"2023-10-19T08:37:56.284744+0000","last_unstale":"2023-10-19T08:38:02.303327+0000","last_undegraded":"2023-10-19T08:38:02.303327+0000","last_fullsized":"2023-10-19T08:38:02.303327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:49.109159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336864+0000","last_change":"2023-10-19T08:37:51.124188+0000","last_active":"2023-10-19T08:38:02.336864+0000","last_peered":"2023-10-19T08:38:02.336864+0000","last_clean":"2023-10-19T08:38:02.336864+0000","last_became_active":"2023-10-19T08:37:51.123944+0000","last_became_peered":"2023-10-19T08:37:51.123944+0000","last_unstale":"2023-10-19T08:38:02.336864+0000","last_undegraded":"2023-10-19T08:38:02.336864+0000","last_fullsized":"2023-10-19T08:38:02.336864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:15.708544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302239+0000","last_change":"2023-10-19T08:37:57.292133+0000","last_active":"2023-10-19T08:38:02.302239+0000","last_peered":"2023-10-19T08:38:02.302239+0000","last_clean":"2023-10-19T08:38:02.302239+0000","last_became_active":"2023-10-19T08:37:57.291516+0000","last_became_peered":"2023-10-19T08:37:57.291516+0000","last_unstale":"2023-10-19T08:38:02.302239+0000","last_undegraded":"2023-10-19T08:38:02.302239+0000","last_fullsized":"2023-10-19T08:38:02.302239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:41.090590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302236+0000","last_change":"2023-10-19T08:38:01.346818+0000","last_active":"2023-10-19T08:38:02.302236+0000","last_peered":"2023-10-19T08:38:02.302236+0000","last_clean":"2023-10-19T08:38:02.302236+0000","last_became_active":"2023-10-19T08:38:01.346160+0000","last_became_peered":"2023-10-19T08:38:01.346160+0000","last_unstale":"2023-10-19T08:38:02.302236+0000","last_undegraded":"2023-10-19T08:38:02.302236+0000","last_fullsized":"2023-10-19T08:38:02.302236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:58:38.199370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337121+0000","last_change":"2023-10-19T08:37:52.296732+0000","last_active":"2023-10-19T08:38:02.337121+0000","last_peered":"2023-10-19T08:38:02.337121+0000","last_clean":"2023-10-19T08:38:02.337121+0000","last_became_active":"2023-10-19T08:37:52.296445+0000","last_became_peered":"2023-10-19T08:37:52.296445+0000","last_unstale":"2023-10-19T08:38:02.337121+0000","last_undegraded":"2023-10-19T08:38:02.337121+0000","last_fullsized":"2023-10-19T08:38:02.337121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:06:03.911706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328377+0000","last_change":"2023-10-19T08:37:56.284122+0000","last_active":"2023-10-19T08:38:02.328377+0000","last_peered":"2023-10-19T08:38:02.328377+0000","last_clean":"2023-10-19T08:38:02.328377+0000","last_became_active":"2023-10-19T08:37:56.283849+0000","last_became_peered":"2023-10-19T08:37:56.283849+0000","last_unstale":"2023-10-19T08:38:02.328377+0000","last_undegraded":"2023-10-19T08:38:02.328377+0000","last_fullsized":"2023-10-19T08:38:02.328377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:39.158559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336659+0000","last_change":"2023-10-19T08:37:57.285543+0000","last_active":"2023-10-19T08:38:02.336659+0000","last_peered":"2023-10-19T08:38:02.336659+0000","last_clean":"2023-10-19T08:38:02.336659+0000","last_became_active":"2023-10-19T08:37:57.284966+0000","last_became_peered":"2023-10-19T08:37:57.284966+0000","last_unstale":"2023-10-19T08:38:02.336659+0000","last_undegraded":"2023-10-19T08:38:02.336659+0000","last_fullsized":"2023-10-19T08:38:02.336659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:07:16.162389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336877+0000","last_change":"2023-10-19T08:38:01.351967+0000","last_active":"2023-10-19T08:38:02.336877+0000","last_peered":"2023-10-19T08:38:02.336877+0000","last_clean":"2023-10-19T08:38:02.336877+0000","last_became_active":"2023-10-19T08:38:01.351672+0000","last_became_peered":"2023-10-19T08:38:01.351672+0000","last_unstale":"2023-10-19T08:38:02.336877+0000","last_undegraded":"2023-10-19T08:38:02.336877+0000","last_fullsized":"2023-10-19T08:38:02.336877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:56.518286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327742+0000","last_change":"2023-10-19T08:37:56.276005+0000","last_active":"2023-10-19T08:38:02.327742+0000","last_peered":"2023-10-19T08:38:02.327742+0000","last_clean":"2023-10-19T08:38:02.327742+0000","last_became_active":"2023-10-19T08:37:56.275738+0000","last_became_peered":"2023-10-19T08:37:56.275738+0000","last_unstale":"2023-10-19T08:38:02.327742+0000","last_undegraded":"2023-10-19T08:38:02.327742+0000","last_fullsized":"2023-10-19T08:38:02.327742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:01.303025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336641+0000","last_change":"2023-10-19T08:37:57.282141+0000","last_active":"2023-10-19T08:38:02.336641+0000","last_peered":"2023-10-19T08:38:02.336641+0000","last_clean":"2023-10-19T08:38:02.336641+0000","last_became_active":"2023-10-19T08:37:57.281854+0000","last_became_peered":"2023-10-19T08:37:57.281854+0000","last_unstale":"2023-10-19T08:38:02.336641+0000","last_undegraded":"2023-10-19T08:38:02.336641+0000","last_fullsized":"2023-10-19T08:38:02.336641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:08:06.606119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337880+0000","last_change":"2023-10-19T08:38:01.345085+0000","last_active":"2023-10-19T08:38:02.337880+0000","last_peered":"2023-10-19T08:38:02.337880+0000","last_clean":"2023-10-19T08:38:02.337880+0000","last_became_active":"2023-10-19T08:38:01.344682+0000","last_became_peered":"2023-10-19T08:38:01.344682+0000","last_unstale":"2023-10-19T08:38:02.337880+0000","last_undegraded":"2023-10-19T08:38:02.337880+0000","last_fullsized":"2023-10-19T08:38:02.337880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:13.159933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302932+0000","last_change":"2023-10-19T08:37:56.279226+0000","last_active":"2023-10-19T08:38:02.302932+0000","last_peered":"2023-10-19T08:38:02.302932+0000","last_clean":"2023-10-19T08:38:02.302932+0000","last_became_active":"2023-10-19T08:37:56.278922+0000","last_became_peered":"2023-10-19T08:37:56.278922+0000","last_unstale":"2023-10-19T08:38:02.302932+0000","last_undegraded":"2023-10-19T08:38:02.302932+0000","last_fullsized":"2023-10-19T08:38:02.302932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:29.730980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337314+0000","last_change":"2023-10-19T08:37:57.295005+0000","last_active":"2023-10-19T08:38:02.337314+0000","last_peered":"2023-10-19T08:38:02.337314+0000","last_clean":"2023-10-19T08:38:02.337314+0000","last_became_active":"2023-10-19T08:37:57.294608+0000","last_became_peered":"2023-10-19T08:37:57.294608+0000","last_unstale":"2023-10-19T08:38:02.337314+0000","last_undegraded":"2023-10-19T08:38:02.337314+0000","last_fullsized":"2023-10-19T08:38:02.337314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:49:06.947549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302938+0000","last_change":"2023-10-19T08:38:01.340671+0000","last_active":"2023-10-19T08:38:02.302938+0000","last_peered":"2023-10-19T08:38:02.302938+0000","last_clean":"2023-10-19T08:38:02.302938+0000","last_became_active":"2023-10-19T08:38:01.340227+0000","last_became_peered":"2023-10-19T08:38:01.340227+0000","last_unstale":"2023-10-19T08:38:02.302938+0000","last_undegraded":"2023-10-19T08:38:02.302938+0000","last_fullsized":"2023-10-19T08:38:02.302938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:25.917329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303068+0000","last_change":"2023-10-19T08:37:56.279662+0000","last_active":"2023-10-19T08:38:02.303068+0000","last_peered":"2023-10-19T08:38:02.303068+0000","last_clean":"2023-10-19T08:38:02.303068+0000","last_became_active":"2023-10-19T08:37:56.279082+0000","last_became_peered":"2023-10-19T08:37:56.279082+0000","last_unstale":"2023-10-19T08:38:02.303068+0000","last_undegraded":"2023-10-19T08:38:02.303068+0000","last_fullsized":"2023-10-19T08:38:02.303068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:15.152471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336105+0000","last_change":"2023-10-19T08:37:57.291366+0000","last_active":"2023-10-19T08:38:02.336105+0000","last_peered":"2023-10-19T08:38:02.336105+0000","last_clean":"2023-10-19T08:38:02.336105+0000","last_became_active":"2023-10-19T08:37:57.291122+0000","last_became_peered":"2023-10-19T08:37:57.291122+0000","last_unstale":"2023-10-19T08:38:02.336105+0000","last_undegraded":"2023-10-19T08:38:02.336105+0000","last_fullsized":"2023-10-19T08:38:02.336105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:10:57.605170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336071+0000","last_change":"2023-10-19T08:38:01.343824+0000","last_active":"2023-10-19T08:38:02.336071+0000","last_peered":"2023-10-19T08:38:02.336071+0000","last_clean":"2023-10-19T08:38:02.336071+0000","last_became_active":"2023-10-19T08:38:01.343411+0000","last_became_peered":"2023-10-19T08:38:01.343411+0000","last_unstale":"2023-10-19T08:38:02.336071+0000","last_undegraded":"2023-10-19T08:38:02.336071+0000","last_fullsized":"2023-10-19T08:38:02.336071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:18:50.610592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302995+0000","last_change":"2023-10-19T08:37:56.279882+0000","last_active":"2023-10-19T08:38:02.302995+0000","last_peered":"2023-10-19T08:38:02.302995+0000","last_clean":"2023-10-19T08:38:02.302995+0000","last_became_active":"2023-10-19T08:37:56.279620+0000","last_became_peered":"2023-10-19T08:37:56.279620+0000","last_unstale":"2023-10-19T08:38:02.302995+0000","last_undegraded":"2023-10-19T08:38:02.302995+0000","last_fullsized":"2023-10-19T08:38:02.302995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:58:27.340847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302471+0000","last_change":"2023-10-19T08:37:57.291911+0000","last_active":"2023-10-19T08:38:02.302471+0000","last_peered":"2023-10-19T08:38:02.302471+0000","last_clean":"2023-10-19T08:38:02.302471+0000","last_became_active":"2023-10-19T08:37:57.291157+0000","last_became_peered":"2023-10-19T08:37:57.291157+0000","last_unstale":"2023-10-19T08:38:02.302471+0000","last_undegraded":"2023-10-19T08:38:02.302471+0000","last_fullsized":"2023-10-19T08:38:02.302471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:40.165807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337238+0000","last_change":"2023-10-19T08:38:01.350894+0000","last_active":"2023-10-19T08:38:02.337238+0000","last_peered":"2023-10-19T08:38:02.337238+0000","last_clean":"2023-10-19T08:38:02.337238+0000","last_became_active":"2023-10-19T08:38:01.347794+0000","last_became_peered":"2023-10-19T08:38:01.347794+0000","last_unstale":"2023-10-19T08:38:02.337238+0000","last_undegraded":"2023-10-19T08:38:02.337238+0000","last_fullsized":"2023-10-19T08:38:02.337238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:47.081654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328719+0000","last_change":"2023-10-19T08:37:56.285044+0000","last_active":"2023-10-19T08:38:02.328719+0000","last_peered":"2023-10-19T08:38:02.328719+0000","last_clean":"2023-10-19T08:38:02.328719+0000","last_became_active":"2023-10-19T08:37:56.284825+0000","last_became_peered":"2023-10-19T08:37:56.284825+0000","last_unstale":"2023-10-19T08:38:02.328719+0000","last_undegraded":"2023-10-19T08:38:02.328719+0000","last_fullsized":"2023-10-19T08:38:02.328719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:15.363627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336251+0000","last_change":"2023-10-19T08:37:57.287724+0000","last_active":"2023-10-19T08:38:02.336251+0000","last_peered":"2023-10-19T08:38:02.336251+0000","last_clean":"2023-10-19T08:38:02.336251+0000","last_became_active":"2023-10-19T08:37:57.287402+0000","last_became_peered":"2023-10-19T08:37:57.287402+0000","last_unstale":"2023-10-19T08:38:02.336251+0000","last_undegraded":"2023-10-19T08:38:02.336251+0000","last_fullsized":"2023-10-19T08:38:02.336251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:11:01.726937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336321+0000","last_change":"2023-10-19T08:37:57.280610+0000","last_active":"2023-10-19T08:38:02.336321+0000","last_peered":"2023-10-19T08:38:02.336321+0000","last_clean":"2023-10-19T08:38:02.336321+0000","last_became_active":"2023-10-19T08:37:57.280180+0000","last_became_peered":"2023-10-19T08:37:57.280180+0000","last_unstale":"2023-10-19T08:38:02.336321+0000","last_undegraded":"2023-10-19T08:38:02.336321+0000","last_fullsized":"2023-10-19T08:38:02.336321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:50:11.458306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302739+0000","last_change":"2023-10-19T08:37:57.292317+0000","last_active":"2023-10-19T08:38:02.302739+0000","last_peered":"2023-10-19T08:38:02.302739+0000","last_clean":"2023-10-19T08:38:02.302739+0000","last_became_active":"2023-10-19T08:37:57.291863+0000","last_became_peered":"2023-10-19T08:37:57.291863+0000","last_unstale":"2023-10-19T08:38:02.302739+0000","last_undegraded":"2023-10-19T08:38:02.302739+0000","last_fullsized":"2023-10-19T08:38:02.302739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:45:25.612225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337065+0000","last_change":"2023-10-19T08:37:57.289937+0000","last_active":"2023-10-19T08:38:02.337065+0000","last_peered":"2023-10-19T08:38:02.337065+0000","last_clean":"2023-10-19T08:38:02.337065+0000","last_became_active":"2023-10-19T08:37:57.289356+0000","last_became_peered":"2023-10-19T08:37:57.289356+0000","last_unstale":"2023-10-19T08:38:02.337065+0000","last_undegraded":"2023-10-19T08:38:02.337065+0000","last_fullsized":"2023-10-19T08:38:02.337065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:46.461250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302347+0000","last_change":"2023-10-19T08:37:57.292611+0000","last_active":"2023-10-19T08:38:02.302347+0000","last_peered":"2023-10-19T08:38:02.302347+0000","last_clean":"2023-10-19T08:38:02.302347+0000","last_became_active":"2023-10-19T08:37:57.291906+0000","last_became_peered":"2023-10-19T08:37:57.291906+0000","last_unstale":"2023-10-19T08:38:02.302347+0000","last_undegraded":"2023-10-19T08:38:02.302347+0000","last_fullsized":"2023-10-19T08:38:02.302347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:52.465054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336760+0000","last_change":"2023-10-19T08:37:57.288360+0000","last_active":"2023-10-19T08:38:02.336760+0000","last_peered":"2023-10-19T08:38:02.336760+0000","last_clean":"2023-10-19T08:38:02.336760+0000","last_became_active":"2023-10-19T08:37:57.288107+0000","last_became_peered":"2023-10-19T08:37:57.288107+0000","last_unstale":"2023-10-19T08:38:02.336760+0000","last_undegraded":"2023-10-19T08:38:02.336760+0000","last_fullsized":"2023-10-19T08:38:02.336760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:02.310273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":888832,"data_stored":704558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":110132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":110132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":699721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":109148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":110222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":112669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":110784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-19T08:38:21.488 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-19T08:38:21.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.637+0000 7f76dabdb700 1 Processor -- start 2023-10-19T08:38:21.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.637+0000 7f76dabdb700 1 -- start start 2023-10-19T08:38:21.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.638+0000 7f76dabdb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f76d40af170 0x7f76d40cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:21.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.638+0000 7f76dabdb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f76d40b1de0 0x7f76d40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:21.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.638+0000 7f76dabdb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d415de50 con 0x7f76d40cd800 2023-10-19T08:38:21.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.638+0000 7f76dabdb700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d40af550 con 0x7f76d40b1de0 2023-10-19T08:38:21.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.638+0000 7f76dabdb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d40b16b0 con 0x7f76d40af170 2023-10-19T08:38:21.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.638+0000 7f76d3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f76d40b1de0 0x7f76d40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:21.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.638+0000 7f76d3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f76d40b1de0 0x7f76d40b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46178/0 (socket says 172.21.15.79:46178) 2023-10-19T08:38:21.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.638+0000 7f76d3fff700 1 -- 172.21.15.79:0/2963803363 learned_addr learned my addr 172.21.15.79:0/2963803363 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:21.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.639+0000 7f76d8977700 1 --2- 172.21.15.79:0/2963803363 >> v2:172.21.15.89:3300/0 conn(0x7f76d40af170 0x7f76d40cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:21.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.639+0000 7f76d3fff700 1 -- 172.21.15.79:0/2963803363 >> v2:172.21.15.89:3300/0 conn(0x7f76d40af170 msgr2=0x7f76d40cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:21.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.639+0000 7f76d3fff700 1 --2- 172.21.15.79:0/2963803363 >> v2:172.21.15.89:3300/0 conn(0x7f76d40af170 0x7f76d40cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.639+0000 7f76d3fff700 1 -- 172.21.15.79:0/2963803363 >> v1:172.21.15.89:6789/0 conn(0x7f76d40cd800 legacy=0x7f76d406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:21.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.639+0000 7f76d3fff700 1 -- 172.21.15.79:0/2963803363 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d415e130 con 0x7f76d40b1de0 2023-10-19T08:38:21.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.639+0000 7f76d3fff700 1 --2- 172.21.15.79:0/2963803363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d40b1de0 0x7f76d40b2270 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f76c00098f0 tx=0x7f76c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d7a63a18691110 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:21.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.639+0000 7f76d37fe700 1 -- 172.21.15.79:0/2963803363 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c0004230 con 0x7f76d40b1de0 2023-10-19T08:38:21.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.639+0000 7f76d37fe700 1 -- 172.21.15.79:0/2963803363 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c0004390 con 0x7f76d40b1de0 2023-10-19T08:38:21.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.639+0000 7f76d37fe700 1 -- 172.21.15.79:0/2963803363 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c00036a0 con 0x7f76d40b1de0 2023-10-19T08:38:21.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.639+0000 7f76dabdb700 1 -- 172.21.15.79:0/2963803363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d40b1de0 msgr2=0x7f76d40b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:21.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.639+0000 7f76dabdb700 1 --2- 172.21.15.79:0/2963803363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d40b1de0 0x7f76d40b2270 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f76c00098f0 tx=0x7f76c0009c00 comp rx=0 tx=0).stop 2023-10-19T08:38:21.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.639+0000 7f76dabdb700 1 -- 172.21.15.79:0/2963803363 shutdown_connections 2023-10-19T08:38:21.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.640+0000 7f76dabdb700 1 --2- 172.21.15.79:0/2963803363 >> v2:172.21.15.89:3300/0 conn(0x7f76d40af170 0x7f76d40cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.640+0000 7f76dabdb700 1 --2- 172.21.15.79:0/2963803363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d40b1de0 0x7f76d40b2270 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.640+0000 7f76dabdb700 1 -- 172.21.15.79:0/2963803363 >> 172.21.15.79:0/2963803363 conn(0x7f76d406dcc0 msgr2=0x7f76d406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:21.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.640+0000 7f76dabdb700 1 -- 172.21.15.79:0/2963803363 shutdown_connections 2023-10-19T08:38:21.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.640+0000 7f76dabdb700 1 -- 172.21.15.79:0/2963803363 wait complete. 2023-10-19T08:38:21.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.641+0000 7f76dabdb700 1 Processor -- start 2023-10-19T08:38:21.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.641+0000 7f76dabdb700 1 -- start start 2023-10-19T08:38:21.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.642+0000 7f76dabdb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d40af170 0x7f76d40c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:21.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.642+0000 7f76dabdb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76d40b1de0 0x7f76d40ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:21.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.642+0000 7f76dabdb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76d40cd800 0x7f76d40af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:21.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.642+0000 7f76dabdb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d40b2d10 con 0x7f76d40af170 2023-10-19T08:38:21.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.642+0000 7f76dabdb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d40b2ff0 con 0x7f76d40cd800 2023-10-19T08:38:21.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.642+0000 7f76dabdb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d40b32d0 con 0x7f76d40b1de0 2023-10-19T08:38:21.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.642+0000 7f76d8977700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d40af170 0x7f76d40c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:21.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.642+0000 7f76d8977700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d40af170 0x7f76d40c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46182/0 (socket says 172.21.15.79:46182) 2023-10-19T08:38:21.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.642+0000 7f76d8977700 1 -- 172.21.15.79:0/1478023217 learned_addr learned my addr 172.21.15.79:0/1478023217 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:21.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.642+0000 7f76d3fff700 1 --2- 172.21.15.79:0/1478023217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76d40b1de0 0x7f76d40ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:21.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.642+0000 7f76d9178700 1 --2- 172.21.15.79:0/1478023217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76d40cd800 0x7f76d40af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:21.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.643+0000 7f76d8977700 1 -- 172.21.15.79:0/1478023217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76d40b1de0 msgr2=0x7f76d40ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:21.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.643+0000 7f76d8977700 1 --2- 172.21.15.79:0/1478023217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76d40b1de0 0x7f76d40ae340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.643+0000 7f76d8977700 1 -- 172.21.15.79:0/1478023217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76d40cd800 msgr2=0x7f76d40af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:21.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.643+0000 7f76d8977700 1 --2- 172.21.15.79:0/1478023217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76d40cd800 0x7f76d40af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.643+0000 7f76d8977700 1 -- 172.21.15.79:0/1478023217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c0009550 con 0x7f76d40af170 2023-10-19T08:38:21.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.643+0000 7f76d8977700 1 --2- 172.21.15.79:0/1478023217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d40af170 0x7f76d40c8db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f76c800c7f0 tx=0x7f76c800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:21.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.643+0000 7f76d17fa700 1 -- 172.21.15.79:0/1478023217 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c8011800 con 0x7f76d40af170 2023-10-19T08:38:21.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.643+0000 7f76d17fa700 1 -- 172.21.15.79:0/1478023217 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c8011960 con 0x7f76d40af170 2023-10-19T08:38:21.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.643+0000 7f76dabdb700 1 -- 172.21.15.79:0/1478023217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d40b35b0 con 0x7f76d40af170 2023-10-19T08:38:21.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.643+0000 7f76d17fa700 1 -- 172.21.15.79:0/1478023217 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c8011cf0 con 0x7f76d40af170 2023-10-19T08:38:21.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.643+0000 7f76dabdb700 1 -- 172.21.15.79:0/1478023217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d40c92f0 con 0x7f76d40af170 2023-10-19T08:38:21.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.644+0000 7f76dabdb700 1 -- 172.21.15.79:0/1478023217 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d40ac180 con 0x7f76d40af170 2023-10-19T08:38:21.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.644+0000 7f76d17fa700 1 -- 172.21.15.79:0/1478023217 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f76c8018360 con 0x7f76d40af170 2023-10-19T08:38:21.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.645+0000 7f76d17fa700 1 --2- 172.21.15.79:0/1478023217 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f76b806a0e0 0x7f76b806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:21.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.645+0000 7f76d17fa700 1 -- 172.21.15.79:0/1478023217 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f76c80888b0 con 0x7f76d40af170 2023-10-19T08:38:21.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.645+0000 7f76d3fff700 1 --2- 172.21.15.79:0/1478023217 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f76b806a0e0 0x7f76b806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:21.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.645+0000 7f76d3fff700 1 --2- 172.21.15.79:0/1478023217 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f76b806a0e0 0x7f76b806c5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f76c0009130 tx=0x7f76c0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:21.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.649+0000 7f76d17fa700 1 -- 172.21.15.79:0/1478023217 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f76d40ac180 con 0x7f76d40af170 2023-10-19T08:38:21.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.833+0000 7f76dabdb700 1 -- 172.21.15.79:0/1478023217 --> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76d40b18c0 con 0x7f76b806a0e0 2023-10-19T08:38:21.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.842+0000 7f76d17fa700 1 -- 172.21.15.79:0/1478023217 <== mgr.4113 v2:172.21.15.79:6832/316135984 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367292 (secure 0 0 0) 0x7f76c00041d0 con 0x7f76b806a0e0 2023-10-19T08:38:21.852 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:21.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.846+0000 7f76dabdb700 1 -- 172.21.15.79:0/1478023217 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f76b806a0e0 msgr2=0x7f76b806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:21.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.846+0000 7f76dabdb700 1 --2- 172.21.15.79:0/1478023217 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f76b806a0e0 0x7f76b806c5a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f76c0009130 tx=0x7f76c0008030 comp rx=0 tx=0).stop 2023-10-19T08:38:21.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.846+0000 7f76dabdb700 1 -- 172.21.15.79:0/1478023217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d40af170 msgr2=0x7f76d40c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:21.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.846+0000 7f76dabdb700 1 --2- 172.21.15.79:0/1478023217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d40af170 0x7f76d40c8db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f76c800c7f0 tx=0x7f76c800cbb0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.846+0000 7f76dabdb700 1 -- 172.21.15.79:0/1478023217 shutdown_connections 2023-10-19T08:38:21.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.846+0000 7f76dabdb700 1 --2- 172.21.15.79:0/1478023217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76d40cd800 0x7f76d40af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.858 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.846+0000 7f76dabdb700 1 --2- 172.21.15.79:0/1478023217 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76d40af170 0x7f76d40c8db0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.846+0000 7f76dabdb700 1 --2- 172.21.15.79:0/1478023217 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f76b806a0e0 0x7f76b806c5a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.846+0000 7f76dabdb700 1 --2- 172.21.15.79:0/1478023217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76d40b1de0 0x7f76d40ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:21.859 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.846+0000 7f76dabdb700 1 -- 172.21.15.79:0/1478023217 >> 172.21.15.79:0/1478023217 conn(0x7f76d406dcc0 msgr2=0x7f76d406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:21.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.846+0000 7f76dabdb700 1 -- 172.21.15.79:0/1478023217 shutdown_connections 2023-10-19T08:38:21.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:21.846+0000 7f76dabdb700 1 -- 172.21.15.79:0/1478023217 wait complete. 2023-10-19T08:38:21.860 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-19T08:38:21.861 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-10-19T08:38:21.099415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219444,"kb_used_data":3292,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755276,"statfs":{"total":773094113280,"available":772869402624,"internally_reserved":0,"allocated":3371008,"data_stored":2067366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002951"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336361+0000","last_change":"2023-10-19T08:37:57.298197+0000","last_active":"2023-10-19T08:38:02.336361+0000","last_peered":"2023-10-19T08:38:02.336361+0000","last_clean":"2023-10-19T08:38:02.336361+0000","last_became_active":"2023-10-19T08:37:57.297874+0000","last_became_peered":"2023-10-19T08:37:57.297874+0000","last_unstale":"2023-10-19T08:38:02.336361+0000","last_undegraded":"2023-10-19T08:38:02.336361+0000","last_fullsized":"2023-10-19T08:38:02.336361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:29:22.588510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303213+0000","last_change":"2023-10-19T08:37:57.272011+0000","last_active":"2023-10-19T08:38:02.303213+0000","last_peered":"2023-10-19T08:38:02.303213+0000","last_clean":"2023-10-19T08:38:02.303213+0000","last_became_active":"2023-10-19T08:37:57.271773+0000","last_became_peered":"2023-10-19T08:37:57.271773+0000","last_unstale":"2023-10-19T08:38:02.303213+0000","last_undegraded":"2023-10-19T08:38:02.303213+0000","last_fullsized":"2023-10-19T08:38:02.303213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:04.184252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338528+0000","last_change":"2023-10-19T08:37:57.286551+0000","last_active":"2023-10-19T08:38:02.338528+0000","last_peered":"2023-10-19T08:38:02.338528+0000","last_clean":"2023-10-19T08:38:02.338528+0000","last_became_active":"2023-10-19T08:37:57.286151+0000","last_became_peered":"2023-10-19T08:37:57.286151+0000","last_unstale":"2023-10-19T08:38:02.338528+0000","last_undegraded":"2023-10-19T08:38:02.338528+0000","last_fullsized":"2023-10-19T08:38:02.338528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:06:59.905183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336888+0000","last_change":"2023-10-19T08:37:57.279635+0000","last_active":"2023-10-19T08:38:02.336888+0000","last_peered":"2023-10-19T08:38:02.336888+0000","last_clean":"2023-10-19T08:38:02.336888+0000","last_became_active":"2023-10-19T08:37:57.279358+0000","last_became_peered":"2023-10-19T08:37:57.279358+0000","last_unstale":"2023-10-19T08:38:02.336888+0000","last_undegraded":"2023-10-19T08:38:02.336888+0000","last_fullsized":"2023-10-19T08:38:02.336888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:11:03.215012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327987+0000","last_change":"2023-10-19T08:37:57.291593+0000","last_active":"2023-10-19T08:38:02.327987+0000","last_peered":"2023-10-19T08:38:02.327987+0000","last_clean":"2023-10-19T08:38:02.327987+0000","last_became_active":"2023-10-19T08:37:57.291321+0000","last_became_peered":"2023-10-19T08:37:57.291321+0000","last_unstale":"2023-10-19T08:38:02.327987+0000","last_undegraded":"2023-10-19T08:38:02.327987+0000","last_fullsized":"2023-10-19T08:38:02.327987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:52.465054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337282+0000","last_change":"2023-10-19T08:37:57.285508+0000","last_active":"2023-10-19T08:38:02.337282+0000","last_peered":"2023-10-19T08:38:02.337282+0000","last_clean":"2023-10-19T08:38:02.337282+0000","last_became_active":"2023-10-19T08:37:57.285110+0000","last_became_peered":"2023-10-19T08:37:57.285110+0000","last_unstale":"2023-10-19T08:38:02.337282+0000","last_undegraded":"2023-10-19T08:38:02.337282+0000","last_fullsized":"2023-10-19T08:38:02.337282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:36:45.197928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337337+0000","last_change":"2023-10-19T08:37:57.284428+0000","last_active":"2023-10-19T08:38:02.337337+0000","last_peered":"2023-10-19T08:38:02.337337+0000","last_clean":"2023-10-19T08:38:02.337337+0000","last_became_active":"2023-10-19T08:37:57.283626+0000","last_became_peered":"2023-10-19T08:37:57.283626+0000","last_unstale":"2023-10-19T08:38:02.337337+0000","last_undegraded":"2023-10-19T08:38:02.337337+0000","last_fullsized":"2023-10-19T08:38:02.337337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:43.028422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302532+0000","last_change":"2023-10-19T08:37:57.281050+0000","last_active":"2023-10-19T08:38:02.302532+0000","last_peered":"2023-10-19T08:38:02.302532+0000","last_clean":"2023-10-19T08:38:02.302532+0000","last_became_active":"2023-10-19T08:37:57.280763+0000","last_became_peered":"2023-10-19T08:37:57.280763+0000","last_unstale":"2023-10-19T08:38:02.302532+0000","last_undegraded":"2023-10-19T08:38:02.302532+0000","last_fullsized":"2023-10-19T08:38:02.302532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:23.560291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328470+0000","last_change":"2023-10-19T08:37:57.295958+0000","last_active":"2023-10-19T08:38:02.328470+0000","last_peered":"2023-10-19T08:38:02.328470+0000","last_clean":"2023-10-19T08:38:02.328470+0000","last_became_active":"2023-10-19T08:37:57.295552+0000","last_became_peered":"2023-10-19T08:37:57.295552+0000","last_unstale":"2023-10-19T08:38:02.328470+0000","last_undegraded":"2023-10-19T08:38:02.328470+0000","last_fullsized":"2023-10-19T08:38:02.328470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:09.106701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303592+0000","last_change":"2023-10-19T08:37:57.281702+0000","last_active":"2023-10-19T08:38:02.303592+0000","last_peered":"2023-10-19T08:38:02.303592+0000","last_clean":"2023-10-19T08:38:02.303592+0000","last_became_active":"2023-10-19T08:37:57.281458+0000","last_became_peered":"2023-10-19T08:37:57.281458+0000","last_unstale":"2023-10-19T08:38:02.303592+0000","last_undegraded":"2023-10-19T08:38:02.303592+0000","last_fullsized":"2023-10-19T08:38:02.303592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:50.116408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338336+0000","last_change":"2023-10-19T08:37:57.287060+0000","last_active":"2023-10-19T08:38:02.338336+0000","last_peered":"2023-10-19T08:38:02.338336+0000","last_clean":"2023-10-19T08:38:02.338336+0000","last_became_active":"2023-10-19T08:37:57.286457+0000","last_became_peered":"2023-10-19T08:37:57.286457+0000","last_unstale":"2023-10-19T08:38:02.338336+0000","last_undegraded":"2023-10-19T08:38:02.338336+0000","last_fullsized":"2023-10-19T08:38:02.338336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:42:12.580615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336291+0000","last_change":"2023-10-19T08:37:57.287153+0000","last_active":"2023-10-19T08:38:02.336291+0000","last_peered":"2023-10-19T08:38:02.336291+0000","last_clean":"2023-10-19T08:38:02.336291+0000","last_became_active":"2023-10-19T08:37:57.286892+0000","last_became_peered":"2023-10-19T08:37:57.286892+0000","last_unstale":"2023-10-19T08:38:02.336291+0000","last_undegraded":"2023-10-19T08:38:02.336291+0000","last_fullsized":"2023-10-19T08:38:02.336291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:15:28.529966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336795+0000","last_change":"2023-10-19T08:37:57.295506+0000","last_active":"2023-10-19T08:38:02.336795+0000","last_peered":"2023-10-19T08:38:02.336795+0000","last_clean":"2023-10-19T08:38:02.336795+0000","last_became_active":"2023-10-19T08:37:57.295228+0000","last_became_peered":"2023-10-19T08:37:57.295228+0000","last_unstale":"2023-10-19T08:38:02.336795+0000","last_undegraded":"2023-10-19T08:38:02.336795+0000","last_fullsized":"2023-10-19T08:38:02.336795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:50:11.458306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302667+0000","last_change":"2023-10-19T08:37:57.281958+0000","last_active":"2023-10-19T08:38:02.302667+0000","last_peered":"2023-10-19T08:38:02.302667+0000","last_clean":"2023-10-19T08:38:02.302667+0000","last_became_active":"2023-10-19T08:37:57.280798+0000","last_became_peered":"2023-10-19T08:37:57.280798+0000","last_unstale":"2023-10-19T08:38:02.302667+0000","last_undegraded":"2023-10-19T08:38:02.302667+0000","last_fullsized":"2023-10-19T08:38:02.302667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:52.465054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337080+0000","last_change":"2023-10-19T08:37:57.284152+0000","last_active":"2023-10-19T08:38:02.337080+0000","last_peered":"2023-10-19T08:38:02.337080+0000","last_clean":"2023-10-19T08:38:02.337080+0000","last_became_active":"2023-10-19T08:37:57.283958+0000","last_became_peered":"2023-10-19T08:37:57.283958+0000","last_unstale":"2023-10-19T08:38:02.337080+0000","last_undegraded":"2023-10-19T08:38:02.337080+0000","last_fullsized":"2023-10-19T08:38:02.337080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:21.864097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336495+0000","last_change":"2023-10-19T08:37:57.282193+0000","last_active":"2023-10-19T08:38:02.336495+0000","last_peered":"2023-10-19T08:38:02.336495+0000","last_clean":"2023-10-19T08:38:02.336495+0000","last_became_active":"2023-10-19T08:37:57.281902+0000","last_became_peered":"2023-10-19T08:37:57.281902+0000","last_unstale":"2023-10-19T08:38:02.336495+0000","last_undegraded":"2023-10-19T08:38:02.336495+0000","last_fullsized":"2023-10-19T08:38:02.336495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:28:55.738875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328478+0000","last_change":"2023-10-19T08:37:57.295795+0000","last_active":"2023-10-19T08:38:02.328478+0000","last_peered":"2023-10-19T08:38:02.328478+0000","last_clean":"2023-10-19T08:38:02.328478+0000","last_became_active":"2023-10-19T08:37:57.295248+0000","last_became_peered":"2023-10-19T08:37:57.295248+0000","last_unstale":"2023-10-19T08:38:02.328478+0000","last_undegraded":"2023-10-19T08:38:02.328478+0000","last_fullsized":"2023-10-19T08:38:02.328478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:30.738229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338681+0000","last_change":"2023-10-19T08:37:57.285995+0000","last_active":"2023-10-19T08:38:02.338681+0000","last_peered":"2023-10-19T08:38:02.338681+0000","last_clean":"2023-10-19T08:38:02.338681+0000","last_became_active":"2023-10-19T08:37:57.285508+0000","last_became_peered":"2023-10-19T08:37:57.285508+0000","last_unstale":"2023-10-19T08:38:02.338681+0000","last_undegraded":"2023-10-19T08:38:02.338681+0000","last_fullsized":"2023-10-19T08:38:02.338681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:47:25.178769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336266+0000","last_change":"2023-10-19T08:37:57.287058+0000","last_active":"2023-10-19T08:38:02.336266+0000","last_peered":"2023-10-19T08:38:02.336266+0000","last_clean":"2023-10-19T08:38:02.336266+0000","last_became_active":"2023-10-19T08:37:57.286444+0000","last_became_peered":"2023-10-19T08:37:57.286444+0000","last_unstale":"2023-10-19T08:38:02.336266+0000","last_undegraded":"2023-10-19T08:38:02.336266+0000","last_fullsized":"2023-10-19T08:38:02.336266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:00:25.346262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337609+0000","last_change":"2023-10-19T08:37:57.286561+0000","last_active":"2023-10-19T08:38:02.337609+0000","last_peered":"2023-10-19T08:38:02.337609+0000","last_clean":"2023-10-19T08:38:02.337609+0000","last_became_active":"2023-10-19T08:37:57.286258+0000","last_became_peered":"2023-10-19T08:37:57.286258+0000","last_unstale":"2023-10-19T08:38:02.337609+0000","last_undegraded":"2023-10-19T08:38:02.337609+0000","last_fullsized":"2023-10-19T08:38:02.337609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:36:37.342175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338298+0000","last_change":"2023-10-19T08:37:57.298841+0000","last_active":"2023-10-19T08:38:02.338298+0000","last_peered":"2023-10-19T08:38:02.338298+0000","last_clean":"2023-10-19T08:38:02.338298+0000","last_became_active":"2023-10-19T08:37:57.297120+0000","last_became_peered":"2023-10-19T08:37:57.297120+0000","last_unstale":"2023-10-19T08:38:02.338298+0000","last_undegraded":"2023-10-19T08:38:02.338298+0000","last_fullsized":"2023-10-19T08:38:02.338298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:45:25.612225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327349+0000","last_change":"2023-10-19T08:37:57.278547+0000","last_active":"2023-10-19T08:38:02.327349+0000","last_peered":"2023-10-19T08:38:02.327349+0000","last_clean":"2023-10-19T08:38:02.327349+0000","last_became_active":"2023-10-19T08:37:57.278248+0000","last_became_peered":"2023-10-19T08:37:57.278248+0000","last_unstale":"2023-10-19T08:38:02.327349+0000","last_undegraded":"2023-10-19T08:38:02.327349+0000","last_fullsized":"2023-10-19T08:38:02.327349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:57:26.558851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302205+0000","last_change":"2023-10-19T08:37:57.292075+0000","last_active":"2023-10-19T08:38:02.302205+0000","last_peered":"2023-10-19T08:38:02.302205+0000","last_clean":"2023-10-19T08:38:02.302205+0000","last_became_active":"2023-10-19T08:37:57.291577+0000","last_became_peered":"2023-10-19T08:37:57.291577+0000","last_unstale":"2023-10-19T08:38:02.302205+0000","last_undegraded":"2023-10-19T08:38:02.302205+0000","last_fullsized":"2023-10-19T08:38:02.302205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:02.310273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336592+0000","last_change":"2023-10-19T08:37:57.297303+0000","last_active":"2023-10-19T08:38:02.336592+0000","last_peered":"2023-10-19T08:38:02.336592+0000","last_clean":"2023-10-19T08:38:02.336592+0000","last_became_active":"2023-10-19T08:37:57.297038+0000","last_became_peered":"2023-10-19T08:37:57.297038+0000","last_unstale":"2023-10-19T08:38:02.336592+0000","last_undegraded":"2023-10-19T08:38:02.336592+0000","last_fullsized":"2023-10-19T08:38:02.336592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:52.465054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337263+0000","last_change":"2023-10-19T08:37:57.283306+0000","last_active":"2023-10-19T08:38:02.337263+0000","last_peered":"2023-10-19T08:38:02.337263+0000","last_clean":"2023-10-19T08:38:02.337263+0000","last_became_active":"2023-10-19T08:37:57.282978+0000","last_became_peered":"2023-10-19T08:37:57.282978+0000","last_unstale":"2023-10-19T08:38:02.337263+0000","last_undegraded":"2023-10-19T08:38:02.337263+0000","last_fullsized":"2023-10-19T08:38:02.337263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:30.738229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337108+0000","last_change":"2023-10-19T08:37:57.280269+0000","last_active":"2023-10-19T08:38:02.337108+0000","last_peered":"2023-10-19T08:38:02.337108+0000","last_clean":"2023-10-19T08:38:02.337108+0000","last_became_active":"2023-10-19T08:37:57.279940+0000","last_became_peered":"2023-10-19T08:37:57.279940+0000","last_unstale":"2023-10-19T08:38:02.337108+0000","last_undegraded":"2023-10-19T08:38:02.337108+0000","last_fullsized":"2023-10-19T08:38:02.337108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:40.165807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303297+0000","last_change":"2023-10-19T08:37:57.285132+0000","last_active":"2023-10-19T08:38:02.303297+0000","last_peered":"2023-10-19T08:38:02.303297+0000","last_clean":"2023-10-19T08:38:02.303297+0000","last_became_active":"2023-10-19T08:37:57.284701+0000","last_became_peered":"2023-10-19T08:37:57.284701+0000","last_unstale":"2023-10-19T08:38:02.303297+0000","last_undegraded":"2023-10-19T08:38:02.303297+0000","last_fullsized":"2023-10-19T08:38:02.303297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:16.370875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337879+0000","last_change":"2023-10-19T08:38:01.340490+0000","last_active":"2023-10-19T08:38:02.337879+0000","last_peered":"2023-10-19T08:38:02.337879+0000","last_clean":"2023-10-19T08:38:02.337879+0000","last_became_active":"2023-10-19T08:38:01.340119+0000","last_became_peered":"2023-10-19T08:38:01.340119+0000","last_unstale":"2023-10-19T08:38:02.337879+0000","last_undegraded":"2023-10-19T08:38:02.337879+0000","last_fullsized":"2023-10-19T08:38:02.337879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:28:51.111704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336413+0000","last_change":"2023-10-19T08:37:56.283885+0000","last_active":"2023-10-19T08:38:02.336413+0000","last_peered":"2023-10-19T08:38:02.336413+0000","last_clean":"2023-10-19T08:38:02.336413+0000","last_became_active":"2023-10-19T08:37:56.283591+0000","last_became_peered":"2023-10-19T08:37:56.283591+0000","last_unstale":"2023-10-19T08:38:02.336413+0000","last_undegraded":"2023-10-19T08:38:02.336413+0000","last_fullsized":"2023-10-19T08:38:02.336413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:15:58.663548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303063+0000","last_change":"2023-10-19T08:37:57.291292+0000","last_active":"2023-10-19T08:38:02.303063+0000","last_peered":"2023-10-19T08:38:02.303063+0000","last_clean":"2023-10-19T08:38:02.303063+0000","last_became_active":"2023-10-19T08:37:57.291007+0000","last_became_peered":"2023-10-19T08:37:57.291007+0000","last_unstale":"2023-10-19T08:38:02.303063+0000","last_undegraded":"2023-10-19T08:38:02.303063+0000","last_fullsized":"2023-10-19T08:38:02.303063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:48.642240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337486+0000","last_change":"2023-10-19T08:38:01.346131+0000","last_active":"2023-10-19T08:38:02.337486+0000","last_peered":"2023-10-19T08:38:02.337486+0000","last_clean":"2023-10-19T08:38:02.337486+0000","last_became_active":"2023-10-19T08:38:01.345770+0000","last_became_peered":"2023-10-19T08:38:01.345770+0000","last_unstale":"2023-10-19T08:38:02.337486+0000","last_undegraded":"2023-10-19T08:38:02.337486+0000","last_fullsized":"2023-10-19T08:38:02.337486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:36:36.064644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336120+0000","last_change":"2023-10-19T08:37:56.285233+0000","last_active":"2023-10-19T08:38:02.336120+0000","last_peered":"2023-10-19T08:38:02.336120+0000","last_clean":"2023-10-19T08:38:02.336120+0000","last_became_active":"2023-10-19T08:37:56.284954+0000","last_became_peered":"2023-10-19T08:37:56.284954+0000","last_unstale":"2023-10-19T08:38:02.336120+0000","last_undegraded":"2023-10-19T08:38:02.336120+0000","last_fullsized":"2023-10-19T08:38:02.336120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:40.083342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328472+0000","last_change":"2023-10-19T08:37:57.285760+0000","last_active":"2023-10-19T08:38:02.328472+0000","last_peered":"2023-10-19T08:38:02.328472+0000","last_clean":"2023-10-19T08:38:02.328472+0000","last_became_active":"2023-10-19T08:37:57.285420+0000","last_became_peered":"2023-10-19T08:37:57.285420+0000","last_unstale":"2023-10-19T08:38:02.328472+0000","last_undegraded":"2023-10-19T08:38:02.328472+0000","last_fullsized":"2023-10-19T08:38:02.328472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:43.028422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328649+0000","last_change":"2023-10-19T08:38:01.343224+0000","last_active":"2023-10-19T08:38:02.328649+0000","last_peered":"2023-10-19T08:38:02.328649+0000","last_clean":"2023-10-19T08:38:02.328649+0000","last_became_active":"2023-10-19T08:38:01.341932+0000","last_became_peered":"2023-10-19T08:38:01.341932+0000","last_unstale":"2023-10-19T08:38:02.328649+0000","last_undegraded":"2023-10-19T08:38:02.328649+0000","last_fullsized":"2023-10-19T08:38:02.328649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:08.237484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302526+0000","last_change":"2023-10-19T08:37:56.279221+0000","last_active":"2023-10-19T08:38:02.302526+0000","last_peered":"2023-10-19T08:38:02.302526+0000","last_clean":"2023-10-19T08:38:02.302526+0000","last_became_active":"2023-10-19T08:37:56.278945+0000","last_became_peered":"2023-10-19T08:37:56.278945+0000","last_unstale":"2023-10-19T08:38:02.302526+0000","last_undegraded":"2023-10-19T08:38:02.302526+0000","last_fullsized":"2023-10-19T08:38:02.302526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:15.152471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337264+0000","last_change":"2023-10-19T08:37:57.286458+0000","last_active":"2023-10-19T08:38:02.337264+0000","last_peered":"2023-10-19T08:38:02.337264+0000","last_clean":"2023-10-19T08:38:02.337264+0000","last_became_active":"2023-10-19T08:37:57.286202+0000","last_became_peered":"2023-10-19T08:37:57.286202+0000","last_unstale":"2023-10-19T08:38:02.337264+0000","last_undegraded":"2023-10-19T08:38:02.337264+0000","last_fullsized":"2023-10-19T08:38:02.337264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:03:17.001375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336640+0000","last_change":"2023-10-19T08:38:01.345314+0000","last_active":"2023-10-19T08:38:02.336640+0000","last_peered":"2023-10-19T08:38:02.336640+0000","last_clean":"2023-10-19T08:38:02.336640+0000","last_became_active":"2023-10-19T08:38:01.344867+0000","last_became_peered":"2023-10-19T08:38:01.344867+0000","last_unstale":"2023-10-19T08:38:02.336640+0000","last_undegraded":"2023-10-19T08:38:02.336640+0000","last_fullsized":"2023-10-19T08:38:02.336640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:14:55.301418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328589+0000","last_change":"2023-10-19T08:37:56.284935+0000","last_active":"2023-10-19T08:38:02.328589+0000","last_peered":"2023-10-19T08:38:02.328589+0000","last_clean":"2023-10-19T08:38:02.328589+0000","last_became_active":"2023-10-19T08:37:56.284622+0000","last_became_peered":"2023-10-19T08:37:56.284622+0000","last_unstale":"2023-10-19T08:38:02.328589+0000","last_undegraded":"2023-10-19T08:38:02.328589+0000","last_fullsized":"2023-10-19T08:38:02.328589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:43:07.850875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302488+0000","last_change":"2023-10-19T08:37:57.291320+0000","last_active":"2023-10-19T08:38:02.302488+0000","last_peered":"2023-10-19T08:38:02.302488+0000","last_clean":"2023-10-19T08:38:02.302488+0000","last_became_active":"2023-10-19T08:37:57.290894+0000","last_became_peered":"2023-10-19T08:37:57.290894+0000","last_unstale":"2023-10-19T08:38:02.302488+0000","last_undegraded":"2023-10-19T08:38:02.302488+0000","last_fullsized":"2023-10-19T08:38:02.302488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:30.738229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336048+0000","last_change":"2023-10-19T08:38:01.340374+0000","last_active":"2023-10-19T08:38:02.336048+0000","last_peered":"2023-10-19T08:38:02.336048+0000","last_clean":"2023-10-19T08:38:02.336048+0000","last_became_active":"2023-10-19T08:38:01.339982+0000","last_became_peered":"2023-10-19T08:38:01.339982+0000","last_unstale":"2023-10-19T08:38:02.336048+0000","last_undegraded":"2023-10-19T08:38:02.336048+0000","last_fullsized":"2023-10-19T08:38:02.336048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:06.363506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303440+0000","last_change":"2023-10-19T08:37:56.286352+0000","last_active":"2023-10-19T08:38:02.303440+0000","last_peered":"2023-10-19T08:38:02.303440+0000","last_clean":"2023-10-19T08:38:02.303440+0000","last_became_active":"2023-10-19T08:37:56.286038+0000","last_became_peered":"2023-10-19T08:37:56.286038+0000","last_unstale":"2023-10-19T08:38:02.303440+0000","last_undegraded":"2023-10-19T08:38:02.303440+0000","last_fullsized":"2023-10-19T08:38:02.303440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:47.634992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302226+0000","last_change":"2023-10-19T08:37:57.291702+0000","last_active":"2023-10-19T08:38:02.302226+0000","last_peered":"2023-10-19T08:38:02.302226+0000","last_clean":"2023-10-19T08:38:02.302226+0000","last_became_active":"2023-10-19T08:37:57.290849+0000","last_became_peered":"2023-10-19T08:37:57.290849+0000","last_unstale":"2023-10-19T08:38:02.302226+0000","last_undegraded":"2023-10-19T08:38:02.302226+0000","last_fullsized":"2023-10-19T08:38:02.302226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:43:08.858123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302757+0000","last_change":"2023-10-19T08:38:01.345973+0000","last_active":"2023-10-19T08:38:02.302757+0000","last_peered":"2023-10-19T08:38:02.302757+0000","last_clean":"2023-10-19T08:38:02.302757+0000","last_became_active":"2023-10-19T08:38:01.345569+0000","last_became_peered":"2023-10-19T08:38:01.345569+0000","last_unstale":"2023-10-19T08:38:02.302757+0000","last_undegraded":"2023-10-19T08:38:02.302757+0000","last_fullsized":"2023-10-19T08:38:02.302757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:20.424108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338312+0000","last_change":"2023-10-19T08:37:56.284648+0000","last_active":"2023-10-19T08:38:02.338312+0000","last_peered":"2023-10-19T08:38:02.338312+0000","last_clean":"2023-10-19T08:38:02.338312+0000","last_became_active":"2023-10-19T08:37:56.284377+0000","last_became_peered":"2023-10-19T08:37:56.284377+0000","last_unstale":"2023-10-19T08:38:02.338312+0000","last_undegraded":"2023-10-19T08:38:02.338312+0000","last_fullsized":"2023-10-19T08:38:02.338312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:03.177003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336475+0000","last_change":"2023-10-19T08:37:57.283545+0000","last_active":"2023-10-19T08:38:02.336475+0000","last_peered":"2023-10-19T08:38:02.336475+0000","last_clean":"2023-10-19T08:38:02.336475+0000","last_became_active":"2023-10-19T08:37:57.283287+0000","last_became_peered":"2023-10-19T08:37:57.283287+0000","last_unstale":"2023-10-19T08:38:02.336475+0000","last_undegraded":"2023-10-19T08:38:02.336475+0000","last_fullsized":"2023-10-19T08:38:02.336475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:13.404733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336264+0000","last_change":"2023-10-19T08:38:01.353317+0000","last_active":"2023-10-19T08:38:02.336264+0000","last_peered":"2023-10-19T08:38:02.336264+0000","last_clean":"2023-10-19T08:38:02.336264+0000","last_became_active":"2023-10-19T08:38:01.352964+0000","last_became_peered":"2023-10-19T08:38:01.352964+0000","last_unstale":"2023-10-19T08:38:02.336264+0000","last_undegraded":"2023-10-19T08:38:02.336264+0000","last_fullsized":"2023-10-19T08:38:02.336264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:29:16.804794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:07.165443+0000","last_change":"2023-10-19T08:37:56.285044+0000","last_active":"2023-10-19T08:38:07.165443+0000","last_peered":"2023-10-19T08:38:07.165443+0000","last_clean":"2023-10-19T08:38:07.165443+0000","last_became_active":"2023-10-19T08:37:56.284729+0000","last_became_peered":"2023-10-19T08:37:56.284729+0000","last_unstale":"2023-10-19T08:38:07.165443+0000","last_undegraded":"2023-10-19T08:38:07.165443+0000","last_fullsized":"2023-10-19T08:38:07.165443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:55:11.490980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337780+0000","last_change":"2023-10-19T08:37:57.289683+0000","last_active":"2023-10-19T08:38:02.337780+0000","last_peered":"2023-10-19T08:38:02.337780+0000","last_clean":"2023-10-19T08:38:02.337780+0000","last_became_active":"2023-10-19T08:37:57.289339+0000","last_became_peered":"2023-10-19T08:37:57.289339+0000","last_unstale":"2023-10-19T08:38:02.337780+0000","last_undegraded":"2023-10-19T08:38:02.337780+0000","last_fullsized":"2023-10-19T08:38:02.337780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:57:38.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303603+0000","last_change":"2023-10-19T08:38:01.344790+0000","last_active":"2023-10-19T08:38:02.303603+0000","last_peered":"2023-10-19T08:38:02.303603+0000","last_clean":"2023-10-19T08:38:02.303603+0000","last_became_active":"2023-10-19T08:38:01.344405+0000","last_became_peered":"2023-10-19T08:38:01.344405+0000","last_unstale":"2023-10-19T08:38:02.303603+0000","last_undegraded":"2023-10-19T08:38:02.303603+0000","last_fullsized":"2023-10-19T08:38:02.303603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:22:22.893691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338184+0000","last_change":"2023-10-19T08:37:56.286506+0000","last_active":"2023-10-19T08:38:02.338184+0000","last_peered":"2023-10-19T08:38:02.338184+0000","last_clean":"2023-10-19T08:38:02.338184+0000","last_became_active":"2023-10-19T08:37:56.286246+0000","last_became_peered":"2023-10-19T08:37:56.286246+0000","last_unstale":"2023-10-19T08:38:02.338184+0000","last_undegraded":"2023-10-19T08:38:02.338184+0000","last_fullsized":"2023-10-19T08:38:02.338184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:43:07.850875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302485+0000","last_change":"2023-10-19T08:37:57.291345+0000","last_active":"2023-10-19T08:38:02.302485+0000","last_peered":"2023-10-19T08:38:02.302485+0000","last_clean":"2023-10-19T08:38:02.302485+0000","last_became_active":"2023-10-19T08:37:57.291061+0000","last_became_peered":"2023-10-19T08:37:57.291061+0000","last_unstale":"2023-10-19T08:38:02.302485+0000","last_undegraded":"2023-10-19T08:38:02.302485+0000","last_fullsized":"2023-10-19T08:38:02.302485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:43.028422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302758+0000","last_change":"2023-10-19T08:38:01.347178+0000","last_active":"2023-10-19T08:38:02.302758+0000","last_peered":"2023-10-19T08:38:02.302758+0000","last_clean":"2023-10-19T08:38:02.302758+0000","last_became_active":"2023-10-19T08:38:01.346237+0000","last_became_peered":"2023-10-19T08:38:01.346237+0000","last_unstale":"2023-10-19T08:38:02.302758+0000","last_undegraded":"2023-10-19T08:38:02.302758+0000","last_fullsized":"2023-10-19T08:38:02.302758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:25.917329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327204+0000","last_change":"2023-10-19T08:37:56.284660+0000","last_active":"2023-10-19T08:38:02.327204+0000","last_peered":"2023-10-19T08:38:02.327204+0000","last_clean":"2023-10-19T08:38:02.327204+0000","last_became_active":"2023-10-19T08:37:56.284426+0000","last_became_peered":"2023-10-19T08:37:56.284426+0000","last_unstale":"2023-10-19T08:38:02.327204+0000","last_undegraded":"2023-10-19T08:38:02.327204+0000","last_fullsized":"2023-10-19T08:38:02.327204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:12.397484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303242+0000","last_change":"2023-10-19T08:37:57.284960+0000","last_active":"2023-10-19T08:38:02.303242+0000","last_peered":"2023-10-19T08:38:02.303242+0000","last_clean":"2023-10-19T08:38:02.303242+0000","last_became_active":"2023-10-19T08:37:57.284360+0000","last_became_peered":"2023-10-19T08:37:57.284360+0000","last_unstale":"2023-10-19T08:38:02.303242+0000","last_undegraded":"2023-10-19T08:38:02.303242+0000","last_fullsized":"2023-10-19T08:38:02.303242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:45:25.612225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303233+0000","last_change":"2023-10-19T08:38:01.346877+0000","last_active":"2023-10-19T08:38:02.303233+0000","last_peered":"2023-10-19T08:38:02.303233+0000","last_clean":"2023-10-19T08:38:02.303233+0000","last_became_active":"2023-10-19T08:38:01.346460+0000","last_became_peered":"2023-10-19T08:38:01.346460+0000","last_unstale":"2023-10-19T08:38:02.303233+0000","last_undegraded":"2023-10-19T08:38:02.303233+0000","last_fullsized":"2023-10-19T08:38:02.303233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:24:52.905240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337215+0000","last_change":"2023-10-19T08:37:56.285689+0000","last_active":"2023-10-19T08:38:02.337215+0000","last_peered":"2023-10-19T08:38:02.337215+0000","last_clean":"2023-10-19T08:38:02.337215+0000","last_became_active":"2023-10-19T08:37:56.285284+0000","last_became_peered":"2023-10-19T08:37:56.285284+0000","last_unstale":"2023-10-19T08:38:02.337215+0000","last_undegraded":"2023-10-19T08:38:02.337215+0000","last_fullsized":"2023-10-19T08:38:02.337215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:39.158559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328527+0000","last_change":"2023-10-19T08:37:57.293680+0000","last_active":"2023-10-19T08:38:02.328527+0000","last_peered":"2023-10-19T08:38:02.328527+0000","last_clean":"2023-10-19T08:38:02.328527+0000","last_became_active":"2023-10-19T08:37:57.293401+0000","last_became_peered":"2023-10-19T08:37:57.293401+0000","last_unstale":"2023-10-19T08:38:02.328527+0000","last_undegraded":"2023-10-19T08:38:02.328527+0000","last_fullsized":"2023-10-19T08:38:02.328527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:16.159720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303448+0000","last_change":"2023-10-19T08:38:01.342623+0000","last_active":"2023-10-19T08:38:02.303448+0000","last_peered":"2023-10-19T08:38:02.303448+0000","last_clean":"2023-10-19T08:38:02.303448+0000","last_became_active":"2023-10-19T08:38:01.342009+0000","last_became_peered":"2023-10-19T08:38:01.342009+0000","last_unstale":"2023-10-19T08:38:02.303448+0000","last_undegraded":"2023-10-19T08:38:02.303448+0000","last_fullsized":"2023-10-19T08:38:02.303448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:24:52.905240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336100+0000","last_change":"2023-10-19T08:37:56.281800+0000","last_active":"2023-10-19T08:38:02.336100+0000","last_peered":"2023-10-19T08:38:02.336100+0000","last_clean":"2023-10-19T08:38:02.336100+0000","last_became_active":"2023-10-19T08:37:56.281533+0000","last_became_peered":"2023-10-19T08:37:56.281533+0000","last_unstale":"2023-10-19T08:38:02.336100+0000","last_undegraded":"2023-10-19T08:38:02.336100+0000","last_fullsized":"2023-10-19T08:38:02.336100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:08:05.598870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303187+0000","last_change":"2023-10-19T08:37:57.295506+0000","last_active":"2023-10-19T08:38:02.303187+0000","last_peered":"2023-10-19T08:38:02.303187+0000","last_clean":"2023-10-19T08:38:02.303187+0000","last_became_active":"2023-10-19T08:37:57.295267+0000","last_became_peered":"2023-10-19T08:37:57.295267+0000","last_unstale":"2023-10-19T08:38:02.303187+0000","last_undegraded":"2023-10-19T08:38:02.303187+0000","last_fullsized":"2023-10-19T08:38:02.303187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:22:18.840459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337512+0000","last_change":"2023-10-19T08:38:01.349967+0000","last_active":"2023-10-19T08:38:02.337512+0000","last_peered":"2023-10-19T08:38:02.337512+0000","last_clean":"2023-10-19T08:38:02.337512+0000","last_became_active":"2023-10-19T08:38:01.349632+0000","last_became_peered":"2023-10-19T08:38:01.349632+0000","last_unstale":"2023-10-19T08:38:02.337512+0000","last_undegraded":"2023-10-19T08:38:02.337512+0000","last_fullsized":"2023-10-19T08:38:02.337512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:34.791461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338637+0000","last_change":"2023-10-19T08:37:56.287543+0000","last_active":"2023-10-19T08:38:02.338637+0000","last_peered":"2023-10-19T08:38:02.338637+0000","last_clean":"2023-10-19T08:38:02.338637+0000","last_became_active":"2023-10-19T08:37:56.287018+0000","last_became_peered":"2023-10-19T08:37:56.287018+0000","last_unstale":"2023-10-19T08:38:02.338637+0000","last_undegraded":"2023-10-19T08:38:02.338637+0000","last_fullsized":"2023-10-19T08:38:02.338637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:47.634992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302382+0000","last_change":"2023-10-19T08:37:57.289156+0000","last_active":"2023-10-19T08:38:02.302382+0000","last_peered":"2023-10-19T08:38:02.302382+0000","last_clean":"2023-10-19T08:38:02.302382+0000","last_became_active":"2023-10-19T08:37:57.288736+0000","last_became_peered":"2023-10-19T08:37:57.288736+0000","last_unstale":"2023-10-19T08:38:02.302382+0000","last_undegraded":"2023-10-19T08:38:02.302382+0000","last_fullsized":"2023-10-19T08:38:02.302382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:02.310273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.335829+0000","last_change":"2023-10-19T08:38:01.332463+0000","last_active":"2023-10-19T08:38:02.335829+0000","last_peered":"2023-10-19T08:38:02.335829+0000","last_clean":"2023-10-19T08:38:02.335829+0000","last_became_active":"2023-10-19T08:38:01.330857+0000","last_became_peered":"2023-10-19T08:38:01.330857+0000","last_unstale":"2023-10-19T08:38:02.335829+0000","last_undegraded":"2023-10-19T08:38:02.335829+0000","last_fullsized":"2023-10-19T08:38:02.335829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:27:27.393059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338367+0000","last_change":"2023-10-19T08:37:56.285623+0000","last_active":"2023-10-19T08:38:02.338367+0000","last_peered":"2023-10-19T08:38:02.338367+0000","last_clean":"2023-10-19T08:38:02.338367+0000","last_became_active":"2023-10-19T08:37:56.285324+0000","last_became_peered":"2023-10-19T08:37:56.285324+0000","last_unstale":"2023-10-19T08:38:02.338367+0000","last_undegraded":"2023-10-19T08:38:02.338367+0000","last_fullsized":"2023-10-19T08:38:02.338367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:58:27.340847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336799+0000","last_change":"2023-10-19T08:37:57.283094+0000","last_active":"2023-10-19T08:38:02.336799+0000","last_peered":"2023-10-19T08:38:02.336799+0000","last_clean":"2023-10-19T08:38:02.336799+0000","last_became_active":"2023-10-19T08:37:57.282824+0000","last_became_peered":"2023-10-19T08:37:57.282824+0000","last_unstale":"2023-10-19T08:38:02.336799+0000","last_undegraded":"2023-10-19T08:38:02.336799+0000","last_fullsized":"2023-10-19T08:38:02.336799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:23:48.860817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336247+0000","last_change":"2023-10-19T08:38:01.331969+0000","last_active":"2023-10-19T08:38:02.336247+0000","last_peered":"2023-10-19T08:38:02.336247+0000","last_clean":"2023-10-19T08:38:02.336247+0000","last_became_active":"2023-10-19T08:38:01.331538+0000","last_became_peered":"2023-10-19T08:38:01.331538+0000","last_unstale":"2023-10-19T08:38:02.336247+0000","last_undegraded":"2023-10-19T08:38:02.336247+0000","last_fullsized":"2023-10-19T08:38:02.336247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:19:38.947409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338570+0000","last_change":"2023-10-19T08:37:56.287547+0000","last_active":"2023-10-19T08:38:02.338570+0000","last_peered":"2023-10-19T08:38:02.338570+0000","last_clean":"2023-10-19T08:38:02.338570+0000","last_became_active":"2023-10-19T08:37:56.287249+0000","last_became_peered":"2023-10-19T08:37:56.287249+0000","last_unstale":"2023-10-19T08:38:02.338570+0000","last_undegraded":"2023-10-19T08:38:02.338570+0000","last_fullsized":"2023-10-19T08:38:02.338570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:24:47.844759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336329+0000","last_change":"2023-10-19T08:37:57.282999+0000","last_active":"2023-10-19T08:38:02.336329+0000","last_peered":"2023-10-19T08:38:02.336329+0000","last_clean":"2023-10-19T08:38:02.336329+0000","last_became_active":"2023-10-19T08:37:57.282689+0000","last_became_peered":"2023-10-19T08:37:57.282689+0000","last_unstale":"2023-10-19T08:38:02.336329+0000","last_undegraded":"2023-10-19T08:38:02.336329+0000","last_fullsized":"2023-10-19T08:38:02.336329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:07:15.629005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336395+0000","last_change":"2023-10-19T08:38:01.346058+0000","last_active":"2023-10-19T08:38:02.336395+0000","last_peered":"2023-10-19T08:38:02.336395+0000","last_clean":"2023-10-19T08:38:02.336395+0000","last_became_active":"2023-10-19T08:38:01.345734+0000","last_became_peered":"2023-10-19T08:38:01.345734+0000","last_unstale":"2023-10-19T08:38:02.336395+0000","last_undegraded":"2023-10-19T08:38:02.336395+0000","last_fullsized":"2023-10-19T08:38:02.336395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:24:06.589136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302825+0000","last_change":"2023-10-19T08:37:56.281540+0000","last_active":"2023-10-19T08:38:02.302825+0000","last_peered":"2023-10-19T08:38:02.302825+0000","last_clean":"2023-10-19T08:38:02.302825+0000","last_became_active":"2023-10-19T08:37:56.281201+0000","last_became_peered":"2023-10-19T08:37:56.281201+0000","last_unstale":"2023-10-19T08:38:02.302825+0000","last_undegraded":"2023-10-19T08:38:02.302825+0000","last_fullsized":"2023-10-19T08:38:02.302825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:40.083342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328158+0000","last_change":"2023-10-19T08:37:57.281817+0000","last_active":"2023-10-19T08:38:02.328158+0000","last_peered":"2023-10-19T08:38:02.328158+0000","last_clean":"2023-10-19T08:38:02.328158+0000","last_became_active":"2023-10-19T08:37:57.281565+0000","last_became_peered":"2023-10-19T08:37:57.281565+0000","last_unstale":"2023-10-19T08:38:02.328158+0000","last_undegraded":"2023-10-19T08:38:02.328158+0000","last_fullsized":"2023-10-19T08:38:02.328158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:41.090590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336532+0000","last_change":"2023-10-19T08:38:01.334333+0000","last_active":"2023-10-19T08:38:02.336532+0000","last_peered":"2023-10-19T08:38:02.336532+0000","last_clean":"2023-10-19T08:38:02.336532+0000","last_became_active":"2023-10-19T08:38:01.333865+0000","last_became_peered":"2023-10-19T08:38:01.333865+0000","last_unstale":"2023-10-19T08:38:02.336532+0000","last_undegraded":"2023-10-19T08:38:02.336532+0000","last_fullsized":"2023-10-19T08:38:02.336532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:34:35.198286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302576+0000","last_change":"2023-10-19T08:37:56.281808+0000","last_active":"2023-10-19T08:38:02.302576+0000","last_peered":"2023-10-19T08:38:02.302576+0000","last_clean":"2023-10-19T08:38:02.302576+0000","last_became_active":"2023-10-19T08:37:56.281530+0000","last_became_peered":"2023-10-19T08:37:56.281530+0000","last_unstale":"2023-10-19T08:38:02.302576+0000","last_undegraded":"2023-10-19T08:38:02.302576+0000","last_fullsized":"2023-10-19T08:38:02.302576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:03.177003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337444+0000","last_change":"2023-10-19T08:37:57.291709+0000","last_active":"2023-10-19T08:38:02.337444+0000","last_peered":"2023-10-19T08:38:02.337444+0000","last_clean":"2023-10-19T08:38:02.337444+0000","last_became_active":"2023-10-19T08:37:57.291449+0000","last_became_peered":"2023-10-19T08:37:57.291449+0000","last_unstale":"2023-10-19T08:38:02.337444+0000","last_undegraded":"2023-10-19T08:38:02.337444+0000","last_fullsized":"2023-10-19T08:38:02.337444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:44:52.511554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336558+0000","last_change":"2023-10-19T08:38:01.347589+0000","last_active":"2023-10-19T08:38:02.336558+0000","last_peered":"2023-10-19T08:38:02.336558+0000","last_clean":"2023-10-19T08:38:02.336558+0000","last_became_active":"2023-10-19T08:38:01.347219+0000","last_became_peered":"2023-10-19T08:38:01.347219+0000","last_unstale":"2023-10-19T08:38:02.336558+0000","last_undegraded":"2023-10-19T08:38:02.336558+0000","last_fullsized":"2023-10-19T08:38:02.336558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:57:30.612083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336383+0000","last_change":"2023-10-19T08:37:56.280035+0000","last_active":"2023-10-19T08:38:02.336383+0000","last_peered":"2023-10-19T08:38:02.336383+0000","last_clean":"2023-10-19T08:38:02.336383+0000","last_became_active":"2023-10-19T08:37:56.279742+0000","last_became_peered":"2023-10-19T08:37:56.279742+0000","last_unstale":"2023-10-19T08:38:02.336383+0000","last_undegraded":"2023-10-19T08:38:02.336383+0000","last_fullsized":"2023-10-19T08:38:02.336383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:21:53.831892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338051+0000","last_change":"2023-10-19T08:37:57.286021+0000","last_active":"2023-10-19T08:38:02.338051+0000","last_peered":"2023-10-19T08:38:02.338051+0000","last_clean":"2023-10-19T08:38:02.338051+0000","last_became_active":"2023-10-19T08:37:57.285166+0000","last_became_peered":"2023-10-19T08:37:57.285166+0000","last_unstale":"2023-10-19T08:38:02.338051+0000","last_undegraded":"2023-10-19T08:38:02.338051+0000","last_fullsized":"2023-10-19T08:38:02.338051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:59:24.110607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303417+0000","last_change":"2023-10-19T08:38:01.342875+0000","last_active":"2023-10-19T08:38:02.303417+0000","last_peered":"2023-10-19T08:38:02.303417+0000","last_clean":"2023-10-19T08:38:02.303417+0000","last_became_active":"2023-10-19T08:38:01.341788+0000","last_became_peered":"2023-10-19T08:38:01.341788+0000","last_unstale":"2023-10-19T08:38:02.303417+0000","last_undegraded":"2023-10-19T08:38:02.303417+0000","last_fullsized":"2023-10-19T08:38:02.303417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:58:32.401327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336598+0000","last_change":"2023-10-19T08:37:56.283990+0000","last_active":"2023-10-19T08:38:02.336598+0000","last_peered":"2023-10-19T08:38:02.336598+0000","last_clean":"2023-10-19T08:38:02.336598+0000","last_became_active":"2023-10-19T08:37:56.283678+0000","last_became_peered":"2023-10-19T08:37:56.283678+0000","last_unstale":"2023-10-19T08:38:02.336598+0000","last_undegraded":"2023-10-19T08:38:02.336598+0000","last_fullsized":"2023-10-19T08:38:02.336598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:33:10.909410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338725+0000","last_change":"2023-10-19T08:37:57.289730+0000","last_active":"2023-10-19T08:38:02.338725+0000","last_peered":"2023-10-19T08:38:02.338725+0000","last_clean":"2023-10-19T08:38:02.338725+0000","last_became_active":"2023-10-19T08:37:57.289411+0000","last_became_peered":"2023-10-19T08:37:57.289411+0000","last_unstale":"2023-10-19T08:38:02.338725+0000","last_undegraded":"2023-10-19T08:38:02.338725+0000","last_fullsized":"2023-10-19T08:38:02.338725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:55:07.829465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338629+0000","last_change":"2023-10-19T08:38:01.341111+0000","last_active":"2023-10-19T08:38:02.338629+0000","last_peered":"2023-10-19T08:38:02.338629+0000","last_clean":"2023-10-19T08:38:02.338629+0000","last_became_active":"2023-10-19T08:38:01.340717+0000","last_became_peered":"2023-10-19T08:38:01.340717+0000","last_unstale":"2023-10-19T08:38:02.338629+0000","last_undegraded":"2023-10-19T08:38:02.338629+0000","last_fullsized":"2023-10-19T08:38:02.338629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:04:48.063590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302334+0000","last_change":"2023-10-19T08:37:56.286850+0000","last_active":"2023-10-19T08:38:02.302334+0000","last_peered":"2023-10-19T08:38:02.302334+0000","last_clean":"2023-10-19T08:38:02.302334+0000","last_became_active":"2023-10-19T08:37:56.286593+0000","last_became_peered":"2023-10-19T08:37:56.286593+0000","last_unstale":"2023-10-19T08:38:02.302334+0000","last_undegraded":"2023-10-19T08:38:02.302334+0000","last_fullsized":"2023-10-19T08:38:02.302334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:22.553042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337352+0000","last_change":"2023-10-19T08:37:57.296081+0000","last_active":"2023-10-19T08:38:02.337352+0000","last_peered":"2023-10-19T08:38:02.337352+0000","last_clean":"2023-10-19T08:38:02.337352+0000","last_became_active":"2023-10-19T08:37:57.295834+0000","last_became_peered":"2023-10-19T08:37:57.295834+0000","last_unstale":"2023-10-19T08:38:02.337352+0000","last_undegraded":"2023-10-19T08:38:02.337352+0000","last_fullsized":"2023-10-19T08:38:02.337352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:16.159720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327643+0000","last_change":"2023-10-19T08:38:01.344908+0000","last_active":"2023-10-19T08:38:02.327643+0000","last_peered":"2023-10-19T08:38:02.327643+0000","last_clean":"2023-10-19T08:38:02.327643+0000","last_became_active":"2023-10-19T08:38:01.342061+0000","last_became_peered":"2023-10-19T08:38:01.342061+0000","last_unstale":"2023-10-19T08:38:02.327643+0000","last_undegraded":"2023-10-19T08:38:02.327643+0000","last_fullsized":"2023-10-19T08:38:02.327643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:58:38.199370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336703+0000","last_change":"2023-10-19T08:37:51.153209+0000","last_active":"2023-10-19T08:38:02.336703+0000","last_peered":"2023-10-19T08:38:02.336703+0000","last_clean":"2023-10-19T08:38:02.336703+0000","last_became_active":"2023-10-19T08:37:51.152844+0000","last_became_peered":"2023-10-19T08:37:51.152844+0000","last_unstale":"2023-10-19T08:38:02.336703+0000","last_undegraded":"2023-10-19T08:38:02.336703+0000","last_fullsized":"2023-10-19T08:38:02.336703+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:58:27.990585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303140+0000","last_change":"2023-10-19T08:37:56.283202+0000","last_active":"2023-10-19T08:38:02.303140+0000","last_peered":"2023-10-19T08:38:02.303140+0000","last_clean":"2023-10-19T08:38:02.303140+0000","last_became_active":"2023-10-19T08:37:56.282930+0000","last_became_peered":"2023-10-19T08:37:56.282930+0000","last_unstale":"2023-10-19T08:38:02.303140+0000","last_undegraded":"2023-10-19T08:38:02.303140+0000","last_fullsized":"2023-10-19T08:38:02.303140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:43:07.850875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336384+0000","last_change":"2023-10-19T08:37:57.273005+0000","last_active":"2023-10-19T08:38:02.336384+0000","last_peered":"2023-10-19T08:38:02.336384+0000","last_clean":"2023-10-19T08:38:02.336384+0000","last_became_active":"2023-10-19T08:37:57.272159+0000","last_became_peered":"2023-10-19T08:37:57.272159+0000","last_unstale":"2023-10-19T08:38:02.336384+0000","last_undegraded":"2023-10-19T08:38:02.336384+0000","last_fullsized":"2023-10-19T08:38:02.336384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:49.381912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327478+0000","last_change":"2023-10-19T08:38:01.342853+0000","last_active":"2023-10-19T08:38:02.327478+0000","last_peered":"2023-10-19T08:38:02.327478+0000","last_clean":"2023-10-19T08:38:02.327478+0000","last_became_active":"2023-10-19T08:38:01.342166+0000","last_became_peered":"2023-10-19T08:38:01.342166+0000","last_unstale":"2023-10-19T08:38:02.327478+0000","last_undegraded":"2023-10-19T08:38:02.327478+0000","last_fullsized":"2023-10-19T08:38:02.327478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:50:56.650312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302902+0000","last_change":"2023-10-19T08:37:51.116743+0000","last_active":"2023-10-19T08:38:02.302902+0000","last_peered":"2023-10-19T08:38:02.302902+0000","last_clean":"2023-10-19T08:38:02.302902+0000","last_became_active":"2023-10-19T08:37:51.116511+0000","last_became_peered":"2023-10-19T08:37:51.116511+0000","last_unstale":"2023-10-19T08:38:02.302902+0000","last_undegraded":"2023-10-19T08:38:02.302902+0000","last_fullsized":"2023-10-19T08:38:02.302902+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:36.872869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337533+0000","last_change":"2023-10-19T08:37:56.280470+0000","last_active":"2023-10-19T08:38:02.337533+0000","last_peered":"2023-10-19T08:38:02.337533+0000","last_clean":"2023-10-19T08:38:02.337533+0000","last_became_active":"2023-10-19T08:37:56.280178+0000","last_became_peered":"2023-10-19T08:37:56.280178+0000","last_unstale":"2023-10-19T08:38:02.337533+0000","last_undegraded":"2023-10-19T08:38:02.337533+0000","last_fullsized":"2023-10-19T08:38:02.337533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:58:02.145386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336644+0000","last_change":"2023-10-19T08:37:57.283444+0000","last_active":"2023-10-19T08:38:02.336644+0000","last_peered":"2023-10-19T08:38:02.336644+0000","last_clean":"2023-10-19T08:38:02.336644+0000","last_became_active":"2023-10-19T08:37:57.283153+0000","last_became_peered":"2023-10-19T08:37:57.283153+0000","last_unstale":"2023-10-19T08:38:02.336644+0000","last_undegraded":"2023-10-19T08:38:02.336644+0000","last_fullsized":"2023-10-19T08:38:02.336644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:50:52.597080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336583+0000","last_change":"2023-10-19T08:38:01.342565+0000","last_active":"2023-10-19T08:38:02.336583+0000","last_peered":"2023-10-19T08:38:02.336583+0000","last_clean":"2023-10-19T08:38:02.336583+0000","last_became_active":"2023-10-19T08:38:01.341889+0000","last_became_peered":"2023-10-19T08:38:01.341889+0000","last_unstale":"2023-10-19T08:38:02.336583+0000","last_undegraded":"2023-10-19T08:38:02.336583+0000","last_fullsized":"2023-10-19T08:38:02.336583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:02:48.585528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336488+0000","last_change":"2023-10-19T08:37:51.114782+0000","last_active":"2023-10-19T08:38:02.336488+0000","last_peered":"2023-10-19T08:38:02.336488+0000","last_clean":"2023-10-19T08:38:02.336488+0000","last_became_active":"2023-10-19T08:37:51.114388+0000","last_became_peered":"2023-10-19T08:37:51.114388+0000","last_unstale":"2023-10-19T08:38:02.336488+0000","last_undegraded":"2023-10-19T08:38:02.336488+0000","last_fullsized":"2023-10-19T08:38:02.336488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:36:18.887665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.335983+0000","last_change":"2023-10-19T08:37:56.283345+0000","last_active":"2023-10-19T08:38:02.335983+0000","last_peered":"2023-10-19T08:38:02.335983+0000","last_clean":"2023-10-19T08:38:02.335983+0000","last_became_active":"2023-10-19T08:37:56.283066+0000","last_became_peered":"2023-10-19T08:37:56.283066+0000","last_unstale":"2023-10-19T08:38:02.335983+0000","last_undegraded":"2023-10-19T08:38:02.335983+0000","last_fullsized":"2023-10-19T08:38:02.335983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:00:05.442442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337299+0000","last_change":"2023-10-19T08:37:57.272609+0000","last_active":"2023-10-19T08:38:02.337299+0000","last_peered":"2023-10-19T08:38:02.337299+0000","last_clean":"2023-10-19T08:38:02.337299+0000","last_became_active":"2023-10-19T08:37:57.272328+0000","last_became_peered":"2023-10-19T08:37:57.272328+0000","last_unstale":"2023-10-19T08:38:02.337299+0000","last_undegraded":"2023-10-19T08:38:02.337299+0000","last_fullsized":"2023-10-19T08:38:02.337299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:09.106701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338110+0000","last_change":"2023-10-19T08:38:01.350479+0000","last_active":"2023-10-19T08:38:02.338110+0000","last_peered":"2023-10-19T08:38:02.338110+0000","last_clean":"2023-10-19T08:38:02.338110+0000","last_became_active":"2023-10-19T08:38:01.350030+0000","last_became_peered":"2023-10-19T08:38:01.350030+0000","last_unstale":"2023-10-19T08:38:02.338110+0000","last_undegraded":"2023-10-19T08:38:02.338110+0000","last_fullsized":"2023-10-19T08:38:02.338110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:20.212952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302863+0000","last_change":"2023-10-19T08:37:51.115141+0000","last_active":"2023-10-19T08:38:02.302863+0000","last_peered":"2023-10-19T08:38:02.302863+0000","last_clean":"2023-10-19T08:38:02.302863+0000","last_became_active":"2023-10-19T08:37:51.114829+0000","last_became_peered":"2023-10-19T08:37:51.114829+0000","last_unstale":"2023-10-19T08:38:02.302863+0000","last_undegraded":"2023-10-19T08:38:02.302863+0000","last_fullsized":"2023-10-19T08:38:02.302863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:34.010255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336533+0000","last_change":"2023-10-19T08:37:51.153453+0000","last_active":"2023-10-19T08:38:02.336533+0000","last_peered":"2023-10-19T08:38:02.336533+0000","last_clean":"2023-10-19T08:38:02.336533+0000","last_became_active":"2023-10-19T08:37:51.153093+0000","last_became_peered":"2023-10-19T08:37:51.153093+0000","last_unstale":"2023-10-19T08:38:02.336533+0000","last_undegraded":"2023-10-19T08:38:02.336533+0000","last_fullsized":"2023-10-19T08:38:02.336533+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:17.404738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302485+0000","last_change":"2023-10-19T08:37:56.285142+0000","last_active":"2023-10-19T08:38:02.302485+0000","last_peered":"2023-10-19T08:38:02.302485+0000","last_clean":"2023-10-19T08:38:02.302485+0000","last_became_active":"2023-10-19T08:37:56.284717+0000","last_became_peered":"2023-10-19T08:37:56.284717+0000","last_unstale":"2023-10-19T08:38:02.302485+0000","last_undegraded":"2023-10-19T08:38:02.302485+0000","last_fullsized":"2023-10-19T08:38:02.302485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:08.099452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337159+0000","last_change":"2023-10-19T08:37:57.287714+0000","last_active":"2023-10-19T08:38:02.337159+0000","last_peered":"2023-10-19T08:38:02.337159+0000","last_clean":"2023-10-19T08:38:02.337159+0000","last_became_active":"2023-10-19T08:37:57.287427+0000","last_became_peered":"2023-10-19T08:37:57.287427+0000","last_unstale":"2023-10-19T08:38:02.337159+0000","last_undegraded":"2023-10-19T08:38:02.337159+0000","last_fullsized":"2023-10-19T08:38:02.337159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:55:59.475158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303093+0000","last_change":"2023-10-19T08:38:01.343223+0000","last_active":"2023-10-19T08:38:02.303093+0000","last_peered":"2023-10-19T08:38:02.303093+0000","last_clean":"2023-10-19T08:38:02.303093+0000","last_became_active":"2023-10-19T08:38:01.342425+0000","last_became_peered":"2023-10-19T08:38:01.342425+0000","last_unstale":"2023-10-19T08:38:02.303093+0000","last_undegraded":"2023-10-19T08:38:02.303093+0000","last_fullsized":"2023-10-19T08:38:02.303093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:13.159933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336674+0000","last_change":"2023-10-19T08:37:51.118439+0000","last_active":"2023-10-19T08:38:02.336674+0000","last_peered":"2023-10-19T08:38:02.336674+0000","last_clean":"2023-10-19T08:38:02.336674+0000","last_became_active":"2023-10-19T08:37:51.118146+0000","last_became_peered":"2023-10-19T08:37:51.118146+0000","last_unstale":"2023-10-19T08:38:02.336674+0000","last_undegraded":"2023-10-19T08:38:02.336674+0000","last_fullsized":"2023-10-19T08:38:02.336674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:34.935038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327100+0000","last_change":"2023-10-19T08:37:56.275735+0000","last_active":"2023-10-19T08:38:02.327100+0000","last_peered":"2023-10-19T08:38:02.327100+0000","last_clean":"2023-10-19T08:38:02.327100+0000","last_became_active":"2023-10-19T08:37:56.275386+0000","last_became_peered":"2023-10-19T08:37:56.275386+0000","last_unstale":"2023-10-19T08:38:02.327100+0000","last_undegraded":"2023-10-19T08:38:02.327100+0000","last_fullsized":"2023-10-19T08:38:02.327100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:48.374663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328345+0000","last_change":"2023-10-19T08:37:57.280800+0000","last_active":"2023-10-19T08:38:02.328345+0000","last_peered":"2023-10-19T08:38:02.328345+0000","last_clean":"2023-10-19T08:38:02.328345+0000","last_became_active":"2023-10-19T08:37:57.280464+0000","last_became_peered":"2023-10-19T08:37:57.280464+0000","last_unstale":"2023-10-19T08:38:02.328345+0000","last_undegraded":"2023-10-19T08:38:02.328345+0000","last_fullsized":"2023-10-19T08:38:02.328345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:21.864097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336567+0000","last_change":"2023-10-19T08:38:01.335275+0000","last_active":"2023-10-19T08:38:02.336567+0000","last_peered":"2023-10-19T08:38:02.336567+0000","last_clean":"2023-10-19T08:38:02.336567+0000","last_became_active":"2023-10-19T08:38:01.334707+0000","last_became_peered":"2023-10-19T08:38:01.334707+0000","last_unstale":"2023-10-19T08:38:02.336567+0000","last_undegraded":"2023-10-19T08:38:02.336567+0000","last_fullsized":"2023-10-19T08:38:02.336567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:03.691358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338327+0000","last_change":"2023-10-19T08:37:51.153416+0000","last_active":"2023-10-19T08:38:02.338327+0000","last_peered":"2023-10-19T08:38:02.338327+0000","last_clean":"2023-10-19T08:38:02.338327+0000","last_became_active":"2023-10-19T08:37:51.152844+0000","last_became_peered":"2023-10-19T08:37:51.152844+0000","last_unstale":"2023-10-19T08:38:02.338327+0000","last_undegraded":"2023-10-19T08:38:02.338327+0000","last_fullsized":"2023-10-19T08:38:02.338327+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:10.215323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336833+0000","last_change":"2023-10-19T08:37:56.284323+0000","last_active":"2023-10-19T08:38:02.336833+0000","last_peered":"2023-10-19T08:38:02.336833+0000","last_clean":"2023-10-19T08:38:02.336833+0000","last_became_active":"2023-10-19T08:37:56.283556+0000","last_became_peered":"2023-10-19T08:37:56.283556+0000","last_unstale":"2023-10-19T08:38:02.336833+0000","last_undegraded":"2023-10-19T08:38:02.336833+0000","last_fullsized":"2023-10-19T08:38:02.336833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:22.553042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327868+0000","last_change":"2023-10-19T08:37:57.283892+0000","last_active":"2023-10-19T08:38:02.327868+0000","last_peered":"2023-10-19T08:38:02.327868+0000","last_clean":"2023-10-19T08:38:02.327868+0000","last_became_active":"2023-10-19T08:37:57.283605+0000","last_became_peered":"2023-10-19T08:37:57.283605+0000","last_unstale":"2023-10-19T08:38:02.327868+0000","last_undegraded":"2023-10-19T08:38:02.327868+0000","last_fullsized":"2023-10-19T08:38:02.327868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:23.560291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336875+0000","last_change":"2023-10-19T08:38:01.348839+0000","last_active":"2023-10-19T08:38:02.336875+0000","last_peered":"2023-10-19T08:38:02.336875+0000","last_clean":"2023-10-19T08:38:02.336875+0000","last_became_active":"2023-10-19T08:38:01.348383+0000","last_became_peered":"2023-10-19T08:38:01.348383+0000","last_unstale":"2023-10-19T08:38:02.336875+0000","last_undegraded":"2023-10-19T08:38:02.336875+0000","last_fullsized":"2023-10-19T08:38:02.336875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:28:33.114633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303327+0000","last_change":"2023-10-19T08:37:56.285043+0000","last_active":"2023-10-19T08:38:02.303327+0000","last_peered":"2023-10-19T08:38:02.303327+0000","last_clean":"2023-10-19T08:38:02.303327+0000","last_became_active":"2023-10-19T08:37:56.284744+0000","last_became_peered":"2023-10-19T08:37:56.284744+0000","last_unstale":"2023-10-19T08:38:02.303327+0000","last_undegraded":"2023-10-19T08:38:02.303327+0000","last_fullsized":"2023-10-19T08:38:02.303327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:49.109159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336864+0000","last_change":"2023-10-19T08:37:51.124188+0000","last_active":"2023-10-19T08:38:02.336864+0000","last_peered":"2023-10-19T08:38:02.336864+0000","last_clean":"2023-10-19T08:38:02.336864+0000","last_became_active":"2023-10-19T08:37:51.123944+0000","last_became_peered":"2023-10-19T08:37:51.123944+0000","last_unstale":"2023-10-19T08:38:02.336864+0000","last_undegraded":"2023-10-19T08:38:02.336864+0000","last_fullsized":"2023-10-19T08:38:02.336864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:15.708544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302239+0000","last_change":"2023-10-19T08:37:57.292133+0000","last_active":"2023-10-19T08:38:02.302239+0000","last_peered":"2023-10-19T08:38:02.302239+0000","last_clean":"2023-10-19T08:38:02.302239+0000","last_became_active":"2023-10-19T08:37:57.291516+0000","last_became_peered":"2023-10-19T08:37:57.291516+0000","last_unstale":"2023-10-19T08:38:02.302239+0000","last_undegraded":"2023-10-19T08:38:02.302239+0000","last_fullsized":"2023-10-19T08:38:02.302239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:41.090590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302236+0000","last_change":"2023-10-19T08:38:01.346818+0000","last_active":"2023-10-19T08:38:02.302236+0000","last_peered":"2023-10-19T08:38:02.302236+0000","last_clean":"2023-10-19T08:38:02.302236+0000","last_became_active":"2023-10-19T08:38:01.346160+0000","last_became_peered":"2023-10-19T08:38:01.346160+0000","last_unstale":"2023-10-19T08:38:02.302236+0000","last_undegraded":"2023-10-19T08:38:02.302236+0000","last_fullsized":"2023-10-19T08:38:02.302236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:58:38.199370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337121+0000","last_change":"2023-10-19T08:37:52.296732+0000","last_active":"2023-10-19T08:38:02.337121+0000","last_peered":"2023-10-19T08:38:02.337121+0000","last_clean":"2023-10-19T08:38:02.337121+0000","last_became_active":"2023-10-19T08:37:52.296445+0000","last_became_peered":"2023-10-19T08:37:52.296445+0000","last_unstale":"2023-10-19T08:38:02.337121+0000","last_undegraded":"2023-10-19T08:38:02.337121+0000","last_fullsized":"2023-10-19T08:38:02.337121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:06:03.911706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328377+0000","last_change":"2023-10-19T08:37:56.284122+0000","last_active":"2023-10-19T08:38:02.328377+0000","last_peered":"2023-10-19T08:38:02.328377+0000","last_clean":"2023-10-19T08:38:02.328377+0000","last_became_active":"2023-10-19T08:37:56.283849+0000","last_became_peered":"2023-10-19T08:37:56.283849+0000","last_unstale":"2023-10-19T08:38:02.328377+0000","last_undegraded":"2023-10-19T08:38:02.328377+0000","last_fullsized":"2023-10-19T08:38:02.328377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:39.158559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336659+0000","last_change":"2023-10-19T08:37:57.285543+0000","last_active":"2023-10-19T08:38:02.336659+0000","last_peered":"2023-10-19T08:38:02.336659+0000","last_clean":"2023-10-19T08:38:02.336659+0000","last_became_active":"2023-10-19T08:37:57.284966+0000","last_became_peered":"2023-10-19T08:37:57.284966+0000","last_unstale":"2023-10-19T08:38:02.336659+0000","last_undegraded":"2023-10-19T08:38:02.336659+0000","last_fullsized":"2023-10-19T08:38:02.336659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:07:16.162389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336877+0000","last_change":"2023-10-19T08:38:01.351967+0000","last_active":"2023-10-19T08:38:02.336877+0000","last_peered":"2023-10-19T08:38:02.336877+0000","last_clean":"2023-10-19T08:38:02.336877+0000","last_became_active":"2023-10-19T08:38:01.351672+0000","last_became_peered":"2023-10-19T08:38:01.351672+0000","last_unstale":"2023-10-19T08:38:02.336877+0000","last_undegraded":"2023-10-19T08:38:02.336877+0000","last_fullsized":"2023-10-19T08:38:02.336877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:56.518286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327742+0000","last_change":"2023-10-19T08:37:56.276005+0000","last_active":"2023-10-19T08:38:02.327742+0000","last_peered":"2023-10-19T08:38:02.327742+0000","last_clean":"2023-10-19T08:38:02.327742+0000","last_became_active":"2023-10-19T08:37:56.275738+0000","last_became_peered":"2023-10-19T08:37:56.275738+0000","last_unstale":"2023-10-19T08:38:02.327742+0000","last_undegraded":"2023-10-19T08:38:02.327742+0000","last_fullsized":"2023-10-19T08:38:02.327742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:01.303025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336641+0000","last_change":"2023-10-19T08:37:57.282141+0000","last_active":"2023-10-19T08:38:02.336641+0000","last_peered":"2023-10-19T08:38:02.336641+0000","last_clean":"2023-10-19T08:38:02.336641+0000","last_became_active":"2023-10-19T08:37:57.281854+0000","last_became_peered":"2023-10-19T08:37:57.281854+0000","last_unstale":"2023-10-19T08:38:02.336641+0000","last_undegraded":"2023-10-19T08:38:02.336641+0000","last_fullsized":"2023-10-19T08:38:02.336641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:08:06.606119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337880+0000","last_change":"2023-10-19T08:38:01.345085+0000","last_active":"2023-10-19T08:38:02.337880+0000","last_peered":"2023-10-19T08:38:02.337880+0000","last_clean":"2023-10-19T08:38:02.337880+0000","last_became_active":"2023-10-19T08:38:01.344682+0000","last_became_peered":"2023-10-19T08:38:01.344682+0000","last_unstale":"2023-10-19T08:38:02.337880+0000","last_undegraded":"2023-10-19T08:38:02.337880+0000","last_fullsized":"2023-10-19T08:38:02.337880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:13.159933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302932+0000","last_change":"2023-10-19T08:37:56.279226+0000","last_active":"2023-10-19T08:38:02.302932+0000","last_peered":"2023-10-19T08:38:02.302932+0000","last_clean":"2023-10-19T08:38:02.302932+0000","last_became_active":"2023-10-19T08:37:56.278922+0000","last_became_peered":"2023-10-19T08:37:56.278922+0000","last_unstale":"2023-10-19T08:38:02.302932+0000","last_undegraded":"2023-10-19T08:38:02.302932+0000","last_fullsized":"2023-10-19T08:38:02.302932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:29.730980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337314+0000","last_change":"2023-10-19T08:37:57.295005+0000","last_active":"2023-10-19T08:38:02.337314+0000","last_peered":"2023-10-19T08:38:02.337314+0000","last_clean":"2023-10-19T08:38:02.337314+0000","last_became_active":"2023-10-19T08:37:57.294608+0000","last_became_peered":"2023-10-19T08:37:57.294608+0000","last_unstale":"2023-10-19T08:38:02.337314+0000","last_undegraded":"2023-10-19T08:38:02.337314+0000","last_fullsized":"2023-10-19T08:38:02.337314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:49:06.947549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302938+0000","last_change":"2023-10-19T08:38:01.340671+0000","last_active":"2023-10-19T08:38:02.302938+0000","last_peered":"2023-10-19T08:38:02.302938+0000","last_clean":"2023-10-19T08:38:02.302938+0000","last_became_active":"2023-10-19T08:38:01.340227+0000","last_became_peered":"2023-10-19T08:38:01.340227+0000","last_unstale":"2023-10-19T08:38:02.302938+0000","last_undegraded":"2023-10-19T08:38:02.302938+0000","last_fullsized":"2023-10-19T08:38:02.302938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:25.917329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303068+0000","last_change":"2023-10-19T08:37:56.279662+0000","last_active":"2023-10-19T08:38:02.303068+0000","last_peered":"2023-10-19T08:38:02.303068+0000","last_clean":"2023-10-19T08:38:02.303068+0000","last_became_active":"2023-10-19T08:37:56.279082+0000","last_became_peered":"2023-10-19T08:37:56.279082+0000","last_unstale":"2023-10-19T08:38:02.303068+0000","last_undegraded":"2023-10-19T08:38:02.303068+0000","last_fullsized":"2023-10-19T08:38:02.303068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:15.152471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336105+0000","last_change":"2023-10-19T08:37:57.291366+0000","last_active":"2023-10-19T08:38:02.336105+0000","last_peered":"2023-10-19T08:38:02.336105+0000","last_clean":"2023-10-19T08:38:02.336105+0000","last_became_active":"2023-10-19T08:37:57.291122+0000","last_became_peered":"2023-10-19T08:37:57.291122+0000","last_unstale":"2023-10-19T08:38:02.336105+0000","last_undegraded":"2023-10-19T08:38:02.336105+0000","last_fullsized":"2023-10-19T08:38:02.336105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:10:57.605170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336071+0000","last_change":"2023-10-19T08:38:01.343824+0000","last_active":"2023-10-19T08:38:02.336071+0000","last_peered":"2023-10-19T08:38:02.336071+0000","last_clean":"2023-10-19T08:38:02.336071+0000","last_became_active":"2023-10-19T08:38:01.343411+0000","last_became_peered":"2023-10-19T08:38:01.343411+0000","last_unstale":"2023-10-19T08:38:02.336071+0000","last_undegraded":"2023-10-19T08:38:02.336071+0000","last_fullsized":"2023-10-19T08:38:02.336071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:18:50.610592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302995+0000","last_change":"2023-10-19T08:37:56.279882+0000","last_active":"2023-10-19T08:38:02.302995+0000","last_peered":"2023-10-19T08:38:02.302995+0000","last_clean":"2023-10-19T08:38:02.302995+0000","last_became_active":"2023-10-19T08:37:56.279620+0000","last_became_peered":"2023-10-19T08:37:56.279620+0000","last_unstale":"2023-10-19T08:38:02.302995+0000","last_undegraded":"2023-10-19T08:38:02.302995+0000","last_fullsized":"2023-10-19T08:38:02.302995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:58:27.340847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302471+0000","last_change":"2023-10-19T08:37:57.291911+0000","last_active":"2023-10-19T08:38:02.302471+0000","last_peered":"2023-10-19T08:38:02.302471+0000","last_clean":"2023-10-19T08:38:02.302471+0000","last_became_active":"2023-10-19T08:37:57.291157+0000","last_became_peered":"2023-10-19T08:37:57.291157+0000","last_unstale":"2023-10-19T08:38:02.302471+0000","last_undegraded":"2023-10-19T08:38:02.302471+0000","last_fullsized":"2023-10-19T08:38:02.302471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:40.165807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337238+0000","last_change":"2023-10-19T08:38:01.350894+0000","last_active":"2023-10-19T08:38:02.337238+0000","last_peered":"2023-10-19T08:38:02.337238+0000","last_clean":"2023-10-19T08:38:02.337238+0000","last_became_active":"2023-10-19T08:38:01.347794+0000","last_became_peered":"2023-10-19T08:38:01.347794+0000","last_unstale":"2023-10-19T08:38:02.337238+0000","last_undegraded":"2023-10-19T08:38:02.337238+0000","last_fullsized":"2023-10-19T08:38:02.337238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:47.081654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328719+0000","last_change":"2023-10-19T08:37:56.285044+0000","last_active":"2023-10-19T08:38:02.328719+0000","last_peered":"2023-10-19T08:38:02.328719+0000","last_clean":"2023-10-19T08:38:02.328719+0000","last_became_active":"2023-10-19T08:37:56.284825+0000","last_became_peered":"2023-10-19T08:37:56.284825+0000","last_unstale":"2023-10-19T08:38:02.328719+0000","last_undegraded":"2023-10-19T08:38:02.328719+0000","last_fullsized":"2023-10-19T08:38:02.328719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:15.363627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336251+0000","last_change":"2023-10-19T08:37:57.287724+0000","last_active":"2023-10-19T08:38:02.336251+0000","last_peered":"2023-10-19T08:38:02.336251+0000","last_clean":"2023-10-19T08:38:02.336251+0000","last_became_active":"2023-10-19T08:37:57.287402+0000","last_became_peered":"2023-10-19T08:37:57.287402+0000","last_unstale":"2023-10-19T08:38:02.336251+0000","last_undegraded":"2023-10-19T08:38:02.336251+0000","last_fullsized":"2023-10-19T08:38:02.336251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:11:01.726937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336321+0000","last_change":"2023-10-19T08:37:57.280610+0000","last_active":"2023-10-19T08:38:02.336321+0000","last_peered":"2023-10-19T08:38:02.336321+0000","last_clean":"2023-10-19T08:38:02.336321+0000","last_became_active":"2023-10-19T08:37:57.280180+0000","last_became_peered":"2023-10-19T08:37:57.280180+0000","last_unstale":"2023-10-19T08:38:02.336321+0000","last_undegraded":"2023-10-19T08:38:02.336321+0000","last_fullsized":"2023-10-19T08:38:02.336321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:50:11.458306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302739+0000","last_change":"2023-10-19T08:37:57.292317+0000","last_active":"2023-10-19T08:38:02.302739+0000","last_peered":"2023-10-19T08:38:02.302739+0000","last_clean":"2023-10-19T08:38:02.302739+0000","last_became_active":"2023-10-19T08:37:57.291863+0000","last_became_peered":"2023-10-19T08:37:57.291863+0000","last_unstale":"2023-10-19T08:38:02.302739+0000","last_undegraded":"2023-10-19T08:38:02.302739+0000","last_fullsized":"2023-10-19T08:38:02.302739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:45:25.612225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337065+0000","last_change":"2023-10-19T08:37:57.289937+0000","last_active":"2023-10-19T08:38:02.337065+0000","last_peered":"2023-10-19T08:38:02.337065+0000","last_clean":"2023-10-19T08:38:02.337065+0000","last_became_active":"2023-10-19T08:37:57.289356+0000","last_became_peered":"2023-10-19T08:37:57.289356+0000","last_unstale":"2023-10-19T08:38:02.337065+0000","last_undegraded":"2023-10-19T08:38:02.337065+0000","last_fullsized":"2023-10-19T08:38:02.337065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:46.461250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302347+0000","last_change":"2023-10-19T08:37:57.292611+0000","last_active":"2023-10-19T08:38:02.302347+0000","last_peered":"2023-10-19T08:38:02.302347+0000","last_clean":"2023-10-19T08:38:02.302347+0000","last_became_active":"2023-10-19T08:37:57.291906+0000","last_became_peered":"2023-10-19T08:37:57.291906+0000","last_unstale":"2023-10-19T08:38:02.302347+0000","last_undegraded":"2023-10-19T08:38:02.302347+0000","last_fullsized":"2023-10-19T08:38:02.302347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:52.465054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336760+0000","last_change":"2023-10-19T08:37:57.288360+0000","last_active":"2023-10-19T08:38:02.336760+0000","last_peered":"2023-10-19T08:38:02.336760+0000","last_clean":"2023-10-19T08:38:02.336760+0000","last_became_active":"2023-10-19T08:37:57.288107+0000","last_became_peered":"2023-10-19T08:37:57.288107+0000","last_unstale":"2023-10-19T08:38:02.336760+0000","last_undegraded":"2023-10-19T08:38:02.336760+0000","last_fullsized":"2023-10-19T08:38:02.336760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:02.310273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":888832,"data_stored":704558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":110132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":110132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":699721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":109148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":110222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":112669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":110784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-19T08:38:21.871 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-19T08:38:21.872 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-19T08:38:21.872 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-19T08:38:21.873 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-19T08:38:21.873 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-19T08:38:22.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.018+0000 7f0decf38700 1 Processor -- start 2023-10-19T08:38:22.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.018+0000 7f0decf38700 1 -- start start 2023-10-19T08:38:22.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.019+0000 7f0decf38700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0de80d0890 0x7f0de80d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.019+0000 7f0decf38700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0de80cedf0 0x7f0de80b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.019+0000 7f0decf38700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de80cfd90 con 0x7f0de815af90 2023-10-19T08:38:22.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.019+0000 7f0decf38700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de80b3f20 con 0x7f0de80cedf0 2023-10-19T08:38:22.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.019+0000 7f0decf38700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de80cf2a0 con 0x7f0de80d0890 2023-10-19T08:38:22.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.019+0000 7f0de6d9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0de80cedf0 0x7f0de80b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.019+0000 7f0de5d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0de80d0890 0x7f0de80d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.019+0000 7f0de5d9b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0de80d0890 0x7f0de80d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:48816/0 (socket says 172.21.15.79:48816) 2023-10-19T08:38:22.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.019+0000 7f0de5d9b700 1 -- 172.21.15.79:0/1073016865 learned_addr learned my addr 172.21.15.79:0/1073016865 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:22.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.019+0000 7f0de559a700 1 -- 172.21.15.79:0/1073016865 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2146879509 0 0) 0x7f0de80cfd90 con 0x7f0de815af90 2023-10-19T08:38:22.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.019+0000 7f0de559a700 1 -- 172.21.15.79:0/1073016865 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dd00035b0 con 0x7f0de815af90 2023-10-19T08:38:22.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.019+0000 7f0de5d9b700 1 -- 172.21.15.79:0/1073016865 >> v2:172.21.15.89:3300/0 conn(0x7f0de80cedf0 msgr2=0x7f0de80b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:22.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.019+0000 7f0de5d9b700 1 --2- 172.21.15.79:0/1073016865 >> v2:172.21.15.89:3300/0 conn(0x7f0de80cedf0 0x7f0de80b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.019+0000 7f0de5d9b700 1 -- 172.21.15.79:0/1073016865 >> v1:172.21.15.89:6789/0 conn(0x7f0de815af90 legacy=0x7f0de80d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:22.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.019+0000 7f0de5d9b700 1 -- 172.21.15.79:0/1073016865 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de80cf4f0 con 0x7f0de80d0890 2023-10-19T08:38:22.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.019+0000 7f0de6d9d700 1 --2- 172.21.15.79:0/1073016865 >> v2:172.21.15.89:3300/0 conn(0x7f0de80cedf0 0x7f0de80b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:38:22.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.020+0000 7f0de5d9b700 1 --2- 172.21.15.79:0/1073016865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0de80d0890 0x7f0de80d1680 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0098f0 tx=0x7f0ddc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=562344e17272aca3 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:22.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.020+0000 7f0de559a700 1 -- 172.21.15.79:0/1073016865 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc011830 con 0x7f0de80d0890 2023-10-19T08:38:22.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.020+0000 7f0de559a700 1 -- 172.21.15.79:0/1073016865 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ddc011990 con 0x7f0de80d0890 2023-10-19T08:38:22.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.020+0000 7f0de559a700 1 -- 172.21.15.79:0/1073016865 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc011d20 con 0x7f0de80d0890 2023-10-19T08:38:22.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.020+0000 7f0decf38700 1 -- 172.21.15.79:0/1073016865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0de80d0890 msgr2=0x7f0de80d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:22.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.020+0000 7f0decf38700 1 --2- 172.21.15.79:0/1073016865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0de80d0890 0x7f0de80d1680 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0098f0 tx=0x7f0ddc009c00 comp rx=0 tx=0).stop 2023-10-19T08:38:22.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.020+0000 7f0decf38700 1 -- 172.21.15.79:0/1073016865 shutdown_connections 2023-10-19T08:38:22.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.020+0000 7f0decf38700 1 --2- 172.21.15.79:0/1073016865 >> v2:172.21.15.89:3300/0 conn(0x7f0de80cedf0 0x7f0de80b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.020+0000 7f0decf38700 1 --2- 172.21.15.79:0/1073016865 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0de80d0890 0x7f0de80d1680 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.020+0000 7f0decf38700 1 -- 172.21.15.79:0/1073016865 >> 172.21.15.79:0/1073016865 conn(0x7f0de806a400 msgr2=0x7f0de806a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:22.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.020+0000 7f0decf38700 1 -- 172.21.15.79:0/1073016865 shutdown_connections 2023-10-19T08:38:22.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.020+0000 7f0decf38700 1 -- 172.21.15.79:0/1073016865 wait complete. 2023-10-19T08:38:22.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.022+0000 7f0decf38700 1 Processor -- start 2023-10-19T08:38:22.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.022+0000 7f0decf38700 1 -- start start 2023-10-19T08:38:22.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.022+0000 7f0decf38700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0de80cedf0 0x7f0de8148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.022+0000 7f0decf38700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0de80d0890 0x7f0de80c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.022+0000 7f0decf38700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0de815af90 0x7f0de80c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.022+0000 7f0decf38700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de814a2d0 con 0x7f0de815af90 2023-10-19T08:38:22.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.022+0000 7f0decf38700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de8149400 con 0x7f0de80d0890 2023-10-19T08:38:22.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.023+0000 7f0decf38700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de8149650 con 0x7f0de80cedf0 2023-10-19T08:38:22.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.023+0000 7f0de6d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0de815af90 0x7f0de80c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.023+0000 7f0de6d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0de815af90 0x7f0de80c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46200/0 (socket says 172.21.15.79:46200) 2023-10-19T08:38:22.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.023+0000 7f0de6d9d700 1 -- 172.21.15.79:0/3859419086 learned_addr learned my addr 172.21.15.79:0/3859419086 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:22.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.023+0000 7f0de659c700 1 --2- 172.21.15.79:0/3859419086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0de80cedf0 0x7f0de8148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.023+0000 7f0de5d9b700 1 --2- 172.21.15.79:0/3859419086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0de80d0890 0x7f0de80c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.023+0000 7f0de6d9d700 1 -- 172.21.15.79:0/3859419086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0de80cedf0 msgr2=0x7f0de8148d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:22.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.023+0000 7f0de6d9d700 1 --2- 172.21.15.79:0/3859419086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0de80cedf0 0x7f0de8148d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.023+0000 7f0de6d9d700 1 -- 172.21.15.79:0/3859419086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0de80d0890 msgr2=0x7f0de80c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:22.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.023+0000 7f0de6d9d700 1 --2- 172.21.15.79:0/3859419086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0de80d0890 0x7f0de80c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.023+0000 7f0de6d9d700 1 -- 172.21.15.79:0/3859419086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de0009a70 con 0x7f0de815af90 2023-10-19T08:38:22.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.023+0000 7f0de659c700 1 --2- 172.21.15.79:0/3859419086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0de80cedf0 0x7f0de8148d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:22.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.023+0000 7f0de6d9d700 1 --2- 172.21.15.79:0/3859419086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0de815af90 0x7f0de80c9740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0de000efc0 tx=0x7f0de000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:22.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.023+0000 7f0dd6ffd700 1 -- 172.21.15.79:0/3859419086 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de0009d70 con 0x7f0de815af90 2023-10-19T08:38:22.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.023+0000 7f0dd6ffd700 1 -- 172.21.15.79:0/3859419086 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de000f040 con 0x7f0de815af90 2023-10-19T08:38:22.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.023+0000 7f0decf38700 1 -- 172.21.15.79:0/3859419086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ddc009550 con 0x7f0de815af90 2023-10-19T08:38:22.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.023+0000 7f0dd6ffd700 1 -- 172.21.15.79:0/3859419086 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de000ce00 con 0x7f0de815af90 2023-10-19T08:38:22.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.023+0000 7f0decf38700 1 -- 172.21.15.79:0/3859419086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de8149c10 con 0x7f0de815af90 2023-10-19T08:38:22.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.024+0000 7f0decf38700 1 -- 172.21.15.79:0/3859419086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de814a410 con 0x7f0de815af90 2023-10-19T08:38:22.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.025+0000 7f0dd6ffd700 1 -- 172.21.15.79:0/3859419086 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0de0014480 con 0x7f0de815af90 2023-10-19T08:38:22.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.025+0000 7f0dd6ffd700 1 --2- 172.21.15.79:0/3859419086 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0dc806a0e0 0x7f0dc806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.025+0000 7f0dd6ffd700 1 -- 172.21.15.79:0/3859419086 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0de0088f40 con 0x7f0de815af90 2023-10-19T08:38:22.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.025+0000 7f0de659c700 1 --2- 172.21.15.79:0/3859419086 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0dc806a0e0 0x7f0dc806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.026+0000 7f0de659c700 1 --2- 172.21.15.79:0/3859419086 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0dc806a0e0 0x7f0dc806c5a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80011e0 tx=0x7f0dd8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:22.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.030+0000 7f0dd6ffd700 1 -- 172.21.15.79:0/3859419086 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f0de814a410 con 0x7f0de815af90 2023-10-19T08:38:22.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.274+0000 7f0decf38700 1 -- 172.21.15.79:0/3859419086 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0de814a410 con 0x7f0de815af90 2023-10-19T08:38:22.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.277+0000 7f0dd6ffd700 1 -- 172.21.15.79:0/3859419086 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169488 (secure 0 0 0) 0x7f0de814a410 con 0x7f0de815af90 2023-10-19T08:38:22.283 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:22.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.279+0000 7f0decf38700 1 -- 172.21.15.79:0/3859419086 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0dc806a0e0 msgr2=0x7f0dc806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:22.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.279+0000 7f0decf38700 1 --2- 172.21.15.79:0/3859419086 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0dc806a0e0 0x7f0dc806c5a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0dd80011e0 tx=0x7f0dd8009040 comp rx=0 tx=0).stop 2023-10-19T08:38:22.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.279+0000 7f0decf38700 1 -- 172.21.15.79:0/3859419086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0de815af90 msgr2=0x7f0de80c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:22.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.279+0000 7f0decf38700 1 --2- 172.21.15.79:0/3859419086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0de815af90 0x7f0de80c9740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0de000efc0 tx=0x7f0de000c3a0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.280+0000 7f0decf38700 1 -- 172.21.15.79:0/3859419086 shutdown_connections 2023-10-19T08:38:22.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.280+0000 7f0decf38700 1 --2- 172.21.15.79:0/3859419086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0de815af90 0x7f0de80c9740 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.280+0000 7f0decf38700 1 --2- 172.21.15.79:0/3859419086 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0dc806a0e0 0x7f0dc806c5a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.280+0000 7f0decf38700 1 --2- 172.21.15.79:0/3859419086 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0de80cedf0 0x7f0de8148d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.280+0000 7f0decf38700 1 --2- 172.21.15.79:0/3859419086 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0de80d0890 0x7f0de80c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.280+0000 7f0decf38700 1 -- 172.21.15.79:0/3859419086 >> 172.21.15.79:0/3859419086 conn(0x7f0de806a400 msgr2=0x7f0de80b5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:22.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.280+0000 7f0decf38700 1 -- 172.21.15.79:0/3859419086 shutdown_connections 2023-10-19T08:38:22.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.280+0000 7f0decf38700 1 -- 172.21.15.79:0/3859419086 wait complete. 2023-10-19T08:38:22.295 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":5,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":316135984},{"type":"v1","addr":"172.21.15.79:6833","nonce":316135984}]},"active_addr":"172.21.15.79:6833/316135984","active_change":"2023-10-19T08:37:43.087538+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":2031435469}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":832690691}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":1826607048}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":3559411106}]}]} 2023-10-19T08:38:22.299 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-19T08:38:22.299 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-19T08:38:22.299 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:22.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.416+0000 7fdf5539e700 1 Processor -- start 2023-10-19T08:38:22.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.416+0000 7fdf5539e700 1 -- start start 2023-10-19T08:38:22.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.417+0000 7fdf5539e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdf5015d060 0x7fdf500d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.417+0000 7fdf5539e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdf500b8590 0x7fdf500b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.417+0000 7fdf5539e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf500b5080 con 0x7fdf500b4c30 2023-10-19T08:38:22.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.417+0000 7fdf5539e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf500d1850 con 0x7fdf500b8590 2023-10-19T08:38:22.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.417+0000 7fdf5539e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf500d1b30 con 0x7fdf5015d060 2023-10-19T08:38:22.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.417+0000 7fdf4f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdf500b8590 0x7fdf500b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.417+0000 7fdf4f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdf500b8590 0x7fdf500b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46206/0 (socket says 172.21.15.79:46206) 2023-10-19T08:38:22.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.417+0000 7fdf54b9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdf500b4c30 0x7fdf5006b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56280/0 (socket says 172.21.15.79:56280) 2023-10-19T08:38:22.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.417+0000 7fdf4f7fe700 1 -- 172.21.15.79:0/3812052480 learned_addr learned my addr 172.21.15.79:0/3812052480 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:22.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.417+0000 7fdf4ffff700 1 --2- 172.21.15.79:0/3812052480 >> v2:172.21.15.89:3300/0 conn(0x7fdf5015d060 0x7fdf500d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.417+0000 7fdf4f7fe700 1 -- 172.21.15.79:0/3812052480 >> v2:172.21.15.89:3300/0 conn(0x7fdf5015d060 msgr2=0x7fdf500d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:22.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.417+0000 7fdf4f7fe700 1 --2- 172.21.15.79:0/3812052480 >> v2:172.21.15.89:3300/0 conn(0x7fdf5015d060 0x7fdf500d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.417+0000 7fdf4f7fe700 1 -- 172.21.15.79:0/3812052480 >> v1:172.21.15.79:6789/0 conn(0x7fdf500b4c30 legacy=0x7fdf5006b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:22.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.417+0000 7fdf4effd700 1 -- 172.21.15.79:0/3812052480 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780184283 0 0) 0x7fdf48001490 con 0x7fdf500b4c30 2023-10-19T08:38:22.426 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.418+0000 7fdf4f7fe700 1 -- 172.21.15.79:0/3812052480 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf500d1e10 con 0x7fdf500b8590 2023-10-19T08:38:22.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.418+0000 7fdf4f7fe700 1 --2- 172.21.15.79:0/3812052480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf500b8590 0x7fdf500b46f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdf500cd4c0 tx=0x7fdf40009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81d2870c423e81 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:22.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.418+0000 7fdf4effd700 1 -- 172.21.15.79:0/3812052480 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4000b870 con 0x7fdf500b8590 2023-10-19T08:38:22.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.418+0000 7fdf4effd700 1 -- 172.21.15.79:0/3812052480 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4000b9d0 con 0x7fdf500b8590 2023-10-19T08:38:22.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.418+0000 7fdf4effd700 1 -- 172.21.15.79:0/3812052480 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4000bd60 con 0x7fdf500b8590 2023-10-19T08:38:22.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.418+0000 7fdf5539e700 1 -- 172.21.15.79:0/3812052480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf500b8590 msgr2=0x7fdf500b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:22.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.418+0000 7fdf5539e700 1 --2- 172.21.15.79:0/3812052480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf500b8590 0x7fdf500b46f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdf500cd4c0 tx=0x7fdf40009bd0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.418+0000 7fdf5539e700 1 -- 172.21.15.79:0/3812052480 shutdown_connections 2023-10-19T08:38:22.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.418+0000 7fdf5539e700 1 --2- 172.21.15.79:0/3812052480 >> v2:172.21.15.89:3300/0 conn(0x7fdf5015d060 0x7fdf500d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.418+0000 7fdf5539e700 1 --2- 172.21.15.79:0/3812052480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf500b8590 0x7fdf500b46f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.418+0000 7fdf5539e700 1 -- 172.21.15.79:0/3812052480 >> 172.21.15.79:0/3812052480 conn(0x7fdf50071fb0 msgr2=0x7fdf500cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:22.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.418+0000 7fdf5539e700 1 -- 172.21.15.79:0/3812052480 shutdown_connections 2023-10-19T08:38:22.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.418+0000 7fdf5539e700 1 -- 172.21.15.79:0/3812052480 wait complete. 2023-10-19T08:38:22.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.420+0000 7fdf5539e700 1 Processor -- start 2023-10-19T08:38:22.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.420+0000 7fdf5539e700 1 -- start start 2023-10-19T08:38:22.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf5539e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf500b4c30 0x7fdf5014a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf5539e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf500b8590 0x7fdf500b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf5539e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf5015d060 0x7fdf500b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf5539e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf500cc630 con 0x7fdf5015d060 2023-10-19T08:38:22.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf5539e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf501f27b0 con 0x7fdf500b8590 2023-10-19T08:38:22.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf5539e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf501e3880 con 0x7fdf500b4c30 2023-10-19T08:38:22.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf54b9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf5015d060 0x7fdf500b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf54b9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf5015d060 0x7fdf500b62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46214/0 (socket says 172.21.15.79:46214) 2023-10-19T08:38:22.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf54b9d700 1 -- 172.21.15.79:0/2379324903 learned_addr learned my addr 172.21.15.79:0/2379324903 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:22.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf4f7fe700 1 --2- 172.21.15.79:0/2379324903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf500b8590 0x7fdf500b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf4ffff700 1 --2- 172.21.15.79:0/2379324903 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf500b4c30 0x7fdf5014a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf54b9d700 1 -- 172.21.15.79:0/2379324903 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf500b4c30 msgr2=0x7fdf5014a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:22.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf54b9d700 1 --2- 172.21.15.79:0/2379324903 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf500b4c30 0x7fdf5014a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf54b9d700 1 -- 172.21.15.79:0/2379324903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf500b8590 msgr2=0x7fdf500b5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:22.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf54b9d700 1 --2- 172.21.15.79:0/2379324903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf500b8590 0x7fdf500b5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf54b9d700 1 -- 172.21.15.79:0/2379324903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf40009550 con 0x7fdf5015d060 2023-10-19T08:38:22.435 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf4ffff700 1 --2- 172.21.15.79:0/2379324903 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf500b4c30 0x7fdf5014a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:22.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf54b9d700 1 --2- 172.21.15.79:0/2379324903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf5015d060 0x7fdf500b62a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800cca0 tx=0x7fdf4800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:22.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf4cff9700 1 -- 172.21.15.79:0/2379324903 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4800abc0 con 0x7fdf5015d060 2023-10-19T08:38:22.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf4cff9700 1 -- 172.21.15.79:0/2379324903 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4800ad20 con 0x7fdf5015d060 2023-10-19T08:38:22.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf5539e700 1 -- 172.21.15.79:0/2379324903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf501e3b60 con 0x7fdf5015d060 2023-10-19T08:38:22.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf4cff9700 1 -- 172.21.15.79:0/2379324903 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf48007310 con 0x7fdf5015d060 2023-10-19T08:38:22.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.421+0000 7fdf5539e700 1 -- 172.21.15.79:0/2379324903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf501e4120 con 0x7fdf5015d060 2023-10-19T08:38:22.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.422+0000 7fdf5539e700 1 -- 172.21.15.79:0/2379324903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf501f2950 con 0x7fdf5015d060 2023-10-19T08:38:22.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.423+0000 7fdf4cff9700 1 -- 172.21.15.79:0/2379324903 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdf48007470 con 0x7fdf5015d060 2023-10-19T08:38:22.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.423+0000 7fdf4cff9700 1 --2- 172.21.15.79:0/2379324903 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdf3c06a0e0 0x7fdf3c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.423+0000 7fdf4cff9700 1 -- 172.21.15.79:0/2379324903 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdf480885b0 con 0x7fdf5015d060 2023-10-19T08:38:22.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.423+0000 7fdf4ffff700 1 --2- 172.21.15.79:0/2379324903 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdf3c06a0e0 0x7fdf3c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.424+0000 7fdf4ffff700 1 --2- 172.21.15.79:0/2379324903 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdf3c06a0e0 0x7fdf3c06c5a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdf44007a50 tx=0x7fdf44008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:22.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.428+0000 7fdf4cff9700 1 -- 172.21.15.79:0/2379324903 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fdf501f2950 con 0x7fdf5015d060 2023-10-19T08:38:22.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.617+0000 7fdf5539e700 1 -- 172.21.15.79:0/2379324903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf500b5080 con 0x7fdf5015d060 2023-10-19T08:38:22.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.618+0000 7fdf4cff9700 1 -- 172.21.15.79:0/2379324903 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20060 (secure 0 0 0) 0x7fdf500b5080 con 0x7fdf5015d060 2023-10-19T08:38:22.622 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:22.622 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":25,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:01.725914+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:22.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.620+0000 7fdf5539e700 1 -- 172.21.15.79:0/2379324903 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdf3c06a0e0 msgr2=0x7fdf3c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:22.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.620+0000 7fdf5539e700 1 --2- 172.21.15.79:0/2379324903 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdf3c06a0e0 0x7fdf3c06c5a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdf44007a50 tx=0x7fdf44008040 comp rx=0 tx=0).stop 2023-10-19T08:38:22.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.620+0000 7fdf5539e700 1 -- 172.21.15.79:0/2379324903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf5015d060 msgr2=0x7fdf500b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:22.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.620+0000 7fdf5539e700 1 --2- 172.21.15.79:0/2379324903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf5015d060 0x7fdf500b62a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800cca0 tx=0x7fdf4800a060 comp rx=0 tx=0).stop 2023-10-19T08:38:22.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.620+0000 7fdf5539e700 1 -- 172.21.15.79:0/2379324903 shutdown_connections 2023-10-19T08:38:22.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.620+0000 7fdf5539e700 1 --2- 172.21.15.79:0/2379324903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf5015d060 0x7fdf500b62a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.620+0000 7fdf5539e700 1 --2- 172.21.15.79:0/2379324903 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdf3c06a0e0 0x7fdf3c06c5a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.620+0000 7fdf5539e700 1 --2- 172.21.15.79:0/2379324903 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf500b4c30 0x7fdf5014a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.620+0000 7fdf5539e700 1 --2- 172.21.15.79:0/2379324903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf500b8590 0x7fdf500b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.620+0000 7fdf5539e700 1 -- 172.21.15.79:0/2379324903 >> 172.21.15.79:0/2379324903 conn(0x7fdf50071fb0 msgr2=0x7fdf50072cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:22.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.621+0000 7fdf5539e700 1 -- 172.21.15.79:0/2379324903 shutdown_connections 2023-10-19T08:38:22.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.621+0000 7fdf5539e700 1 -- 172.21.15.79:0/2379324903 wait complete. 2023-10-19T08:38:22.636 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-19T08:38:22.637 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:22.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.753+0000 7f5dcafb6700 1 Processor -- start 2023-10-19T08:38:22.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.753+0000 7f5dcafb6700 1 -- start start 2023-10-19T08:38:22.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.754+0000 7f5dcafb6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5dc40af170 0x7f5dc40cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.754+0000 7f5dcafb6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5dc40b1de0 0x7f5dc40b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.754+0000 7f5dcafb6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc415de50 con 0x7f5dc40cd800 2023-10-19T08:38:22.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.754+0000 7f5dcafb6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc40af550 con 0x7f5dc40af170 2023-10-19T08:38:22.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.754+0000 7f5dcafb6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40b16b0 con 0x7f5dc40b1de0 2023-10-19T08:38:22.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.754+0000 7f5dc9553700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5dc40cd800 0x7f5dc406a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56294/0 (socket says 172.21.15.79:56294) 2023-10-19T08:38:22.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.754+0000 7f5dc9553700 1 -- 172.21.15.79:0/243261564 learned_addr learned my addr 172.21.15.79:0/243261564 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:22.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.754+0000 7f5dc8d52700 1 --2- 172.21.15.79:0/243261564 >> v2:172.21.15.89:3300/0 conn(0x7f5dc40af170 0x7f5dc40cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.754+0000 7f5dc3fff700 1 --2- 172.21.15.79:0/243261564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5dc40b1de0 0x7f5dc40b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc37fe700 1 -- 172.21.15.79:0/243261564 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814990007 0 0) 0x7f5dc415de50 con 0x7f5dc40cd800 2023-10-19T08:38:22.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc37fe700 1 -- 172.21.15.79:0/243261564 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5db40035b0 con 0x7f5dc40cd800 2023-10-19T08:38:22.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc37fe700 1 -- 172.21.15.79:0/243261564 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3360498436 0 0) 0x7f5db40035b0 con 0x7f5dc40cd800 2023-10-19T08:38:22.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc37fe700 1 -- 172.21.15.79:0/243261564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5dc40b1de0 msgr2=0x7f5dc40b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:22.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc37fe700 1 --2- 172.21.15.79:0/243261564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5dc40b1de0 0x7f5dc40b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc37fe700 1 -- 172.21.15.79:0/243261564 >> v2:172.21.15.89:3300/0 conn(0x7f5dc40af170 msgr2=0x7f5dc40cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:22.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc37fe700 1 --2- 172.21.15.79:0/243261564 >> v2:172.21.15.89:3300/0 conn(0x7f5dc40af170 0x7f5dc40cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc37fe700 1 -- 172.21.15.79:0/243261564 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc415e130 con 0x7f5dc40cd800 2023-10-19T08:38:22.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc37fe700 1 -- 172.21.15.79:0/243261564 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f5dbc0019f0 con 0x7f5dc40cd800 2023-10-19T08:38:22.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc37fe700 1 -- 172.21.15.79:0/243261564 >> v1:172.21.15.79:6789/0 conn(0x7f5dc40cd800 legacy=0x7f5dc406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:22.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc37fe700 1 --2- 172.21.15.79:0/243261564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5db4003a00 0x7f5db4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc37fe700 1 --2- 172.21.15.79:0/243261564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5dc40b1de0 0x7f5db4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc37fe700 1 --2- 172.21.15.79:0/243261564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5db4004d90 0x7f5db4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc37fe700 1 -- 172.21.15.79:0/243261564 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40af550 con 0x7f5db4003a00 2023-10-19T08:38:22.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc37fe700 1 -- 172.21.15.79:0/243261564 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40b16b0 con 0x7f5db4004d90 2023-10-19T08:38:22.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc37fe700 1 -- 172.21.15.79:0/243261564 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db400ba10 con 0x7f5dc40b1de0 2023-10-19T08:38:22.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc8d52700 1 --2- 172.21.15.79:0/243261564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5db4003a00 0x7f5db4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc3fff700 1 --2- 172.21.15.79:0/243261564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5dc40b1de0 0x7f5db4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc9553700 1 --2- 172.21.15.79:0/243261564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5db4004d90 0x7f5db4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc8d52700 1 -- 172.21.15.79:0/243261564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5dc40b1de0 msgr2=0x7f5db4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:22.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc8d52700 1 --2- 172.21.15.79:0/243261564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5dc40b1de0 0x7f5db4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc8d52700 1 -- 172.21.15.79:0/243261564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5db4004d90 msgr2=0x7f5db4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:22.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc8d52700 1 --2- 172.21.15.79:0/243261564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5db4004d90 0x7f5db4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc8d52700 1 -- 172.21.15.79:0/243261564 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db40035b0 con 0x7f5db4003a00 2023-10-19T08:38:22.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc9553700 1 --2- 172.21.15.79:0/243261564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5db4004d90 0x7f5db4005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:22.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc8d52700 1 --2- 172.21.15.79:0/243261564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5db4003a00 0x7f5db4003e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5db8009b90 tx=0x7f5db4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad64e47ac054c3f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:22.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.755+0000 7f5dc37fe700 1 -- 172.21.15.79:0/243261564 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db800e6c0 con 0x7f5db4003a00 2023-10-19T08:38:22.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.756+0000 7f5dc37fe700 1 -- 172.21.15.79:0/243261564 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db800e820 con 0x7f5db4003a00 2023-10-19T08:38:22.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.756+0000 7f5dc37fe700 1 -- 172.21.15.79:0/243261564 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db800eb90 con 0x7f5db4003a00 2023-10-19T08:38:22.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.756+0000 7f5dcafb6700 1 -- 172.21.15.79:0/243261564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5db4003a00 msgr2=0x7f5db4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:22.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.756+0000 7f5dcafb6700 1 --2- 172.21.15.79:0/243261564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5db4003a00 0x7f5db4003e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5db8009b90 tx=0x7f5db4005880 comp rx=0 tx=0).stop 2023-10-19T08:38:22.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.756+0000 7f5dc9553700 1 -- 172.21.15.79:0/243261564 reap_dead start 2023-10-19T08:38:22.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.756+0000 7f5dcafb6700 1 -- 172.21.15.79:0/243261564 shutdown_connections 2023-10-19T08:38:22.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.756+0000 7f5dcafb6700 1 -- 172.21.15.79:0/243261564 >> 172.21.15.79:0/243261564 conn(0x7f5dc406dcc0 msgr2=0x7f5dc406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:22.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.756+0000 7f5dcafb6700 1 -- 172.21.15.79:0/243261564 shutdown_connections 2023-10-19T08:38:22.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.756+0000 7f5dcafb6700 1 -- 172.21.15.79:0/243261564 wait complete. 2023-10-19T08:38:22.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.757+0000 7f5dcafb6700 1 Processor -- start 2023-10-19T08:38:22.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.757+0000 7f5dcafb6700 1 -- start start 2023-10-19T08:38:22.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.758+0000 7f5dcafb6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5db4003a00 0x7f5dc4156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.758+0000 7f5dcafb6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dc4156f30 0x7f5dc41e69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.758+0000 7f5dcafb6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5dc41e6ef0 0x7f5dc41e73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.758+0000 7f5dcafb6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40b5120 con 0x7f5dc4156f30 2023-10-19T08:38:22.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.758+0000 7f5dcafb6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40b4b60 con 0x7f5dc41e6ef0 2023-10-19T08:38:22.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.758+0000 7f5dcafb6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40b4e40 con 0x7f5db4003a00 2023-10-19T08:38:22.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.758+0000 7f5dc3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dc4156f30 0x7f5dc41e69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.758+0000 7f5dc8d52700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5db4003a00 0x7f5dc4156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.758+0000 7f5dc3fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dc4156f30 0x7f5dc41e69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46232/0 (socket says 172.21.15.79:46232) 2023-10-19T08:38:22.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.758+0000 7f5dc3fff700 1 -- 172.21.15.79:0/4150392371 learned_addr learned my addr 172.21.15.79:0/4150392371 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:22.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.758+0000 7f5dc9553700 1 --2- 172.21.15.79:0/4150392371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5dc41e6ef0 0x7f5dc41e73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.759+0000 7f5dc3fff700 1 -- 172.21.15.79:0/4150392371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5db4003a00 msgr2=0x7f5dc4156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:22.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.759+0000 7f5dc3fff700 1 --2- 172.21.15.79:0/4150392371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5db4003a00 0x7f5dc4156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.759+0000 7f5dc3fff700 1 -- 172.21.15.79:0/4150392371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5dc41e6ef0 msgr2=0x7f5dc41e73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:22.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.759+0000 7f5dc3fff700 1 --2- 172.21.15.79:0/4150392371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5dc41e6ef0 0x7f5dc41e73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.759+0000 7f5dc3fff700 1 -- 172.21.15.79:0/4150392371 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc415e8b0 con 0x7f5dc4156f30 2023-10-19T08:38:22.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.759+0000 7f5dc3fff700 1 --2- 172.21.15.79:0/4150392371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dc4156f30 0x7f5dc41e69b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5db0011aa0 tx=0x7f5db0011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:22.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.759+0000 7f5dc17fa700 1 -- 172.21.15.79:0/4150392371 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db0011ed0 con 0x7f5dc4156f30 2023-10-19T08:38:22.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.759+0000 7f5dc17fa700 1 -- 172.21.15.79:0/4150392371 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db000f940 con 0x7f5dc4156f30 2023-10-19T08:38:22.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.759+0000 7f5dcafb6700 1 -- 172.21.15.79:0/4150392371 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc415eb90 con 0x7f5dc4156f30 2023-10-19T08:38:22.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.759+0000 7f5dc17fa700 1 -- 172.21.15.79:0/4150392371 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db000fcf0 con 0x7f5dc4156f30 2023-10-19T08:38:22.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.759+0000 7f5dcafb6700 1 -- 172.21.15.79:0/4150392371 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc40b3700 con 0x7f5dc4156f30 2023-10-19T08:38:22.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.760+0000 7f5dcafb6700 1 -- 172.21.15.79:0/4150392371 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc415ef00 con 0x7f5dc4156f30 2023-10-19T08:38:22.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.760+0000 7f5dc17fa700 1 -- 172.21.15.79:0/4150392371 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5db0014440 con 0x7f5dc4156f30 2023-10-19T08:38:22.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.761+0000 7f5dc17fa700 1 --2- 172.21.15.79:0/4150392371 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5da806a0e0 0x7f5da806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:22.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.761+0000 7f5dc17fa700 1 -- 172.21.15.79:0/4150392371 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5db0088e70 con 0x7f5dc4156f30 2023-10-19T08:38:22.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.761+0000 7f5dc8d52700 1 --2- 172.21.15.79:0/4150392371 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5da806a0e0 0x7f5da806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:22.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.761+0000 7f5dc8d52700 1 --2- 172.21.15.79:0/4150392371 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5da806a0e0 0x7f5da806c5a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5db80090b0 tx=0x7f5db8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:22.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.765+0000 7f5dc17fa700 1 -- 172.21.15.79:0/4150392371 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f5db0057e50 con 0x7f5dc4156f30 2023-10-19T08:38:22.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.954+0000 7f5dcafb6700 1 -- 172.21.15.79:0/4150392371 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5dc404ee70 con 0x7f5dc4156f30 2023-10-19T08:38:22.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.955+0000 7f5dc17fa700 1 -- 172.21.15.79:0/4150392371 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20060 (secure 0 0 0) 0x7f5db00579e0 con 0x7f5dc4156f30 2023-10-19T08:38:22.959 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:22.960 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":25,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:01.725914+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:22.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.957+0000 7f5dcafb6700 1 -- 172.21.15.79:0/4150392371 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5da806a0e0 msgr2=0x7f5da806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:22.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.957+0000 7f5dcafb6700 1 --2- 172.21.15.79:0/4150392371 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5da806a0e0 0x7f5da806c5a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5db80090b0 tx=0x7f5db8008030 comp rx=0 tx=0).stop 2023-10-19T08:38:22.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.957+0000 7f5dcafb6700 1 -- 172.21.15.79:0/4150392371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dc4156f30 msgr2=0x7f5dc41e69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:22.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.957+0000 7f5dcafb6700 1 --2- 172.21.15.79:0/4150392371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dc4156f30 0x7f5dc41e69b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5db0011aa0 tx=0x7f5db0011db0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.958+0000 7f5dcafb6700 1 -- 172.21.15.79:0/4150392371 shutdown_connections 2023-10-19T08:38:22.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.958+0000 7f5dcafb6700 1 --2- 172.21.15.79:0/4150392371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5dc41e6ef0 0x7f5dc41e73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.958+0000 7f5dcafb6700 1 --2- 172.21.15.79:0/4150392371 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5da806a0e0 0x7f5da806c5a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.958+0000 7f5dcafb6700 1 --2- 172.21.15.79:0/4150392371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5db4003a00 0x7f5dc4156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.958+0000 7f5dcafb6700 1 --2- 172.21.15.79:0/4150392371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5dc4156f30 0x7f5dc41e69b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:22.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.958+0000 7f5dcafb6700 1 -- 172.21.15.79:0/4150392371 >> 172.21.15.79:0/4150392371 conn(0x7f5dc406dcc0 msgr2=0x7f5dc40ca700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:22.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.958+0000 7f5dcafb6700 1 -- 172.21.15.79:0/4150392371 shutdown_connections 2023-10-19T08:38:22.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:22.958+0000 7f5dcafb6700 1 -- 172.21.15.79:0/4150392371 wait complete. 2023-10-19T08:38:22.974 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-19T08:38:22.974 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-19T08:38:22.975 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-19T08:38:22.975 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-19T08:38:22.976 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-19T08:38:22.976 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-19T08:38:22.977 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-19T08:38:22.977 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-19T08:38:23.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.183+0000 7f44f7740700 1 Processor -- start 2023-10-19T08:38:23.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.183+0000 7f44f7740700 1 -- start start 2023-10-19T08:38:23.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.184+0000 7f44f7740700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f44f00710b0 0x7f44f00890e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.184+0000 7f44f7740700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f00c9ec0 con 0x7f44f00cde00 2023-10-19T08:38:23.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.184+0000 7f44f7740700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f00cad00 con 0x7f44f00adc00 2023-10-19T08:38:23.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.184+0000 7f44f7740700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f0169f90 con 0x7f44f00710b0 2023-10-19T08:38:23.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.185+0000 7f44f54dc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f44f00cde00 0x7f44f016e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56310/0 (socket says 172.21.15.79:56310) 2023-10-19T08:38:23.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.185+0000 7f44f4cdb700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f44f00adc00 0x7f44f00709a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:41152/0 (socket says 172.21.15.79:41152) 2023-10-19T08:38:23.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.185+0000 7f44f54dc700 1 -- 172.21.15.79:0/1026748393 learned_addr learned my addr 172.21.15.79:0/1026748393 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:23.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.185+0000 7f44f5cdd700 1 --2- 172.21.15.79:0/1026748393 >> v2:172.21.15.89:3300/0 conn(0x7f44f00710b0 0x7f44f00890e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.185+0000 7f44e7fff700 1 -- 172.21.15.79:0/1026748393 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562805402 0 0) 0x7f44f00c9ec0 con 0x7f44f00cde00 2023-10-19T08:38:23.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.185+0000 7f44e7fff700 1 -- 172.21.15.79:0/1026748393 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44dc0035b0 con 0x7f44f00cde00 2023-10-19T08:38:23.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.186+0000 7f44e7fff700 1 -- 172.21.15.79:0/1026748393 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 268873972 0 0) 0x7f44dc0035b0 con 0x7f44f00cde00 2023-10-19T08:38:23.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.186+0000 7f44e7fff700 1 -- 172.21.15.79:0/1026748393 >> v2:172.21.15.89:3300/0 conn(0x7f44f00710b0 msgr2=0x7f44f00890e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.186+0000 7f44e7fff700 1 --2- 172.21.15.79:0/1026748393 >> v2:172.21.15.89:3300/0 conn(0x7f44f00710b0 0x7f44f00890e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.186+0000 7f44e7fff700 1 -- 172.21.15.79:0/1026748393 >> v1:172.21.15.89:6789/0 conn(0x7f44f00adc00 legacy=0x7f44f00709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.186+0000 7f44e7fff700 1 -- 172.21.15.79:0/1026748393 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f00ca0f0 con 0x7f44f00cde00 2023-10-19T08:38:23.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.186+0000 7f44e7fff700 1 -- 172.21.15.79:0/1026748393 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f44ec001670 con 0x7f44f00cde00 2023-10-19T08:38:23.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.186+0000 7f44e7fff700 1 -- 172.21.15.79:0/1026748393 >> v1:172.21.15.79:6789/0 conn(0x7f44f00cde00 legacy=0x7f44f016e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.186+0000 7f44e7fff700 1 --2- 172.21.15.79:0/1026748393 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44dc003a00 0x7f44dc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.186+0000 7f44e7fff700 1 --2- 172.21.15.79:0/1026748393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44dc004850 0x7f44dc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.186+0000 7f44e7fff700 1 --2- 172.21.15.79:0/1026748393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44dc009a00 0x7f44dc005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.186+0000 7f44e7fff700 1 -- 172.21.15.79:0/1026748393 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f0169f90 con 0x7f44dc004850 2023-10-19T08:38:23.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.186+0000 7f44e7fff700 1 -- 172.21.15.79:0/1026748393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc009df0 con 0x7f44dc009a00 2023-10-19T08:38:23.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.186+0000 7f44e7fff700 1 -- 172.21.15.79:0/1026748393 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44dc009fb0 con 0x7f44dc003a00 2023-10-19T08:38:23.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.186+0000 7f44f4cdb700 1 --2- 172.21.15.79:0/1026748393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44dc004850 0x7f44dc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.187+0000 7f44f4cdb700 1 -- 172.21.15.79:0/1026748393 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44dc003a00 msgr2=0x7f44dc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.187+0000 7f44f54dc700 1 --2- 172.21.15.79:0/1026748393 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44dc003a00 0x7f44dc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.187+0000 7f44f4cdb700 1 --2- 172.21.15.79:0/1026748393 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44dc003a00 0x7f44dc003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.187+0000 7f44f4cdb700 1 -- 172.21.15.79:0/1026748393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44dc009a00 msgr2=0x7f44dc005230 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-19T08:38:23.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.187+0000 7f44f4cdb700 1 --2- 172.21.15.79:0/1026748393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44dc009a00 0x7f44dc005230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.187+0000 7f44f4cdb700 1 -- 172.21.15.79:0/1026748393 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f00ca0f0 con 0x7f44dc004850 2023-10-19T08:38:23.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.187+0000 7f44f5cdd700 1 -- 172.21.15.79:0/1026748393 reap_dead start 2023-10-19T08:38:23.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.187+0000 7efc0a031700 1 Processor -- start 2023-10-19T08:38:23.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.187+0000 7fa6011ab700 1 Processor -- start 2023-10-19T08:38:23.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.187+0000 7f44f4cdb700 1 --2- 172.21.15.79:0/1026748393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44dc004850 0x7f44dc004cd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f44e00017b0 tx=0x7f44dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bff066798007707 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.188+0000 7f44e7fff700 1 -- 172.21.15.79:0/1026748393 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0004a70 con 0x7f44dc004850 2023-10-19T08:38:23.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.188+0000 7f44e7fff700 1 -- 172.21.15.79:0/1026748393 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e0004bd0 con 0x7f44dc004850 2023-10-19T08:38:23.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.188+0000 7f44e7fff700 1 -- 172.21.15.79:0/1026748393 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e00070d0 con 0x7f44dc004850 2023-10-19T08:38:23.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.187+0000 7fa6011ab700 1 -- start start 2023-10-19T08:38:23.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.187+0000 7efc0a031700 1 -- start start 2023-10-19T08:38:23.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7f4a6813e700 1 Processor -- start 2023-10-19T08:38:23.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7f44f7740700 1 -- 172.21.15.79:0/1026748393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44dc004850 msgr2=0x7f44dc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7f44f7740700 1 --2- 172.21.15.79:0/1026748393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44dc004850 0x7f44dc004cd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f44e00017b0 tx=0x7f44dc005880 comp rx=0 tx=0).stop 2023-10-19T08:38:23.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7f44f7740700 1 -- 172.21.15.79:0/1026748393 shutdown_connections 2023-10-19T08:38:23.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7f44f7740700 1 --2- 172.21.15.79:0/1026748393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44dc004850 0x7f44dc004cd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7f44f7740700 1 -- 172.21.15.79:0/1026748393 >> 172.21.15.79:0/1026748393 conn(0x7f44f00cb3e0 msgr2=0x7f44f00cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7faf57b17700 1 Processor -- start 2023-10-19T08:38:23.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7efc0a031700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc040ce9b0 0x7efc040b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7efc0a031700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc041659c0 0x7efc040b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7efc0a031700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc040cd600 con 0x7efc04072290 2023-10-19T08:38:23.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7efc0a031700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc04165f60 con 0x7efc041659c0 2023-10-19T08:38:23.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7efc0a031700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc040cf030 con 0x7efc040ce9b0 2023-10-19T08:38:23.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7efc037fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7efc04072290 0x7efc04161950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56322/0 (socket says 172.21.15.79:56322) 2023-10-19T08:38:23.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7efc037fe700 1 -- 172.21.15.79:0/1630124468 learned_addr learned my addr 172.21.15.79:0/1630124468 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:23.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7fa6011ab700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5fc06a930 0x7fa5fc0ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7fa6011ab700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5fc165b10 con 0x7fa5fc0add00 2023-10-19T08:38:23.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7fa6011ab700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5fc164f00 con 0x7fa5fc161260 2023-10-19T08:38:23.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7fa6011ab700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc1651e0 con 0x7fa5fc06a930 2023-10-19T08:38:23.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7f4a6813e700 1 -- start start 2023-10-19T08:38:23.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7fa5fb59e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa5fc0add00 0x7fa5fc0c40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56328/0 (socket says 172.21.15.79:56328) 2023-10-19T08:38:23.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.189+0000 7fa5fb59e700 1 -- 172.21.15.79:0/34887494 learned_addr learned my addr 172.21.15.79:0/34887494 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:23.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.190+0000 7efc03fff700 1 --2- 172.21.15.79:0/1630124468 >> v2:172.21.15.79:3300/0 conn(0x7efc041659c0 0x7efc040b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.190+0000 7efc02ffd700 1 --2- 172.21.15.79:0/1630124468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc040ce9b0 0x7efc040b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.190+0000 7f44f7740700 1 -- 172.21.15.79:0/1026748393 shutdown_connections 2023-10-19T08:38:23.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.190+0000 7f44f7740700 1 -- 172.21.15.79:0/1026748393 wait complete. 2023-10-19T08:38:23.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.190+0000 7efc03fff700 1 -- 172.21.15.79:0/1630124468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc040ce9b0 msgr2=0x7efc040b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.190+0000 7efc03fff700 1 --2- 172.21.15.79:0/1630124468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc040ce9b0 0x7efc040b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.190+0000 7efc03fff700 1 -- 172.21.15.79:0/1630124468 >> v1:172.21.15.79:6789/0 conn(0x7efc04072290 legacy=0x7efc04161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.190+0000 7efc03fff700 1 -- 172.21.15.79:0/1630124468 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc040cf310 con 0x7efc041659c0 2023-10-19T08:38:23.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.190+0000 7f4a6813e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4a600c50d0 0x7f4a600aded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.190+0000 7f4a6813e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a60165b10 con 0x7f4a6006a930 2023-10-19T08:38:23.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.190+0000 7f4a6813e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a60164f00 con 0x7f4a60161260 2023-10-19T08:38:23.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.190+0000 7f4a6813e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a601651e0 con 0x7f4a600c50d0 2023-10-19T08:38:23.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.190+0000 7faf57b17700 1 -- start start 2023-10-19T08:38:23.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.190+0000 7fa5fa59c700 1 --2- 172.21.15.79:0/34887494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5fc06a930 0x7fa5fc0ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.191+0000 7fa5f9d9b700 1 -- 172.21.15.79:0/34887494 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149591259 0 0) 0x7fa5fc165b10 con 0x7fa5fc0add00 2023-10-19T08:38:23.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.191+0000 7fa5f9d9b700 1 -- 172.21.15.79:0/34887494 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5e40035b0 con 0x7fa5fc0add00 2023-10-19T08:38:23.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.191+0000 7f4a656d9700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4a6006a930 0x7f4a600ad7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56336/0 (socket says 172.21.15.79:56336) 2023-10-19T08:38:23.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.191+0000 7f4a656d9700 1 -- 172.21.15.79:0/3315411947 learned_addr learned my addr 172.21.15.79:0/3315411947 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:23.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.191+0000 7efc03fff700 1 --2- 172.21.15.79:0/1630124468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc041659c0 0x7efc040b4ee0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009d90 tx=0x7efbfc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99524cfc6f31df4d server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.191+0000 7faf57b17700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf50161260 0x7faf5006a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.191+0000 7faf57b17700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf50165b10 con 0x7faf5006a760 2023-10-19T08:38:23.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.191+0000 7faf57b17700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf500ae340 con 0x7faf500aded0 2023-10-19T08:38:23.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.191+0000 7faf57b17700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5006abe0 con 0x7faf50161260 2023-10-19T08:38:23.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.191+0000 7faf550b2700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7faf5006a760 0x7faf500ad7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56342/0 (socket says 172.21.15.79:56342) 2023-10-19T08:38:23.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.191+0000 7faf550b2700 1 -- 172.21.15.79:0/114851730 learned_addr learned my addr 172.21.15.79:0/114851730 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:23.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.191+0000 7faf558b3700 1 --2- 172.21.15.79:0/114851730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf50161260 0x7faf5006a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.191+0000 7fa5fa59c700 1 -- 172.21.15.79:0/34887494 >> v1:172.21.15.89:6789/0 conn(0x7fa5fc161260 legacy=0x7fa5fc06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.191+0000 7fa5fa59c700 1 -- 172.21.15.79:0/34887494 >> v1:172.21.15.79:6789/0 conn(0x7fa5fc0add00 legacy=0x7fa5fc0c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.191+0000 7fa5fa59c700 1 -- 172.21.15.79:0/34887494 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc1654c0 con 0x7fa5fc06a930 2023-10-19T08:38:23.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.191+0000 7efc027fc700 1 -- 172.21.15.79:0/1630124468 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc00e070 con 0x7efc041659c0 2023-10-19T08:38:23.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.191+0000 7faf548b1700 1 -- 172.21.15.79:0/114851730 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138958681 0 0) 0x7faf50165b10 con 0x7faf5006a760 2023-10-19T08:38:23.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7faf548b1700 1 -- 172.21.15.79:0/114851730 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf3c0035b0 con 0x7faf5006a760 2023-10-19T08:38:23.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7efc027fc700 1 -- 172.21.15.79:0/1630124468 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbfc00bad0 con 0x7efc041659c0 2023-10-19T08:38:23.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7efc027fc700 1 -- 172.21.15.79:0/1630124468 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc00be80 con 0x7efc041659c0 2023-10-19T08:38:23.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7fa5fa59c700 1 --2- 172.21.15.79:0/34887494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5fc06a930 0x7fa5fc0ad7c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4009dc0 tx=0x7fa5f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5626ca2740aa04e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.191+0000 7f4a666db700 1 --2- 172.21.15.79:0/3315411947 >> v2:172.21.15.89:3300/0 conn(0x7f4a600c50d0 0x7f4a600aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7f44f7740700 1 Processor -- start 2023-10-19T08:38:23.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7f44f7740700 1 -- start start 2023-10-19T08:38:23.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7fa5f9d9b700 1 -- 172.21.15.79:0/34887494 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f400e070 con 0x7fa5fc06a930 2023-10-19T08:38:23.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7fa5f9d9b700 1 -- 172.21.15.79:0/34887494 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f4003a20 con 0x7fa5fc06a930 2023-10-19T08:38:23.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7f44f7740700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44dc004850 0x7f44f00c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7f44f7740700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44f00b16c0 0x7f44f006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7f44f7740700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44f0167320 0x7f44f01677d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7f44f7740700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f00b2a40 con 0x7f44dc004850 2023-10-19T08:38:23.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7f44f7740700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f0167d10 con 0x7f44f00b16c0 2023-10-19T08:38:23.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7f44f7740700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f00b1e30 con 0x7f44f0167320 2023-10-19T08:38:23.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7f44f4cdb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44f00b16c0 0x7f44f006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7f44f4cdb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44f00b16c0 0x7f44f006d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:60758/0 (socket says 172.21.15.79:60758) 2023-10-19T08:38:23.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7f44f4cdb700 1 -- 172.21.15.79:0/3709827593 learned_addr learned my addr 172.21.15.79:0/3709827593 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7f44f5cdd700 1 --2- 172.21.15.79:0/3709827593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44f0167320 0x7f44f01677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7f44f5cdd700 1 -- 172.21.15.79:0/3709827593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44f00b16c0 msgr2=0x7f44f006d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7f44f5cdd700 1 --2- 172.21.15.79:0/3709827593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44f00b16c0 0x7f44f006d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7f44f5cdd700 1 -- 172.21.15.79:0/3709827593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44dc004850 msgr2=0x7f44f00c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7f44f5cdd700 1 --2- 172.21.15.79:0/3709827593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44dc004850 0x7f44f00c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7f44f5cdd700 1 -- 172.21.15.79:0/3709827593 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f00b2110 con 0x7f44f0167320 2023-10-19T08:38:23.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7f44f5cdd700 1 --2- 172.21.15.79:0/3709827593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44f0167320 0x7f44f01677d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f44f00ce8c0 tx=0x7f44e8004550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7faf548b1700 1 -- 172.21.15.79:0/114851730 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1774184958 0 0) 0x7faf3c0035b0 con 0x7faf5006a760 2023-10-19T08:38:23.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7faf548b1700 1 -- 172.21.15.79:0/114851730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf50161260 msgr2=0x7faf5006a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7faf548b1700 1 --2- 172.21.15.79:0/114851730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf50161260 0x7faf5006a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7faf548b1700 1 -- 172.21.15.79:0/114851730 >> v1:172.21.15.89:6789/0 conn(0x7faf500aded0 legacy=0x7faf500c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7faf548b1700 1 -- 172.21.15.79:0/114851730 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf50164f00 con 0x7faf5006a760 2023-10-19T08:38:23.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7faf548b1700 1 -- 172.21.15.79:0/114851730 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7faf4c001670 con 0x7faf5006a760 2023-10-19T08:38:23.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7faf558b3700 1 --2- 172.21.15.79:0/114851730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf50161260 0x7faf5006a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:38:23.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7faf548b1700 1 -- 172.21.15.79:0/114851730 >> v1:172.21.15.79:6789/0 conn(0x7faf5006a760 legacy=0x7faf500ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7faf548b1700 1 --2- 172.21.15.79:0/114851730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf3c003a30 0x7faf3c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7faf548b1700 1 --2- 172.21.15.79:0/114851730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf3c004850 0x7faf3c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7faf548b1700 1 --2- 172.21.15.79:0/114851730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf50161260 0x7faf3c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7faf548b1700 1 -- 172.21.15.79:0/114851730 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5006abe0 con 0x7faf3c003a30 2023-10-19T08:38:23.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7faf548b1700 1 -- 172.21.15.79:0/114851730 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c00ba40 con 0x7faf3c004850 2023-10-19T08:38:23.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7faf548b1700 1 -- 172.21.15.79:0/114851730 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c00bc00 con 0x7faf50161260 2023-10-19T08:38:23.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7faf560b4700 1 --2- 172.21.15.79:0/114851730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf50161260 0x7faf3c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7faf550b2700 1 --2- 172.21.15.79:0/114851730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf3c004850 0x7faf3c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7faf560b4700 1 -- 172.21.15.79:0/114851730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf3c004850 msgr2=0x7faf3c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7faf560b4700 1 --2- 172.21.15.79:0/114851730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf3c004850 0x7faf3c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7faf560b4700 1 -- 172.21.15.79:0/114851730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf3c003a30 msgr2=0x7faf3c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7faf560b4700 1 --2- 172.21.15.79:0/114851730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf3c003a30 0x7faf3c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7faf560b4700 1 -- 172.21.15.79:0/114851730 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf48009a70 con 0x7faf50161260 2023-10-19T08:38:23.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7faf560b4700 1 --2- 172.21.15.79:0/114851730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf50161260 0x7faf3c005210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faf40007fd0 tx=0x7faf3c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e82669e6c37230a server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7faf548b1700 1 -- 172.21.15.79:0/114851730 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf400052d0 con 0x7faf50161260 2023-10-19T08:38:23.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7faf548b1700 1 -- 172.21.15.79:0/114851730 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf40005430 con 0x7faf50161260 2023-10-19T08:38:23.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7faf548b1700 1 -- 172.21.15.79:0/114851730 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf400038e0 con 0x7faf50161260 2023-10-19T08:38:23.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7faf57b17700 1 -- 172.21.15.79:0/114851730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf50161260 msgr2=0x7faf3c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7faf57b17700 1 --2- 172.21.15.79:0/114851730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf50161260 0x7faf3c005210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faf40007fd0 tx=0x7faf3c005880 comp rx=0 tx=0).stop 2023-10-19T08:38:23.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7faf560b4700 1 -- 172.21.15.79:0/114851730 reap_dead start 2023-10-19T08:38:23.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7faf57b17700 1 -- 172.21.15.79:0/114851730 shutdown_connections 2023-10-19T08:38:23.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7faf57b17700 1 -- 172.21.15.79:0/114851730 >> 172.21.15.79:0/114851730 conn(0x7faf500ce960 msgr2=0x7faf500ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7efc0a031700 1 -- 172.21.15.79:0/1630124468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc041659c0 msgr2=0x7efc040b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7efc0a031700 1 --2- 172.21.15.79:0/1630124468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc041659c0 0x7efc040b4ee0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efbfc009d90 tx=0x7efbfc00b330 comp rx=0 tx=0).stop 2023-10-19T08:38:23.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7efc0a031700 1 -- 172.21.15.79:0/1630124468 shutdown_connections 2023-10-19T08:38:23.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7efc0a031700 1 --2- 172.21.15.79:0/1630124468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc041659c0 0x7efc040b4ee0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7efc0a031700 1 --2- 172.21.15.79:0/1630124468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc040ce9b0 0x7efc040b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7efc0a031700 1 -- 172.21.15.79:0/1630124468 >> 172.21.15.79:0/1630124468 conn(0x7efc040cf9a0 msgr2=0x7efc040cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7efc0a031700 1 -- 172.21.15.79:0/1630124468 shutdown_connections 2023-10-19T08:38:23.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7efc0a031700 1 -- 172.21.15.79:0/1630124468 wait complete. 2023-10-19T08:38:23.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7fa5f9d9b700 1 -- 172.21.15.79:0/34887494 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0001670 con 0x7fa5fc06a930 2023-10-19T08:38:23.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7fa6011ab700 1 -- 172.21.15.79:0/34887494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5fc06a930 msgr2=0x7fa5fc0ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7fa6011ab700 1 --2- 172.21.15.79:0/34887494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5fc06a930 0x7fa5fc0ad7c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4009dc0 tx=0x7fa5f400b330 comp rx=0 tx=0).stop 2023-10-19T08:38:23.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7fa6011ab700 1 -- 172.21.15.79:0/34887494 shutdown_connections 2023-10-19T08:38:23.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7fa6011ab700 1 --2- 172.21.15.79:0/34887494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5fc06a930 0x7fa5fc0ad7c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7fa6011ab700 1 -- 172.21.15.79:0/34887494 >> 172.21.15.79:0/34887494 conn(0x7fa5fc0ce960 msgr2=0x7fa5fc0ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7f4a666db700 1 -- 172.21.15.79:0/3315411947 >> v1:172.21.15.89:6789/0 conn(0x7f4a60161260 legacy=0x7f4a6006a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7f4a666db700 1 -- 172.21.15.79:0/3315411947 >> v1:172.21.15.79:6789/0 conn(0x7f4a6006a930 legacy=0x7f4a600ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7f4a666db700 1 -- 172.21.15.79:0/3315411947 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a601654c0 con 0x7f4a600c50d0 2023-10-19T08:38:23.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.192+0000 7f4a666db700 1 --2- 172.21.15.79:0/3315411947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a600c50d0 0x7f4a600aded0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009840 tx=0x7f4a50009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=943d6150c28cf804 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7f4a64ed8700 1 -- 172.21.15.79:0/3315411947 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50004230 con 0x7f4a600c50d0 2023-10-19T08:38:23.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7f4a64ed8700 1 -- 172.21.15.79:0/3315411947 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50004390 con 0x7f4a600c50d0 2023-10-19T08:38:23.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7f4a64ed8700 1 -- 172.21.15.79:0/3315411947 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a500036a0 con 0x7f4a600c50d0 2023-10-19T08:38:23.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7f4a6813e700 1 -- 172.21.15.79:0/3315411947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a600c50d0 msgr2=0x7f4a600aded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7f4a6813e700 1 --2- 172.21.15.79:0/3315411947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a600c50d0 0x7f4a600aded0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009840 tx=0x7f4a50009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:23.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7f4a6813e700 1 -- 172.21.15.79:0/3315411947 shutdown_connections 2023-10-19T08:38:23.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7f4a6813e700 1 --2- 172.21.15.79:0/3315411947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a600c50d0 0x7f4a600aded0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7f4a6813e700 1 -- 172.21.15.79:0/3315411947 >> 172.21.15.79:0/3315411947 conn(0x7f4a600ce960 msgr2=0x7f4a600ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.193+0000 7efc683ec700 1 Processor -- start 2023-10-19T08:38:23.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.194+0000 7efc683ec700 1 -- start start 2023-10-19T08:38:23.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.195+0000 7f4a6813e700 1 -- 172.21.15.79:0/3315411947 shutdown_connections 2023-10-19T08:38:23.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.195+0000 7f4a6813e700 1 -- 172.21.15.79:0/3315411947 wait complete. 2023-10-19T08:38:23.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.195+0000 7efc683ec700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efc600caca0 0x7efc600709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.195+0000 7efc683ec700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc60070ee0 0x7efc6015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.195+0000 7fa6011ab700 1 -- 172.21.15.79:0/34887494 shutdown_connections 2023-10-19T08:38:23.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.195+0000 7efc683ec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc600cbf00 0x7efc600ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.195+0000 7efc683ec700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc60071390 con 0x7efc60070ee0 2023-10-19T08:38:23.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.195+0000 7efc683ec700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc600cd750 con 0x7efc600caca0 2023-10-19T08:38:23.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.195+0000 7efc683ec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc600cda10 con 0x7efc600cbf00 2023-10-19T08:38:23.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.195+0000 7fa6011ab700 1 -- 172.21.15.79:0/34887494 wait complete. 2023-10-19T08:38:23.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.195+0000 7efc66188700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efc600caca0 0x7efc600709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.195+0000 7efc66188700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efc600caca0 0x7efc600709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:60766/0 (socket says 172.21.15.79:60766) 2023-10-19T08:38:23.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.195+0000 7efc65987700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc60070ee0 0x7efc6015cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.195+0000 7efc66188700 1 -- 172.21.15.79:0/4056275490 learned_addr learned my addr 172.21.15.79:0/4056275490 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.195+0000 7efc66989700 1 --2- 172.21.15.79:0/4056275490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc600cbf00 0x7efc600ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.196+0000 7efc66989700 1 -- 172.21.15.79:0/4056275490 >> v2:172.21.15.89:3300/0 conn(0x7efc600caca0 msgr2=0x7efc600709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.196+0000 7efc66989700 1 --2- 172.21.15.79:0/4056275490 >> v2:172.21.15.89:3300/0 conn(0x7efc600caca0 0x7efc600709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.196+0000 7efc66989700 1 -- 172.21.15.79:0/4056275490 >> v2:172.21.15.79:3300/0 conn(0x7efc60070ee0 msgr2=0x7efc6015cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.196+0000 7efc66989700 1 --2- 172.21.15.79:0/4056275490 >> v2:172.21.15.79:3300/0 conn(0x7efc60070ee0 0x7efc6015cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.196+0000 7efc66989700 1 -- 172.21.15.79:0/4056275490 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc600cdcf0 con 0x7efc600cbf00 2023-10-19T08:38:23.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.196+0000 7efc0a031700 1 Processor -- start 2023-10-19T08:38:23.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.196+0000 7efc66989700 1 --2- 172.21.15.79:0/4056275490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc600cbf00 0x7efc600ccdc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efc600cc3b0 tx=0x7efc5800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc8829084c5e5699 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.196+0000 7efc65186700 1 -- 172.21.15.79:0/4056275490 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5800e070 con 0x7efc600cbf00 2023-10-19T08:38:23.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.196+0000 7efc65186700 1 -- 172.21.15.79:0/4056275490 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5800bb20 con 0x7efc600cbf00 2023-10-19T08:38:23.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.196+0000 7efc65186700 1 -- 172.21.15.79:0/4056275490 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58012430 con 0x7efc600cbf00 2023-10-19T08:38:23.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.197+0000 7f44e5ffb700 1 -- 172.21.15.79:0/3709827593 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e800c7e0 con 0x7f44f0167320 2023-10-19T08:38:23.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.197+0000 7f44e5ffb700 1 -- 172.21.15.79:0/3709827593 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e800c980 con 0x7f44f0167320 2023-10-19T08:38:23.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.197+0000 7f44e5ffb700 1 -- 172.21.15.79:0/3709827593 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e800cd30 con 0x7f44f0167320 2023-10-19T08:38:23.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.196+0000 7f4a6813e700 1 Processor -- start 2023-10-19T08:38:23.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.196+0000 7f4a6813e700 1 -- start start 2023-10-19T08:38:23.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.197+0000 7fa6011ab700 1 Processor -- start 2023-10-19T08:38:23.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.197+0000 7efc683ec700 1 -- 172.21.15.79:0/4056275490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc600cbf00 msgr2=0x7efc600ccdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.197+0000 7efc683ec700 1 --2- 172.21.15.79:0/4056275490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc600cbf00 0x7efc600ccdc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efc600cc3b0 tx=0x7efc5800b330 comp rx=0 tx=0).stop 2023-10-19T08:38:23.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.197+0000 7f44f7740700 1 -- 172.21.15.79:0/3709827593 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f00b23f0 con 0x7f44f0167320 2023-10-19T08:38:23.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.197+0000 7f006873d700 1 Processor -- start 2023-10-19T08:38:23.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.197+0000 7efc0a031700 1 -- start start 2023-10-19T08:38:23.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.197+0000 7f4a6813e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a6006a930 0x7f4a60152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.197+0000 7f4a6813e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a600c50d0 0x7f4a601530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7f4a6813e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a60161260 0x7f4a601fa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7f4a6813e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6015b2d0 con 0x7f4a600c50d0 2023-10-19T08:38:23.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7f4a6813e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a600c5e10 con 0x7f4a60161260 2023-10-19T08:38:23.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7f4a6813e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6015b520 con 0x7f4a6006a930 2023-10-19T08:38:23.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7f4a666db700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a60161260 0x7f4a601fa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7f4a666db700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a60161260 0x7f4a601fa070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:60770/0 (socket says 172.21.15.79:60770) 2023-10-19T08:38:23.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7f4a666db700 1 -- 172.21.15.79:0/762214027 learned_addr learned my addr 172.21.15.79:0/762214027 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7f4a666db700 1 -- 172.21.15.79:0/762214027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a6006a930 msgr2=0x7f4a60152ba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-19T08:38:23.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7f4a666db700 1 --2- 172.21.15.79:0/762214027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a6006a930 0x7f4a60152ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7f4a666db700 1 -- 172.21.15.79:0/762214027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a600c50d0 msgr2=0x7f4a601530e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-19T08:38:23.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7f4a666db700 1 --2- 172.21.15.79:0/762214027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4a600c50d0 0x7f4a601530e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7f4a666db700 1 -- 172.21.15.79:0/762214027 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a500094a0 con 0x7f4a60161260 2023-10-19T08:38:23.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7efc683ec700 1 -- 172.21.15.79:0/4056275490 shutdown_connections 2023-10-19T08:38:23.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7efc683ec700 1 --2- 172.21.15.79:0/4056275490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc600cbf00 0x7efc600ccdc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7efc683ec700 1 --2- 172.21.15.79:0/4056275490 >> v2:172.21.15.89:3300/0 conn(0x7efc600caca0 0x7efc600709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7efc683ec700 1 --2- 172.21.15.79:0/4056275490 >> v2:172.21.15.79:3300/0 conn(0x7efc60070ee0 0x7efc6015cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7efc683ec700 1 -- 172.21.15.79:0/4056275490 >> 172.21.15.79:0/4056275490 conn(0x7efc600cb3e0 msgr2=0x7efc600cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7f44f7740700 1 -- 172.21.15.79:0/3709827593 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f00b1b40 con 0x7f44f0167320 2023-10-19T08:38:23.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7efc683ec700 1 -- 172.21.15.79:0/4056275490 shutdown_connections 2023-10-19T08:38:23.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7faf57b17700 1 -- 172.21.15.79:0/114851730 shutdown_connections 2023-10-19T08:38:23.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7faf57b17700 1 -- 172.21.15.79:0/114851730 wait complete. 2023-10-19T08:38:23.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7f006873d700 1 -- start start 2023-10-19T08:38:23.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7f006873d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00600c3290 0x7f0060165af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7f006873d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f006006a220 0x7f006006a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7f006873d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f00601619a0 0x7f0060161e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7f006873d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00601656d0 con 0x7f00601619a0 2023-10-19T08:38:23.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7f006873d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006006abe0 con 0x7f006006a220 2023-10-19T08:38:23.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7f006873d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0060162370 con 0x7f00600c3290 2023-10-19T08:38:23.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.197+0000 7fa6011ab700 1 -- start start 2023-10-19T08:38:23.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7fa6011ab700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5fc06a930 0x7fa5fc153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.198+0000 7fa6011ab700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5fc0add00 0x7fa5fc162b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7fa6011ab700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5fc161260 0x7fa5fc163070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7fa6011ab700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc163f20 con 0x7fa5fc0add00 2023-10-19T08:38:23.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7fa6011ab700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc154430 con 0x7fa5fc161260 2023-10-19T08:38:23.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7fa6011ab700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5fc163680 con 0x7fa5fc06a930 2023-10-19T08:38:23.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7fa5fa59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5fc0add00 0x7fa5fc162b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7fa5fa59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5fc0add00 0x7fa5fc162b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46296/0 (socket says 172.21.15.79:46296) 2023-10-19T08:38:23.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7fa5fa59c700 1 -- 172.21.15.79:0/3459199637 learned_addr learned my addr 172.21.15.79:0/3459199637 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7f44f7740700 1 -- 172.21.15.79:0/3709827593 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f44d0000fc0 con 0x7f44f0167320 2023-10-19T08:38:23.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7fa5fb59e700 1 --2- 172.21.15.79:0/3459199637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5fc161260 0x7fa5fc163070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7f0066cda700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f00601619a0 0x7f0060161e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7f0066cda700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f00601619a0 0x7f0060161e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46310/0 (socket says 172.21.15.79:46310) 2023-10-19T08:38:23.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7f0066cda700 1 -- 172.21.15.79:0/3873349765 learned_addr learned my addr 172.21.15.79:0/3873349765 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7f00664d9700 1 --2- 172.21.15.79:0/3873349765 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00600c3290 0x7f0060165af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7fa5fa59c700 1 -- 172.21.15.79:0/3459199637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5fc06a930 msgr2=0x7fa5fc153ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-19T08:38:23.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7fa5fa59c700 1 --2- 172.21.15.79:0/3459199637 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa5fc06a930 0x7fa5fc153ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7fa5fa59c700 1 -- 172.21.15.79:0/3459199637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5fc161260 msgr2=0x7fa5fc163070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7fa5fa59c700 1 --2- 172.21.15.79:0/3459199637 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5fc161260 0x7fa5fc163070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7fa5fa59c700 1 -- 172.21.15.79:0/3459199637 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f4009a70 con 0x7fa5fc0add00 2023-10-19T08:38:23.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7f0065cd8700 1 --2- 172.21.15.79:0/3873349765 >> v2:172.21.15.89:3300/0 conn(0x7f006006a220 0x7f006006a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7f0066cda700 1 -- 172.21.15.79:0/3873349765 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00600c3290 msgr2=0x7f0060165af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7f0066cda700 1 --2- 172.21.15.79:0/3873349765 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00600c3290 0x7f0060165af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7f0066cda700 1 -- 172.21.15.79:0/3873349765 >> v2:172.21.15.89:3300/0 conn(0x7f006006a220 msgr2=0x7f006006a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7f0066cda700 1 --2- 172.21.15.79:0/3873349765 >> v2:172.21.15.89:3300/0 conn(0x7f006006a220 0x7f006006a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7f0066cda700 1 -- 172.21.15.79:0/3873349765 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006006ea80 con 0x7f00601619a0 2023-10-19T08:38:23.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7f0065cd8700 1 --2- 172.21.15.79:0/3873349765 >> v2:172.21.15.89:3300/0 conn(0x7f006006a220 0x7f006006a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:23.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7fa5fa59c700 1 --2- 172.21.15.79:0/3459199637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5fc0add00 0x7fa5fc162b30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4000f80 tx=0x7fa5f4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7f0066cda700 1 --2- 172.21.15.79:0/3873349765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00601619a0 0x7f0060161e30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f00600676e0 tx=0x7f005800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc0e6d9e3e6b86d server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7efc0a031700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc04072290 0x7efc040c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7efc0a031700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc040ce9b0 0x7efc040cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7efc0a031700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc041659c0 0x7efc04153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7efc0a031700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc040ccea0 con 0x7efc04072290 2023-10-19T08:38:23.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7efc0a031700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc040c7060 con 0x7efc040ce9b0 2023-10-19T08:38:23.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7efc0a031700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc040c7340 con 0x7efc041659c0 2023-10-19T08:38:23.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7efc02ffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc040ce9b0 0x7efc040cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7efc02ffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc040ce9b0 0x7efc040cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:60776/0 (socket says 172.21.15.79:60776) 2023-10-19T08:38:23.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7efc02ffd700 1 -- 172.21.15.79:0/2754518488 learned_addr learned my addr 172.21.15.79:0/2754518488 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7efc02ffd700 1 -- 172.21.15.79:0/2754518488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc041659c0 msgr2=0x7efc04153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7efc02ffd700 1 --2- 172.21.15.79:0/2754518488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc041659c0 0x7efc04153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7efc02ffd700 1 -- 172.21.15.79:0/2754518488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc04072290 msgr2=0x7efc040c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7efc02ffd700 1 --2- 172.21.15.79:0/2754518488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc04072290 0x7efc040c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7efc02ffd700 1 -- 172.21.15.79:0/2754518488 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc009a70 con 0x7efc040ce9b0 2023-10-19T08:38:23.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7efc02ffd700 1 --2- 172.21.15.79:0/2754518488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc040ce9b0 0x7efc040cc960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009f10 tx=0x7efbf400ea70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7efbebfff700 1 -- 172.21.15.79:0/2754518488 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf4024830 con 0x7efc040ce9b0 2023-10-19T08:38:23.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7efc0a031700 1 -- 172.21.15.79:0/2754518488 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc040c7620 con 0x7efc040ce9b0 2023-10-19T08:38:23.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7efc0a031700 1 -- 172.21.15.79:0/2754518488 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc04154210 con 0x7efc040ce9b0 2023-10-19T08:38:23.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7efbebfff700 1 -- 172.21.15.79:0/2754518488 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf4024990 con 0x7efc040ce9b0 2023-10-19T08:38:23.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7efbebfff700 1 -- 172.21.15.79:0/2754518488 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf4024d20 con 0x7efc040ce9b0 2023-10-19T08:38:23.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.199+0000 7efc683ec700 1 -- 172.21.15.79:0/4056275490 wait complete. 2023-10-19T08:38:23.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7efc683ec700 1 Processor -- start 2023-10-19T08:38:23.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.201+0000 7faf57b17700 1 Processor -- start 2023-10-19T08:38:23.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.201+0000 7f4a666db700 1 --2- 172.21.15.79:0/762214027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a60161260 0x7f4a601fa070 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009f50 tx=0x7f4a50004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.200+0000 7fa5e37fe700 1 -- 172.21.15.79:0/3459199637 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f40045c0 con 0x7fa5fc0add00 2023-10-19T08:38:23.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.201+0000 7fa6011ab700 1 -- 172.21.15.79:0/3459199637 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5fc163960 con 0x7fa5fc0add00 2023-10-19T08:38:23.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.201+0000 7fa6011ab700 1 -- 172.21.15.79:0/3459199637 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5fc0c5b60 con 0x7fa5fc0add00 2023-10-19T08:38:23.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.201+0000 7f00654d7700 1 -- 172.21.15.79:0/3873349765 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005800e070 con 0x7f00601619a0 2023-10-19T08:38:23.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.201+0000 7f00654d7700 1 -- 172.21.15.79:0/3873349765 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005800b9c0 con 0x7f00601619a0 2023-10-19T08:38:23.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.201+0000 7f00654d7700 1 -- 172.21.15.79:0/3873349765 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005800bd70 con 0x7f00601619a0 2023-10-19T08:38:23.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.201+0000 7f44e5ffb700 1 -- 172.21.15.79:0/3709827593 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f44e8008040 con 0x7f44f0167320 2023-10-19T08:38:23.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.201+0000 7f44e5ffb700 1 --2- 172.21.15.79:0/3709827593 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f44d406a1b0 0x7f44d406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.201+0000 7f44e5ffb700 1 -- 172.21.15.79:0/3709827593 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f44e8088c10 con 0x7f44f0167320 2023-10-19T08:38:23.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.201+0000 7f44e5ffb700 1 --2- 172.21.15.79:0/3709827593 >> [v2:172.21.15.79:6800/942045489,v1:172.21.15.79:6801/942045489] conn(0x7f44d4073e90 0x7f44d40762d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.201+0000 7f44e5ffb700 1 -- 172.21.15.79:0/3709827593 --> [v2:172.21.15.79:6800/942045489,v1:172.21.15.79:6801/942045489] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f44d40769a0 con 0x7f44d4073e90 2023-10-19T08:38:23.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.201+0000 7f44e5ffb700 1 -- 172.21.15.79:0/3709827593 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44e8088fc0 con 0x7f44f0167320 2023-10-19T08:38:23.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7fa5e37fe700 1 -- 172.21.15.79:0/3459199637 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f4004720 con 0x7fa5fc0add00 2023-10-19T08:38:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7fa5e37fe700 1 -- 172.21.15.79:0/3459199637 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f4026450 con 0x7fa5fc0add00 2023-10-19T08:38:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7f44f4cdb700 1 --2- 172.21.15.79:0/3709827593 >> [v2:172.21.15.79:6800/942045489,v1:172.21.15.79:6801/942045489] conn(0x7f44d4073e90 0x7f44d40762d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7f44f54dc700 1 --2- 172.21.15.79:0/3709827593 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f44d406a1b0 0x7f44d406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.203+0000 7f44f4cdb700 1 --2- 172.21.15.79:0/3709827593 >> [v2:172.21.15.79:6800/942045489,v1:172.21.15.79:6801/942045489] conn(0x7f44d4073e90 0x7f44d40762d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.201+0000 7faf57b17700 1 -- start start 2023-10-19T08:38:23.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7faf57b17700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf50161260 0x7faf50161640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7faf57b17700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf500b2180 0x7faf500c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7faf57b17700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf50163f30 0x7faf501643e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7faf57b17700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf50164920 con 0x7faf50161260 2023-10-19T08:38:23.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7faf57b17700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf500b2600 con 0x7faf500b2180 2023-10-19T08:38:23.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7faf57b17700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf50161d40 con 0x7faf50163f30 2023-10-19T08:38:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.203+0000 7faf558b3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf50161260 0x7faf50161640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.203+0000 7faf550b2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf500b2180 0x7faf500c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.203+0000 7faf558b3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf50161260 0x7faf50161640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46322/0 (socket says 172.21.15.79:46322) 2023-10-19T08:38:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.203+0000 7faf558b3700 1 -- 172.21.15.79:0/3641491561 learned_addr learned my addr 172.21.15.79:0/3641491561 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.203+0000 7faf560b4700 1 --2- 172.21.15.79:0/3641491561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf50163f30 0x7faf501643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7efc0a031700 1 -- 172.21.15.79:0/2754518488 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efbe4000fc0 con 0x7efc040ce9b0 2023-10-19T08:38:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.203+0000 7efbebfff700 1 -- 172.21.15.79:0/2754518488 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efbf4023380 con 0x7efc040ce9b0 2023-10-19T08:38:23.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.201+0000 7efc683ec700 1 -- start start 2023-10-19T08:38:23.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7efc683ec700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc60070ee0 0x7efc6006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7efc683ec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc600caca0 0x7efc600c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7efc683ec700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc600cbf00 0x7efc6014ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7efc683ec700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc600c8970 con 0x7efc60070ee0 2023-10-19T08:38:23.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7efc683ec700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6006dd20 con 0x7efc600cbf00 2023-10-19T08:38:23.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7efc683ec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6006e5a0 con 0x7efc600caca0 2023-10-19T08:38:23.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7efc66188700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc60070ee0 0x7efc6006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7efc66188700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc60070ee0 0x7efc6006ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46316/0 (socket says 172.21.15.79:46316) 2023-10-19T08:38:23.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7efc66188700 1 -- 172.21.15.79:0/3244514916 learned_addr learned my addr 172.21.15.79:0/3244514916 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7efc65987700 1 --2- 172.21.15.79:0/3244514916 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc600caca0 0x7efc600c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7efc66188700 1 -- 172.21.15.79:0/3244514916 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc600caca0 msgr2=0x7efc600c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7efc66188700 1 --2- 172.21.15.79:0/3244514916 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc600caca0 0x7efc600c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7efc66188700 1 -- 172.21.15.79:0/3244514916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc600cbf00 msgr2=0x7efc6014ed10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-19T08:38:23.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7efc66188700 1 --2- 172.21.15.79:0/3244514916 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc600cbf00 0x7efc6014ed10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7efc66188700 1 -- 172.21.15.79:0/3244514916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc58009a70 con 0x7efc60070ee0 2023-10-19T08:38:23.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.203+0000 7efc65987700 1 --2- 172.21.15.79:0/3244514916 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc600caca0 0x7efc600c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:23.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.203+0000 7f44f54dc700 1 --2- 172.21.15.79:0/3709827593 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f44d406a1b0 0x7f44d406c670 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f44ec000c00 tx=0x7f44ec009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.203+0000 7faf550b2700 1 -- 172.21.15.79:0/3641491561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf50163f30 msgr2=0x7faf501643e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.203+0000 7faf550b2700 1 --2- 172.21.15.79:0/3641491561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf50163f30 0x7faf501643e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.203+0000 7faf550b2700 1 -- 172.21.15.79:0/3641491561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf50161260 msgr2=0x7faf50161640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.203+0000 7faf550b2700 1 --2- 172.21.15.79:0/3641491561 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf50161260 0x7faf50161640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.203+0000 7faf550b2700 1 -- 172.21.15.79:0/3641491561 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf50162020 con 0x7faf500b2180 2023-10-19T08:38:23.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.203+0000 7efbebfff700 1 --2- 172.21.15.79:0/2754518488 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efbf006a160 0x7efbf006c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.203+0000 7efc66188700 1 --2- 172.21.15.79:0/3244514916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc60070ee0 0x7efc6006ec80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00e910 tx=0x7efc5c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.203+0000 7efbebfff700 1 -- 172.21.15.79:0/2754518488 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efbf40994c0 con 0x7efc040ce9b0 2023-10-19T08:38:23.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.203+0000 7efc037fe700 1 --2- 172.21.15.79:0/2754518488 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efbf006a160 0x7efbf006c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7efbebfff700 1 --2- 172.21.15.79:0/2754518488 >> [v2:172.21.15.79:6817/3593161836,v1:172.21.15.79:6819/3593161836] conn(0x7efbf0073dc0 0x7efbf0076200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7efbebfff700 1 -- 172.21.15.79:0/2754518488 --> [v2:172.21.15.79:6817/3593161836,v1:172.21.15.79:6819/3593161836] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efbf00768d0 con 0x7efbf0073dc0 2023-10-19T08:38:23.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7fa6011ab700 1 -- 172.21.15.79:0/3459199637 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa5dc000fc0 con 0x7fa5fc0add00 2023-10-19T08:38:23.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7efc03fff700 1 --2- 172.21.15.79:0/2754518488 >> [v2:172.21.15.79:6817/3593161836,v1:172.21.15.79:6819/3593161836] conn(0x7efbf0073dc0 0x7efbf0076200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7f006873d700 1 -- 172.21.15.79:0/3873349765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00601619a0 msgr2=0x7f0060161e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.202+0000 7f006873d700 1 --2- 172.21.15.79:0/3873349765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00601619a0 0x7f0060161e30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f00600676e0 tx=0x7f005800b330 comp rx=0 tx=0).stop 2023-10-19T08:38:23.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7faf550b2700 1 --2- 172.21.15.79:0/3641491561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf500b2180 0x7faf500c7e70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faf50064010 tx=0x7faf4c00edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7f006873d700 1 -- 172.21.15.79:0/3873349765 shutdown_connections 2023-10-19T08:38:23.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7f006873d700 1 --2- 172.21.15.79:0/3873349765 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00600c3290 0x7f0060165af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7fa5e37fe700 1 -- 172.21.15.79:0/3459199637 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa5f401d420 con 0x7fa5fc0add00 2023-10-19T08:38:23.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7f006873d700 1 --2- 172.21.15.79:0/3873349765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00601619a0 0x7f0060161e30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7f006873d700 1 --2- 172.21.15.79:0/3873349765 >> v2:172.21.15.89:3300/0 conn(0x7f006006a220 0x7f006006a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7f006873d700 1 -- 172.21.15.79:0/3873349765 >> 172.21.15.79:0/3873349765 conn(0x7f006006dcc0 msgr2=0x7f006006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7f44e5ffb700 1 -- 172.21.15.79:0/3709827593 <== osd.0 v2:172.21.15.79:6800/942045489 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f44d40769a0 con 0x7f44d4073e90 2023-10-19T08:38:23.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7efbebfff700 1 -- 172.21.15.79:0/2754518488 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbf4064a30 con 0x7efc040ce9b0 2023-10-19T08:38:23.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7faf467fc700 1 -- 172.21.15.79:0/3641491561 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c005e00 con 0x7faf500b2180 2023-10-19T08:38:23.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7faf467fc700 1 -- 172.21.15.79:0/3641491561 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c00c7b0 con 0x7faf500b2180 2023-10-19T08:38:23.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7faf467fc700 1 -- 172.21.15.79:0/3641491561 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c00cb20 con 0x7faf500b2180 2023-10-19T08:38:23.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7efc03fff700 1 --2- 172.21.15.79:0/2754518488 >> [v2:172.21.15.79:6817/3593161836,v1:172.21.15.79:6819/3593161836] conn(0x7efbf0073dc0 0x7efbf0076200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7f006873d700 1 -- 172.21.15.79:0/3873349765 shutdown_connections 2023-10-19T08:38:23.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7fa5e37fe700 1 --2- 172.21.15.79:0/3459199637 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa5e806a0e0 0x7fa5e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7f4a567fc700 1 -- 172.21.15.79:0/762214027 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50010590 con 0x7f4a60161260 2023-10-19T08:38:23.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7f4a567fc700 1 -- 172.21.15.79:0/762214027 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a50010710 con 0x7f4a60161260 2023-10-19T08:38:23.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7f4a567fc700 1 -- 172.21.15.79:0/762214027 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50010ac0 con 0x7f4a60161260 2023-10-19T08:38:23.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7f4a6813e700 1 -- 172.21.15.79:0/762214027 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6015b800 con 0x7f4a60161260 2023-10-19T08:38:23.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7f4a6813e700 1 -- 172.21.15.79:0/762214027 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6015bdc0 con 0x7f4a60161260 2023-10-19T08:38:23.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.205+0000 7fa5e37fe700 1 -- 172.21.15.79:0/3459199637 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa5f4089ee0 con 0x7fa5fc0add00 2023-10-19T08:38:23.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.205+0000 7fa5fad9d700 1 --2- 172.21.15.79:0/3459199637 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa5e806a0e0 0x7fa5e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.205+0000 7fa5e37fe700 1 --2- 172.21.15.79:0/3459199637 >> [v2:172.21.15.89:6816/4289815223,v1:172.21.15.89:6817/4289815223] conn(0x7fa5e8073d40 0x7fa5e8076180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.205+0000 7fa5e37fe700 1 -- 172.21.15.79:0/3459199637 --> [v2:172.21.15.89:6816/4289815223,v1:172.21.15.89:6817/4289815223] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5e8076850 con 0x7fa5e8073d40 2023-10-19T08:38:23.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.204+0000 7f006873d700 1 -- 172.21.15.79:0/3873349765 wait complete. 2023-10-19T08:38:23.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.205+0000 7fa5fb59e700 1 --2- 172.21.15.79:0/3459199637 >> [v2:172.21.15.89:6816/4289815223,v1:172.21.15.89:6817/4289815223] conn(0x7fa5e8073d40 0x7fa5e8076180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.205+0000 7efc037fe700 1 --2- 172.21.15.79:0/2754518488 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efbf006a160 0x7efbf006c620 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efbf8000f60 tx=0x7efbf8007a70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.205+0000 7faf57b17700 1 -- 172.21.15.79:0/3641491561 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf50162300 con 0x7faf500b2180 2023-10-19T08:38:23.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.205+0000 7faf57b17700 1 -- 172.21.15.79:0/3641491561 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf501628c0 con 0x7faf500b2180 2023-10-19T08:38:23.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.205+0000 7fa5fad9d700 1 --2- 172.21.15.79:0/3459199637 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa5e806a0e0 0x7fa5e806c5a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec000f60 tx=0x7fa5ec007a40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.205+0000 7efbebfff700 1 -- 172.21.15.79:0/2754518488 <== osd.3 v2:172.21.15.79:6817/3593161836 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7efbf00768d0 con 0x7efbf0073dc0 2023-10-19T08:38:23.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.205+0000 7fa5fb59e700 1 --2- 172.21.15.79:0/3459199637 >> [v2:172.21.15.89:6816/4289815223,v1:172.21.15.89:6817/4289815223] conn(0x7fa5e8073d40 0x7fa5e8076180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.205+0000 7faf57b17700 1 -- 172.21.15.79:0/3641491561 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faf501654c0 con 0x7faf500b2180 2023-10-19T08:38:23.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.206+0000 7f006873d700 1 Processor -- start 2023-10-19T08:38:23.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.206+0000 7f006873d700 1 -- start start 2023-10-19T08:38:23.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.206+0000 7fa5e37fe700 1 -- 172.21.15.79:0/3459199637 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5f40552a0 con 0x7fa5fc0add00 2023-10-19T08:38:23.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.207+0000 7f006873d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f006006a220 0x7f006014e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.207+0000 7f006873d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00600c3290 0x7f00601543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.207+0000 7f006873d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00601619a0 0x7f0060150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.207+0000 7f006873d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0060147c00 con 0x7f00601619a0 2023-10-19T08:38:23.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.207+0000 7f006873d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0060151b80 con 0x7f006006a220 2023-10-19T08:38:23.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.207+0000 7f006873d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0060152210 con 0x7f00600c3290 2023-10-19T08:38:23.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.208+0000 7f0066cda700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00601619a0 0x7f0060150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.208+0000 7f0066cda700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00601619a0 0x7f0060150b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46346/0 (socket says 172.21.15.79:46346) 2023-10-19T08:38:23.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.208+0000 7f0066cda700 1 -- 172.21.15.79:0/288750549 learned_addr learned my addr 172.21.15.79:0/288750549 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.208+0000 7f0065cd8700 1 --2- 172.21.15.79:0/288750549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00600c3290 0x7f00601543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.208+0000 7f00664d9700 1 --2- 172.21.15.79:0/288750549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f006006a220 0x7f006014e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.208+0000 7faf467fc700 1 -- 172.21.15.79:0/3641491561 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faf4c00cc80 con 0x7faf500b2180 2023-10-19T08:38:23.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.208+0000 7f0066cda700 1 -- 172.21.15.79:0/288750549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00600c3290 msgr2=0x7f00601543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.208+0000 7f0066cda700 1 --2- 172.21.15.79:0/288750549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00600c3290 0x7f00601543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.208+0000 7f0066cda700 1 -- 172.21.15.79:0/288750549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f006006a220 msgr2=0x7f006014e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.208+0000 7f0066cda700 1 --2- 172.21.15.79:0/288750549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f006006a220 0x7f006014e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.208+0000 7f0066cda700 1 -- 172.21.15.79:0/288750549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0058009b30 con 0x7f00601619a0 2023-10-19T08:38:23.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.208+0000 7fa5e37fe700 1 -- 172.21.15.79:0/3459199637 <== osd.5 v2:172.21.15.89:6816/4289815223 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa5e8076850 con 0x7fa5e8073d40 2023-10-19T08:38:23.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.208+0000 7f0066cda700 1 --2- 172.21.15.79:0/288750549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00601619a0 0x7f0060150b70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f005800b370 tx=0x7f0058004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.208+0000 7faf467fc700 1 --2- 172.21.15.79:0/3641491561 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faf3406a0e0 0x7faf3406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.208+0000 7faf467fc700 1 -- 172.21.15.79:0/3641491561 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faf4c0885d0 con 0x7faf500b2180 2023-10-19T08:38:23.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.209+0000 7faf467fc700 1 --2- 172.21.15.79:0/3641491561 >> [v2:172.21.15.79:6816/2397905014,v1:172.21.15.79:6818/2397905014] conn(0x7faf34073cc0 0x7faf34076100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.209+0000 7faf467fc700 1 -- 172.21.15.79:0/3641491561 --> [v2:172.21.15.79:6816/2397905014,v1:172.21.15.79:6818/2397905014] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf340767d0 con 0x7faf34073cc0 2023-10-19T08:38:23.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.209+0000 7faf560b4700 1 --2- 172.21.15.79:0/3641491561 >> [v2:172.21.15.79:6816/2397905014,v1:172.21.15.79:6818/2397905014] conn(0x7faf34073cc0 0x7faf34076100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.210+0000 7faf560b4700 1 --2- 172.21.15.79:0/3641491561 >> [v2:172.21.15.79:6816/2397905014,v1:172.21.15.79:6818/2397905014] conn(0x7faf34073cc0 0x7faf34076100 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.206+0000 7f886b422700 1 Processor -- start 2023-10-19T08:38:23.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.206+0000 7f886b422700 1 -- start start 2023-10-19T08:38:23.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.207+0000 7f886b422700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f88640cde00 0x7f886416e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.207+0000 7f886b422700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f88640710b0 0x7f88640890e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.207+0000 7f886b422700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88640c9ec0 con 0x7f88640adc00 2023-10-19T08:38:23.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.207+0000 7f886b422700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88640cad00 con 0x7f88640710b0 2023-10-19T08:38:23.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.207+0000 7f886b422700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886416e5d0 con 0x7f88640cde00 2023-10-19T08:38:23.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.207+0000 7f88691be700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f88640cde00 0x7f886416e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.208+0000 7f88689bd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f88640adc00 0x7f88640709a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:41252/0 (socket says 172.21.15.79:41252) 2023-10-19T08:38:23.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.208+0000 7f88689bd700 1 -- 172.21.15.79:0/3093734235 learned_addr learned my addr 172.21.15.79:0/3093734235 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:23.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.208+0000 7f88699bf700 1 --2- 172.21.15.79:0/3093734235 >> v2:172.21.15.79:3300/0 conn(0x7f88640710b0 0x7f88640890e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.210+0000 7f88691be700 1 -- 172.21.15.79:0/3093734235 >> v2:172.21.15.79:3300/0 conn(0x7f88640710b0 msgr2=0x7f88640890e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.210+0000 7f88691be700 1 --2- 172.21.15.79:0/3093734235 >> v2:172.21.15.79:3300/0 conn(0x7f88640710b0 0x7f88640890e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.210+0000 7f88691be700 1 -- 172.21.15.79:0/3093734235 >> v1:172.21.15.89:6789/0 conn(0x7f88640adc00 legacy=0x7f88640709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.210+0000 7f88691be700 1 -- 172.21.15.79:0/3093734235 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8864169f90 con 0x7f88640cde00 2023-10-19T08:38:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.211+0000 7f88691be700 1 --2- 172.21.15.79:0/3093734235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88640cde00 0x7f886416e090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f88640cc290 tx=0x7f886000bdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c3e2c4fbaa68038 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.209+0000 7f0056ffd700 1 -- 172.21.15.79:0/288750549 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00580099b0 con 0x7f00601619a0 2023-10-19T08:38:23.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.209+0000 7f0056ffd700 1 -- 172.21.15.79:0/288750549 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0058004250 con 0x7f00601619a0 2023-10-19T08:38:23.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.209+0000 7f0056ffd700 1 -- 172.21.15.79:0/288750549 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00580045e0 con 0x7f00601619a0 2023-10-19T08:38:23.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.209+0000 7f006873d700 1 -- 172.21.15.79:0/288750549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00601524f0 con 0x7f00601619a0 2023-10-19T08:38:23.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.209+0000 7f006873d700 1 -- 172.21.15.79:0/288750549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0060152ab0 con 0x7f00601619a0 2023-10-19T08:38:23.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.209+0000 7f4a567fc700 1 -- 172.21.15.79:0/762214027 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4a50010c20 con 0x7f4a60161260 2023-10-19T08:38:23.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.209+0000 7f4a567fc700 1 --2- 172.21.15.79:0/762214027 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4a4406a130 0x7f4a4406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.209+0000 7f4a567fc700 1 -- 172.21.15.79:0/762214027 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4a5008a470 con 0x7f4a60161260 2023-10-19T08:38:23.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.210+0000 7f4a6813e700 1 --2- 172.21.15.79:0/762214027 >> [v2:172.21.15.89:6800/1904262341,v1:172.21.15.89:6801/1904262341] conn(0x7f4a480015e0 0x7f4a48003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.210+0000 7f4a6813e700 1 -- 172.21.15.79:0/762214027 --> [v2:172.21.15.89:6800/1904262341,v1:172.21.15.89:6801/1904262341] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a48006bd0 con 0x7f4a480015e0 2023-10-19T08:38:23.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.210+0000 7f4a656d9700 1 --2- 172.21.15.79:0/762214027 >> [v2:172.21.15.89:6800/1904262341,v1:172.21.15.89:6801/1904262341] conn(0x7f4a480015e0 0x7f4a48003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.211+0000 7f4a65eda700 1 --2- 172.21.15.79:0/762214027 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4a4406a130 0x7f4a4406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.211+0000 7faf558b3700 1 --2- 172.21.15.79:0/3641491561 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faf3406a0e0 0x7faf3406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.211+0000 7faf467fc700 1 -- 172.21.15.79:0/3641491561 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf4c0539d0 con 0x7faf500b2180 2023-10-19T08:38:23.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.211+0000 7faf467fc700 1 -- 172.21.15.79:0/3641491561 <== osd.1 v2:172.21.15.79:6816/2397905014 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7faf340767d0 con 0x7faf34073cc0 2023-10-19T08:38:23.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.211+0000 7faf558b3700 1 --2- 172.21.15.79:0/3641491561 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faf3406a0e0 0x7faf3406c5a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf480070b0 tx=0x7faf4800d040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.211+0000 7f4a65eda700 1 --2- 172.21.15.79:0/762214027 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4a4406a130 0x7f4a4406c5f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4a58007fd0 tx=0x7f4a58007dc0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.208+0000 7f885bfff700 1 -- 172.21.15.79:0/3093734235 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658244882 0 0) 0x7f88640c9ec0 con 0x7f88640adc00 2023-10-19T08:38:23.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.211+0000 7f885bfff700 1 -- 172.21.15.79:0/3093734235 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886000dc70 con 0x7f88640cde00 2023-10-19T08:38:23.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.212+0000 7f885bfff700 1 -- 172.21.15.79:0/3093734235 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886000ddd0 con 0x7f88640cde00 2023-10-19T08:38:23.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.212+0000 7f885bfff700 1 -- 172.21.15.79:0/3093734235 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860010670 con 0x7f88640cde00 2023-10-19T08:38:23.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.212+0000 7f0056ffd700 1 -- 172.21.15.79:0/288750549 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0058004740 con 0x7f00601619a0 2023-10-19T08:38:23.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.212+0000 7f4a656d9700 1 --2- 172.21.15.79:0/762214027 >> [v2:172.21.15.89:6800/1904262341,v1:172.21.15.89:6801/1904262341] conn(0x7f4a480015e0 0x7f4a48003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.212+0000 7f886b422700 1 -- 172.21.15.79:0/3093734235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88640cde00 msgr2=0x7f886416e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.212+0000 7f886b422700 1 --2- 172.21.15.79:0/3093734235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88640cde00 0x7f886416e090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f88640cc290 tx=0x7f886000bdc0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.213+0000 7f006873d700 1 -- 172.21.15.79:0/288750549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0048000fc0 con 0x7f00601619a0 2023-10-19T08:38:23.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.213+0000 7f0056ffd700 1 --2- 172.21.15.79:0/288750549 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f004406a130 0x7f004406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.213+0000 7f0056ffd700 1 -- 172.21.15.79:0/288750549 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0058089810 con 0x7f00601619a0 2023-10-19T08:38:23.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.213+0000 7f0056ffd700 1 --2- 172.21.15.79:0/288750549 >> [v2:172.21.15.89:6808/1735906914,v1:172.21.15.89:6809/1735906914] conn(0x7f0044073d90 0x7f00440761d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.213+0000 7f0056ffd700 1 -- 172.21.15.79:0/288750549 --> [v2:172.21.15.89:6808/1735906914,v1:172.21.15.89:6809/1735906914] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00440768a0 con 0x7f0044073d90 2023-10-19T08:38:23.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.213+0000 7f0056ffd700 1 -- 172.21.15.79:0/288750549 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0058054d00 con 0x7f00601619a0 2023-10-19T08:38:23.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.214+0000 7f00664d9700 1 --2- 172.21.15.79:0/288750549 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f004406a130 0x7f004406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.214+0000 7f886b422700 1 -- 172.21.15.79:0/3093734235 shutdown_connections 2023-10-19T08:38:23.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.214+0000 7f886b422700 1 --2- 172.21.15.79:0/3093734235 >> v2:172.21.15.79:3300/0 conn(0x7f88640710b0 0x7f88640890e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.214+0000 7f886b422700 1 --2- 172.21.15.79:0/3093734235 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88640cde00 0x7f886416e090 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.214+0000 7f886b422700 1 -- 172.21.15.79:0/3093734235 >> 172.21.15.79:0/3093734235 conn(0x7f88640cb3e0 msgr2=0x7f88640cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.214+0000 7f4a567fc700 1 -- 172.21.15.79:0/762214027 <== osd.6 v2:172.21.15.89:6800/1904262341 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f4a48006bd0 con 0x7f4a480015e0 2023-10-19T08:38:23.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.214+0000 7f0065cd8700 1 --2- 172.21.15.79:0/288750549 >> [v2:172.21.15.89:6808/1735906914,v1:172.21.15.89:6809/1735906914] conn(0x7f0044073d90 0x7f00440761d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.214+0000 7f00664d9700 1 --2- 172.21.15.79:0/288750549 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f004406a130 0x7f004406c5f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f005c006b20 tx=0x7f005c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.214+0000 7f0065cd8700 1 --2- 172.21.15.79:0/288750549 >> [v2:172.21.15.89:6808/1735906914,v1:172.21.15.89:6809/1735906914] conn(0x7f0044073d90 0x7f00440761d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.214+0000 7f886b422700 1 -- 172.21.15.79:0/3093734235 shutdown_connections 2023-10-19T08:38:23.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.212+0000 7efc56ffd700 1 -- 172.21.15.79:0/3244514916 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c0096a0 con 0x7efc60070ee0 2023-10-19T08:38:23.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.212+0000 7efc56ffd700 1 -- 172.21.15.79:0/3244514916 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5c00c850 con 0x7efc60070ee0 2023-10-19T08:38:23.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.212+0000 7efc683ec700 1 -- 172.21.15.79:0/3244514916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6006dfe0 con 0x7efc60070ee0 2023-10-19T08:38:23.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.213+0000 7efc683ec700 1 -- 172.21.15.79:0/3244514916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6014fce0 con 0x7efc60070ee0 2023-10-19T08:38:23.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.213+0000 7efc56ffd700 1 -- 172.21.15.79:0/3244514916 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5c00cc00 con 0x7efc60070ee0 2023-10-19T08:38:23.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.213+0000 7efc683ec700 1 -- 172.21.15.79:0/3244514916 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc48000fc0 con 0x7efc60070ee0 2023-10-19T08:38:23.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.215+0000 7f886b422700 1 -- 172.21.15.79:0/3093734235 wait complete. 2023-10-19T08:38:23.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.216+0000 7f0056ffd700 1 -- 172.21.15.79:0/288750549 <== osd.4 v2:172.21.15.89:6808/1735906914 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f00440768a0 con 0x7f0044073d90 2023-10-19T08:38:23.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.216+0000 7f886b422700 1 Processor -- start 2023-10-19T08:38:23.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.218+0000 7efc56ffd700 1 -- 172.21.15.79:0/3244514916 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efc5c00cd60 con 0x7efc60070ee0 2023-10-19T08:38:23.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.218+0000 7efc56ffd700 1 --2- 172.21.15.79:0/3244514916 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efc4406a130 0x7efc4406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.218+0000 7efc56ffd700 1 -- 172.21.15.79:0/3244514916 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efc5c088a80 con 0x7efc60070ee0 2023-10-19T08:38:23.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.218+0000 7efc56ffd700 1 --2- 172.21.15.79:0/3244514916 >> [v2:172.21.15.89:6824/3325999642,v1:172.21.15.89:6825/3325999642] conn(0x7efc44073e10 0x7efc44076250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.218+0000 7efc56ffd700 1 -- 172.21.15.79:0/3244514916 --> [v2:172.21.15.89:6824/3325999642,v1:172.21.15.89:6825/3325999642] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc44076920 con 0x7efc44073e10 2023-10-19T08:38:23.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.218+0000 7efc56ffd700 1 -- 172.21.15.79:0/3244514916 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc5c088ea0 con 0x7efc60070ee0 2023-10-19T08:38:23.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.219+0000 7efc66989700 1 --2- 172.21.15.79:0/3244514916 >> [v2:172.21.15.89:6824/3325999642,v1:172.21.15.89:6825/3325999642] conn(0x7efc44073e10 0x7efc44076250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.218+0000 7f886b422700 1 -- start start 2023-10-19T08:38:23.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.219+0000 7f886b422700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88640710b0 0x7f886420a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.219+0000 7f886b422700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88640adc00 0x7f88640c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.219+0000 7f886b422700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88640cde00 0x7f88640c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.219+0000 7f886b422700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88642077e0 con 0x7f88640cde00 2023-10-19T08:38:23.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.219+0000 7f886b422700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8864207a50 con 0x7f88640adc00 2023-10-19T08:38:23.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.219+0000 7f886b422700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8864207d30 con 0x7f88640710b0 2023-10-19T08:38:23.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.219+0000 7f88691be700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88640710b0 0x7f886420a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.219+0000 7f88691be700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88640710b0 0x7f886420a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:48986/0 (socket says 172.21.15.79:48986) 2023-10-19T08:38:23.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.219+0000 7f88691be700 1 -- 172.21.15.79:0/1453614851 learned_addr learned my addr 172.21.15.79:0/1453614851 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.219+0000 7f88689bd700 1 --2- 172.21.15.79:0/1453614851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88640adc00 0x7f88640c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.219+0000 7f88691be700 1 -- 172.21.15.79:0/1453614851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88640adc00 msgr2=0x7f88640c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.220+0000 7f88691be700 1 --2- 172.21.15.79:0/1453614851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88640adc00 0x7f88640c5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.220+0000 7f88691be700 1 -- 172.21.15.79:0/1453614851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88640cde00 msgr2=0x7f88640c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.220+0000 7f88699bf700 1 --2- 172.21.15.79:0/1453614851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88640cde00 0x7f88640c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.220+0000 7f88691be700 1 --2- 172.21.15.79:0/1453614851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88640cde00 0x7f88640c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.220+0000 7f88691be700 1 -- 172.21.15.79:0/1453614851 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886000b740 con 0x7f88640710b0 2023-10-19T08:38:23.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.219+0000 7efc66989700 1 --2- 172.21.15.79:0/3244514916 >> [v2:172.21.15.89:6824/3325999642,v1:172.21.15.89:6825/3325999642] conn(0x7efc44073e10 0x7efc44076250 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.220+0000 7f88699bf700 1 --2- 172.21.15.79:0/1453614851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88640cde00 0x7f88640c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:23.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.220+0000 7f88691be700 1 --2- 172.21.15.79:0/1453614851 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88640710b0 0x7f886420a590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f886000b2c0 tx=0x7f8860004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.220+0000 7efc56ffd700 1 -- 172.21.15.79:0/3244514916 <== osd.7 v2:172.21.15.89:6824/3325999642 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7efc44076920 con 0x7efc44073e10 2023-10-19T08:38:23.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.228+0000 7f44f7740700 1 -- 172.21.15.79:0/3709827593 --> [v2:172.21.15.79:6800/942045489,v1:172.21.15.79:6801/942045489] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f44d0002d40 con 0x7f44d4073e90 2023-10-19T08:38:23.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.228+0000 7efc65987700 1 --2- 172.21.15.79:0/3244514916 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efc4406a130 0x7efc4406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.229+0000 7efc65987700 1 --2- 172.21.15.79:0/3244514916 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efc4406a130 0x7efc4406c5f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efc601554e0 tx=0x7efc50008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.235+0000 7f44e5ffb700 1 -- 172.21.15.79:0/3709827593 <== osd.0 v2:172.21.15.79:6800/942045489 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f44d0002d40 con 0x7f44d4073e90 2023-10-19T08:38:23.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.235+0000 7f8859ffb700 1 -- 172.21.15.79:0/1453614851 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886001d070 con 0x7f88640710b0 2023-10-19T08:38:23.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.235+0000 7f44f7740700 1 -- 172.21.15.79:0/3709827593 >> [v2:172.21.15.79:6800/942045489,v1:172.21.15.79:6801/942045489] conn(0x7f44d4073e90 msgr2=0x7f44d40762d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.235+0000 7f44f7740700 1 --2- 172.21.15.79:0/3709827593 >> [v2:172.21.15.79:6800/942045489,v1:172.21.15.79:6801/942045489] conn(0x7f44d4073e90 0x7f44d40762d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.235+0000 7f44f7740700 1 -- 172.21.15.79:0/3709827593 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f44d406a1b0 msgr2=0x7f44d406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.235+0000 7f44f7740700 1 --2- 172.21.15.79:0/3709827593 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f44d406a1b0 0x7f44d406c670 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f44ec000c00 tx=0x7f44ec009040 comp rx=0 tx=0).stop 2023-10-19T08:38:23.333 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.235+0000 7f44f7740700 1 -- 172.21.15.79:0/3709827593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44f0167320 msgr2=0x7f44f01677d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.235+0000 7f44f7740700 1 --2- 172.21.15.79:0/3709827593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44f0167320 0x7f44f01677d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f44f00ce8c0 tx=0x7f44e8004550 comp rx=0 tx=0).stop 2023-10-19T08:38:23.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.235+0000 7f8859ffb700 1 -- 172.21.15.79:0/1453614851 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88600039f0 con 0x7f88640710b0 2023-10-19T08:38:23.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.235+0000 7f8859ffb700 1 -- 172.21.15.79:0/1453614851 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860003d80 con 0x7f88640710b0 2023-10-19T08:38:23.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.235+0000 7f886b422700 1 -- 172.21.15.79:0/1453614851 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8864208010 con 0x7f88640710b0 2023-10-19T08:38:23.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.235+0000 7f886b422700 1 -- 172.21.15.79:0/1453614851 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88642085d0 con 0x7f88640710b0 2023-10-19T08:38:23.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.236+0000 7f886b422700 1 -- 172.21.15.79:0/1453614851 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8844000fc0 con 0x7f88640710b0 2023-10-19T08:38:23.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.238+0000 7f8859ffb700 1 -- 172.21.15.79:0/1453614851 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8860019400 con 0x7f88640710b0 2023-10-19T08:38:23.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.238+0000 7f8859ffb700 1 --2- 172.21.15.79:0/1453614851 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f884806a130 0x7f884806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.239+0000 7f8859ffb700 1 -- 172.21.15.79:0/1453614851 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8860089bb0 con 0x7f88640710b0 2023-10-19T08:38:23.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.239+0000 7f88689bd700 1 --2- 172.21.15.79:0/1453614851 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f884806a130 0x7f884806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.239+0000 7f8859ffb700 1 --2- 172.21.15.79:0/1453614851 >> [v2:172.21.15.79:6802/184279381,v1:172.21.15.79:6804/184279381] conn(0x7f8848073e10 0x7f8848076250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.239+0000 7f8859ffb700 1 -- 172.21.15.79:0/1453614851 --> [v2:172.21.15.79:6802/184279381,v1:172.21.15.79:6804/184279381] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8848076920 con 0x7f8848073e10 2023-10-19T08:38:23.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.239+0000 7f8859ffb700 1 -- 172.21.15.79:0/1453614851 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8860089fd0 con 0x7f88640710b0 2023-10-19T08:38:23.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.239+0000 7f88699bf700 1 --2- 172.21.15.79:0/1453614851 >> [v2:172.21.15.79:6802/184279381,v1:172.21.15.79:6804/184279381] conn(0x7f8848073e10 0x7f8848076250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.239+0000 7f88699bf700 1 --2- 172.21.15.79:0/1453614851 >> [v2:172.21.15.79:6802/184279381,v1:172.21.15.79:6804/184279381] conn(0x7f8848073e10 0x7f8848076250 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.240+0000 7f88689bd700 1 --2- 172.21.15.79:0/1453614851 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f884806a130 0x7f884806c5f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f88642089b0 tx=0x7f8854009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.240+0000 7f44f5cdd700 1 -- 172.21.15.79:0/3709827593 reap_dead start 2023-10-19T08:38:23.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.240+0000 7f44f7740700 1 -- 172.21.15.79:0/3709827593 shutdown_connections 2023-10-19T08:38:23.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.240+0000 7f44f7740700 1 -- 172.21.15.79:0/3709827593 >> 172.21.15.79:0/3709827593 conn(0x7f44f00cb3e0 msgr2=0x7f44f006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.240+0000 7fa6011ab700 1 -- 172.21.15.79:0/3459199637 --> [v2:172.21.15.89:6816/4289815223,v1:172.21.15.89:6817/4289815223] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa5dc002d40 con 0x7fa5e8073d40 2023-10-19T08:38:23.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.240+0000 7f8859ffb700 1 -- 172.21.15.79:0/1453614851 <== osd.2 v2:172.21.15.79:6802/184279381 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f8848076920 con 0x7f8848073e10 2023-10-19T08:38:23.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.240+0000 7f44f7740700 1 -- 172.21.15.79:0/3709827593 shutdown_connections 2023-10-19T08:38:23.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.240+0000 7f44f7740700 1 -- 172.21.15.79:0/3709827593 wait complete. 2023-10-19T08:38:23.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.244+0000 7efc0a031700 1 -- 172.21.15.79:0/2754518488 --> [v2:172.21.15.79:6817/3593161836,v1:172.21.15.79:6819/3593161836] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efbe4002d40 con 0x7efbf0073dc0 2023-10-19T08:38:23.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.244+0000 7efbebfff700 1 -- 172.21.15.79:0/2754518488 <== osd.3 v2:172.21.15.79:6817/3593161836 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efbe4002d40 con 0x7efbf0073dc0 2023-10-19T08:38:23.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.244+0000 7fa5e37fe700 1 -- 172.21.15.79:0/3459199637 <== osd.5 v2:172.21.15.89:6816/4289815223 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa5dc002d40 con 0x7fa5e8073d40 2023-10-19T08:38:23.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.245+0000 7efc0a031700 1 -- 172.21.15.79:0/2754518488 >> [v2:172.21.15.79:6817/3593161836,v1:172.21.15.79:6819/3593161836] conn(0x7efbf0073dc0 msgr2=0x7efbf0076200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.245+0000 7efc0a031700 1 --2- 172.21.15.79:0/2754518488 >> [v2:172.21.15.79:6817/3593161836,v1:172.21.15.79:6819/3593161836] conn(0x7efbf0073dc0 0x7efbf0076200 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.245+0000 7efc0a031700 1 -- 172.21.15.79:0/2754518488 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efbf006a160 msgr2=0x7efbf006c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.245+0000 7efc0a031700 1 --2- 172.21.15.79:0/2754518488 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efbf006a160 0x7efbf006c620 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efbf8000f60 tx=0x7efbf8007a70 comp rx=0 tx=0).stop 2023-10-19T08:38:23.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.245+0000 7efc0a031700 1 -- 172.21.15.79:0/2754518488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc040ce9b0 msgr2=0x7efc040cc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.245+0000 7efc0a031700 1 --2- 172.21.15.79:0/2754518488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc040ce9b0 0x7efc040cc960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009f10 tx=0x7efbf400ea70 comp rx=0 tx=0).stop 2023-10-19T08:38:23.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.245+0000 7efc03fff700 1 -- 172.21.15.79:0/2754518488 reap_dead start 2023-10-19T08:38:23.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.245+0000 7efc0a031700 1 -- 172.21.15.79:0/2754518488 shutdown_connections 2023-10-19T08:38:23.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.245+0000 7efc0a031700 1 -- 172.21.15.79:0/2754518488 >> 172.21.15.79:0/2754518488 conn(0x7efc040cf9a0 msgr2=0x7efc040b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.245+0000 7efc0a031700 1 -- 172.21.15.79:0/2754518488 shutdown_connections 2023-10-19T08:38:23.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.245+0000 7efc0a031700 1 -- 172.21.15.79:0/2754518488 wait complete. 2023-10-19T08:38:23.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.246+0000 7faf57b17700 1 -- 172.21.15.79:0/3641491561 --> [v2:172.21.15.79:6816/2397905014,v1:172.21.15.79:6818/2397905014] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faf501651e0 con 0x7faf34073cc0 2023-10-19T08:38:23.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.246+0000 7faf467fc700 1 -- 172.21.15.79:0/3641491561 <== osd.1 v2:172.21.15.79:6816/2397905014 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faf400050d0 con 0x7faf34073cc0 2023-10-19T08:38:23.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.247+0000 7faf57b17700 1 -- 172.21.15.79:0/3641491561 >> [v2:172.21.15.79:6816/2397905014,v1:172.21.15.79:6818/2397905014] conn(0x7faf34073cc0 msgr2=0x7faf34076100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.247+0000 7faf57b17700 1 --2- 172.21.15.79:0/3641491561 >> [v2:172.21.15.79:6816/2397905014,v1:172.21.15.79:6818/2397905014] conn(0x7faf34073cc0 0x7faf34076100 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.248+0000 7faf57b17700 1 -- 172.21.15.79:0/3641491561 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faf3406a0e0 msgr2=0x7faf3406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.248+0000 7faf57b17700 1 --2- 172.21.15.79:0/3641491561 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faf3406a0e0 0x7faf3406c5a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf480070b0 tx=0x7faf4800d040 comp rx=0 tx=0).stop 2023-10-19T08:38:23.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.248+0000 7faf57b17700 1 -- 172.21.15.79:0/3641491561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf500b2180 msgr2=0x7faf500c7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.248+0000 7faf57b17700 1 --2- 172.21.15.79:0/3641491561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf500b2180 0x7faf500c7e70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faf50064010 tx=0x7faf4c00edd0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.248+0000 7f4a6813e700 1 -- 172.21.15.79:0/762214027 --> [v2:172.21.15.89:6800/1904262341,v1:172.21.15.89:6801/1904262341] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4a48005cb0 con 0x7f4a480015e0 2023-10-19T08:38:23.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.248+0000 7faf560b4700 1 -- 172.21.15.79:0/3641491561 reap_dead start 2023-10-19T08:38:23.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.248+0000 7faf57b17700 1 -- 172.21.15.79:0/3641491561 shutdown_connections 2023-10-19T08:38:23.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.248+0000 7faf57b17700 1 -- 172.21.15.79:0/3641491561 >> 172.21.15.79:0/3641491561 conn(0x7faf500ce960 msgr2=0x7faf5006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.248+0000 7fa6011ab700 1 -- 172.21.15.79:0/3459199637 >> [v2:172.21.15.89:6816/4289815223,v1:172.21.15.89:6817/4289815223] conn(0x7fa5e8073d40 msgr2=0x7fa5e8076180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.248+0000 7fa6011ab700 1 --2- 172.21.15.79:0/3459199637 >> [v2:172.21.15.89:6816/4289815223,v1:172.21.15.89:6817/4289815223] conn(0x7fa5e8073d40 0x7fa5e8076180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.248+0000 7faf57b17700 1 -- 172.21.15.79:0/3641491561 shutdown_connections 2023-10-19T08:38:23.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.248+0000 7fa6011ab700 1 -- 172.21.15.79:0/3459199637 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa5e806a0e0 msgr2=0x7fa5e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.248+0000 7fa6011ab700 1 --2- 172.21.15.79:0/3459199637 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa5e806a0e0 0x7fa5e806c5a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec000f60 tx=0x7fa5ec007a40 comp rx=0 tx=0).stop 2023-10-19T08:38:23.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.248+0000 7fa6011ab700 1 -- 172.21.15.79:0/3459199637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5fc0add00 msgr2=0x7fa5fc162b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.248+0000 7fa6011ab700 1 --2- 172.21.15.79:0/3459199637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa5fc0add00 0x7fa5fc162b30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4000f80 tx=0x7fa5f4004ad0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.248+0000 7faf57b17700 1 -- 172.21.15.79:0/3641491561 wait complete. 2023-10-19T08:38:23.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.248+0000 7fa5fb59e700 1 -- 172.21.15.79:0/3459199637 reap_dead start 2023-10-19T08:38:23.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.248+0000 7fa6011ab700 1 -- 172.21.15.79:0/3459199637 shutdown_connections 2023-10-19T08:38:23.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.248+0000 7fa6011ab700 1 -- 172.21.15.79:0/3459199637 >> 172.21.15.79:0/3459199637 conn(0x7fa5fc0ce960 msgr2=0x7fa5fc0ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.249+0000 7fa6011ab700 1 -- 172.21.15.79:0/3459199637 shutdown_connections 2023-10-19T08:38:23.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.249+0000 7fa6011ab700 1 -- 172.21.15.79:0/3459199637 wait complete. 2023-10-19T08:38:23.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.251+0000 7f4a567fc700 1 -- 172.21.15.79:0/762214027 <== osd.6 v2:172.21.15.89:6800/1904262341 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4a48005cb0 con 0x7f4a480015e0 2023-10-19T08:38:23.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.251+0000 7efc683ec700 1 -- 172.21.15.79:0/3244514916 --> [v2:172.21.15.89:6824/3325999642,v1:172.21.15.89:6825/3325999642] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efc48002d40 con 0x7efc44073e10 2023-10-19T08:38:23.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.252+0000 7efc56ffd700 1 -- 172.21.15.79:0/3244514916 <== osd.7 v2:172.21.15.89:6824/3325999642 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efc48002d40 con 0x7efc44073e10 2023-10-19T08:38:23.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.253+0000 7efc683ec700 1 -- 172.21.15.79:0/3244514916 >> [v2:172.21.15.89:6824/3325999642,v1:172.21.15.89:6825/3325999642] conn(0x7efc44073e10 msgr2=0x7efc44076250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.253+0000 7efc683ec700 1 --2- 172.21.15.79:0/3244514916 >> [v2:172.21.15.89:6824/3325999642,v1:172.21.15.89:6825/3325999642] conn(0x7efc44073e10 0x7efc44076250 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.253+0000 7efc683ec700 1 -- 172.21.15.79:0/3244514916 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efc4406a130 msgr2=0x7efc4406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.253+0000 7efc683ec700 1 --2- 172.21.15.79:0/3244514916 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efc4406a130 0x7efc4406c5f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efc601554e0 tx=0x7efc50008040 comp rx=0 tx=0).stop 2023-10-19T08:38:23.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.253+0000 7efc683ec700 1 -- 172.21.15.79:0/3244514916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc60070ee0 msgr2=0x7efc6006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.253+0000 7efc683ec700 1 --2- 172.21.15.79:0/3244514916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc60070ee0 0x7efc6006ec80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00e910 tx=0x7efc5c00ecd0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.253+0000 7efc66989700 1 -- 172.21.15.79:0/3244514916 reap_dead start 2023-10-19T08:38:23.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.253+0000 7efc683ec700 1 -- 172.21.15.79:0/3244514916 shutdown_connections 2023-10-19T08:38:23.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.253+0000 7efc683ec700 1 -- 172.21.15.79:0/3244514916 >> 172.21.15.79:0/3244514916 conn(0x7efc600cb3e0 msgr2=0x7efc600cb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.253+0000 7efc683ec700 1 -- 172.21.15.79:0/3244514916 shutdown_connections 2023-10-19T08:38:23.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.253+0000 7efc683ec700 1 -- 172.21.15.79:0/3244514916 wait complete. 2023-10-19T08:38:23.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.254+0000 7f006873d700 1 -- 172.21.15.79:0/288750549 --> [v2:172.21.15.89:6808/1735906914,v1:172.21.15.89:6809/1735906914] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0048002d40 con 0x7f0044073d90 2023-10-19T08:38:23.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.255+0000 7f0056ffd700 1 -- 172.21.15.79:0/288750549 <== osd.4 v2:172.21.15.89:6808/1735906914 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0048002d40 con 0x7f0044073d90 2023-10-19T08:38:23.358 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2023-10-19T08:38:23.359 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-19T08:38:23.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.258+0000 7f006873d700 1 -- 172.21.15.79:0/288750549 >> [v2:172.21.15.89:6808/1735906914,v1:172.21.15.89:6809/1735906914] conn(0x7f0044073d90 msgr2=0x7f00440761d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.258+0000 7f006873d700 1 --2- 172.21.15.79:0/288750549 >> [v2:172.21.15.89:6808/1735906914,v1:172.21.15.89:6809/1735906914] conn(0x7f0044073d90 0x7f00440761d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.258+0000 7f006873d700 1 -- 172.21.15.79:0/288750549 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f004406a130 msgr2=0x7f004406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.258+0000 7f006873d700 1 --2- 172.21.15.79:0/288750549 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f004406a130 0x7f004406c5f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f005c006b20 tx=0x7f005c008040 comp rx=0 tx=0).stop 2023-10-19T08:38:23.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.258+0000 7f006873d700 1 -- 172.21.15.79:0/288750549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00601619a0 msgr2=0x7f0060150b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.258+0000 7f006873d700 1 --2- 172.21.15.79:0/288750549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00601619a0 0x7f0060150b70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f005800b370 tx=0x7f0058004ad0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.258+0000 7f0066cda700 1 -- 172.21.15.79:0/288750549 reap_dead start 2023-10-19T08:38:23.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.261+0000 7f006873d700 1 -- 172.21.15.79:0/288750549 shutdown_connections 2023-10-19T08:38:23.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.261+0000 7f006873d700 1 -- 172.21.15.79:0/288750549 >> 172.21.15.79:0/288750549 conn(0x7f006006dcc0 msgr2=0x7f00601645b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.261+0000 7f006873d700 1 -- 172.21.15.79:0/288750549 shutdown_connections 2023-10-19T08:38:23.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.261+0000 7f006873d700 1 -- 172.21.15.79:0/288750549 wait complete. 2023-10-19T08:38:23.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.268+0000 7f4a6813e700 1 -- 172.21.15.79:0/762214027 >> [v2:172.21.15.89:6800/1904262341,v1:172.21.15.89:6801/1904262341] conn(0x7f4a480015e0 msgr2=0x7f4a48003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.268+0000 7f4a6813e700 1 --2- 172.21.15.79:0/762214027 >> [v2:172.21.15.89:6800/1904262341,v1:172.21.15.89:6801/1904262341] conn(0x7f4a480015e0 0x7f4a48003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.363 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2023-10-19T08:38:23.364 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-19T08:38:23.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.268+0000 7f4a6813e700 1 -- 172.21.15.79:0/762214027 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4a4406a130 msgr2=0x7f4a4406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.268+0000 7f4a6813e700 1 --2- 172.21.15.79:0/762214027 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4a4406a130 0x7f4a4406c5f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4a58007fd0 tx=0x7f4a58007dc0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.268+0000 7f4a6813e700 1 -- 172.21.15.79:0/762214027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a60161260 msgr2=0x7f4a601fa070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.268+0000 7f4a6813e700 1 --2- 172.21.15.79:0/762214027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a60161260 0x7f4a601fa070 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a50009f50 tx=0x7f4a50004750 comp rx=0 tx=0).stop 2023-10-19T08:38:23.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.269+0000 7f4a666db700 1 -- 172.21.15.79:0/762214027 reap_dead start 2023-10-19T08:38:23.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.269+0000 7f4a6813e700 1 -- 172.21.15.79:0/762214027 shutdown_connections 2023-10-19T08:38:23.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.269+0000 7f4a6813e700 1 -- 172.21.15.79:0/762214027 >> 172.21.15.79:0/762214027 conn(0x7f4a600ce960 msgr2=0x7f4a600cc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.269+0000 7f4a6813e700 1 -- 172.21.15.79:0/762214027 shutdown_connections 2023-10-19T08:38:23.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.269+0000 7f4a6813e700 1 -- 172.21.15.79:0/762214027 wait complete. 2023-10-19T08:38:23.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.272+0000 7f886b422700 1 -- 172.21.15.79:0/1453614851 --> [v2:172.21.15.79:6802/184279381,v1:172.21.15.79:6804/184279381] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8844002d40 con 0x7f8848073e10 2023-10-19T08:38:23.367 INFO:teuthology.orchestra.run.smithi079.stdout:55834574856 2023-10-19T08:38:23.368 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-19T08:38:23.369 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2023-10-19T08:38:23.369 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-19T08:38:23.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.272+0000 7f8859ffb700 1 -- 172.21.15.79:0/1453614851 <== osd.2 v2:172.21.15.79:6802/184279381 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8844002d40 con 0x7f8848073e10 2023-10-19T08:38:23.370 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2023-10-19T08:38:23.371 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-19T08:38:23.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.274+0000 7f886b422700 1 -- 172.21.15.79:0/1453614851 >> [v2:172.21.15.79:6802/184279381,v1:172.21.15.79:6804/184279381] conn(0x7f8848073e10 msgr2=0x7f8848076250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.274+0000 7f886b422700 1 --2- 172.21.15.79:0/1453614851 >> [v2:172.21.15.79:6802/184279381,v1:172.21.15.79:6804/184279381] conn(0x7f8848073e10 0x7f8848076250 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.274+0000 7f886b422700 1 -- 172.21.15.79:0/1453614851 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f884806a130 msgr2=0x7f884806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.274+0000 7f886b422700 1 --2- 172.21.15.79:0/1453614851 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f884806a130 0x7f884806c5f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f88642089b0 tx=0x7f8854009040 comp rx=0 tx=0).stop 2023-10-19T08:38:23.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.274+0000 7f886b422700 1 -- 172.21.15.79:0/1453614851 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88640710b0 msgr2=0x7f886420a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.274+0000 7f886b422700 1 --2- 172.21.15.79:0/1453614851 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88640710b0 0x7f886420a590 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f886000b2c0 tx=0x7f8860004750 comp rx=0 tx=0).stop 2023-10-19T08:38:23.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.274+0000 7f88699bf700 1 -- 172.21.15.79:0/1453614851 reap_dead start 2023-10-19T08:38:23.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.274+0000 7f886b422700 1 -- 172.21.15.79:0/1453614851 shutdown_connections 2023-10-19T08:38:23.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.274+0000 7f886b422700 1 -- 172.21.15.79:0/1453614851 >> 172.21.15.79:0/1453614851 conn(0x7f88640cb3e0 msgr2=0x7f88641694f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.274+0000 7f886b422700 1 -- 172.21.15.79:0/1453614851 shutdown_connections 2023-10-19T08:38:23.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.274+0000 7f886b422700 1 -- 172.21.15.79:0/1453614851 wait complete. 2023-10-19T08:38:23.375 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2023-10-19T08:38:23.375 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-19T08:38:23.376 INFO:teuthology.orchestra.run.smithi079.stdout:55834574857 2023-10-19T08:38:23.377 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-19T08:38:23.377 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2023-10-19T08:38:23.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-19T08:38:23.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.610+0000 7f3827990700 1 Processor -- start 2023-10-19T08:38:23.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.610+0000 7f2c6a263700 1 Processor -- start 2023-10-19T08:38:23.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.610+0000 7f2c6a263700 1 -- start start 2023-10-19T08:38:23.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.611+0000 7f2c6a263700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2c640cde00 0x7f2c6416e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.611+0000 7f2c6a263700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c640adc00 0x7f2c640709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.611+0000 7f2c6a263700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c640c9ec0 con 0x7f2c64070ee0 2023-10-19T08:38:23.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.611+0000 7f2c6a263700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c64071370 con 0x7f2c640cde00 2023-10-19T08:38:23.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.611+0000 7f2c6a263700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c640cad00 con 0x7f2c640adc00 2023-10-19T08:38:23.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.612+0000 7f2633ac8700 1 Processor -- start 2023-10-19T08:38:23.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.612+0000 7f2c637fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c640adc00 0x7f2c640709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.612+0000 7f2c68800700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2c64070ee0 0x7f2c640890e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:41296/0 (socket says 172.21.15.79:41296) 2023-10-19T08:38:23.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.613+0000 7f2c68800700 1 -- 172.21.15.79:0/878354235 learned_addr learned my addr 172.21.15.79:0/878354235 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:23.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.613+0000 7f2c62ffd700 1 -- 172.21.15.79:0/878354235 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248748049 0 0) 0x7f2c640c9ec0 con 0x7f2c64070ee0 2023-10-19T08:38:23.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.613+0000 7f2c62ffd700 1 -- 172.21.15.79:0/878354235 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c4c0035b0 con 0x7f2c64070ee0 2023-10-19T08:38:23.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.610+0000 7f3827990700 1 -- start start 2023-10-19T08:38:23.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.611+0000 7f3827990700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38200cd520 0x7f38200b1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.611+0000 7f3827990700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f382006cfb0 0x7f38200716b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.611+0000 7f3827990700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3820165750 con 0x7f38200cd900 2023-10-19T08:38:23.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.611+0000 7f3827990700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3820165a30 con 0x7f382006cfb0 2023-10-19T08:38:23.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.611+0000 7f3827990700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3820165d10 con 0x7f38200cd520 2023-10-19T08:38:23.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.612+0000 7f3824f2b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f38200cd900 0x7f3820164f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56448/0 (socket says 172.21.15.79:56448) 2023-10-19T08:38:23.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.612+0000 7f3824f2b700 1 -- 172.21.15.79:0/1329915551 learned_addr learned my addr 172.21.15.79:0/1329915551 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:23.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.612+0000 7f3825f2d700 1 --2- 172.21.15.79:0/1329915551 >> v2:172.21.15.79:3300/0 conn(0x7f382006cfb0 0x7f38200716b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.612+0000 7f3825f2d700 1 -- 172.21.15.79:0/1329915551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38200cd520 msgr2=0x7f38200b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.612+0000 7f3825f2d700 1 --2- 172.21.15.79:0/1329915551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38200cd520 0x7f38200b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.612+0000 7f3825f2d700 1 -- 172.21.15.79:0/1329915551 >> v1:172.21.15.79:6789/0 conn(0x7f38200cd900 legacy=0x7f3820164f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.612+0000 7f3825f2d700 1 -- 172.21.15.79:0/1329915551 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3820070eb0 con 0x7f382006cfb0 2023-10-19T08:38:23.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.612+0000 7f3825f2d700 1 --2- 172.21.15.79:0/1329915551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f382006cfb0 0x7f38200716b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f381c009840 tx=0x7f381c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4ff444031c196f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.613+0000 7f3817fff700 1 -- 172.21.15.79:0/1329915551 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c011830 con 0x7f382006cfb0 2023-10-19T08:38:23.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.613+0000 7f3817fff700 1 -- 172.21.15.79:0/1329915551 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c011990 con 0x7f382006cfb0 2023-10-19T08:38:23.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.613+0000 7f3817fff700 1 -- 172.21.15.79:0/1329915551 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c011d00 con 0x7f382006cfb0 2023-10-19T08:38:23.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.613+0000 7f2c637fe700 1 -- 172.21.15.79:0/878354235 >> v2:172.21.15.79:3300/0 conn(0x7f2c640cde00 msgr2=0x7f2c6416e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.613+0000 7f2c637fe700 1 --2- 172.21.15.79:0/878354235 >> v2:172.21.15.79:3300/0 conn(0x7f2c640cde00 0x7f2c6416e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.613+0000 7f2c637fe700 1 -- 172.21.15.79:0/878354235 >> v1:172.21.15.89:6789/0 conn(0x7f2c64070ee0 legacy=0x7f2c640890e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.613+0000 7f2c637fe700 1 -- 172.21.15.79:0/878354235 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6416e5d0 con 0x7f2c640adc00 2023-10-19T08:38:23.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.612+0000 7f2633ac8700 1 -- start start 2023-10-19T08:38:23.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.613+0000 7f2633ac8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0caca0 0x7f262c0709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.613+0000 7f2633ac8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f262c070ee0 0x7f262c15cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.613+0000 7f2633ac8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f262c15d2f0 0x7f262c0cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.613+0000 7f2633ac8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262c071360 con 0x7f262c15d2f0 2023-10-19T08:38:23.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.613+0000 7f2633ac8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262c0cd750 con 0x7f262c070ee0 2023-10-19T08:38:23.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.613+0000 7f2633ac8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262c0cda10 con 0x7f262c0caca0 2023-10-19T08:38:23.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.613+0000 7f2c637fe700 1 --2- 172.21.15.79:0/878354235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c640adc00 0x7f2c640709a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2c54005e40 tx=0x7f2c5400bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6d45686e1aa8eb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.614+0000 7f8b2f541700 1 Processor -- start 2023-10-19T08:38:23.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.614+0000 7f2631864700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0caca0 0x7f262c0709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.614+0000 7f2631864700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0caca0 0x7f262c0709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:49010/0 (socket says 172.21.15.79:49010) 2023-10-19T08:38:23.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.614+0000 7f2631864700 1 -- 172.21.15.79:0/3427328434 learned_addr learned my addr 172.21.15.79:0/3427328434 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.614+0000 7f3827990700 1 -- 172.21.15.79:0/1329915551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f382006cfb0 msgr2=0x7f38200716b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.614+0000 7f3827990700 1 --2- 172.21.15.79:0/1329915551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f382006cfb0 0x7f38200716b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f381c009840 tx=0x7f381c009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:23.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.614+0000 7f3827990700 1 -- 172.21.15.79:0/1329915551 shutdown_connections 2023-10-19T08:38:23.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.614+0000 7f3827990700 1 --2- 172.21.15.79:0/1329915551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f382006cfb0 0x7f38200716b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.614+0000 7f3827990700 1 --2- 172.21.15.79:0/1329915551 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38200cd520 0x7f38200b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.614+0000 7f3827990700 1 -- 172.21.15.79:0/1329915551 >> 172.21.15.79:0/1329915551 conn(0x7f38200cefd0 msgr2=0x7f38200cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.615+0000 7f3827990700 1 -- 172.21.15.79:0/1329915551 shutdown_connections 2023-10-19T08:38:23.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.614+0000 7f2c62ffd700 1 -- 172.21.15.79:0/878354235 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5400dc50 con 0x7f2c640adc00 2023-10-19T08:38:23.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.614+0000 7f2c62ffd700 1 -- 172.21.15.79:0/878354235 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5400ddb0 con 0x7f2c640adc00 2023-10-19T08:38:23.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.614+0000 7f2c62ffd700 1 -- 172.21.15.79:0/878354235 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c54004230 con 0x7f2c640adc00 2023-10-19T08:38:23.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.615+0000 7f2c6a263700 1 -- 172.21.15.79:0/878354235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c640adc00 msgr2=0x7f2c640709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.615+0000 7f2c6a263700 1 --2- 172.21.15.79:0/878354235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c640adc00 0x7f2c640709a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2c54005e40 tx=0x7f2c5400bec0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.614+0000 7f8b2f541700 1 -- start start 2023-10-19T08:38:23.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.615+0000 7f3827990700 1 -- 172.21.15.79:0/1329915551 wait complete. 2023-10-19T08:38:23.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.616+0000 7f3827990700 1 Processor -- start 2023-10-19T08:38:23.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.615+0000 7f8b2f541700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8b280caca0 0x7f8b280709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.615+0000 7f8b2f541700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b280cbf00 0x7f8b28070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.615+0000 7f8b2f541700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b280cd750 con 0x7f8b2815d640 2023-10-19T08:38:23.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.615+0000 7f8b2f541700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b280cda10 con 0x7f8b280caca0 2023-10-19T08:38:23.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.615+0000 7f8b2f541700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280cdcf0 con 0x7f8b280cbf00 2023-10-19T08:38:23.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.616+0000 7f8b2cadc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f8b2815d640 0x7f8b280cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56466/0 (socket says 172.21.15.79:56466) 2023-10-19T08:38:23.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.616+0000 7f8b2cadc700 1 -- 172.21.15.79:0/387825740 learned_addr learned my addr 172.21.15.79:0/387825740 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:23.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.616+0000 7f8b2d2dd700 1 --2- 172.21.15.79:0/387825740 >> v2:172.21.15.79:3300/0 conn(0x7f8b280caca0 0x7f8b280709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.616+0000 7f8b2d2dd700 1 -- 172.21.15.79:0/387825740 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b280cbf00 msgr2=0x7f8b28070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.616+0000 7f8b2dade700 1 --2- 172.21.15.79:0/387825740 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b280cbf00 0x7f8b28070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.616+0000 7f8b2d2dd700 1 --2- 172.21.15.79:0/387825740 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b280cbf00 0x7f8b28070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.616+0000 7f8b2d2dd700 1 -- 172.21.15.79:0/387825740 >> v1:172.21.15.79:6789/0 conn(0x7f8b2815d640 legacy=0x7f8b280cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.616+0000 7f8b2d2dd700 1 -- 172.21.15.79:0/387825740 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b280cdfd0 con 0x7f8b280caca0 2023-10-19T08:38:23.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.617+0000 7f492985c700 1 Processor -- start 2023-10-19T08:38:23.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.617+0000 7f8b2dade700 1 --2- 172.21.15.79:0/387825740 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b280cbf00 0x7f8b28070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:23.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.617+0000 7f8b2d2dd700 1 --2- 172.21.15.79:0/387825740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b280caca0 0x7f8b280709a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8b24013150 tx=0x7f8b24013460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e3563d2ada766f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.617+0000 7f2632065700 1 --2- 172.21.15.79:0/3427328434 >> v2:172.21.15.79:3300/0 conn(0x7f262c15d2f0 0x7f262c0cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.617+0000 7f8b1ffff700 1 -- 172.21.15.79:0/387825740 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24016070 con 0x7f8b280caca0 2023-10-19T08:38:23.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f8b1ffff700 1 -- 172.21.15.79:0/387825740 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b24013dc0 con 0x7f8b280caca0 2023-10-19T08:38:23.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f8b1ffff700 1 -- 172.21.15.79:0/387825740 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b240112f0 con 0x7f8b280caca0 2023-10-19T08:38:23.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f2631063700 1 --2- 172.21.15.79:0/3427328434 >> v2:172.21.15.89:3300/0 conn(0x7f262c070ee0 0x7f262c15cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.616+0000 7f3827990700 1 -- start start 2023-10-19T08:38:23.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.617+0000 7f3827990700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f382006cfb0 0x7f3820150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.617+0000 7f3827990700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38200cd520 0x7f3820151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.617+0000 7f3827990700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38200cd900 0x7f38200b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.617+0000 7f3827990700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38200c6de0 con 0x7f38200cd900 2023-10-19T08:38:23.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.617+0000 7f3827990700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38200c61d0 con 0x7f38200cd520 2023-10-19T08:38:23.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.617+0000 7f3827990700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38200c64b0 con 0x7f382006cfb0 2023-10-19T08:38:23.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f3824f2b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38200cd520 0x7f3820151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f3824f2b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38200cd520 0x7f3820151d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:60876/0 (socket says 172.21.15.79:60876) 2023-10-19T08:38:23.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f3824f2b700 1 -- 172.21.15.79:0/3543208063 learned_addr learned my addr 172.21.15.79:0/3543208063 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f2631864700 1 -- 172.21.15.79:0/3427328434 >> v2:172.21.15.89:3300/0 conn(0x7f262c070ee0 msgr2=0x7f262c15cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f2631864700 1 --2- 172.21.15.79:0/3427328434 >> v2:172.21.15.89:3300/0 conn(0x7f262c070ee0 0x7f262c15cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f2631864700 1 -- 172.21.15.79:0/3427328434 >> v2:172.21.15.79:3300/0 conn(0x7f262c15d2f0 msgr2=0x7f262c0cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f2631864700 1 --2- 172.21.15.79:0/3427328434 >> v2:172.21.15.79:3300/0 conn(0x7f262c15d2f0 0x7f262c0cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f2631864700 1 -- 172.21.15.79:0/3427328434 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f262c0cdcf0 con 0x7f262c0caca0 2023-10-19T08:38:23.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.617+0000 7f492985c700 1 -- start start 2023-10-19T08:38:23.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f492985c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49240cfcf0 0x7f49240d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f492985c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49240b2180 0x7f49240d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f492985c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49240d2eb0 0x7f49240d3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f492985c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49240d0610 con 0x7f49240d2eb0 2023-10-19T08:38:23.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f492985c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49240d1120 con 0x7f49240cfcf0 2023-10-19T08:38:23.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f492985c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49240d1400 con 0x7f49240b2180 2023-10-19T08:38:23.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f4922ffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49240cfcf0 0x7f49240d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f4922ffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49240cfcf0 0x7f49240d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:60882/0 (socket says 172.21.15.79:60882) 2023-10-19T08:38:23.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f4922ffd700 1 -- 172.21.15.79:0/1191087879 learned_addr learned my addr 172.21.15.79:0/1191087879 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f49227fc700 1 --2- 172.21.15.79:0/1191087879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49240b2180 0x7f49240d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f49237fe700 1 --2- 172.21.15.79:0/1191087879 >> v2:172.21.15.79:3300/0 conn(0x7f49240d2eb0 0x7f49240d3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f49237fe700 1 -- 172.21.15.79:0/1191087879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49240b2180 msgr2=0x7f49240d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f49237fe700 1 --2- 172.21.15.79:0/1191087879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49240b2180 0x7f49240d2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f49237fe700 1 -- 172.21.15.79:0/1191087879 >> v2:172.21.15.89:3300/0 conn(0x7f49240cfcf0 msgr2=0x7f49240d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f49237fe700 1 --2- 172.21.15.79:0/1191087879 >> v2:172.21.15.89:3300/0 conn(0x7f49240cfcf0 0x7f49240d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f49237fe700 1 -- 172.21.15.79:0/1191087879 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49240d16e0 con 0x7f49240d2eb0 2023-10-19T08:38:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f8b2f541700 1 -- 172.21.15.79:0/387825740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b280caca0 msgr2=0x7f8b280709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f8b2f541700 1 --2- 172.21.15.79:0/387825740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b280caca0 0x7f8b280709a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8b24013150 tx=0x7f8b24013460 comp rx=0 tx=0).stop 2023-10-19T08:38:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f8b2f541700 1 -- 172.21.15.79:0/387825740 shutdown_connections 2023-10-19T08:38:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f8b2f541700 1 --2- 172.21.15.79:0/387825740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b280caca0 0x7f8b280709a0 secure :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8b24013150 tx=0x7f8b24013460 comp rx=0 tx=0).stop 2023-10-19T08:38:23.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f8b2f541700 1 --2- 172.21.15.79:0/387825740 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b280cbf00 0x7f8b28070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f8b2f541700 1 -- 172.21.15.79:0/387825740 >> 172.21.15.79:0/387825740 conn(0x7f8b280cb3e0 msgr2=0x7f8b280cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f382572c700 1 --2- 172.21.15.79:0/3543208063 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f382006cfb0 0x7f3820150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f3825f2d700 1 --2- 172.21.15.79:0/3543208063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38200cd900 0x7f38200b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f3825f2d700 1 -- 172.21.15.79:0/3543208063 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f382006cfb0 msgr2=0x7f3820150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f3825f2d700 1 --2- 172.21.15.79:0/3543208063 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f382006cfb0 0x7f3820150db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f3825f2d700 1 -- 172.21.15.79:0/3543208063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38200cd520 msgr2=0x7f3820151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f3825f2d700 1 --2- 172.21.15.79:0/3543208063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38200cd520 0x7f3820151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f3825f2d700 1 -- 172.21.15.79:0/3543208063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c0094a0 con 0x7f38200cd900 2023-10-19T08:38:23.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f3824f2b700 1 --2- 172.21.15.79:0/3543208063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38200cd520 0x7f3820151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:38:23.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f2c6a263700 1 -- 172.21.15.79:0/878354235 shutdown_connections 2023-10-19T08:38:23.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f2c6a263700 1 --2- 172.21.15.79:0/878354235 >> v2:172.21.15.79:3300/0 conn(0x7f2c640cde00 0x7f2c6416e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f2c6a263700 1 --2- 172.21.15.79:0/878354235 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c640adc00 0x7f2c640709a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.618+0000 7f2c6a263700 1 -- 172.21.15.79:0/878354235 >> 172.21.15.79:0/878354235 conn(0x7f2c640cb3e0 msgr2=0x7f2c640cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f2c6a263700 1 -- 172.21.15.79:0/878354235 shutdown_connections 2023-10-19T08:38:23.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f2c6a263700 1 -- 172.21.15.79:0/878354235 wait complete. 2023-10-19T08:38:23.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f49237fe700 1 --2- 172.21.15.79:0/1191087879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49240d2eb0 0x7f49240d3320 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4924072930 tx=0x7f4914009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c56d596606c268 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f3825f2d700 1 --2- 172.21.15.79:0/3543208063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38200cd900 0x7f38200b43f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f381c016000 tx=0x7f381c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f52f6d4b700 1 Processor -- start 2023-10-19T08:38:23.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f4921ffb700 1 -- 172.21.15.79:0/1191087879 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914011830 con 0x7f49240d2eb0 2023-10-19T08:38:23.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f4921ffb700 1 -- 172.21.15.79:0/1191087879 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4914011990 con 0x7f49240d2eb0 2023-10-19T08:38:23.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f4921ffb700 1 -- 172.21.15.79:0/1191087879 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914011d20 con 0x7f49240d2eb0 2023-10-19T08:38:23.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.619+0000 7f52f6d4b700 1 -- start start 2023-10-19T08:38:23.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.620+0000 7f492985c700 1 -- 172.21.15.79:0/1191087879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49240d2eb0 msgr2=0x7f49240d3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.620+0000 7f492985c700 1 --2- 172.21.15.79:0/1191087879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49240d2eb0 0x7f49240d3320 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4924072930 tx=0x7f4914009b20 comp rx=0 tx=0).stop 2023-10-19T08:38:23.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.620+0000 7f492985c700 1 -- 172.21.15.79:0/1191087879 shutdown_connections 2023-10-19T08:38:23.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.620+0000 7f492985c700 1 --2- 172.21.15.79:0/1191087879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49240d2eb0 0x7f49240d3320 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.620+0000 7f492985c700 1 --2- 172.21.15.79:0/1191087879 >> v2:172.21.15.89:3300/0 conn(0x7f49240cfcf0 0x7f49240d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.620+0000 7f492985c700 1 --2- 172.21.15.79:0/1191087879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49240b2180 0x7f49240d2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.620+0000 7f492985c700 1 -- 172.21.15.79:0/1191087879 >> 172.21.15.79:0/1191087879 conn(0x7f4924071b30 msgr2=0x7f4924071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.620+0000 7f492985c700 1 -- 172.21.15.79:0/1191087879 shutdown_connections 2023-10-19T08:38:23.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.620+0000 7f492985c700 1 -- 172.21.15.79:0/1191087879 wait complete. 2023-10-19T08:38:23.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.621+0000 7f52f6d4b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f52f00cbf00 0x7f52f00caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.621+0000 7f52f6d4b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f00710b0 0x7f52f015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.621+0000 7f52f6d4b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f00cda10 con 0x7f52f00caf70 2023-10-19T08:38:23.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.621+0000 7f52f6d4b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f00cdcf0 con 0x7f52f00cbf00 2023-10-19T08:38:23.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.621+0000 7f52f6d4b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f00cdfd0 con 0x7f52f00710b0 2023-10-19T08:38:23.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.621+0000 7f2c6a263700 1 Processor -- start 2023-10-19T08:38:23.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.621+0000 7f2c6a263700 1 -- start start 2023-10-19T08:38:23.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.621+0000 7f52f4ae7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f52f00cbf00 0x7f52f00caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.621+0000 7f52f4ae7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f52f00cbf00 0x7f52f00caa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46410/0 (socket says 172.21.15.79:46410) 2023-10-19T08:38:23.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.621+0000 7f52f4ae7700 1 -- 172.21.15.79:0/2776643405 learned_addr learned my addr 172.21.15.79:0/2776643405 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.621+0000 7f3815ffb700 1 -- 172.21.15.79:0/3543208063 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c0036a0 con 0x7f38200cd900 2023-10-19T08:38:23.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.621+0000 7f3815ffb700 1 -- 172.21.15.79:0/3543208063 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c01f070 con 0x7f38200cd900 2023-10-19T08:38:23.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.621+0000 7f3827990700 1 -- 172.21.15.79:0/3543208063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38200c6790 con 0x7f38200cd900 2023-10-19T08:38:23.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.621+0000 7f3815ffb700 1 -- 172.21.15.79:0/3543208063 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381c003a80 con 0x7f38200cd900 2023-10-19T08:38:23.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.621+0000 7f3827990700 1 -- 172.21.15.79:0/3543208063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38200b4930 con 0x7f38200cd900 2023-10-19T08:38:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.622+0000 7f52f4ae7700 1 -- 172.21.15.79:0/2776643405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f00710b0 msgr2=0x7f52f015cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.622+0000 7f52f4ae7700 1 --2- 172.21.15.79:0/2776643405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f00710b0 0x7f52f015cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.622+0000 7f52f4ae7700 1 -- 172.21.15.79:0/2776643405 >> v1:172.21.15.89:6789/0 conn(0x7f52f00caf70 legacy=0x7f52f00709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.622+0000 7f52f4ae7700 1 -- 172.21.15.79:0/2776643405 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f00ce2b0 con 0x7f52f00cbf00 2023-10-19T08:38:23.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.622+0000 7f52f4ae7700 1 --2- 172.21.15.79:0/2776643405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52f00cbf00 0x7f52f00caa30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f52e00098f0 tx=0x7f52e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9d308d9549c696 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.620+0000 7f2631864700 1 --2- 172.21.15.79:0/3427328434 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0caca0 0x7f262c0709a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f262c0cc460 tx=0x7f2628008bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f924ae1549b32469 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.620+0000 7f2630862700 1 -- 172.21.15.79:0/3427328434 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262800b770 con 0x7f262c0caca0 2023-10-19T08:38:23.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.620+0000 7f2630862700 1 -- 172.21.15.79:0/3427328434 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262800b8d0 con 0x7f262c0caca0 2023-10-19T08:38:23.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.620+0000 7f2630862700 1 -- 172.21.15.79:0/3427328434 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26280126f0 con 0x7f262c0caca0 2023-10-19T08:38:23.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.621+0000 7f2633ac8700 1 -- 172.21.15.79:0/3427328434 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0caca0 msgr2=0x7f262c0709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.621+0000 7f2633ac8700 1 --2- 172.21.15.79:0/3427328434 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0caca0 0x7f262c0709a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f262c0cc460 tx=0x7f2628008bd0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.622+0000 7f2c6a263700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c64070ee0 0x7f2c640b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.622+0000 7f2c6a263700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c640adc00 0x7f2c640c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.622+0000 7f2c6a263700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c640cde00 0x7f2c640c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.622+0000 7f2c6a263700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c640c6e90 con 0x7f2c640cde00 2023-10-19T08:38:23.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.622+0000 7f2c6a263700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c640b39b0 con 0x7f2c640adc00 2023-10-19T08:38:23.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.622+0000 7f2c6a263700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c640b2da0 con 0x7f2c64070ee0 2023-10-19T08:38:23.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.622+0000 7f2c63fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c64070ee0 0x7f2c640b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.622+0000 7f2c637fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c640adc00 0x7f2c640c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.622+0000 7f2c63fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c64070ee0 0x7f2c640b2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:49040/0 (socket says 172.21.15.79:49040) 2023-10-19T08:38:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.622+0000 7f2c63fff700 1 -- 172.21.15.79:0/115160649 learned_addr learned my addr 172.21.15.79:0/115160649 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.622+0000 7f2c637fe700 1 --2- 172.21.15.79:0/115160649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c640adc00 0x7f2c640c6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:60896/0 (socket says 172.21.15.79:60896) 2023-10-19T08:38:23.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.623+0000 7f2c68800700 1 --2- 172.21.15.79:0/115160649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c640cde00 0x7f2c640c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.622+0000 7f492985c700 1 Processor -- start 2023-10-19T08:38:23.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.623+0000 7f2c637fe700 1 -- 172.21.15.79:0/115160649 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c64070ee0 msgr2=0x7f2c640b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.623+0000 7f2c637fe700 1 --2- 172.21.15.79:0/115160649 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c64070ee0 0x7f2c640b2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.623+0000 7f2c637fe700 1 -- 172.21.15.79:0/115160649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c640cde00 msgr2=0x7f2c640c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.623+0000 7f2c637fe700 1 --2- 172.21.15.79:0/115160649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c640cde00 0x7f2c640c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.623+0000 7f2c637fe700 1 -- 172.21.15.79:0/115160649 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5400b840 con 0x7f2c640adc00 2023-10-19T08:38:23.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.623+0000 7f2c63fff700 1 --2- 172.21.15.79:0/115160649 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c64070ee0 0x7f2c640b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:38:23.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.623+0000 7f2c637fe700 1 --2- 172.21.15.79:0/115160649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c640adc00 0x7f2c640c6950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2c54017000 tx=0x7f2c54004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.623+0000 7f492985c700 1 -- start start 2023-10-19T08:38:23.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.623+0000 7f3827990700 1 -- 172.21.15.79:0/3543208063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38200c6f50 con 0x7f38200cd900 2023-10-19T08:38:23.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.623+0000 7f8b2f541700 1 -- 172.21.15.79:0/387825740 shutdown_connections 2023-10-19T08:38:23.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.623+0000 7f2633ac8700 1 -- 172.21.15.79:0/3427328434 shutdown_connections 2023-10-19T08:38:23.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.623+0000 7f2633ac8700 1 --2- 172.21.15.79:0/3427328434 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0caca0 0x7f262c0709a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.623+0000 7f2633ac8700 1 --2- 172.21.15.79:0/3427328434 >> v2:172.21.15.79:3300/0 conn(0x7f262c15d2f0 0x7f262c0cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.623+0000 7f2633ac8700 1 --2- 172.21.15.79:0/3427328434 >> v2:172.21.15.89:3300/0 conn(0x7f262c070ee0 0x7f262c15cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.623+0000 7f2633ac8700 1 -- 172.21.15.79:0/3427328434 >> 172.21.15.79:0/3427328434 conn(0x7f262c0cb3e0 msgr2=0x7f262c0cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.623+0000 7fa715cd0700 1 Processor -- start 2023-10-19T08:38:23.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.623+0000 7fa715cd0700 1 -- start start 2023-10-19T08:38:23.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.624+0000 7f8b2f541700 1 -- 172.21.15.79:0/387825740 wait complete. 2023-10-19T08:38:23.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.624+0000 7f52e77fe700 1 -- 172.21.15.79:0/2776643405 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e0004230 con 0x7f52f00cbf00 2023-10-19T08:38:23.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.624+0000 7f52e77fe700 1 -- 172.21.15.79:0/2776643405 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e0004390 con 0x7f52f00cbf00 2023-10-19T08:38:23.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.624+0000 7f52e77fe700 1 -- 172.21.15.79:0/2776643405 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e00036a0 con 0x7f52f00cbf00 2023-10-19T08:38:23.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.624+0000 7f2633ac8700 1 -- 172.21.15.79:0/3427328434 shutdown_connections 2023-10-19T08:38:23.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.624+0000 7f492985c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49240b2180 0x7f4924071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.624+0000 7f492985c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49240cfcf0 0x7f492406f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.624+0000 7f492985c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49240d2eb0 0x7f492415ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.624+0000 7f492985c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4924145fd0 con 0x7f49240b2180 2023-10-19T08:38:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.624+0000 7f492985c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49241462b0 con 0x7f49240cfcf0 2023-10-19T08:38:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.624+0000 7f492985c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4924146590 con 0x7f49240d2eb0 2023-10-19T08:38:23.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.624+0000 7f4922ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49240b2180 0x7f4924071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.624+0000 7f4922ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49240b2180 0x7f4924071300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46422/0 (socket says 172.21.15.79:46422) 2023-10-19T08:38:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.624+0000 7f4922ffd700 1 -- 172.21.15.79:0/2808001920 learned_addr learned my addr 172.21.15.79:0/2808001920 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.625+0000 7f49237fe700 1 --2- 172.21.15.79:0/2808001920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49240d2eb0 0x7f492415ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.625+0000 7fa715cd0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa710165aa0 0x7fa7100cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.625+0000 7fa715cd0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa7100709a0 0x7fa710070e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.625+0000 7fa715cd0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7100ca330 con 0x7fa71015ba40 2023-10-19T08:38:23.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.625+0000 7fa715cd0700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa71015be20 con 0x7fa7100709a0 2023-10-19T08:38:23.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.625+0000 7fa715cd0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa710071370 con 0x7fa710165aa0 2023-10-19T08:38:23.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.625+0000 7f49237fe700 1 -- 172.21.15.79:0/2808001920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49240cfcf0 msgr2=0x7f492406f2d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-19T08:38:23.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.625+0000 7f49237fe700 1 --2- 172.21.15.79:0/2808001920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49240cfcf0 0x7f492406f2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.625+0000 7f49237fe700 1 -- 172.21.15.79:0/2808001920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49240b2180 msgr2=0x7f4924071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.625+0000 7f49237fe700 1 --2- 172.21.15.79:0/2808001920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49240b2180 0x7f4924071300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.625+0000 7f49237fe700 1 -- 172.21.15.79:0/2808001920 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49140094a0 con 0x7f49240d2eb0 2023-10-19T08:38:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.624+0000 7f3815ffb700 1 -- 172.21.15.79:0/3543208063 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f381c003be0 con 0x7f38200cd900 2023-10-19T08:38:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.624+0000 7f3815ffb700 1 --2- 172.21.15.79:0/3543208063 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f380406a1b0 0x7f380406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.625+0000 7f3815ffb700 1 -- 172.21.15.79:0/3543208063 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f381c021070 con 0x7f38200cd900 2023-10-19T08:38:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.625+0000 7f382572c700 1 --2- 172.21.15.79:0/3543208063 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f380406a1b0 0x7f380406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.625+0000 7f49237fe700 1 --2- 172.21.15.79:0/2808001920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49240d2eb0 0x7f492415ec20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4914016000 tx=0x7f4914004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.625+0000 7f8b2f541700 1 Processor -- start 2023-10-19T08:38:23.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.625+0000 7fa70f7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa71015ba40 0x7fa7101618a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56502/0 (socket says 172.21.15.79:56502) 2023-10-19T08:38:23.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.626+0000 7fa70f7fe700 1 -- 172.21.15.79:0/2870690367 learned_addr learned my addr 172.21.15.79:0/2870690367 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:23.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.626+0000 7f2c60ff9700 1 -- 172.21.15.79:0/115160649 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c54024070 con 0x7f2c640adc00 2023-10-19T08:38:23.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.626+0000 7f2c60ff9700 1 -- 172.21.15.79:0/115160649 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c54003c60 con 0x7f2c640adc00 2023-10-19T08:38:23.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.626+0000 7f2c60ff9700 1 -- 172.21.15.79:0/115160649 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5400dc50 con 0x7f2c640adc00 2023-10-19T08:38:23.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.626+0000 7f2c6a263700 1 -- 172.21.15.79:0/115160649 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c640b3080 con 0x7f2c640adc00 2023-10-19T08:38:23.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.626+0000 7f2c6a263700 1 -- 172.21.15.79:0/115160649 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c640b3640 con 0x7f2c640adc00 2023-10-19T08:38:23.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.624+0000 7f2633ac8700 1 -- 172.21.15.79:0/3427328434 wait complete. 2023-10-19T08:38:23.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.626+0000 7f2633ac8700 1 Processor -- start 2023-10-19T08:38:23.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.626+0000 7f2633ac8700 1 -- start start 2023-10-19T08:38:23.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.626+0000 7f382572c700 1 --2- 172.21.15.79:0/3543208063 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f380406a1b0 0x7f380406c670 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3818007dc0 tx=0x7f38180072f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.627+0000 7f52f6d4b700 1 -- 172.21.15.79:0/2776643405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52f00cbf00 msgr2=0x7f52f00caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.627+0000 7f52f6d4b700 1 --2- 172.21.15.79:0/2776643405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52f00cbf00 0x7f52f00caa30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f52e00098f0 tx=0x7f52e0009c00 comp rx=0 tx=0).stop 2023-10-19T08:38:23.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.627+0000 7f52f6d4b700 1 -- 172.21.15.79:0/2776643405 shutdown_connections 2023-10-19T08:38:23.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.627+0000 7f52f6d4b700 1 --2- 172.21.15.79:0/2776643405 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f00710b0 0x7f52f015cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.627+0000 7f52f6d4b700 1 --2- 172.21.15.79:0/2776643405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52f00cbf00 0x7f52f00caa30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.627+0000 7f52f6d4b700 1 -- 172.21.15.79:0/2776643405 >> 172.21.15.79:0/2776643405 conn(0x7f52f00cb3e0 msgr2=0x7f52f00cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.626+0000 7f490bfff700 1 -- 172.21.15.79:0/2808001920 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914004450 con 0x7f49240d2eb0 2023-10-19T08:38:23.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.626+0000 7f490bfff700 1 -- 172.21.15.79:0/2808001920 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491401e070 con 0x7f49240d2eb0 2023-10-19T08:38:23.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.626+0000 7f490bfff700 1 -- 172.21.15.79:0/2808001920 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49140038a0 con 0x7f49240d2eb0 2023-10-19T08:38:23.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f492985c700 1 -- 172.21.15.79:0/2808001920 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4924146870 con 0x7f49240d2eb0 2023-10-19T08:38:23.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f492985c700 1 -- 172.21.15.79:0/2808001920 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492406f810 con 0x7f49240d2eb0 2023-10-19T08:38:23.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.626+0000 7f8b2f541700 1 -- start start 2023-10-19T08:38:23.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.627+0000 7f8b2f541700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b280cbf00 0x7f8b28154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.627+0000 7f8b2f541700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b2815d640 0x7f8b280c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.627+0000 7f8b2f541700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b28150850 0x7f8b2806dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.627+0000 7f8b2f541700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b28151560 con 0x7f8b280cbf00 2023-10-19T08:38:23.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.627+0000 7f8b2f541700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b28151b20 con 0x7f8b2815d640 2023-10-19T08:38:23.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.627+0000 7f8b2f541700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280c8860 con 0x7f8b28150850 2023-10-19T08:38:23.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.627+0000 7f2633ac8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f262c070ee0 0x7f262c1f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.627+0000 7f2633ac8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0caca0 0x7f262c159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.627+0000 7f2633ac8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f262c15d2f0 0x7f262c159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.627+0000 7f2633ac8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c1f5880 con 0x7f262c070ee0 2023-10-19T08:38:23.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.627+0000 7f2633ac8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c0c7740 con 0x7f262c15d2f0 2023-10-19T08:38:23.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.627+0000 7f2633ac8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262c0c7a20 con 0x7f262c0caca0 2023-10-19T08:38:23.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f52f6d4b700 1 -- 172.21.15.79:0/2776643405 shutdown_connections 2023-10-19T08:38:23.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7fa70effd700 1 --2- 172.21.15.79:0/2870690367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa710165aa0 0x7fa7100cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f8b2cadc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b2815d640 0x7f8b280c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f8b2d2dd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b280cbf00 0x7f8b28154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f8b2d2dd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b280cbf00 0x7f8b28154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46440/0 (socket says 172.21.15.79:46440) 2023-10-19T08:38:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f8b2d2dd700 1 -- 172.21.15.79:0/2215334981 learned_addr learned my addr 172.21.15.79:0/2215334981 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7fa70ffff700 1 --2- 172.21.15.79:0/2870690367 >> v2:172.21.15.79:3300/0 conn(0x7fa7100709a0 0x7fa710070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f2c6a263700 1 -- 172.21.15.79:0/115160649 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c400052f0 con 0x7f2c640adc00 2023-10-19T08:38:23.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7fa70effd700 1 -- 172.21.15.79:0/2870690367 >> v2:172.21.15.79:3300/0 conn(0x7fa7100709a0 msgr2=0x7fa710070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7fa70effd700 1 --2- 172.21.15.79:0/2870690367 >> v2:172.21.15.79:3300/0 conn(0x7fa7100709a0 0x7fa710070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7fa70effd700 1 -- 172.21.15.79:0/2870690367 >> v1:172.21.15.79:6789/0 conn(0x7fa71015ba40 legacy=0x7fa7101618a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7fa70effd700 1 -- 172.21.15.79:0/2870690367 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa710162140 con 0x7fa710165aa0 2023-10-19T08:38:23.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f2c60ff9700 1 -- 172.21.15.79:0/115160649 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2c5401c070 con 0x7f2c640adc00 2023-10-19T08:38:23.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f8b2cadc700 1 -- 172.21.15.79:0/2215334981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b28150850 msgr2=0x7f8b2806dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f8b2cadc700 1 --2- 172.21.15.79:0/2215334981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b28150850 0x7f8b2806dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f8b2cadc700 1 -- 172.21.15.79:0/2215334981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b280cbf00 msgr2=0x7f8b28154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f8b2cadc700 1 --2- 172.21.15.79:0/2215334981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b280cbf00 0x7f8b28154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f8b2cadc700 1 -- 172.21.15.79:0/2215334981 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b24011d40 con 0x7f8b2815d640 2023-10-19T08:38:23.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.629+0000 7f8b2cadc700 1 --2- 172.21.15.79:0/2215334981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b2815d640 0x7f8b280c6790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800c390 tx=0x7f8b1800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f2631864700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f262c070ee0 0x7f262c1f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f2631864700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f262c070ee0 0x7f262c1f5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46434/0 (socket says 172.21.15.79:46434) 2023-10-19T08:38:23.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f2631864700 1 -- 172.21.15.79:0/2902391624 learned_addr learned my addr 172.21.15.79:0/2902391624 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f2632065700 1 --2- 172.21.15.79:0/2902391624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f262c15d2f0 0x7f262c159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f2632065700 1 -- 172.21.15.79:0/2902391624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0caca0 msgr2=0x7f262c159560 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-19T08:38:23.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f2632065700 1 --2- 172.21.15.79:0/2902391624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0caca0 0x7f262c159560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f2632065700 1 -- 172.21.15.79:0/2902391624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f262c070ee0 msgr2=0x7f262c1f5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f2632065700 1 --2- 172.21.15.79:0/2902391624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f262c070ee0 0x7f262c1f5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f2632065700 1 -- 172.21.15.79:0/2902391624 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26280085d0 con 0x7f262c15d2f0 2023-10-19T08:38:23.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f2631864700 1 --2- 172.21.15.79:0/2902391624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f262c070ee0 0x7f262c1f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:38:23.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.629+0000 7f2632065700 1 --2- 172.21.15.79:0/2902391624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f262c15d2f0 0x7f262c159aa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f262400ebd0 tx=0x7f262400eee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.628+0000 7f52f6d4b700 1 -- 172.21.15.79:0/2776643405 wait complete. 2023-10-19T08:38:23.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.629+0000 7f2c60ff9700 1 --2- 172.21.15.79:0/115160649 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f2c4806a170 0x7f2c4806c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.629+0000 7f2c60ff9700 1 -- 172.21.15.79:0/115160649 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2c54005e40 con 0x7f2c640adc00 2023-10-19T08:38:23.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.629+0000 7f2c63fff700 1 --2- 172.21.15.79:0/115160649 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f2c4806a170 0x7f2c4806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.629+0000 7fa70effd700 1 --2- 172.21.15.79:0/2870690367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa710165aa0 0x7fa7100cc530 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa704009840 tx=0x7fa704009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7050045069582c38 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.629+0000 7f5dba4f3700 1 Processor -- start 2023-10-19T08:38:23.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.630+0000 7f492985c700 1 -- 172.21.15.79:0/2808001920 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4924146d90 con 0x7f49240d2eb0 2023-10-19T08:38:23.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.630+0000 7f490bfff700 1 -- 172.21.15.79:0/2808001920 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4914003a00 con 0x7f49240d2eb0 2023-10-19T08:38:23.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.629+0000 7f2c63fff700 1 --2- 172.21.15.79:0/115160649 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f2c4806a170 0x7f2c4806c630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2c6416b010 tx=0x7f2c580091c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.629+0000 7f5dba4f3700 1 -- start start 2023-10-19T08:38:23.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.630+0000 7fa70e7fc700 1 -- 172.21.15.79:0/2870690367 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa704011830 con 0x7fa710165aa0 2023-10-19T08:38:23.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.630+0000 7fa70e7fc700 1 -- 172.21.15.79:0/2870690367 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa704011990 con 0x7fa710165aa0 2023-10-19T08:38:23.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.630+0000 7fa70e7fc700 1 -- 172.21.15.79:0/2870690367 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa704011d20 con 0x7fa710165aa0 2023-10-19T08:38:23.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.630+0000 7f52f6d4b700 1 Processor -- start 2023-10-19T08:38:23.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.630+0000 7f490bfff700 1 --2- 172.21.15.79:0/2808001920 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f491006a130 0x7f491006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f490bfff700 1 -- 172.21.15.79:0/2808001920 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4914089460 con 0x7f49240d2eb0 2023-10-19T08:38:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f5dba4f3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5db40cbf00 0x7f5db40cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f5dba4f3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5db40709a0 0x7f5db4070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f5dba4f3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5db415cdb0 0x7f5db415d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f5dba4f3700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db4071360 con 0x7f5db415cdb0 2023-10-19T08:38:23.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f5dba4f3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db40cd750 con 0x7f5db40709a0 2023-10-19T08:38:23.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f5dba4f3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db40cb150 con 0x7f5db40cbf00 2023-10-19T08:38:23.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f4922ffd700 1 --2- 172.21.15.79:0/2808001920 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f491006a130 0x7f491006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f5dabfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5db40709a0 0x7f5db4070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f5dabfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5db40709a0 0x7f5db4070e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:60930/0 (socket says 172.21.15.79:60930) 2023-10-19T08:38:23.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f5dabfff700 1 -- 172.21.15.79:0/1945398564 learned_addr learned my addr 172.21.15.79:0/1945398564 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f5db3fff700 1 --2- 172.21.15.79:0/1945398564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5db40cbf00 0x7f5db40cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f5db8a90700 1 --2- 172.21.15.79:0/1945398564 >> v2:172.21.15.79:3300/0 conn(0x7f5db415cdb0 0x7f5db415d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7fa715cd0700 1 -- 172.21.15.79:0/2870690367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa710165aa0 msgr2=0x7fa7100cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7fa715cd0700 1 --2- 172.21.15.79:0/2870690367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa710165aa0 0x7fa7100cc530 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa704009840 tx=0x7fa704009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:23.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7fa715cd0700 1 -- 172.21.15.79:0/2870690367 shutdown_connections 2023-10-19T08:38:23.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7fa715cd0700 1 --2- 172.21.15.79:0/2870690367 >> v2:172.21.15.79:3300/0 conn(0x7fa7100709a0 0x7fa710070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7fa715cd0700 1 --2- 172.21.15.79:0/2870690367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa710165aa0 0x7fa7100cc530 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7fa715cd0700 1 -- 172.21.15.79:0/2870690367 >> 172.21.15.79:0/2870690367 conn(0x7fa7100cb3e0 msgr2=0x7fa7100cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f4922ffd700 1 --2- 172.21.15.79:0/2808001920 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f491006a130 0x7f491006c5f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f491c0114a0 tx=0x7f491c00b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.630+0000 7f52f6d4b700 1 -- start start 2023-10-19T08:38:23.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f5dabfff700 1 -- 172.21.15.79:0/1945398564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5db40cbf00 msgr2=0x7f5db40cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f5dabfff700 1 --2- 172.21.15.79:0/1945398564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5db40cbf00 0x7f5db40cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f5dabfff700 1 -- 172.21.15.79:0/1945398564 >> v2:172.21.15.79:3300/0 conn(0x7f5db415cdb0 msgr2=0x7f5db415d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:23.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f5dabfff700 1 --2- 172.21.15.79:0/1945398564 >> v2:172.21.15.79:3300/0 conn(0x7f5db415cdb0 0x7f5db415d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f5dabfff700 1 -- 172.21.15.79:0/1945398564 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db40cda10 con 0x7f5db40709a0 2023-10-19T08:38:23.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7f5db3fff700 1 --2- 172.21.15.79:0/1945398564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5db40cbf00 0x7f5db40cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:38:23.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7fa715cd0700 1 -- 172.21.15.79:0/2870690367 shutdown_connections 2023-10-19T08:38:23.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.631+0000 7fa715cd0700 1 -- 172.21.15.79:0/2870690367 wait complete. 2023-10-19T08:38:23.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f5dabfff700 1 --2- 172.21.15.79:0/1945398564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5db40709a0 0x7f5db4070e20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5db40cc460 tx=0x7f5da4009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a12f08e7a93338f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f52f6d4b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52f00710b0 0x7f52f00b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f52f6d4b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52f00caf70 0x7f52f00c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f52f6d4b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f00cbf00 0x7f52f00c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f52f6d4b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f01430c0 con 0x7f52f00caf70 2023-10-19T08:38:23.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f52f6d4b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f00c8b30 con 0x7f52f00710b0 2023-10-19T08:38:23.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f52f6d4b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f006e650 con 0x7f52f00cbf00 2023-10-19T08:38:23.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f3815ffb700 1 -- 172.21.15.79:0/3543208063 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f381c055480 con 0x7f38200cd900 2023-10-19T08:38:23.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f52e7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52f00caf70 0x7f52f00c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f52f4ae7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52f00710b0 0x7f52f00b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f52f4ae7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52f00710b0 0x7f52f00b16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:60936/0 (socket says 172.21.15.79:60936) 2023-10-19T08:38:23.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f52e7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52f00caf70 0x7f52f00c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46462/0 (socket says 172.21.15.79:46462) 2023-10-19T08:38:23.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f52f4ae7700 1 -- 172.21.15.79:0/2361557516 learned_addr learned my addr 172.21.15.79:0/2361557516 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f52f52e8700 1 --2- 172.21.15.79:0/2361557516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f00cbf00 0x7f52f00c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f52e7fff700 1 -- 172.21.15.79:0/2361557516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f00cbf00 msgr2=0x7f52f00c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f52e7fff700 1 --2- 172.21.15.79:0/2361557516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f00cbf00 0x7f52f00c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f52e7fff700 1 -- 172.21.15.79:0/2361557516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52f00710b0 msgr2=0x7f52f00b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f52e7fff700 1 --2- 172.21.15.79:0/2361557516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52f00710b0 0x7f52f00b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f52e7fff700 1 -- 172.21.15.79:0/2361557516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e0009550 con 0x7f52f00caf70 2023-10-19T08:38:23.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f52e7fff700 1 --2- 172.21.15.79:0/2361557516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52f00caf70 0x7f52f00c80b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00c3e0 tx=0x7f52ec00c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.632+0000 7f52e57fa700 1 -- 172.21.15.79:0/2361557516 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0052d0 con 0x7f52f00caf70 2023-10-19T08:38:23.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.633+0000 7f52f6d4b700 1 -- 172.21.15.79:0/2361557516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f006e930 con 0x7f52f00caf70 2023-10-19T08:38:23.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.633+0000 7fa715cd0700 1 Processor -- start 2023-10-19T08:38:23.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.633+0000 7fa715cd0700 1 -- start start 2023-10-19T08:38:23.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.633+0000 7f52f6d4b700 1 -- 172.21.15.79:0/2361557516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f01443d0 con 0x7f52f00caf70 2023-10-19T08:38:23.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.633+0000 7f52e57fa700 1 -- 172.21.15.79:0/2361557516 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec005430 con 0x7f52f00caf70 2023-10-19T08:38:23.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.633+0000 7f52e57fa700 1 -- 172.21.15.79:0/2361557516 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec001120 con 0x7f52f00caf70 2023-10-19T08:38:23.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.634+0000 7f52f6d4b700 1 -- 172.21.15.79:0/2361557516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d00052f0 con 0x7f52f00caf70 2023-10-19T08:38:23.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.634+0000 7f8b1dffb700 1 -- 172.21.15.79:0/2215334981 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18005d70 con 0x7f8b2815d640 2023-10-19T08:38:23.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.634+0000 7f26227fc700 1 -- 172.21.15.79:0/2902391624 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262400ca60 con 0x7f262c15d2f0 2023-10-19T08:38:23.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.634+0000 7f8b1dffb700 1 -- 172.21.15.79:0/2215334981 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1800ce50 con 0x7f8b2815d640 2023-10-19T08:38:23.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.634+0000 7f8b1dffb700 1 -- 172.21.15.79:0/2215334981 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b180072d0 con 0x7f8b2815d640 2023-10-19T08:38:23.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.634+0000 7f2c60ff9700 1 -- 172.21.15.79:0/115160649 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2c54055150 con 0x7f2c640adc00 2023-10-19T08:38:23.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.634+0000 7f5db37fe700 1 -- 172.21.15.79:0/1945398564 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da4011830 con 0x7f5db40709a0 2023-10-19T08:38:23.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.634+0000 7f5db37fe700 1 -- 172.21.15.79:0/1945398564 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da4011990 con 0x7f5db40709a0 2023-10-19T08:38:23.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.634+0000 7f5db37fe700 1 -- 172.21.15.79:0/1945398564 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da4011d20 con 0x7f5db40709a0 2023-10-19T08:38:23.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.634+0000 7f8b2f541700 1 -- 172.21.15.79:0/2215334981 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b280c8b40 con 0x7f8b2815d640 2023-10-19T08:38:23.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.634+0000 7f8b2f541700 1 -- 172.21.15.79:0/2215334981 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b280c83f0 con 0x7f8b2815d640 2023-10-19T08:38:23.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.635+0000 7f8b2f541700 1 -- 172.21.15.79:0/2215334981 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b28151c90 con 0x7f8b2815d640 2023-10-19T08:38:23.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.635+0000 7f52e57fa700 1 -- 172.21.15.79:0/2361557516 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f52ec003880 con 0x7f52f00caf70 2023-10-19T08:38:23.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.635+0000 7f52e57fa700 1 --2- 172.21.15.79:0/2361557516 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f52dc06a0e0 0x7f52dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.635+0000 7f52e57fa700 1 -- 172.21.15.79:0/2361557516 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f52ec087bf0 con 0x7f52f00caf70 2023-10-19T08:38:23.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.634+0000 7f26227fc700 1 -- 172.21.15.79:0/2902391624 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262400f040 con 0x7f262c15d2f0 2023-10-19T08:38:23.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.634+0000 7f26227fc700 1 -- 172.21.15.79:0/2902391624 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262400cde0 con 0x7f262c15d2f0 2023-10-19T08:38:23.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.635+0000 7fa715cd0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7100709a0 0x7fa7101f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.635+0000 7fa715cd0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa71015ba40 0x7fa7101f6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.635+0000 7fa715cd0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa710165aa0 0x7fa7100b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.635+0000 7fa715cd0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7101f7ba0 con 0x7fa710165aa0 2023-10-19T08:38:23.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.635+0000 7fa715cd0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7100cc0e0 con 0x7fa7100709a0 2023-10-19T08:38:23.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.635+0000 7fa715cd0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7100cc940 con 0x7fa71015ba40 2023-10-19T08:38:23.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.635+0000 7fa70effd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa71015ba40 0x7fa7101f6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.635+0000 7fa70f7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7100709a0 0x7fa7101f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.635+0000 7fa70effd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa71015ba40 0x7fa7101f6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:49092/0 (socket says 172.21.15.79:49092) 2023-10-19T08:38:23.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.635+0000 7fa70effd700 1 -- 172.21.15.79:0/2984950580 learned_addr learned my addr 172.21.15.79:0/2984950580 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.635+0000 7fa70f7fe700 1 -- 172.21.15.79:0/2984950580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa71015ba40 msgr2=0x7fa7101f6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.635+0000 7fa70f7fe700 1 --2- 172.21.15.79:0/2984950580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa71015ba40 0x7fa7101f6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.635+0000 7fa70f7fe700 1 -- 172.21.15.79:0/2984950580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa710165aa0 msgr2=0x7fa7100b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.635+0000 7fa70f7fe700 1 --2- 172.21.15.79:0/2984950580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa710165aa0 0x7fa7100b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.635+0000 7fa70f7fe700 1 -- 172.21.15.79:0/2984950580 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7040094a0 con 0x7fa7100709a0 2023-10-19T08:38:23.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.636+0000 7fa70f7fe700 1 --2- 172.21.15.79:0/2984950580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7100709a0 0x7fa7101f7d40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa70001d510 tx=0x7fa70001d820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.636+0000 7fa6f7fff700 1 -- 172.21.15.79:0/2984950580 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa700005b70 con 0x7fa7100709a0 2023-10-19T08:38:23.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.636+0000 7fa6f7fff700 1 -- 172.21.15.79:0/2984950580 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa700005cd0 con 0x7fa7100709a0 2023-10-19T08:38:23.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.636+0000 7fa6f7fff700 1 -- 172.21.15.79:0/2984950580 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7000072d0 con 0x7fa7100709a0 2023-10-19T08:38:23.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.636+0000 7f490bfff700 1 -- 172.21.15.79:0/2808001920 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4924146d90 con 0x7f49240d2eb0 2023-10-19T08:38:23.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.636+0000 7fa715cd0700 1 -- 172.21.15.79:0/2984950580 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7100b4750 con 0x7fa7100709a0 2023-10-19T08:38:23.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.636+0000 7fa715cd0700 1 -- 172.21.15.79:0/2984950580 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7100cc5d0 con 0x7fa7100709a0 2023-10-19T08:38:23.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.637+0000 7fa715cd0700 1 -- 172.21.15.79:0/2984950580 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71004ee70 con 0x7fa7100709a0 2023-10-19T08:38:23.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.638+0000 7f8b1dffb700 1 -- 172.21.15.79:0/2215334981 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8b18007430 con 0x7f8b2815d640 2023-10-19T08:38:23.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.638+0000 7f8b1dffb700 1 --2- 172.21.15.79:0/2215334981 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f8b0c06a0e0 0x7f8b0c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.638+0000 7f8b1dffb700 1 -- 172.21.15.79:0/2215334981 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8b18087d90 con 0x7f8b2815d640 2023-10-19T08:38:23.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.638+0000 7f8b2d2dd700 1 --2- 172.21.15.79:0/2215334981 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f8b0c06a0e0 0x7f8b0c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.639+0000 7f8b2d2dd700 1 --2- 172.21.15.79:0/2215334981 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f8b0c06a0e0 0x7f8b0c06c5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8b240134a0 tx=0x7f8b24011000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.636+0000 7f5dba4f3700 1 -- 172.21.15.79:0/1945398564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5db40709a0 msgr2=0x7f5db4070e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.636+0000 7f5dba4f3700 1 --2- 172.21.15.79:0/1945398564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5db40709a0 0x7f5db4070e20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5db40cc460 tx=0x7f5da4009bd0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.641+0000 7f2633ac8700 1 -- 172.21.15.79:0/2902391624 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262c0c7d00 con 0x7f262c15d2f0 2023-10-19T08:38:23.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.641+0000 7f2633ac8700 1 -- 172.21.15.79:0/2902391624 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262c0c82c0 con 0x7f262c15d2f0 2023-10-19T08:38:23.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.642+0000 7f5dba4f3700 1 -- 172.21.15.79:0/1945398564 shutdown_connections 2023-10-19T08:38:23.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.642+0000 7f5dba4f3700 1 --2- 172.21.15.79:0/1945398564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5db40cbf00 0x7f5db40cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.642+0000 7f5dba4f3700 1 --2- 172.21.15.79:0/1945398564 >> v2:172.21.15.79:3300/0 conn(0x7f5db415cdb0 0x7f5db415d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.642+0000 7f5dba4f3700 1 --2- 172.21.15.79:0/1945398564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5db40709a0 0x7f5db4070e20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.642+0000 7f5dba4f3700 1 -- 172.21.15.79:0/1945398564 >> 172.21.15.79:0/1945398564 conn(0x7f5db40cb3e0 msgr2=0x7f5db40cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:23.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.642+0000 7fa6f7fff700 1 -- 172.21.15.79:0/2984950580 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa700007430 con 0x7fa7100709a0 2023-10-19T08:38:23.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.642+0000 7f2633ac8700 1 -- 172.21.15.79:0/2902391624 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262c06b370 con 0x7f262c15d2f0 2023-10-19T08:38:23.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.643+0000 7f26227fc700 1 -- 172.21.15.79:0/2902391624 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2624014480 con 0x7f262c15d2f0 2023-10-19T08:38:23.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.643+0000 7fa6f7fff700 1 --2- 172.21.15.79:0/2984950580 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa6fc06a0e0 0x7fa6fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.643+0000 7fa6f7fff700 1 -- 172.21.15.79:0/2984950580 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa700098cc0 con 0x7fa7100709a0 2023-10-19T08:38:23.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.643+0000 7f26227fc700 1 --2- 172.21.15.79:0/2902391624 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f261006a0e0 0x7f261006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.643+0000 7f2631864700 1 --2- 172.21.15.79:0/2902391624 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f261006a0e0 0x7f261006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.644+0000 7f2631864700 1 --2- 172.21.15.79:0/2902391624 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f261006a0e0 0x7f261006c5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2628000c00 tx=0x7f2628008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.644+0000 7fa70effd700 1 --2- 172.21.15.79:0/2984950580 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa6fc06a0e0 0x7fa6fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.644+0000 7fa70effd700 1 --2- 172.21.15.79:0/2984950580 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa6fc06a0e0 0x7fa6fc06c5a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa7100cdd10 tx=0x7fa704008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.636+0000 7f52f4ae7700 1 --2- 172.21.15.79:0/2361557516 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f52dc06a0e0 0x7f52dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.640+0000 7f52f4ae7700 1 --2- 172.21.15.79:0/2361557516 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f52dc06a0e0 0x7f52dc06c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f52e0009c40 tx=0x7f52e0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.645+0000 7f5dba4f3700 1 -- 172.21.15.79:0/1945398564 shutdown_connections 2023-10-19T08:38:23.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.645+0000 7f5dba4f3700 1 -- 172.21.15.79:0/1945398564 wait complete. 2023-10-19T08:38:23.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.645+0000 7f8b1dffb700 1 -- 172.21.15.79:0/2215334981 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f8b180533b0 con 0x7f8b2815d640 2023-10-19T08:38:23.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.645+0000 7f52e57fa700 1 -- 172.21.15.79:0/2361557516 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f52ec052ed0 con 0x7f52f00caf70 2023-10-19T08:38:23.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.646+0000 7f26227fc700 1 -- 172.21.15.79:0/2902391624 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2624058970 con 0x7f262c15d2f0 2023-10-19T08:38:23.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.646+0000 7f5dba4f3700 1 Processor -- start 2023-10-19T08:38:23.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.646+0000 7f5dba4f3700 1 -- start start 2023-10-19T08:38:23.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.648+0000 7f5dba4f3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5db40709a0 0x7f5db40c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.648+0000 7f5dba4f3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5db40cbf00 0x7f5db40af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.648+0000 7f5dba4f3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5db415cdb0 0x7f5db4165ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.648+0000 7f5dba4f3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db4169b40 con 0x7f5db40cbf00 2023-10-19T08:38:23.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.648+0000 7f5dba4f3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db40c76a0 con 0x7f5db40709a0 2023-10-19T08:38:23.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.648+0000 7f5dba4f3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db415c430 con 0x7f5db415cdb0 2023-10-19T08:38:23.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.648+0000 7f5dabfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5db40cbf00 0x7f5db40af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.648+0000 7f5dabfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5db40cbf00 0x7f5db40af6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46478/0 (socket says 172.21.15.79:46478) 2023-10-19T08:38:23.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.648+0000 7f5dabfff700 1 -- 172.21.15.79:0/987279229 learned_addr learned my addr 172.21.15.79:0/987279229 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:23.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.648+0000 7f5db8a90700 1 --2- 172.21.15.79:0/987279229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5db415cdb0 0x7f5db4165ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.648+0000 7f5dabfff700 1 -- 172.21.15.79:0/987279229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5db415cdb0 msgr2=0x7f5db4165ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:23.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.648+0000 7f5dabfff700 1 --2- 172.21.15.79:0/987279229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5db415cdb0 0x7f5db4165ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.648+0000 7f5dabfff700 1 -- 172.21.15.79:0/987279229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5db40709a0 msgr2=0x7f5db40c83b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-19T08:38:23.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.648+0000 7f5dabfff700 1 --2- 172.21.15.79:0/987279229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5db40709a0 0x7f5db40c83b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:23.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.648+0000 7f5dabfff700 1 -- 172.21.15.79:0/987279229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c0094a0 con 0x7f5db40cbf00 2023-10-19T08:38:23.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.648+0000 7f5db8a90700 1 --2- 172.21.15.79:0/987279229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5db415cdb0 0x7f5db4165ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:38:23.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.649+0000 7f5dabfff700 1 --2- 172.21.15.79:0/987279229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5db40cbf00 0x7f5db40af6d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5da4000c00 tx=0x7f5da4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.650+0000 7f5db17fa700 1 -- 172.21.15.79:0/987279229 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da4004450 con 0x7f5db40cbf00 2023-10-19T08:38:23.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.650+0000 7f5db17fa700 1 -- 172.21.15.79:0/987279229 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da40045b0 con 0x7f5db40cbf00 2023-10-19T08:38:23.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.650+0000 7f5db17fa700 1 -- 172.21.15.79:0/987279229 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da40038c0 con 0x7f5db40cbf00 2023-10-19T08:38:23.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.650+0000 7f5dba4f3700 1 -- 172.21.15.79:0/987279229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da4009550 con 0x7f5db40cbf00 2023-10-19T08:38:23.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.650+0000 7f5dba4f3700 1 -- 172.21.15.79:0/987279229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db40c78d0 con 0x7f5db40cbf00 2023-10-19T08:38:23.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.651+0000 7f26227fc700 1 -- 172.21.15.79:0/2902391624 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f262c06b370 con 0x7f262c15d2f0 2023-10-19T08:38:23.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.652+0000 7f5db17fa700 1 -- 172.21.15.79:0/987279229 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5da4003a20 con 0x7f5db40cbf00 2023-10-19T08:38:23.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.653+0000 7f5db17fa700 1 --2- 172.21.15.79:0/987279229 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5d9406a130 0x7f5d9406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:23.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.653+0000 7f5db17fa700 1 -- 172.21.15.79:0/987279229 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5da4089ac0 con 0x7f5db40cbf00 2023-10-19T08:38:23.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.655+0000 7fa6f7fff700 1 -- 172.21.15.79:0/2984950580 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa700064260 con 0x7fa7100709a0 2023-10-19T08:38:23.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.665+0000 7f5dba4f3700 1 -- 172.21.15.79:0/987279229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d980052f0 con 0x7f5db40cbf00 2023-10-19T08:38:23.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.669+0000 7f5db3fff700 1 --2- 172.21.15.79:0/987279229 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5d9406a130 0x7f5d9406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:23.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.669+0000 7f5db3fff700 1 --2- 172.21.15.79:0/987279229 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5d9406a130 0x7f5d9406c5f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c009c00 tx=0x7f5d9c009210 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:23.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:23.680+0000 7f5db17fa700 1 -- 172.21.15.79:0/987279229 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f5da4054fa0 con 0x7f5db40cbf00 2023-10-19T08:38:24.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.017+0000 7f3827990700 1 -- 172.21.15.79:0/3543208063 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f382004ee70 con 0x7f38200cd900 2023-10-19T08:38:24.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.018+0000 7f3815ffb700 1 -- 172.21.15.79:0/3543208063 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f381c08b020 con 0x7f38200cd900 2023-10-19T08:38:24.024 INFO:teuthology.orchestra.run.smithi079.stdout:55834574857 2023-10-19T08:38:24.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.021+0000 7f3827990700 1 -- 172.21.15.79:0/3543208063 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f380406a1b0 msgr2=0x7f380406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:24.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.022+0000 7f3827990700 1 --2- 172.21.15.79:0/3543208063 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f380406a1b0 0x7f380406c670 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3818007dc0 tx=0x7f38180072f0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.022+0000 7f3827990700 1 -- 172.21.15.79:0/3543208063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38200cd900 msgr2=0x7f38200b43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:24.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.022+0000 7f3827990700 1 --2- 172.21.15.79:0/3543208063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38200cd900 0x7f38200b43f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f381c016000 tx=0x7f381c004750 comp rx=0 tx=0).stop 2023-10-19T08:38:24.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.022+0000 7f3827990700 1 -- 172.21.15.79:0/3543208063 shutdown_connections 2023-10-19T08:38:24.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.022+0000 7f3827990700 1 --2- 172.21.15.79:0/3543208063 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38200cd900 0x7f38200b43f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.022+0000 7f3827990700 1 --2- 172.21.15.79:0/3543208063 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f380406a1b0 0x7f380406c670 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3818007dc0 tx=0x7f38180072f0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.022+0000 7f3827990700 1 --2- 172.21.15.79:0/3543208063 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f382006cfb0 0x7f3820150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.022+0000 7f3827990700 1 --2- 172.21.15.79:0/3543208063 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38200cd520 0x7f3820151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.022+0000 7f3827990700 1 -- 172.21.15.79:0/3543208063 >> 172.21.15.79:0/3543208063 conn(0x7f38200cefd0 msgr2=0x7f382006d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:24.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.022+0000 7f3827990700 1 -- 172.21.15.79:0/3543208063 shutdown_connections 2023-10-19T08:38:24.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.022+0000 7f3827990700 1 -- 172.21.15.79:0/3543208063 wait complete. 2023-10-19T08:38:24.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.037+0000 7f492985c700 1 -- 172.21.15.79:0/2808001920 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4924146d90 con 0x7f49240d2eb0 2023-10-19T08:38:24.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.038+0000 7f2c6a263700 1 -- 172.21.15.79:0/115160649 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2c400055a0 con 0x7f2c640adc00 2023-10-19T08:38:24.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.039+0000 7f2c60ff9700 1 -- 172.21.15.79:0/115160649 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2c54058770 con 0x7f2c640adc00 2023-10-19T08:38:24.043 INFO:teuthology.orchestra.run.smithi079.stdout:55834574856 2023-10-19T08:38:24.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2023-10-19T08:38:24.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.040+0000 7f490bfff700 1 -- 172.21.15.79:0/2808001920 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4924146d90 con 0x7f49240d2eb0 2023-10-19T08:38:24.045 INFO:teuthology.orchestra.run.smithi079.stdout:55834574857 2023-10-19T08:38:24.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.043+0000 7f2c6a263700 1 -- 172.21.15.79:0/115160649 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f2c4806a170 msgr2=0x7f2c4806c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:24.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.043+0000 7f2c6a263700 1 --2- 172.21.15.79:0/115160649 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f2c4806a170 0x7f2c4806c630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2c6416b010 tx=0x7f2c580091c0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.043+0000 7f2c6a263700 1 -- 172.21.15.79:0/115160649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c640adc00 msgr2=0x7f2c640c6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:24.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.043+0000 7f2c6a263700 1 --2- 172.21.15.79:0/115160649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c640adc00 0x7f2c640c6950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2c54017000 tx=0x7f2c54004750 comp rx=0 tx=0).stop 2023-10-19T08:38:24.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.044+0000 7f2c6a263700 1 -- 172.21.15.79:0/115160649 shutdown_connections 2023-10-19T08:38:24.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.044+0000 7f2c6a263700 1 --2- 172.21.15.79:0/115160649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2c640cde00 0x7f2c640c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.044+0000 7f2c6a263700 1 --2- 172.21.15.79:0/115160649 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f2c4806a170 0x7f2c4806c630 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.044+0000 7f2c6a263700 1 --2- 172.21.15.79:0/115160649 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2c64070ee0 0x7f2c640b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.044+0000 7f2c6a263700 1 --2- 172.21.15.79:0/115160649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2c640adc00 0x7f2c640c6950 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.044+0000 7f2c6a263700 1 -- 172.21.15.79:0/115160649 >> 172.21.15.79:0/115160649 conn(0x7f2c640cb3e0 msgr2=0x7f2c6406e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:24.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.044+0000 7f492985c700 1 -- 172.21.15.79:0/2808001920 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f491006a130 msgr2=0x7f491006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:24.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.044+0000 7f492985c700 1 --2- 172.21.15.79:0/2808001920 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f491006a130 0x7f491006c5f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f491c0114a0 tx=0x7f491c00b040 comp rx=0 tx=0).stop 2023-10-19T08:38:24.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.044+0000 7f492985c700 1 -- 172.21.15.79:0/2808001920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49240d2eb0 msgr2=0x7f492415ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:24.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.044+0000 7f492985c700 1 --2- 172.21.15.79:0/2808001920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49240d2eb0 0x7f492415ec20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4914016000 tx=0x7f4914004750 comp rx=0 tx=0).stop 2023-10-19T08:38:24.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.044+0000 7f492985c700 1 -- 172.21.15.79:0/2808001920 shutdown_connections 2023-10-19T08:38:24.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.044+0000 7f492985c700 1 --2- 172.21.15.79:0/2808001920 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f491006a130 0x7f491006c5f0 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f491c0114a0 tx=0x7f491c00b040 comp rx=0 tx=0).stop 2023-10-19T08:38:24.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.044+0000 7f492985c700 1 --2- 172.21.15.79:0/2808001920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49240d2eb0 0x7f492415ec20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.044+0000 7f492985c700 1 --2- 172.21.15.79:0/2808001920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49240b2180 0x7f4924071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.044+0000 7f492985c700 1 --2- 172.21.15.79:0/2808001920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49240cfcf0 0x7f492406f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.044+0000 7f492985c700 1 -- 172.21.15.79:0/2808001920 >> 172.21.15.79:0/2808001920 conn(0x7f4924071b30 msgr2=0x7f49240b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:24.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.043+0000 7f52f6d4b700 1 -- 172.21.15.79:0/2361557516 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f52d00055a0 con 0x7f52f00caf70 2023-10-19T08:38:24.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.045+0000 7f492985c700 1 -- 172.21.15.79:0/2808001920 shutdown_connections 2023-10-19T08:38:24.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.045+0000 7f492985c700 1 -- 172.21.15.79:0/2808001920 wait complete. 2023-10-19T08:38:24.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.047+0000 7fa715cd0700 1 -- 172.21.15.79:0/2984950580 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa7100719d0 con 0x7fa7100709a0 2023-10-19T08:38:24.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.047+0000 7f52e57fa700 1 -- 172.21.15.79:0/2361557516 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f52ec0564f0 con 0x7f52f00caf70 2023-10-19T08:38:24.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.047+0000 7f2c6a263700 1 -- 172.21.15.79:0/115160649 shutdown_connections 2023-10-19T08:38:24.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.047+0000 7fa6f7fff700 1 -- 172.21.15.79:0/2984950580 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa700067880 con 0x7fa7100709a0 2023-10-19T08:38:24.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.047+0000 7f2c6a263700 1 -- 172.21.15.79:0/115160649 wait complete. 2023-10-19T08:38:24.056 INFO:teuthology.orchestra.run.smithi079.stdout:55834574857 2023-10-19T08:38:24.056 INFO:teuthology.orchestra.run.smithi079.stdout:55834574857 2023-10-19T08:38:24.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.049+0000 7f2633ac8700 1 -- 172.21.15.79:0/2902391624 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f262c06b370 con 0x7f262c15d2f0 2023-10-19T08:38:24.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.049+0000 7f26227fc700 1 -- 172.21.15.79:0/2902391624 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f262c06b370 con 0x7f262c15d2f0 2023-10-19T08:38:24.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7fa715cd0700 1 -- 172.21.15.79:0/2984950580 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa6fc06a0e0 msgr2=0x7fa6fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:24.058 INFO:teuthology.orchestra.run.smithi079.stdout:55834574855 2023-10-19T08:38:24.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7fa715cd0700 1 --2- 172.21.15.79:0/2984950580 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa6fc06a0e0 0x7fa6fc06c5a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa7100cdd10 tx=0x7fa704008030 comp rx=0 tx=0).stop 2023-10-19T08:38:24.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7fa715cd0700 1 -- 172.21.15.79:0/2984950580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7100709a0 msgr2=0x7fa7101f7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:24.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7fa715cd0700 1 --2- 172.21.15.79:0/2984950580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7100709a0 0x7fa7101f7d40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa70001d510 tx=0x7fa70001d820 comp rx=0 tx=0).stop 2023-10-19T08:38:24.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7fa715cd0700 1 -- 172.21.15.79:0/2984950580 shutdown_connections 2023-10-19T08:38:24.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7fa715cd0700 1 --2- 172.21.15.79:0/2984950580 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa710165aa0 0x7fa7100b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7fa715cd0700 1 --2- 172.21.15.79:0/2984950580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7100709a0 0x7fa7101f7d40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7fa715cd0700 1 --2- 172.21.15.79:0/2984950580 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa6fc06a0e0 0x7fa6fc06c5a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7fa715cd0700 1 --2- 172.21.15.79:0/2984950580 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa71015ba40 0x7fa7101f6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7fa715cd0700 1 -- 172.21.15.79:0/2984950580 >> 172.21.15.79:0/2984950580 conn(0x7fa7100cb3e0 msgr2=0x7fa7100aeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:24.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7f52f6d4b700 1 -- 172.21.15.79:0/2361557516 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f52dc06a0e0 msgr2=0x7f52dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:24.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7f52f6d4b700 1 --2- 172.21.15.79:0/2361557516 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f52dc06a0e0 0x7f52dc06c5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f52e0009c40 tx=0x7f52e0008030 comp rx=0 tx=0).stop 2023-10-19T08:38:24.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7f52f6d4b700 1 -- 172.21.15.79:0/2361557516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52f00caf70 msgr2=0x7f52f00c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:24.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7f52f6d4b700 1 --2- 172.21.15.79:0/2361557516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52f00caf70 0x7f52f00c80b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00c3e0 tx=0x7f52ec00c6f0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7fa715cd0700 1 -- 172.21.15.79:0/2984950580 shutdown_connections 2023-10-19T08:38:24.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7fa715cd0700 1 -- 172.21.15.79:0/2984950580 wait complete. 2023-10-19T08:38:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7f52f6d4b700 1 -- 172.21.15.79:0/2361557516 shutdown_connections 2023-10-19T08:38:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7f52f6d4b700 1 --2- 172.21.15.79:0/2361557516 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f52dc06a0e0 0x7f52dc06c5a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7f52f6d4b700 1 --2- 172.21.15.79:0/2361557516 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f52f00cbf00 0x7f52f00c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7f52f6d4b700 1 --2- 172.21.15.79:0/2361557516 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52f00710b0 0x7f52f00b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7f52f6d4b700 1 --2- 172.21.15.79:0/2361557516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52f00caf70 0x7f52f00c80b0 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00c3e0 tx=0x7f52ec00c6f0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.051+0000 7f52f6d4b700 1 -- 172.21.15.79:0/2361557516 >> 172.21.15.79:0/2361557516 conn(0x7f52f00cb3e0 msgr2=0x7f52f00aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.052+0000 7f52f6d4b700 1 -- 172.21.15.79:0/2361557516 shutdown_connections 2023-10-19T08:38:24.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.052+0000 7f52f6d4b700 1 -- 172.21.15.79:0/2361557516 wait complete. 2023-10-19T08:38:24.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.054+0000 7f2633ac8700 1 -- 172.21.15.79:0/2902391624 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f261006a0e0 msgr2=0x7f261006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:24.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.054+0000 7f2633ac8700 1 --2- 172.21.15.79:0/2902391624 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f261006a0e0 0x7f261006c5a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2628000c00 tx=0x7f2628008040 comp rx=0 tx=0).stop 2023-10-19T08:38:24.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.054+0000 7f2633ac8700 1 -- 172.21.15.79:0/2902391624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f262c15d2f0 msgr2=0x7f262c159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:24.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.054+0000 7f2633ac8700 1 --2- 172.21.15.79:0/2902391624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f262c15d2f0 0x7f262c159aa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f262400ebd0 tx=0x7f262400eee0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.054+0000 7f8b2f541700 1 -- 172.21.15.79:0/2215334981 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8b2804ee70 con 0x7f8b2815d640 2023-10-19T08:38:24.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.055+0000 7f2633ac8700 1 -- 172.21.15.79:0/2902391624 shutdown_connections 2023-10-19T08:38:24.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.055+0000 7f2633ac8700 1 --2- 172.21.15.79:0/2902391624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f262c15d2f0 0x7f262c159aa0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.055+0000 7f2633ac8700 1 --2- 172.21.15.79:0/2902391624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f262c070ee0 0x7f262c1f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.055+0000 7f2633ac8700 1 --2- 172.21.15.79:0/2902391624 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f261006a0e0 0x7f261006c5a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.055+0000 7f2633ac8700 1 --2- 172.21.15.79:0/2902391624 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f262c0caca0 0x7f262c159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.055+0000 7f2633ac8700 1 -- 172.21.15.79:0/2902391624 >> 172.21.15.79:0/2902391624 conn(0x7f262c0cb3e0 msgr2=0x7f262c157150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:24.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.055+0000 7f8b1dffb700 1 -- 172.21.15.79:0/2215334981 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8b18021020 con 0x7f8b2815d640 2023-10-19T08:38:24.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.057+0000 7f2633ac8700 1 -- 172.21.15.79:0/2902391624 shutdown_connections 2023-10-19T08:38:24.068 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.057+0000 7f2633ac8700 1 -- 172.21.15.79:0/2902391624 wait complete. 2023-10-19T08:38:24.069 INFO:teuthology.orchestra.run.smithi079.stdout:55834574857 2023-10-19T08:38:24.069 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.062+0000 7f8b2f541700 1 -- 172.21.15.79:0/2215334981 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f8b0c06a0e0 msgr2=0x7f8b0c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:24.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.062+0000 7f8b2f541700 1 --2- 172.21.15.79:0/2215334981 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f8b0c06a0e0 0x7f8b0c06c5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8b240134a0 tx=0x7f8b24011000 comp rx=0 tx=0).stop 2023-10-19T08:38:24.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.062+0000 7f8b2f541700 1 -- 172.21.15.79:0/2215334981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b2815d640 msgr2=0x7f8b280c6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:24.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.062+0000 7f8b2f541700 1 --2- 172.21.15.79:0/2215334981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b2815d640 0x7f8b280c6790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800c390 tx=0x7f8b1800c6a0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.071 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2023-10-19T08:38:24.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.067+0000 7f8b2f541700 1 -- 172.21.15.79:0/2215334981 shutdown_connections 2023-10-19T08:38:24.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.067+0000 7f8b2f541700 1 --2- 172.21.15.79:0/2215334981 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f8b0c06a0e0 0x7f8b0c06c5a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.067+0000 7f8b2f541700 1 --2- 172.21.15.79:0/2215334981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8b28150850 0x7f8b2806dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.067+0000 7f8b2f541700 1 --2- 172.21.15.79:0/2215334981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b280cbf00 0x7f8b28154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.067+0000 7f8b2f541700 1 --2- 172.21.15.79:0/2215334981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8b2815d640 0x7f8b280c6790 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.067+0000 7f8b2f541700 1 -- 172.21.15.79:0/2215334981 >> 172.21.15.79:0/2215334981 conn(0x7f8b280cb3e0 msgr2=0x7f8b280708a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:24.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.067+0000 7f8b2f541700 1 -- 172.21.15.79:0/2215334981 shutdown_connections 2023-10-19T08:38:24.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.067+0000 7f8b2f541700 1 -- 172.21.15.79:0/2215334981 wait complete. 2023-10-19T08:38:24.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2023-10-19T08:38:24.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.072+0000 7f5dba4f3700 1 -- 172.21.15.79:0/987279229 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5d98005870 con 0x7f5db40cbf00 2023-10-19T08:38:24.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.072+0000 7f5db17fa700 1 -- 172.21.15.79:0/987279229 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5da40585c0 con 0x7f5db40cbf00 2023-10-19T08:38:24.076 INFO:teuthology.orchestra.run.smithi079.stdout:55834574857 2023-10-19T08:38:24.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2023-10-19T08:38:24.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.075+0000 7f5dba4f3700 1 -- 172.21.15.79:0/987279229 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5d9406a130 msgr2=0x7f5d9406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:24.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.075+0000 7f5dba4f3700 1 --2- 172.21.15.79:0/987279229 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5d9406a130 0x7f5d9406c5f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c009c00 tx=0x7f5d9c009210 comp rx=0 tx=0).stop 2023-10-19T08:38:24.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.075+0000 7f5dba4f3700 1 -- 172.21.15.79:0/987279229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5db40cbf00 msgr2=0x7f5db40af6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:24.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.075+0000 7f5dba4f3700 1 --2- 172.21.15.79:0/987279229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5db40cbf00 0x7f5db40af6d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5da4000c00 tx=0x7f5da4004750 comp rx=0 tx=0).stop 2023-10-19T08:38:24.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.075+0000 7f5dba4f3700 1 -- 172.21.15.79:0/987279229 shutdown_connections 2023-10-19T08:38:24.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.075+0000 7f5dba4f3700 1 --2- 172.21.15.79:0/987279229 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5d9406a130 0x7f5d9406c5f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.075+0000 7f5dba4f3700 1 --2- 172.21.15.79:0/987279229 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5db415cdb0 0x7f5db4165ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.075+0000 7f5dba4f3700 1 --2- 172.21.15.79:0/987279229 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5db40709a0 0x7f5db40c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.075+0000 7f5dba4f3700 1 --2- 172.21.15.79:0/987279229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5db40cbf00 0x7f5db40af6d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:24.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.075+0000 7f5dba4f3700 1 -- 172.21.15.79:0/987279229 >> 172.21.15.79:0/987279229 conn(0x7f5db40cb3e0 msgr2=0x7f5db40c41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:24.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.076+0000 7f5dba4f3700 1 -- 172.21.15.79:0/987279229 shutdown_connections 2023-10-19T08:38:24.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:24.076+0000 7f5dba4f3700 1 -- 172.21.15.79:0/987279229 wait complete. 2023-10-19T08:38:24.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2023-10-19T08:38:24.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2023-10-19T08:38:24.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2023-10-19T08:38:24.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2023-10-19T08:38:25.045 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-19T08:38:25.072 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-19T08:38:25.075 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-19T08:38:25.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-19T08:38:25.084 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-19T08:38:25.085 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-19T08:38:25.089 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-19T08:38:25.093 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-19T08:38:25.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.243+0000 7fadf947c700 1 Processor -- start 2023-10-19T08:38:25.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.243+0000 7fadf947c700 1 -- start start 2023-10-19T08:38:25.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.244+0000 7fadf947c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf40710b0 0x7fadf415cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.244+0000 7fadf947c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fadf415d2f0 0x7fadf40c3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.244+0000 7fadf947c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf40cd750 con 0x7fadf40caca0 2023-10-19T08:38:25.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.244+0000 7fadf947c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf40cda10 con 0x7fadf415d2f0 2023-10-19T08:38:25.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.244+0000 7fadf947c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf40cdcf0 con 0x7fadf40710b0 2023-10-19T08:38:25.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.245+0000 7fadf27fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf40710b0 0x7fadf415cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.245+0000 7fadf27fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf40710b0 0x7fadf415cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:49108/0 (socket says 172.21.15.79:49108) 2023-10-19T08:38:25.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.245+0000 7fadf27fc700 1 -- 172.21.15.79:0/1374839507 learned_addr learned my addr 172.21.15.79:0/1374839507 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:25.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.246+0000 7fadf37fe700 1 --2- 172.21.15.79:0/1374839507 >> v2:172.21.15.79:3300/0 conn(0x7fadf415d2f0 0x7fadf40c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.246+0000 7fadf27fc700 1 -- 172.21.15.79:0/1374839507 >> v2:172.21.15.79:3300/0 conn(0x7fadf415d2f0 msgr2=0x7fadf40c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:25.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.246+0000 7fadf27fc700 1 --2- 172.21.15.79:0/1374839507 >> v2:172.21.15.79:3300/0 conn(0x7fadf415d2f0 0x7fadf40c3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.246+0000 7fadf27fc700 1 -- 172.21.15.79:0/1374839507 >> v1:172.21.15.89:6789/0 conn(0x7fadf40caca0 legacy=0x7fadf40709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:25.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.246+0000 7fadf27fc700 1 -- 172.21.15.79:0/1374839507 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf40cdfd0 con 0x7fadf40710b0 2023-10-19T08:38:25.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.247+0000 7fadf27fc700 1 --2- 172.21.15.79:0/1374839507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf40710b0 0x7fadf415cdb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fadec00d370 tx=0x7fadec00d680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a616f7f9c3a2eb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.247+0000 7fadf1ffb700 1 -- 172.21.15.79:0/1374839507 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec010070 con 0x7fadf40710b0 2023-10-19T08:38:25.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.247+0000 7fadf1ffb700 1 -- 172.21.15.79:0/1374839507 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadec00dc20 con 0x7fadf40710b0 2023-10-19T08:38:25.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.247+0000 7fadf1ffb700 1 -- 172.21.15.79:0/1374839507 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec007b30 con 0x7fadf40710b0 2023-10-19T08:38:25.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.248+0000 7fadf947c700 1 -- 172.21.15.79:0/1374839507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf40710b0 msgr2=0x7fadf415cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.248+0000 7fadf947c700 1 --2- 172.21.15.79:0/1374839507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf40710b0 0x7fadf415cdb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fadec00d370 tx=0x7fadec00d680 comp rx=0 tx=0).stop 2023-10-19T08:38:25.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.248+0000 7fadf947c700 1 -- 172.21.15.79:0/1374839507 shutdown_connections 2023-10-19T08:38:25.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.248+0000 7fadf947c700 1 --2- 172.21.15.79:0/1374839507 >> v2:172.21.15.79:3300/0 conn(0x7fadf415d2f0 0x7fadf40c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.248+0000 7fadf947c700 1 --2- 172.21.15.79:0/1374839507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf40710b0 0x7fadf415cdb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.248+0000 7fadf947c700 1 -- 172.21.15.79:0/1374839507 >> 172.21.15.79:0/1374839507 conn(0x7fadf40cb3e0 msgr2=0x7fadf40cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:25.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.249+0000 7fadf947c700 1 -- 172.21.15.79:0/1374839507 shutdown_connections 2023-10-19T08:38:25.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.249+0000 7fadf947c700 1 -- 172.21.15.79:0/1374839507 wait complete. 2023-10-19T08:38:25.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.251+0000 7fadf947c700 1 Processor -- start 2023-10-19T08:38:25.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.251+0000 7fadf947c700 1 -- start start 2023-10-19T08:38:25.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.252+0000 7fadf947c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf40710b0 0x7fadf406ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.252+0000 7fadf947c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf40caca0 0x7fadf4157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.252+0000 7fadf947c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf415d2f0 0x7fadf4155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.252+0000 7fadf947c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf415a530 con 0x7fadf415d2f0 2023-10-19T08:38:25.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.252+0000 7fadf947c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf4159920 con 0x7fadf40caca0 2023-10-19T08:38:25.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.252+0000 7fadf947c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf4159c00 con 0x7fadf40710b0 2023-10-19T08:38:25.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.253+0000 7fadf27fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf40caca0 0x7fadf4157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.253+0000 7fadf2ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf40710b0 0x7fadf406ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.253+0000 7fadf27fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf40caca0 0x7fadf4157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:60970/0 (socket says 172.21.15.79:60970) 2023-10-19T08:38:25.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.253+0000 7fadf27fc700 1 -- 172.21.15.79:0/1927560535 learned_addr learned my addr 172.21.15.79:0/1927560535 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:25.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.254+0000 7fadf27fc700 1 -- 172.21.15.79:0/1927560535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf40710b0 msgr2=0x7fadf406ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.254+0000 7fadf27fc700 1 --2- 172.21.15.79:0/1927560535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf40710b0 0x7fadf406ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.254+0000 7fadf37fe700 1 --2- 172.21.15.79:0/1927560535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf415d2f0 0x7fadf4155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.254+0000 7fadf27fc700 1 -- 172.21.15.79:0/1927560535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf415d2f0 msgr2=0x7fadf4155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.254+0000 7fadf27fc700 1 --2- 172.21.15.79:0/1927560535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf415d2f0 0x7fadf4155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.254+0000 7fadf27fc700 1 -- 172.21.15.79:0/1927560535 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec00d050 con 0x7fadf40caca0 2023-10-19T08:38:25.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.254+0000 7fadf37fe700 1 --2- 172.21.15.79:0/1927560535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf415d2f0 0x7fadf4155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:25.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.255+0000 7fadf27fc700 1 --2- 172.21.15.79:0/1927560535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf40caca0 0x7fadf4157910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fadec00d6c0 tx=0x7fadec004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.255+0000 7faddb7fe700 1 -- 172.21.15.79:0/1927560535 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec004450 con 0x7fadf40caca0 2023-10-19T08:38:25.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.255+0000 7faddb7fe700 1 -- 172.21.15.79:0/1927560535 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadec0045d0 con 0x7fadf40caca0 2023-10-19T08:38:25.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.255+0000 7faddb7fe700 1 -- 172.21.15.79:0/1927560535 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec008030 con 0x7fadf40caca0 2023-10-19T08:38:25.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.255+0000 7fadf947c700 1 -- 172.21.15.79:0/1927560535 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf4159ee0 con 0x7fadf40caca0 2023-10-19T08:38:25.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.255+0000 7fadf947c700 1 -- 172.21.15.79:0/1927560535 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf4157e50 con 0x7fadf40caca0 2023-10-19T08:38:25.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.259+0000 7faddb7fe700 1 -- 172.21.15.79:0/1927560535 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fadec008190 con 0x7fadf40caca0 2023-10-19T08:38:25.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.259+0000 7faddb7fe700 1 --2- 172.21.15.79:0/1927560535 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faddc06a330 0x7faddc06c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.260+0000 7faddb7fe700 1 -- 172.21.15.79:0/1927560535 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fadec08a370 con 0x7fadf40caca0 2023-10-19T08:38:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.261+0000 7fadf2ffd700 1 --2- 172.21.15.79:0/1927560535 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faddc06a330 0x7faddc06c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.260+0000 7fadf947c700 1 -- 172.21.15.79:0/1927560535 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade0005320 con 0x7fadf40caca0 2023-10-19T08:38:25.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.261+0000 7fadf2ffd700 1 --2- 172.21.15.79:0/1927560535 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faddc06a330 0x7faddc06c7f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fade8007fd0 tx=0x7fade8007ec0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.266+0000 7faddb7fe700 1 -- 172.21.15.79:0/1927560535 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fadec0557e0 con 0x7fadf40caca0 2023-10-19T08:38:25.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.284+0000 7feafec90700 1 Processor -- start 2023-10-19T08:38:25.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.284+0000 7feafec90700 1 -- start start 2023-10-19T08:38:25.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.286+0000 7feafec90700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feaf80b4aa0 0x7feaf815f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.286+0000 7feafec90700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feaf815c020 0x7feaf80b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.286+0000 7feafec90700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf80ca6b0 con 0x7feaf80b0f90 2023-10-19T08:38:25.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.286+0000 7feafec90700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf80b13a0 con 0x7feaf80b4aa0 2023-10-19T08:38:25.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.286+0000 7feafec90700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf815f8b0 con 0x7feaf815c020 2023-10-19T08:38:25.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.286+0000 7feafca2c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feaf80b4aa0 0x7feaf815f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.286+0000 7feafca2c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feaf80b4aa0 0x7feaf815f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46502/0 (socket says 172.21.15.79:46502) 2023-10-19T08:38:25.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.286+0000 7feaf7fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7feaf815c020 0x7feaf80b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.286+0000 7feafca2c700 1 -- 172.21.15.79:0/3209843972 learned_addr learned my addr 172.21.15.79:0/3209843972 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:25.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.286+0000 7feaf7fff700 1 -- 172.21.15.79:0/3209843972 >> v2:172.21.15.79:3300/0 conn(0x7feaf80b4aa0 msgr2=0x7feaf815f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:25.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.286+0000 7feaf7fff700 1 --2- 172.21.15.79:0/3209843972 >> v2:172.21.15.79:3300/0 conn(0x7feaf80b4aa0 0x7feaf815f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.286+0000 7feaf7fff700 1 -- 172.21.15.79:0/3209843972 >> v1:172.21.15.89:6789/0 conn(0x7feaf80b0f90 legacy=0x7feaf8154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.287+0000 7feaf7fff700 1 -- 172.21.15.79:0/3209843972 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf80b1880 con 0x7feaf815c020 2023-10-19T08:38:25.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.287+0000 7feaf7fff700 1 --2- 172.21.15.79:0/3209843972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf815c020 0x7feaf80b0a50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feaf8067430 tx=0x7feaec009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d0871ed96beccc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.287+0000 7feaf77fe700 1 -- 172.21.15.79:0/3209843972 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec011830 con 0x7feaf815c020 2023-10-19T08:38:25.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.287+0000 7feaf77fe700 1 -- 172.21.15.79:0/3209843972 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaec011990 con 0x7feaf815c020 2023-10-19T08:38:25.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.287+0000 7feaf77fe700 1 -- 172.21.15.79:0/3209843972 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec011d20 con 0x7feaf815c020 2023-10-19T08:38:25.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.288+0000 7feafec90700 1 -- 172.21.15.79:0/3209843972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf815c020 msgr2=0x7feaf80b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.288+0000 7feafec90700 1 --2- 172.21.15.79:0/3209843972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf815c020 0x7feaf80b0a50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7feaf8067430 tx=0x7feaec009b20 comp rx=0 tx=0).stop 2023-10-19T08:38:25.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.288+0000 7feafec90700 1 -- 172.21.15.79:0/3209843972 shutdown_connections 2023-10-19T08:38:25.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.288+0000 7feafec90700 1 --2- 172.21.15.79:0/3209843972 >> v2:172.21.15.79:3300/0 conn(0x7feaf80b4aa0 0x7feaf815f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.288+0000 7feafec90700 1 --2- 172.21.15.79:0/3209843972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf815c020 0x7feaf80b0a50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.288+0000 7feafec90700 1 -- 172.21.15.79:0/3209843972 >> 172.21.15.79:0/3209843972 conn(0x7feaf80cefd0 msgr2=0x7feaf80cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:25.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.288+0000 7feafec90700 1 -- 172.21.15.79:0/3209843972 shutdown_connections 2023-10-19T08:38:25.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.288+0000 7feafec90700 1 -- 172.21.15.79:0/3209843972 wait complete. 2023-10-19T08:38:25.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.295+0000 7feafec90700 1 Processor -- start 2023-10-19T08:38:25.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.295+0000 7feafec90700 1 -- start start 2023-10-19T08:38:25.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.297+0000 7feafec90700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf80b0f90 0x7feaf80c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.297+0000 7feafec90700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80b4aa0 0x7feaf81ff9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.297+0000 7feafec90700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaf815c020 0x7feaf81fe5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.297+0000 7feafec90700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf81ff590 con 0x7feaf80b4aa0 2023-10-19T08:38:25.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.297+0000 7feafec90700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf80c90e0 con 0x7feaf80b0f90 2023-10-19T08:38:25.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.297+0000 7feafec90700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf81ffef0 con 0x7feaf815c020 2023-10-19T08:38:25.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.297+0000 7feaf7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80b4aa0 0x7feaf81ff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.297+0000 7feaf7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80b4aa0 0x7feaf81ff9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46504/0 (socket says 172.21.15.79:46504) 2023-10-19T08:38:25.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.297+0000 7feaf7fff700 1 -- 172.21.15.79:0/2844911992 learned_addr learned my addr 172.21.15.79:0/2844911992 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:25.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.297+0000 7feafd22d700 1 --2- 172.21.15.79:0/2844911992 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaf815c020 0x7feaf81fe5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.297+0000 7feafca2c700 1 --2- 172.21.15.79:0/2844911992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf80b0f90 0x7feaf80c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.298+0000 7feaf7fff700 1 -- 172.21.15.79:0/2844911992 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaf815c020 msgr2=0x7feaf81fe5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.298+0000 7feaf7fff700 1 --2- 172.21.15.79:0/2844911992 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaf815c020 0x7feaf81fe5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.298+0000 7feaf7fff700 1 -- 172.21.15.79:0/2844911992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf80b0f90 msgr2=0x7feaf80c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.298+0000 7feaf7fff700 1 --2- 172.21.15.79:0/2844911992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf80b0f90 0x7feaf80c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.298+0000 7feaf7fff700 1 -- 172.21.15.79:0/2844911992 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaec0094a0 con 0x7feaf80b4aa0 2023-10-19T08:38:25.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.298+0000 7feaf7fff700 1 --2- 172.21.15.79:0/2844911992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80b4aa0 0x7feaf81ff9b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feaec009b60 tx=0x7feaec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.298+0000 7feaf57fa700 1 -- 172.21.15.79:0/2844911992 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec0036a0 con 0x7feaf80b4aa0 2023-10-19T08:38:25.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.298+0000 7feaf57fa700 1 -- 172.21.15.79:0/2844911992 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaec01f070 con 0x7feaf80b4aa0 2023-10-19T08:38:25.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.298+0000 7feaf57fa700 1 -- 172.21.15.79:0/2844911992 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec003a20 con 0x7feaf80b4aa0 2023-10-19T08:38:25.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.299+0000 7feafec90700 1 -- 172.21.15.79:0/2844911992 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf80c7790 con 0x7feaf80b4aa0 2023-10-19T08:38:25.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.299+0000 7feafec90700 1 -- 172.21.15.79:0/2844911992 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf815e5f0 con 0x7feaf80b4aa0 2023-10-19T08:38:25.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.300+0000 7feafec90700 1 -- 172.21.15.79:0/2844911992 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf81ff6d0 con 0x7feaf80b4aa0 2023-10-19T08:38:25.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.301+0000 7feaf57fa700 1 -- 172.21.15.79:0/2844911992 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feaec003b80 con 0x7feaf80b4aa0 2023-10-19T08:38:25.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.301+0000 7feaf57fa700 1 --2- 172.21.15.79:0/2844911992 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7feae406a130 0x7feae406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.302+0000 7feaf57fa700 1 -- 172.21.15.79:0/2844911992 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feaec021070 con 0x7feaf80b4aa0 2023-10-19T08:38:25.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.302+0000 7feafca2c700 1 --2- 172.21.15.79:0/2844911992 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7feae406a130 0x7feae406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.302+0000 7feafca2c700 1 --2- 172.21.15.79:0/2844911992 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7feae406a130 0x7feae406c5f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feaf00113e0 tx=0x7feaf000b040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.306+0000 7f203c885700 1 Processor -- start 2023-10-19T08:38:25.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.306+0000 7f07b57ae700 1 Processor -- start 2023-10-19T08:38:25.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.306+0000 7f07b57ae700 1 -- start start 2023-10-19T08:38:25.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.306+0000 7f203c885700 1 -- start start 2023-10-19T08:38:25.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.307+0000 7f203c885700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2038161260 0x7f203806a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.307+0000 7f203c885700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2038165b10 con 0x7f20380aded0 2023-10-19T08:38:25.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.307+0000 7f203c885700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20380ae340 con 0x7f203806a760 2023-10-19T08:38:25.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.307+0000 7f203c885700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203806abe0 con 0x7f2038161260 2023-10-19T08:38:25.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.307+0000 7f203659c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2038161260 0x7f203806a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.307+0000 7f203659c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2038161260 0x7f203806a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:49136/0 (socket says 172.21.15.79:49136) 2023-10-19T08:38:25.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.307+0000 7f203659c700 1 -- 172.21.15.79:0/3740154570 learned_addr learned my addr 172.21.15.79:0/3740154570 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:25.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7f203659c700 1 -- 172.21.15.79:0/3740154570 >> v1:172.21.15.89:6789/0 conn(0x7f203806a760 legacy=0x7f20380ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7f203659c700 1 -- 172.21.15.79:0/3740154570 >> v1:172.21.15.79:6789/0 conn(0x7f20380aded0 legacy=0x7f20380c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:25.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7f203659c700 1 -- 172.21.15.79:0/3740154570 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2038164f00 con 0x7f2038161260 2023-10-19T08:38:25.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7f203659c700 1 --2- 172.21.15.79:0/3740154570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2038161260 0x7f203806a220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2028009920 tx=0x7f2028009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1d621865b10fc85 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7f07b57ae700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f07b006a490 0x7f07b00cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7f07b57ae700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07b006a870 0x7f07b00b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7f07b57ae700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b00cd5e0 con 0x7f07b00d00a0 2023-10-19T08:38:25.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7f07b57ae700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b00cfc80 con 0x7f07b006a490 2023-10-19T08:38:25.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7f07b57ae700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b015dcb0 con 0x7f07b006a870 2023-10-19T08:38:25.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7f203559a700 1 -- 172.21.15.79:0/3740154570 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2028004230 con 0x7f2038161260 2023-10-19T08:38:25.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7f203559a700 1 -- 172.21.15.79:0/3740154570 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2028004390 con 0x7f2038161260 2023-10-19T08:38:25.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7f203559a700 1 -- 172.21.15.79:0/3740154570 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2028009e70 con 0x7f2038161260 2023-10-19T08:38:25.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7f07aeffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f07b006a490 0x7f07b00cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7f07aeffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f07b006a490 0x7f07b00cd0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:60996/0 (socket says 172.21.15.79:60996) 2023-10-19T08:38:25.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7f07aeffd700 1 -- 172.21.15.79:0/30996197 learned_addr learned my addr 172.21.15.79:0/30996197 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:25.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7f07ae7fc700 1 --2- 172.21.15.79:0/30996197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07b006a870 0x7f07b00b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7f07aeffd700 1 -- 172.21.15.79:0/30996197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07b006a870 msgr2=0x7f07b00b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:25.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7f07aeffd700 1 --2- 172.21.15.79:0/30996197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07b006a870 0x7f07b00b16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7f07aeffd700 1 -- 172.21.15.79:0/30996197 >> v1:172.21.15.79:6789/0 conn(0x7f07b00d00a0 legacy=0x7f07b00d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:25.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.308+0000 7feaf57fa700 1 -- 172.21.15.79:0/2844911992 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7feaf81ff6d0 con 0x7feaf80b4aa0 2023-10-19T08:38:25.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f07aeffd700 1 -- 172.21.15.79:0/30996197 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b015df90 con 0x7f07b006a490 2023-10-19T08:38:25.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.310+0000 7f210cb5f700 1 Processor -- start 2023-10-19T08:38:25.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.310+0000 7f210cb5f700 1 -- start start 2023-10-19T08:38:25.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.311+0000 7f210cb5f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f210815e570 0x7f21080d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.311+0000 7f210cb5f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f21080cb6f0 0x7f21080b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.311+0000 7f210cb5f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21080b0e80 con 0x7f21080b0a30 2023-10-19T08:38:25.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.311+0000 7f210cb5f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21080afd60 con 0x7f210815e570 2023-10-19T08:38:25.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.311+0000 7f210cb5f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f210806d340 con 0x7f21080cb6f0 2023-10-19T08:38:25.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f07aeffd700 1 --2- 172.21.15.79:0/30996197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07b006a490 0x7f07b00cd0a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f07a8009e50 tx=0x7f07a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ea4d53474c148d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f07adffb700 1 -- 172.21.15.79:0/30996197 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a800e070 con 0x7f07b006a490 2023-10-19T08:38:25.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f07adffb700 1 -- 172.21.15.79:0/30996197 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a8003a20 con 0x7f07b006a490 2023-10-19T08:38:25.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f07adffb700 1 -- 172.21.15.79:0/30996197 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8003dd0 con 0x7f07b006a490 2023-10-19T08:38:25.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.311+0000 7f07b57ae700 1 -- 172.21.15.79:0/30996197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07b006a490 msgr2=0x7f07b00cd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.311+0000 7f07b57ae700 1 --2- 172.21.15.79:0/30996197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07b006a490 0x7f07b00cd0a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f07a8009e50 tx=0x7f07a800b330 comp rx=0 tx=0).stop 2023-10-19T08:38:25.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.307+0000 7f225bc83700 1 Processor -- start 2023-10-19T08:38:25.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.307+0000 7f225bc83700 1 -- start start 2023-10-19T08:38:25.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f225bc83700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f22540c24a0 0x7f2254165730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f225bc83700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22540c9e20 0x7f22540ca240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f225bc83700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225406fb80 con 0x7f2254164ab0 2023-10-19T08:38:25.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f225bc83700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225406db20 con 0x7f22540c9e20 2023-10-19T08:38:25.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f225bc83700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22540c20d0 con 0x7f22540c24a0 2023-10-19T08:38:25.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f225921e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f22540c24a0 0x7f2254165730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f225921e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f22540c24a0 0x7f2254165730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:32770/0 (socket says 172.21.15.79:32770) 2023-10-19T08:38:25.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f225921e700 1 -- 172.21.15.79:0/827713809 learned_addr learned my addr 172.21.15.79:0/827713809 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:25.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f225a220700 1 --2- 172.21.15.79:0/827713809 >> v2:172.21.15.79:3300/0 conn(0x7f22540c9e20 0x7f22540ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.310+0000 7f225921e700 1 -- 172.21.15.79:0/827713809 >> v2:172.21.15.79:3300/0 conn(0x7f22540c9e20 msgr2=0x7f22540ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:25.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.310+0000 7f225921e700 1 --2- 172.21.15.79:0/827713809 >> v2:172.21.15.79:3300/0 conn(0x7f22540c9e20 0x7f22540ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.310+0000 7f225921e700 1 -- 172.21.15.79:0/827713809 >> v1:172.21.15.79:6789/0 conn(0x7f2254164ab0 legacy=0x7f2254165020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-19T08:38:25.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.310+0000 7f225921e700 1 -- 172.21.15.79:0/827713809 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2254165d60 con 0x7f22540c24a0 2023-10-19T08:38:25.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.310+0000 7f225921e700 1 --2- 172.21.15.79:0/827713809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22540c24a0 0x7f2254165730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f22540664f0 tx=0x7f2250009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a6f76798ddac52a server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f203c885700 1 -- 172.21.15.79:0/3740154570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2038161260 msgr2=0x7f203806a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f203c885700 1 --2- 172.21.15.79:0/3740154570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2038161260 0x7f203806a220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2028009920 tx=0x7f2028009c30 comp rx=0 tx=0).stop 2023-10-19T08:38:25.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f203c885700 1 -- 172.21.15.79:0/3740154570 shutdown_connections 2023-10-19T08:38:25.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f203c885700 1 --2- 172.21.15.79:0/3740154570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2038161260 0x7f203806a220 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f203c885700 1 -- 172.21.15.79:0/3740154570 >> 172.21.15.79:0/3740154570 conn(0x7f20380ce960 msgr2=0x7f20380ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:25.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f203c885700 1 -- 172.21.15.79:0/3740154570 shutdown_connections 2023-10-19T08:38:25.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f203c885700 1 -- 172.21.15.79:0/3740154570 wait complete. 2023-10-19T08:38:25.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.311+0000 7f203c885700 1 Processor -- start 2023-10-19T08:38:25.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f94bc3df700 1 Processor -- start 2023-10-19T08:38:25.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.309+0000 7f94bc3df700 1 -- start start 2023-10-19T08:38:25.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.310+0000 7f94bc3df700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f94b40710b0 0x7f94b415cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.310+0000 7f94bc3df700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94b415d2f0 0x7f94b40c3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.310+0000 7f94bc3df700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b40cd750 con 0x7f94b40caca0 2023-10-19T08:38:25.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.310+0000 7f94bc3df700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b40cda10 con 0x7f94b40710b0 2023-10-19T08:38:25.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.310+0000 7f94bc3df700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40cdcf0 con 0x7f94b415d2f0 2023-10-19T08:38:25.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f210659c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f210815e570 0x7f21080d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f203c885700 1 -- start start 2023-10-19T08:38:25.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f210659c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f210815e570 0x7f21080d1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46530/0 (socket says 172.21.15.79:46530) 2023-10-19T08:38:25.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f210659c700 1 -- 172.21.15.79:0/1248552237 learned_addr learned my addr 172.21.15.79:0/1248552237 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:25.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f2105d9b700 1 --2- 172.21.15.79:0/1248552237 >> v2:172.21.15.89:3300/0 conn(0x7f21080cb6f0 0x7f21080b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f94ba97c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94b415d2f0 0x7f94b40c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f94ba97c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94b415d2f0 0x7f94b40c3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:49152/0 (socket says 172.21.15.79:49152) 2023-10-19T08:38:25.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f94ba97c700 1 -- 172.21.15.79:0/1889552453 learned_addr learned my addr 172.21.15.79:0/1889552453 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:25.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f07b57ae700 1 -- 172.21.15.79:0/30996197 shutdown_connections 2023-10-19T08:38:25.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f07b57ae700 1 --2- 172.21.15.79:0/30996197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07b006a490 0x7f07b00cd0a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f07b57ae700 1 --2- 172.21.15.79:0/30996197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07b006a870 0x7f07b00b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f07b57ae700 1 -- 172.21.15.79:0/30996197 >> 172.21.15.79:0/30996197 conn(0x7f07b006b330 msgr2=0x7f07b006b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:25.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f2105d9b700 1 -- 172.21.15.79:0/1248552237 >> v2:172.21.15.79:3300/0 conn(0x7f210815e570 msgr2=0x7f21080d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:25.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f2105d9b700 1 --2- 172.21.15.79:0/1248552237 >> v2:172.21.15.79:3300/0 conn(0x7f210815e570 0x7f21080d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f2105d9b700 1 -- 172.21.15.79:0/1248552237 >> v1:172.21.15.79:6789/0 conn(0x7f21080b0a30 legacy=0x7f21080b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:25.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f2105d9b700 1 -- 172.21.15.79:0/1248552237 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21080af810 con 0x7f21080cb6f0 2023-10-19T08:38:25.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f94b997a700 1 --2- 172.21.15.79:0/1889552453 >> v2:172.21.15.89:3300/0 conn(0x7f94b40710b0 0x7f94b415cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.310+0000 7f2258a1d700 1 -- 172.21.15.79:0/827713809 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250004230 con 0x7f22540c24a0 2023-10-19T08:38:25.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.310+0000 7f2258a1d700 1 -- 172.21.15.79:0/827713809 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2250004390 con 0x7f22540c24a0 2023-10-19T08:38:25.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.310+0000 7f2258a1d700 1 -- 172.21.15.79:0/827713809 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22500036a0 con 0x7f22540c24a0 2023-10-19T08:38:25.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.311+0000 7f225bc83700 1 -- 172.21.15.79:0/827713809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22540c24a0 msgr2=0x7f2254165730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.311+0000 7f225bc83700 1 --2- 172.21.15.79:0/827713809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22540c24a0 0x7f2254165730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f22540664f0 tx=0x7f2250009bd0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f225bc83700 1 -- 172.21.15.79:0/827713809 shutdown_connections 2023-10-19T08:38:25.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f225bc83700 1 --2- 172.21.15.79:0/827713809 >> v2:172.21.15.79:3300/0 conn(0x7f22540c9e20 0x7f22540ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f225bc83700 1 --2- 172.21.15.79:0/827713809 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22540c24a0 0x7f2254165730 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f225bc83700 1 -- 172.21.15.79:0/827713809 >> 172.21.15.79:0/827713809 conn(0x7f225406d000 msgr2=0x7f225406d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:25.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f225bc83700 1 -- 172.21.15.79:0/827713809 shutdown_connections 2023-10-19T08:38:25.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.312+0000 7f225bc83700 1 -- 172.21.15.79:0/827713809 wait complete. 2023-10-19T08:38:25.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f2105d9b700 1 --2- 172.21.15.79:0/1248552237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21080cb6f0 0x7f21080b04f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f21080ce960 tx=0x7f20f8009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8c1682640364746 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f07b57ae700 1 -- 172.21.15.79:0/30996197 shutdown_connections 2023-10-19T08:38:25.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f07b57ae700 1 -- 172.21.15.79:0/30996197 wait complete. 2023-10-19T08:38:25.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f203c885700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f203806a760 0x7f20380b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f203c885700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20380aded0 0x7f20380cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f203c885700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2038161260 0x7f203814c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f203c885700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20380b45c0 con 0x7f20380aded0 2023-10-19T08:38:25.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f203c885700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20380b4000 con 0x7f2038161260 2023-10-19T08:38:25.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f203c885700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20380b42e0 con 0x7f203806a760 2023-10-19T08:38:25.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f2036d9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2038161260 0x7f203814c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f203659c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f203806a760 0x7f20380b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f2036d9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2038161260 0x7f203814c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:32786/0 (socket says 172.21.15.79:32786) 2023-10-19T08:38:25.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f2036d9d700 1 -- 172.21.15.79:0/1267007041 learned_addr learned my addr 172.21.15.79:0/1267007041 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:25.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f2035d9b700 1 --2- 172.21.15.79:0/1267007041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20380aded0 0x7f20380cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.314+0000 7f203659c700 1 -- 172.21.15.79:0/1267007041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2038161260 msgr2=0x7f203814c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.314+0000 7f203659c700 1 --2- 172.21.15.79:0/1267007041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2038161260 0x7f203814c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.314+0000 7f203659c700 1 -- 172.21.15.79:0/1267007041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20380aded0 msgr2=0x7f20380cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.314+0000 7f203659c700 1 --2- 172.21.15.79:0/1267007041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20380aded0 0x7f20380cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.314+0000 7f203659c700 1 -- 172.21.15.79:0/1267007041 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2028009550 con 0x7f203806a760 2023-10-19T08:38:25.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f94b9179700 1 -- 172.21.15.79:0/1889552453 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4025584343 0 0) 0x7f94b40cd750 con 0x7f94b40caca0 2023-10-19T08:38:25.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f94b9179700 1 -- 172.21.15.79:0/1889552453 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94a00035b0 con 0x7f94b40caca0 2023-10-19T08:38:25.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f94b9179700 1 -- 172.21.15.79:0/1889552453 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 764179880 0 0) 0x7f94a00035b0 con 0x7f94b40caca0 2023-10-19T08:38:25.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f94b9179700 1 -- 172.21.15.79:0/1889552453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94b415d2f0 msgr2=0x7f94b40c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:25.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f94b9179700 1 --2- 172.21.15.79:0/1889552453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94b415d2f0 0x7f94b40c3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f94b9179700 1 -- 172.21.15.79:0/1889552453 >> v2:172.21.15.89:3300/0 conn(0x7f94b40710b0 msgr2=0x7f94b415cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:25.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f94b9179700 1 --2- 172.21.15.79:0/1889552453 >> v2:172.21.15.89:3300/0 conn(0x7f94b40710b0 0x7f94b415cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f94b9179700 1 -- 172.21.15.79:0/1889552453 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b40cdfd0 con 0x7f94b40caca0 2023-10-19T08:38:25.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f94b9179700 1 -- 172.21.15.79:0/1889552453 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f94b0001670 con 0x7f94b40caca0 2023-10-19T08:38:25.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.313+0000 7f94b9179700 1 -- 172.21.15.79:0/1889552453 >> v1:172.21.15.79:6789/0 conn(0x7f94b40caca0 legacy=0x7f94b40709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.314+0000 7f94b9179700 1 --2- 172.21.15.79:0/1889552453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94a0003a00 0x7f94a0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.314+0000 7f94b9179700 1 --2- 172.21.15.79:0/1889552453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94a00043f0 0x7f94a00048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.314+0000 7f94b9179700 1 --2- 172.21.15.79:0/1889552453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94a0004e10 0x7f94a0005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.314+0000 7f94b9179700 1 -- 172.21.15.79:0/1889552453 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40cda10 con 0x7f94a0004e10 2023-10-19T08:38:25.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.314+0000 7f94b9179700 1 -- 172.21.15.79:0/1889552453 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40cdcf0 con 0x7f94a00043f0 2023-10-19T08:38:25.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.314+0000 7f94b9179700 1 -- 172.21.15.79:0/1889552453 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a0009e20 con 0x7f94a0003a00 2023-10-19T08:38:25.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.314+0000 7f210559a700 1 -- 172.21.15.79:0/1248552237 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8004230 con 0x7f21080cb6f0 2023-10-19T08:38:25.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.314+0000 7f210559a700 1 -- 172.21.15.79:0/1248552237 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f8004390 con 0x7f21080cb6f0 2023-10-19T08:38:25.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.314+0000 7f210559a700 1 -- 172.21.15.79:0/1248552237 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f80036a0 con 0x7f21080cb6f0 2023-10-19T08:38:25.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.314+0000 7f203659c700 1 --2- 172.21.15.79:0/1267007041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f203806a760 0x7f20380b3790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2028015000 tx=0x7f2028004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.314+0000 7f94ba17b700 1 --2- 172.21.15.79:0/1889552453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94a0003a00 0x7f94a0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f210cb5f700 1 -- 172.21.15.79:0/1248552237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21080cb6f0 msgr2=0x7f21080b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f210cb5f700 1 --2- 172.21.15.79:0/1248552237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21080cb6f0 0x7f21080b04f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f21080ce960 tx=0x7f20f8009b20 comp rx=0 tx=0).stop 2023-10-19T08:38:25.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f210cb5f700 1 -- 172.21.15.79:0/1248552237 shutdown_connections 2023-10-19T08:38:25.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f210cb5f700 1 --2- 172.21.15.79:0/1248552237 >> v2:172.21.15.79:3300/0 conn(0x7f210815e570 0x7f21080d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f210cb5f700 1 --2- 172.21.15.79:0/1248552237 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21080cb6f0 0x7f21080b04f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f210cb5f700 1 -- 172.21.15.79:0/1248552237 >> 172.21.15.79:0/1248552237 conn(0x7f210809a0b0 msgr2=0x7f21080d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:25.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f210cb5f700 1 -- 172.21.15.79:0/1248552237 shutdown_connections 2023-10-19T08:38:25.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.316+0000 7f210cb5f700 1 -- 172.21.15.79:0/1248552237 wait complete. 2023-10-19T08:38:25.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f07b57ae700 1 Processor -- start 2023-10-19T08:38:25.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.316+0000 7f07b57ae700 1 -- start start 2023-10-19T08:38:25.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.314+0000 7f2026ffd700 1 -- 172.21.15.79:0/1267007041 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202800bd90 con 0x7f203806a760 2023-10-19T08:38:25.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f203c885700 1 -- 172.21.15.79:0/1267007041 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203815d630 con 0x7f203806a760 2023-10-19T08:38:25.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f203c885700 1 -- 172.21.15.79:0/1267007041 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20380b3cd0 con 0x7f203806a760 2023-10-19T08:38:25.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.316+0000 7f2026ffd700 1 -- 172.21.15.79:0/1267007041 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202801f070 con 0x7f203806a760 2023-10-19T08:38:25.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.316+0000 7f2026ffd700 1 -- 172.21.15.79:0/1267007041 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20280038e0 con 0x7f203806a760 2023-10-19T08:38:25.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.317+0000 7f210cb5f700 1 Processor -- start 2023-10-19T08:38:25.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.318+0000 7f210cb5f700 1 -- start start 2023-10-19T08:38:25.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f210cb5f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21080b0a30 0x7f21080c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f210cb5f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21080cb6f0 0x7f210806bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f210cb5f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f210815e570 0x7f210806c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f210cb5f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21080c5930 con 0x7f21080cb6f0 2023-10-19T08:38:25.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f210cb5f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21080cda10 con 0x7f210815e570 2023-10-19T08:38:25.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f210cb5f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21080cd730 con 0x7f21080b0a30 2023-10-19T08:38:25.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.316+0000 7f203c885700 1 -- 172.21.15.79:0/1267007041 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203815db50 con 0x7f203806a760 2023-10-19T08:38:25.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.317+0000 7f94ba17b700 1 -- 172.21.15.79:0/1889552453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94a00043f0 msgr2=0x7f94a00048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:25.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.317+0000 7f94ba17b700 1 --2- 172.21.15.79:0/1889552453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94a00043f0 0x7f94a00048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.317+0000 7f94ba17b700 1 -- 172.21.15.79:0/1889552453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94a0004e10 msgr2=0x7f94a0005290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-19T08:38:25.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.317+0000 7f94ba17b700 1 --2- 172.21.15.79:0/1889552453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94a0004e10 0x7f94a0005290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.317+0000 7f94ba17b700 1 -- 172.21.15.79:0/1889552453 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b40cdfd0 con 0x7f94a0003a00 2023-10-19T08:38:25.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.317+0000 7f94ba17b700 1 --2- 172.21.15.79:0/1889552453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94a0003a00 0x7f94a0003e20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f94b000c290 tx=0x7f94a0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf7e91c03f2ec6d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.317+0000 7f94b9179700 1 -- 172.21.15.79:0/1889552453 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b000cd30 con 0x7f94a0003a00 2023-10-19T08:38:25.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.317+0000 7f94b9179700 1 -- 172.21.15.79:0/1889552453 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b0012420 con 0x7f94a0003a00 2023-10-19T08:38:25.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.317+0000 7f94b9179700 1 -- 172.21.15.79:0/1889552453 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b00127d0 con 0x7f94a0003a00 2023-10-19T08:38:25.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.318+0000 7f94bc3df700 1 -- 172.21.15.79:0/1889552453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94a0003a00 msgr2=0x7f94a0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.318+0000 7f94bc3df700 1 --2- 172.21.15.79:0/1889552453 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94a0003a00 0x7f94a0003e20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f94b000c290 tx=0x7f94a0005880 comp rx=0 tx=0).stop 2023-10-19T08:38:25.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.317+0000 7f07b57ae700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07b006a490 0x7f07b00b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.317+0000 7f07b57ae700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07b006a870 0x7f07b01ff3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.317+0000 7f07b57ae700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07b00d00a0 0x7f07b00c3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.317+0000 7f07b57ae700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b00a74d0 con 0x7f07b006a870 2023-10-19T08:38:25.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.317+0000 7f07b57ae700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b00c71a0 con 0x7f07b00d00a0 2023-10-19T08:38:25.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.317+0000 7f07b57ae700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b0200300 con 0x7f07b006a490 2023-10-19T08:38:25.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.317+0000 7f07ae7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07b006a870 0x7f07b01ff3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.317+0000 7f07ae7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07b006a870 0x7f07b01ff3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46556/0 (socket says 172.21.15.79:46556) 2023-10-19T08:38:25.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.317+0000 7f07ae7fc700 1 -- 172.21.15.79:0/1809322014 learned_addr learned my addr 172.21.15.79:0/1809322014 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:25.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.318+0000 7f07ae7fc700 1 -- 172.21.15.79:0/1809322014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07b006a490 msgr2=0x7f07b00b12d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-19T08:38:25.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.318+0000 7f07ae7fc700 1 --2- 172.21.15.79:0/1809322014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07b006a490 0x7f07b00b12d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.318+0000 7f07ae7fc700 1 -- 172.21.15.79:0/1809322014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07b00d00a0 msgr2=0x7f07b00c3760 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-19T08:38:25.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.318+0000 7f07ae7fc700 1 --2- 172.21.15.79:0/1809322014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07b00d00a0 0x7f07b00c3760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.318+0000 7f07ae7fc700 1 -- 172.21.15.79:0/1809322014 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a8009b30 con 0x7f07b006a870 2023-10-19T08:38:25.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f07ae7fc700 1 --2- 172.21.15.79:0/1809322014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07b006a870 0x7f07b01ff3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f07a400e810 tx=0x7f07a400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f07977fe700 1 -- 172.21.15.79:0/1809322014 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4013610 con 0x7f07b006a870 2023-10-19T08:38:25.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f07977fe700 1 -- 172.21.15.79:0/1809322014 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a4013770 con 0x7f07b006a870 2023-10-19T08:38:25.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f07977fe700 1 -- 172.21.15.79:0/1809322014 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4013b20 con 0x7f07b006a870 2023-10-19T08:38:25.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f07b57ae700 1 -- 172.21.15.79:0/1809322014 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b01ffd40 con 0x7f07b006a870 2023-10-19T08:38:25.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f07b57ae700 1 -- 172.21.15.79:0/1809322014 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b00b1810 con 0x7f07b006a870 2023-10-19T08:38:25.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.314+0000 7f225bc83700 1 Processor -- start 2023-10-19T08:38:25.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.314+0000 7f225bc83700 1 -- start start 2023-10-19T08:38:25.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f225bc83700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22540c24a0 0x7f22540c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f225bc83700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22540c9e20 0x7f22540c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f225bc83700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2254164ab0 0x7f22540c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f225bc83700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22540c4460 con 0x7f22540c24a0 2023-10-19T08:38:25.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f225bc83700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22540c4740 con 0x7f22540c9e20 2023-10-19T08:38:25.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f225bc83700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22540c4a20 con 0x7f2254164ab0 2023-10-19T08:38:25.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f225921e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22540c9e20 0x7f22540c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f2259a1f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22540c24a0 0x7f22540c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f2259a1f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22540c24a0 0x7f22540c73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46552/0 (socket says 172.21.15.79:46552) 2023-10-19T08:38:25.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.315+0000 7f2259a1f700 1 -- 172.21.15.79:0/2197014619 learned_addr learned my addr 172.21.15.79:0/2197014619 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:25.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.316+0000 7f225a220700 1 --2- 172.21.15.79:0/2197014619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2254164ab0 0x7f22540c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.316+0000 7f2259a1f700 1 -- 172.21.15.79:0/2197014619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2254164ab0 msgr2=0x7f22540c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.316+0000 7f2259a1f700 1 --2- 172.21.15.79:0/2197014619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2254164ab0 0x7f22540c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.316+0000 7f2259a1f700 1 -- 172.21.15.79:0/2197014619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22540c9e20 msgr2=0x7f22540c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.316+0000 7f2259a1f700 1 --2- 172.21.15.79:0/2197014619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22540c9e20 0x7f22540c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.316+0000 7f2259a1f700 1 -- 172.21.15.79:0/2197014619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2250009550 con 0x7f22540c24a0 2023-10-19T08:38:25.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f2026ffd700 1 -- 172.21.15.79:0/1267007041 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2028021030 con 0x7f203806a760 2023-10-19T08:38:25.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f2026ffd700 1 --2- 172.21.15.79:0/1267007041 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f201806a0e0 0x7f201806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f2026ffd700 1 -- 172.21.15.79:0/1267007041 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f202808a1c0 con 0x7f203806a760 2023-10-19T08:38:25.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.320+0000 7f2035d9b700 1 --2- 172.21.15.79:0/1267007041 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f201806a0e0 0x7f201806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.320+0000 7f94ba97c700 1 -- 172.21.15.79:0/1889552453 reap_dead start 2023-10-19T08:38:25.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f2105d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21080cb6f0 0x7f210806bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f2105d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21080cb6f0 0x7f210806bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46566/0 (socket says 172.21.15.79:46566) 2023-10-19T08:38:25.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f2105d9b700 1 -- 172.21.15.79:0/3303918058 learned_addr learned my addr 172.21.15.79:0/3303918058 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:25.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.320+0000 7f2105d9b700 1 -- 172.21.15.79:0/3303918058 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21080b0a30 msgr2=0x7f21080c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.320+0000 7f2105d9b700 1 --2- 172.21.15.79:0/3303918058 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21080b0a30 0x7f21080c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.320+0000 7f2105d9b700 1 -- 172.21.15.79:0/3303918058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f210815e570 msgr2=0x7f210806c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.320+0000 7f2105d9b700 1 --2- 172.21.15.79:0/3303918058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f210815e570 0x7f210806c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.320+0000 7f2105d9b700 1 -- 172.21.15.79:0/3303918058 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f80094a0 con 0x7f21080cb6f0 2023-10-19T08:38:25.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.321+0000 7f2105d9b700 1 --2- 172.21.15.79:0/3303918058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21080cb6f0 0x7f210806bb00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009b60 tx=0x7f20f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.316+0000 7f225921e700 1 --2- 172.21.15.79:0/2197014619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22540c9e20 0x7f22540c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:25.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.316+0000 7f2259a1f700 1 --2- 172.21.15.79:0/2197014619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22540c24a0 0x7f22540c73f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f224400b450 tx=0x7f224400b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f224a7fc700 1 -- 172.21.15.79:0/2197014619 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244011830 con 0x7f22540c24a0 2023-10-19T08:38:25.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f224a7fc700 1 -- 172.21.15.79:0/2197014619 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22440119b0 con 0x7f22540c24a0 2023-10-19T08:38:25.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f224a7fc700 1 -- 172.21.15.79:0/2197014619 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244011d60 con 0x7f22540c24a0 2023-10-19T08:38:25.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f225bc83700 1 -- 172.21.15.79:0/2197014619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22540c4d00 con 0x7f22540c24a0 2023-10-19T08:38:25.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.319+0000 7f225bc83700 1 -- 172.21.15.79:0/2197014619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22540c1730 con 0x7f22540c24a0 2023-10-19T08:38:25.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.320+0000 7f225bc83700 1 -- 172.21.15.79:0/2197014619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22540cd5f0 con 0x7f22540c24a0 2023-10-19T08:38:25.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.322+0000 7f224a7fc700 1 -- 172.21.15.79:0/2197014619 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f224401a400 con 0x7f22540c24a0 2023-10-19T08:38:25.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.323+0000 7f224a7fc700 1 --2- 172.21.15.79:0/2197014619 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f223806a1b0 0x7f223806c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.323+0000 7f224a7fc700 1 -- 172.21.15.79:0/2197014619 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2244088f00 con 0x7f22540c24a0 2023-10-19T08:38:25.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.323+0000 7f225921e700 1 --2- 172.21.15.79:0/2197014619 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f223806a1b0 0x7f223806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.320+0000 7f94bc3df700 1 -- 172.21.15.79:0/1889552453 shutdown_connections 2023-10-19T08:38:25.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.320+0000 7f94bc3df700 1 -- 172.21.15.79:0/1889552453 >> 172.21.15.79:0/1889552453 conn(0x7f94b40cb3e0 msgr2=0x7f94b40cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:25.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.320+0000 7f94bc3df700 1 -- 172.21.15.79:0/1889552453 shutdown_connections 2023-10-19T08:38:25.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.321+0000 7f94bc3df700 1 -- 172.21.15.79:0/1889552453 wait complete. 2023-10-19T08:38:25.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.322+0000 7f94bc3df700 1 Processor -- start 2023-10-19T08:38:25.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.323+0000 7f07b57ae700 1 -- 172.21.15.79:0/1809322014 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07900052f0 con 0x7f07b006a870 2023-10-19T08:38:25.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.324+0000 7f225921e700 1 --2- 172.21.15.79:0/2197014619 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f223806a1b0 0x7f223806c670 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f22540c28a0 tx=0x7f2250008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.324+0000 7f2035d9b700 1 --2- 172.21.15.79:0/1267007041 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f201806a0e0 0x7f201806c5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f202c007fd0 tx=0x7f202c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.324+0000 7f2026ffd700 1 -- 172.21.15.79:0/1267007041 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f203815db50 con 0x7f203806a760 2023-10-19T08:38:25.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.322+0000 7f94bc3df700 1 -- start start 2023-10-19T08:38:25.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.323+0000 7f94bc3df700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94b40c84f0 0x7f94b4159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.323+0000 7f94bc3df700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94b40b4450 0x7f94b406dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.323+0000 7f94bc3df700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94b406ee60 0x7f94b406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.324+0000 7f94bc3df700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b41ee300 con 0x7f94b40c84f0 2023-10-19T08:38:25.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.324+0000 7f94bc3df700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40c5da0 con 0x7f94b40b4450 2023-10-19T08:38:25.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.324+0000 7f94bc3df700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40c6080 con 0x7f94b406ee60 2023-10-19T08:38:25.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.324+0000 7f94ba17b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94b40c84f0 0x7f94b4159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.324+0000 7f94ba17b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94b40c84f0 0x7f94b4159560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46574/0 (socket says 172.21.15.79:46574) 2023-10-19T08:38:25.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.324+0000 7f94ba17b700 1 -- 172.21.15.79:0/1020067348 learned_addr learned my addr 172.21.15.79:0/1020067348 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:25.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.324+0000 7f94ba17b700 1 -- 172.21.15.79:0/1020067348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94b406ee60 msgr2=0x7f94b406e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.324+0000 7f94ba17b700 1 --2- 172.21.15.79:0/1020067348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94b406ee60 0x7f94b406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.324+0000 7f94ba17b700 1 -- 172.21.15.79:0/1020067348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94b40b4450 msgr2=0x7f94b406dfb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-19T08:38:25.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.324+0000 7f94ba17b700 1 --2- 172.21.15.79:0/1020067348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94b40b4450 0x7f94b406dfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.324+0000 7f94ba17b700 1 -- 172.21.15.79:0/1020067348 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b40c6360 con 0x7f94b40c84f0 2023-10-19T08:38:25.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.324+0000 7f94ba17b700 1 --2- 172.21.15.79:0/1020067348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94b40c84f0 0x7f94b4159560 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f94a0009fb0 tx=0x7f94b0001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.330+0000 7f224a7fc700 1 -- 172.21.15.79:0/2197014619 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2244054390 con 0x7f22540c24a0 2023-10-19T08:38:25.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.332+0000 7f07977fe700 1 -- 172.21.15.79:0/1809322014 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f07a4013c80 con 0x7f07b006a870 2023-10-19T08:38:25.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.333+0000 7f07977fe700 1 --2- 172.21.15.79:0/1809322014 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f079c06a130 0x7f079c06c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.333+0000 7f07977fe700 1 -- 172.21.15.79:0/1809322014 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f07a40889c0 con 0x7f07b006a870 2023-10-19T08:38:25.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.333+0000 7f20f6ffd700 1 -- 172.21.15.79:0/3303918058 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8011630 con 0x7f21080cb6f0 2023-10-19T08:38:25.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.333+0000 7f20f6ffd700 1 -- 172.21.15.79:0/3303918058 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f801e070 con 0x7f21080cb6f0 2023-10-19T08:38:25.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.333+0000 7f20f6ffd700 1 -- 172.21.15.79:0/3303918058 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f80119b0 con 0x7f21080cb6f0 2023-10-19T08:38:25.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.333+0000 7f07aeffd700 1 --2- 172.21.15.79:0/1809322014 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f079c06a130 0x7f079c06c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.334+0000 7f07aeffd700 1 --2- 172.21.15.79:0/1809322014 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f079c06a130 0x7f079c06c5f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07a800b370 tx=0x7f07a8009000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.334+0000 7f210cb5f700 1 -- 172.21.15.79:0/3303918058 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21080c5270 con 0x7f21080cb6f0 2023-10-19T08:38:25.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.334+0000 7f210cb5f700 1 -- 172.21.15.79:0/3303918058 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21080c6290 con 0x7f21080cb6f0 2023-10-19T08:38:25.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.336+0000 7f210cb5f700 1 -- 172.21.15.79:0/3303918058 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ec0052f0 con 0x7f21080cb6f0 2023-10-19T08:38:25.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.336+0000 7f94aaffd700 1 -- 172.21.15.79:0/1020067348 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b00054e0 con 0x7f94b40c84f0 2023-10-19T08:38:25.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.336+0000 7f94aaffd700 1 -- 172.21.15.79:0/1020067348 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b0001c70 con 0x7f94b40c84f0 2023-10-19T08:38:25.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.336+0000 7f94aaffd700 1 -- 172.21.15.79:0/1020067348 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0006aa0 con 0x7f94b40c84f0 2023-10-19T08:38:25.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.336+0000 7f94bc3df700 1 -- 172.21.15.79:0/1020067348 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b40c6640 con 0x7f94b40c84f0 2023-10-19T08:38:25.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.336+0000 7f94bc3df700 1 -- 172.21.15.79:0/1020067348 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b40c5a30 con 0x7f94b40c84f0 2023-10-19T08:38:25.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.340+0000 7f07977fe700 1 -- 172.21.15.79:0/1809322014 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f07a4053da0 con 0x7f07b006a870 2023-10-19T08:38:25.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.349+0000 7f20f6ffd700 1 -- 172.21.15.79:0/3303918058 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f20f8011b10 con 0x7f21080cb6f0 2023-10-19T08:38:25.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.349+0000 7f20f6ffd700 1 --2- 172.21.15.79:0/3303918058 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f20e806a130 0x7f20e806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.349+0000 7f20f6ffd700 1 -- 172.21.15.79:0/3303918058 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f20f8089c40 con 0x7f21080cb6f0 2023-10-19T08:38:25.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.351+0000 7f210659c700 1 --2- 172.21.15.79:0/3303918058 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f20e806a130 0x7f20e806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.352+0000 7f210659c700 1 --2- 172.21.15.79:0/3303918058 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f20e806a130 0x7f20e806c5f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f20fc006fd0 tx=0x7f20fc006f20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.347+0000 7f94aaffd700 1 -- 172.21.15.79:0/1020067348 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f94b0022070 con 0x7f94b40c84f0 2023-10-19T08:38:25.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.348+0000 7f94aaffd700 1 --2- 172.21.15.79:0/1020067348 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f949806a1b0 0x7f949806c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.348+0000 7f94aaffd700 1 -- 172.21.15.79:0/1020067348 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f94b0089a40 con 0x7f94b40c84f0 2023-10-19T08:38:25.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.353+0000 7f20f6ffd700 1 -- 172.21.15.79:0/3303918058 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f20f80550b0 con 0x7f21080cb6f0 2023-10-19T08:38:25.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.354+0000 7f94b997a700 1 --2- 172.21.15.79:0/1020067348 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f949806a1b0 0x7f949806c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.354+0000 7f94b997a700 1 --2- 172.21.15.79:0/1020067348 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f949806a1b0 0x7f949806c670 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f94a4006dd0 tx=0x7f94a4006d60 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.357+0000 7f94bc3df700 1 -- 172.21.15.79:0/1020067348 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949c0052f0 con 0x7f94b40c84f0 2023-10-19T08:38:25.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.367+0000 7f94aaffd700 1 -- 172.21.15.79:0/1020067348 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f94b0054eb0 con 0x7f94b40c84f0 2023-10-19T08:38:25.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.413+0000 7f3564d4f700 1 Processor -- start 2023-10-19T08:38:25.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.413+0000 7f3564d4f700 1 -- start start 2023-10-19T08:38:25.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.414+0000 7f3564d4f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f35600caca0 0x7f35600709a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.414+0000 7f3564d4f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f356015d4c0 0x7f35600c3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.414+0000 7f3564d4f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356015d8d0 con 0x7f3560070ee0 2023-10-19T08:38:25.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.414+0000 7f3564d4f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3560071390 con 0x7f35600caca0 2023-10-19T08:38:25.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.414+0000 7f3564d4f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35600cd750 con 0x7f356015d4c0 2023-10-19T08:38:25.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.415+0000 7f355e59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f35600caca0 0x7f35600709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.416+0000 7f355e59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f35600caca0 0x7f35600709a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46582/0 (socket says 172.21.15.79:46582) 2023-10-19T08:38:25.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.416+0000 7f355e59c700 1 -- 172.21.15.79:0/3344925292 learned_addr learned my addr 172.21.15.79:0/3344925292 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:25.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.416+0000 7f355e59c700 1 -- 172.21.15.79:0/3344925292 >> v2:172.21.15.89:3300/0 conn(0x7f356015d4c0 msgr2=0x7f35600c3840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-19T08:38:25.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.416+0000 7f355e59c700 1 --2- 172.21.15.79:0/3344925292 >> v2:172.21.15.89:3300/0 conn(0x7f356015d4c0 0x7f35600c3840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.416+0000 7f355e59c700 1 -- 172.21.15.79:0/3344925292 >> v1:172.21.15.79:6789/0 conn(0x7f3560070ee0 legacy=0x7f356015cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:25.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.416+0000 7f355e59c700 1 -- 172.21.15.79:0/3344925292 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35600cda10 con 0x7f35600caca0 2023-10-19T08:38:25.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.416+0000 7f355e59c700 1 --2- 172.21.15.79:0/3344925292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35600caca0 0x7f35600709a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f35600c8f10 tx=0x7f355800d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec43c2caf878ef1 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.417+0000 7f355d59a700 1 -- 172.21.15.79:0/3344925292 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558010070 con 0x7f35600caca0 2023-10-19T08:38:25.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.417+0000 7f355d59a700 1 -- 172.21.15.79:0/3344925292 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355800dca0 con 0x7f35600caca0 2023-10-19T08:38:25.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.417+0000 7f355d59a700 1 -- 172.21.15.79:0/3344925292 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558007d70 con 0x7f35600caca0 2023-10-19T08:38:25.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.418+0000 7f3564d4f700 1 -- 172.21.15.79:0/3344925292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35600caca0 msgr2=0x7f35600709a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.418+0000 7f3564d4f700 1 --2- 172.21.15.79:0/3344925292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35600caca0 0x7f35600709a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f35600c8f10 tx=0x7f355800d650 comp rx=0 tx=0).stop 2023-10-19T08:38:25.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.419+0000 7f3564d4f700 1 -- 172.21.15.79:0/3344925292 shutdown_connections 2023-10-19T08:38:25.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.419+0000 7f3564d4f700 1 --2- 172.21.15.79:0/3344925292 >> v2:172.21.15.89:3300/0 conn(0x7f356015d4c0 0x7f35600c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.419+0000 7f3564d4f700 1 --2- 172.21.15.79:0/3344925292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35600caca0 0x7f35600709a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.419+0000 7f3564d4f700 1 -- 172.21.15.79:0/3344925292 >> 172.21.15.79:0/3344925292 conn(0x7f35600cb3e0 msgr2=0x7f35600cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:25.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.420+0000 7f3564d4f700 1 -- 172.21.15.79:0/3344925292 shutdown_connections 2023-10-19T08:38:25.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.420+0000 7f3564d4f700 1 -- 172.21.15.79:0/3344925292 wait complete. 2023-10-19T08:38:25.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.422+0000 7f3564d4f700 1 Processor -- start 2023-10-19T08:38:25.427 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.422+0000 7f3564d4f700 1 -- start start 2023-10-19T08:38:25.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.423+0000 7f3564d4f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3560070ee0 0x7f35600c5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.423+0000 7f3564d4f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35600caca0 0x7f35600afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.423+0000 7f3564d4f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356015d4c0 0x7f35600c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.423+0000 7f3564d4f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35602031a0 con 0x7f35600caca0 2023-10-19T08:38:25.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.423+0000 7f3564d4f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3560203480 con 0x7f356015d4c0 2023-10-19T08:38:25.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.423+0000 7f3564d4f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3560203760 con 0x7f3560070ee0 2023-10-19T08:38:25.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.424+0000 7f355e59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3560070ee0 0x7f35600c5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.424+0000 7f355dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35600caca0 0x7f35600afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.424+0000 7f355e59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3560070ee0 0x7f35600c5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:49212/0 (socket says 172.21.15.79:49212) 2023-10-19T08:38:25.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.424+0000 7f355e59c700 1 -- 172.21.15.79:0/1435199947 learned_addr learned my addr 172.21.15.79:0/1435199947 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:25.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.424+0000 7f355ed9d700 1 --2- 172.21.15.79:0/1435199947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356015d4c0 0x7f35600c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.424+0000 7f355dd9b700 1 -- 172.21.15.79:0/1435199947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3560070ee0 msgr2=0x7f35600c5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.424+0000 7f355dd9b700 1 --2- 172.21.15.79:0/1435199947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3560070ee0 0x7f35600c5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.424+0000 7f355dd9b700 1 -- 172.21.15.79:0/1435199947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356015d4c0 msgr2=0x7f35600c73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.424+0000 7f355dd9b700 1 --2- 172.21.15.79:0/1435199947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356015d4c0 0x7f35600c73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.425+0000 7f355dd9b700 1 -- 172.21.15.79:0/1435199947 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355800d050 con 0x7f35600caca0 2023-10-19T08:38:25.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.425+0000 7f355dd9b700 1 --2- 172.21.15.79:0/1435199947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35600caca0 0x7f35600afd10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f355000c3e0 tx=0x7f355000c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.434+0000 7f354effd700 1 -- 172.21.15.79:0/1435199947 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000cea0 con 0x7f35600caca0 2023-10-19T08:38:25.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.434+0000 7f354effd700 1 -- 172.21.15.79:0/1435199947 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3550005500 con 0x7f35600caca0 2023-10-19T08:38:25.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.434+0000 7f354effd700 1 -- 172.21.15.79:0/1435199947 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35500038c0 con 0x7f35600caca0 2023-10-19T08:38:25.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.435+0000 7f3564d4f700 1 -- 172.21.15.79:0/1435199947 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3560203a40 con 0x7f35600caca0 2023-10-19T08:38:25.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.435+0000 7f3564d4f700 1 -- 172.21.15.79:0/1435199947 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3560202e50 con 0x7f35600caca0 2023-10-19T08:38:25.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.438+0000 7f354effd700 1 -- 172.21.15.79:0/1435199947 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3550003a20 con 0x7f35600caca0 2023-10-19T08:38:25.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.438+0000 7f354effd700 1 --2- 172.21.15.79:0/1435199947 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f354006a1b0 0x7f354006c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.439+0000 7f354effd700 1 -- 172.21.15.79:0/1435199947 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3550087ca0 con 0x7f35600caca0 2023-10-19T08:38:25.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.439+0000 7f355e59c700 1 --2- 172.21.15.79:0/1435199947 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f354006a1b0 0x7f354006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.440+0000 7f355e59c700 1 --2- 172.21.15.79:0/1435199947 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f354006a1b0 0x7f354006c670 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3558007210 tx=0x7f3558012000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.447+0000 7f3564d4f700 1 -- 172.21.15.79:0/1435199947 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356004ee70 con 0x7f35600caca0 2023-10-19T08:38:25.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.458+0000 7f354effd700 1 -- 172.21.15.79:0/1435199947 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f3550056b10 con 0x7f35600caca0 2023-10-19T08:38:25.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.682+0000 7fadf947c700 1 -- 172.21.15.79:0/1927560535 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fade00055d0 con 0x7fadf40caca0 2023-10-19T08:38:25.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.682+0000 7faddb7fe700 1 -- 172.21.15.79:0/1927560535 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fadec058e00 con 0x7fadf40caca0 2023-10-19T08:38:25.689 INFO:teuthology.orchestra.run.smithi079.stdout:55834574859 2023-10-19T08:38:25.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.686+0000 7fadf947c700 1 -- 172.21.15.79:0/1927560535 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faddc06a330 msgr2=0x7faddc06c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.686+0000 7fadf947c700 1 --2- 172.21.15.79:0/1927560535 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faddc06a330 0x7faddc06c7f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fade8007fd0 tx=0x7fade8007ec0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.686+0000 7fadf947c700 1 -- 172.21.15.79:0/1927560535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf40caca0 msgr2=0x7fadf4157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.686+0000 7fadf947c700 1 --2- 172.21.15.79:0/1927560535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf40caca0 0x7fadf4157910 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fadec00d6c0 tx=0x7fadec004ad0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.686+0000 7fadf947c700 1 -- 172.21.15.79:0/1927560535 shutdown_connections 2023-10-19T08:38:25.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.686+0000 7fadf947c700 1 --2- 172.21.15.79:0/1927560535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf415d2f0 0x7fadf4155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.686+0000 7fadf947c700 1 --2- 172.21.15.79:0/1927560535 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faddc06a330 0x7faddc06c7f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.686+0000 7fadf947c700 1 --2- 172.21.15.79:0/1927560535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf40710b0 0x7fadf406ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.687+0000 7fadf947c700 1 --2- 172.21.15.79:0/1927560535 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf40caca0 0x7fadf4157910 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.687+0000 7fadf947c700 1 -- 172.21.15.79:0/1927560535 >> 172.21.15.79:0/1927560535 conn(0x7fadf40cb3e0 msgr2=0x7fadf406aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:25.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.687+0000 7fadf947c700 1 -- 172.21.15.79:0/1927560535 shutdown_connections 2023-10-19T08:38:25.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.687+0000 7fadf947c700 1 -- 172.21.15.79:0/1927560535 wait complete. 2023-10-19T08:38:25.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.700+0000 7feafec90700 1 -- 172.21.15.79:0/2844911992 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7feaf81ff6d0 con 0x7feaf80b4aa0 2023-10-19T08:38:25.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.700+0000 7feaf57fa700 1 -- 172.21.15.79:0/2844911992 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feaf81ff6d0 con 0x7feaf80b4aa0 2023-10-19T08:38:25.706 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2023-10-19T08:38:25.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.705+0000 7feafec90700 1 -- 172.21.15.79:0/2844911992 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7feae406a130 msgr2=0x7feae406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.705+0000 7feafec90700 1 --2- 172.21.15.79:0/2844911992 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7feae406a130 0x7feae406c5f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7feaf00113e0 tx=0x7feaf000b040 comp rx=0 tx=0).stop 2023-10-19T08:38:25.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.705+0000 7feafec90700 1 -- 172.21.15.79:0/2844911992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80b4aa0 msgr2=0x7feaf81ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.705+0000 7feafec90700 1 --2- 172.21.15.79:0/2844911992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80b4aa0 0x7feaf81ff9b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feaec009b60 tx=0x7feaec004750 comp rx=0 tx=0).stop 2023-10-19T08:38:25.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.5 2023-10-19T08:38:25.711 DEBUG:teuthology.parallel:result is None 2023-10-19T08:38:25.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.705+0000 7feafec90700 1 -- 172.21.15.79:0/2844911992 shutdown_connections 2023-10-19T08:38:25.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.705+0000 7feafec90700 1 --2- 172.21.15.79:0/2844911992 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7feae406a130 0x7feae406c5f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.705+0000 7feafec90700 1 --2- 172.21.15.79:0/2844911992 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feaf815c020 0x7feaf81fe5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.705+0000 7feafec90700 1 --2- 172.21.15.79:0/2844911992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feaf80b0f90 0x7feaf80c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.705+0000 7feafec90700 1 --2- 172.21.15.79:0/2844911992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feaf80b4aa0 0x7feaf81ff9b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.705+0000 7feafec90700 1 -- 172.21.15.79:0/2844911992 >> 172.21.15.79:0/2844911992 conn(0x7feaf80cefd0 msgr2=0x7feaf80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:25.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.705+0000 7feafec90700 1 -- 172.21.15.79:0/2844911992 shutdown_connections 2023-10-19T08:38:25.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.705+0000 7feafec90700 1 -- 172.21.15.79:0/2844911992 wait complete. 2023-10-19T08:38:25.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.711+0000 7f203c885700 1 -- 172.21.15.79:0/1267007041 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f203815db50 con 0x7f203806a760 2023-10-19T08:38:25.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.713+0000 7f2026ffd700 1 -- 172.21.15.79:0/1267007041 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f203815db50 con 0x7f203806a760 2023-10-19T08:38:25.717 INFO:teuthology.orchestra.run.smithi079.stdout:55834574857 2023-10-19T08:38:25.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.716+0000 7f203c885700 1 -- 172.21.15.79:0/1267007041 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f201806a0e0 msgr2=0x7f201806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.716+0000 7f203c885700 1 --2- 172.21.15.79:0/1267007041 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f201806a0e0 0x7f201806c5a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f202c007fd0 tx=0x7f202c009040 comp rx=0 tx=0).stop 2023-10-19T08:38:25.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.716+0000 7f203c885700 1 -- 172.21.15.79:0/1267007041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f203806a760 msgr2=0x7f20380b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.716+0000 7f203c885700 1 --2- 172.21.15.79:0/1267007041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f203806a760 0x7f20380b3790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2028015000 tx=0x7f2028004750 comp rx=0 tx=0).stop 2023-10-19T08:38:25.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.717+0000 7f203c885700 1 -- 172.21.15.79:0/1267007041 shutdown_connections 2023-10-19T08:38:25.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.717+0000 7f203c885700 1 --2- 172.21.15.79:0/1267007041 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2038161260 0x7f203814c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.717+0000 7f203c885700 1 --2- 172.21.15.79:0/1267007041 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f201806a0e0 0x7f201806c5a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.717+0000 7f203c885700 1 --2- 172.21.15.79:0/1267007041 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f203806a760 0x7f20380b3790 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.717+0000 7f203c885700 1 --2- 172.21.15.79:0/1267007041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20380aded0 0x7f20380cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.717+0000 7f203c885700 1 -- 172.21.15.79:0/1267007041 >> 172.21.15.79:0/1267007041 conn(0x7f20380ce960 msgr2=0x7f20380aecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:25.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.717+0000 7f203c885700 1 -- 172.21.15.79:0/1267007041 shutdown_connections 2023-10-19T08:38:25.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.722+0000 7f203c885700 1 -- 172.21.15.79:0/1267007041 wait complete. 2023-10-19T08:38:25.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2023-10-19T08:38:25.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.724+0000 7f225bc83700 1 -- 172.21.15.79:0/2197014619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f22540c45a0 con 0x7f22540c24a0 2023-10-19T08:38:25.728 DEBUG:teuthology.parallel:result is None 2023-10-19T08:38:25.729 INFO:teuthology.orchestra.run.smithi079.stdout:55834574859 2023-10-19T08:38:25.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.725+0000 7f224a7fc700 1 -- 172.21.15.79:0/2197014619 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2244015020 con 0x7f22540c24a0 2023-10-19T08:38:25.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.728+0000 7f225bc83700 1 -- 172.21.15.79:0/2197014619 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f223806a1b0 msgr2=0x7f223806c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.728+0000 7f225bc83700 1 --2- 172.21.15.79:0/2197014619 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f223806a1b0 0x7f223806c670 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f22540c28a0 tx=0x7f2250008030 comp rx=0 tx=0).stop 2023-10-19T08:38:25.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.728+0000 7f225bc83700 1 -- 172.21.15.79:0/2197014619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22540c24a0 msgr2=0x7f22540c73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.728+0000 7f225bc83700 1 --2- 172.21.15.79:0/2197014619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22540c24a0 0x7f22540c73f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f224400b450 tx=0x7f224400b760 comp rx=0 tx=0).stop 2023-10-19T08:38:25.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.728+0000 7f225bc83700 1 -- 172.21.15.79:0/2197014619 shutdown_connections 2023-10-19T08:38:25.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.728+0000 7f225bc83700 1 --2- 172.21.15.79:0/2197014619 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f223806a1b0 0x7f223806c670 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.728+0000 7f225bc83700 1 --2- 172.21.15.79:0/2197014619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2254164ab0 0x7f22540c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.728+0000 7f225bc83700 1 --2- 172.21.15.79:0/2197014619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22540c24a0 0x7f22540c73f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.728+0000 7f225bc83700 1 --2- 172.21.15.79:0/2197014619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22540c9e20 0x7f22540c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.728+0000 7f225bc83700 1 -- 172.21.15.79:0/2197014619 >> 172.21.15.79:0/2197014619 conn(0x7f225406d000 msgr2=0x7f22540caec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:25.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.728+0000 7f225bc83700 1 -- 172.21.15.79:0/2197014619 shutdown_connections 2023-10-19T08:38:25.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.728+0000 7f225bc83700 1 -- 172.21.15.79:0/2197014619 wait complete. 2023-10-19T08:38:25.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.732+0000 7f07b57ae700 1 -- 172.21.15.79:0/1809322014 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0790005870 con 0x7f07b006a870 2023-10-19T08:38:25.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.733+0000 7f07977fe700 1 -- 172.21.15.79:0/1809322014 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f07a40573c0 con 0x7f07b006a870 2023-10-19T08:38:25.736 INFO:teuthology.orchestra.run.smithi079.stdout:55834574858 2023-10-19T08:38:25.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.735+0000 7f07b57ae700 1 -- 172.21.15.79:0/1809322014 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f079c06a130 msgr2=0x7f079c06c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.735+0000 7f07b57ae700 1 --2- 172.21.15.79:0/1809322014 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f079c06a130 0x7f079c06c5f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f07a800b370 tx=0x7f07a8009000 comp rx=0 tx=0).stop 2023-10-19T08:38:25.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.735+0000 7f07b57ae700 1 -- 172.21.15.79:0/1809322014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07b006a870 msgr2=0x7f07b01ff3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.735+0000 7f07b57ae700 1 --2- 172.21.15.79:0/1809322014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07b006a870 0x7f07b01ff3c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f07a400e810 tx=0x7f07a400ebd0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.739+0000 7f07b57ae700 1 -- 172.21.15.79:0/1809322014 shutdown_connections 2023-10-19T08:38:25.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.739+0000 7f07b57ae700 1 --2- 172.21.15.79:0/1809322014 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07b00d00a0 0x7f07b00c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.739+0000 7f07b57ae700 1 --2- 172.21.15.79:0/1809322014 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f079c06a130 0x7f079c06c5f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.739+0000 7f07b57ae700 1 --2- 172.21.15.79:0/1809322014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07b006a490 0x7f07b00b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.739+0000 7f07b57ae700 1 --2- 172.21.15.79:0/1809322014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07b006a870 0x7f07b01ff3c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.739+0000 7f07b57ae700 1 -- 172.21.15.79:0/1809322014 >> 172.21.15.79:0/1809322014 conn(0x7f07b006b330 msgr2=0x7f07b00d04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:25.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.739+0000 7f210cb5f700 1 -- 172.21.15.79:0/3303918058 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f20ec005870 con 0x7f21080cb6f0 2023-10-19T08:38:25.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.740+0000 7f20f6ffd700 1 -- 172.21.15.79:0/3303918058 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f20f80586d0 con 0x7f21080cb6f0 2023-10-19T08:38:25.748 INFO:teuthology.orchestra.run.smithi079.stdout:55834574859 2023-10-19T08:38:25.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.1 2023-10-19T08:38:25.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.742+0000 7f07b57ae700 1 -- 172.21.15.79:0/1809322014 shutdown_connections 2023-10-19T08:38:25.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.742+0000 7f07b57ae700 1 -- 172.21.15.79:0/1809322014 wait complete. 2023-10-19T08:38:25.750 DEBUG:teuthology.parallel:result is None 2023-10-19T08:38:25.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.743+0000 7f210cb5f700 1 -- 172.21.15.79:0/3303918058 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f20e806a130 msgr2=0x7f20e806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.743+0000 7f210cb5f700 1 --2- 172.21.15.79:0/3303918058 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f20e806a130 0x7f20e806c5f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f20fc006fd0 tx=0x7f20fc006f20 comp rx=0 tx=0).stop 2023-10-19T08:38:25.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.743+0000 7f210cb5f700 1 -- 172.21.15.79:0/3303918058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21080cb6f0 msgr2=0x7f210806bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.743+0000 7f210cb5f700 1 --2- 172.21.15.79:0/3303918058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21080cb6f0 0x7f210806bb00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009b60 tx=0x7f20f8004750 comp rx=0 tx=0).stop 2023-10-19T08:38:25.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.747+0000 7f210cb5f700 1 -- 172.21.15.79:0/3303918058 shutdown_connections 2023-10-19T08:38:25.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.747+0000 7f210cb5f700 1 --2- 172.21.15.79:0/3303918058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f210815e570 0x7f210806c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.747+0000 7f210cb5f700 1 --2- 172.21.15.79:0/3303918058 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f20e806a130 0x7f20e806c5f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.747+0000 7f210cb5f700 1 --2- 172.21.15.79:0/3303918058 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21080b0a30 0x7f21080c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.747+0000 7f210cb5f700 1 --2- 172.21.15.79:0/3303918058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21080cb6f0 0x7f210806bb00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.747+0000 7f210cb5f700 1 -- 172.21.15.79:0/3303918058 >> 172.21.15.79:0/3303918058 conn(0x7f210809a0b0 msgr2=0x7f21080c7290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:25.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.747+0000 7f210cb5f700 1 -- 172.21.15.79:0/3303918058 shutdown_connections 2023-10-19T08:38:25.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.747+0000 7f210cb5f700 1 -- 172.21.15.79:0/3303918058 wait complete. 2023-10-19T08:38:25.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.2 2023-10-19T08:38:25.754 DEBUG:teuthology.parallel:result is None 2023-10-19T08:38:25.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.752+0000 7f94bc3df700 1 -- 172.21.15.79:0/1020067348 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f949c0055a0 con 0x7f94b40c84f0 2023-10-19T08:38:25.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.752+0000 7f94aaffd700 1 -- 172.21.15.79:0/1020067348 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f94b00584d0 con 0x7f94b40c84f0 2023-10-19T08:38:25.756 INFO:teuthology.orchestra.run.smithi079.stdout:55834574859 2023-10-19T08:38:25.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.755+0000 7f94bc3df700 1 -- 172.21.15.79:0/1020067348 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f949806a1b0 msgr2=0x7f949806c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.755+0000 7f94bc3df700 1 --2- 172.21.15.79:0/1020067348 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f949806a1b0 0x7f949806c670 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f94a4006dd0 tx=0x7f94a4006d60 comp rx=0 tx=0).stop 2023-10-19T08:38:25.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.755+0000 7f94bc3df700 1 -- 172.21.15.79:0/1020067348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94b40c84f0 msgr2=0x7f94b4159560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.755+0000 7f94bc3df700 1 --2- 172.21.15.79:0/1020067348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94b40c84f0 0x7f94b4159560 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f94a0009fb0 tx=0x7f94b0001930 comp rx=0 tx=0).stop 2023-10-19T08:38:25.760 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.6 2023-10-19T08:38:25.760 DEBUG:teuthology.parallel:result is None 2023-10-19T08:38:25.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.756+0000 7f94bc3df700 1 -- 172.21.15.79:0/1020067348 shutdown_connections 2023-10-19T08:38:25.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.756+0000 7f94bc3df700 1 --2- 172.21.15.79:0/1020067348 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f949806a1b0 0x7f949806c670 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.756+0000 7f94bc3df700 1 --2- 172.21.15.79:0/1020067348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94b406ee60 0x7f94b406e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.756+0000 7f94bc3df700 1 --2- 172.21.15.79:0/1020067348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94b40c84f0 0x7f94b4159560 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.756+0000 7f94bc3df700 1 --2- 172.21.15.79:0/1020067348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94b40b4450 0x7f94b406dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.756+0000 7f94bc3df700 1 -- 172.21.15.79:0/1020067348 >> 172.21.15.79:0/1020067348 conn(0x7f94b40cb3e0 msgr2=0x7f94b4154690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:25.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.756+0000 7f94bc3df700 1 -- 172.21.15.79:0/1020067348 shutdown_connections 2023-10-19T08:38:25.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.756+0000 7f94bc3df700 1 -- 172.21.15.79:0/1020067348 wait complete. 2023-10-19T08:38:25.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.0 2023-10-19T08:38:25.765 DEBUG:teuthology.parallel:result is None 2023-10-19T08:38:25.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.3 2023-10-19T08:38:25.772 DEBUG:teuthology.parallel:result is None 2023-10-19T08:38:25.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.802+0000 7f3564d4f700 1 -- 172.21.15.79:0/1435199947 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f35600c9bd0 con 0x7f35600caca0 2023-10-19T08:38:25.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.802+0000 7f354effd700 1 -- 172.21.15.79:0/1435199947 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3550017070 con 0x7f35600caca0 2023-10-19T08:38:25.806 INFO:teuthology.orchestra.run.smithi079.stdout:55834574859 2023-10-19T08:38:25.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.804+0000 7f3564d4f700 1 -- 172.21.15.79:0/1435199947 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f354006a1b0 msgr2=0x7f354006c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.804+0000 7f3564d4f700 1 --2- 172.21.15.79:0/1435199947 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f354006a1b0 0x7f354006c670 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3558007210 tx=0x7f3558012000 comp rx=0 tx=0).stop 2023-10-19T08:38:25.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.804+0000 7f3564d4f700 1 -- 172.21.15.79:0/1435199947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35600caca0 msgr2=0x7f35600afd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.804+0000 7f3564d4f700 1 --2- 172.21.15.79:0/1435199947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35600caca0 0x7f35600afd10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f355000c3e0 tx=0x7f355000c6f0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.804+0000 7f3564d4f700 1 -- 172.21.15.79:0/1435199947 shutdown_connections 2023-10-19T08:38:25.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.804+0000 7f3564d4f700 1 --2- 172.21.15.79:0/1435199947 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f356015d4c0 0x7f35600c73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.804+0000 7f3564d4f700 1 --2- 172.21.15.79:0/1435199947 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f354006a1b0 0x7f354006c670 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.804+0000 7f3564d4f700 1 --2- 172.21.15.79:0/1435199947 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3560070ee0 0x7f35600c5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.804+0000 7f3564d4f700 1 --2- 172.21.15.79:0/1435199947 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35600caca0 0x7f35600afd10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.804+0000 7f3564d4f700 1 -- 172.21.15.79:0/1435199947 >> 172.21.15.79:0/1435199947 conn(0x7f35600cb3e0 msgr2=0x7f3560156af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:25.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.804+0000 7f3564d4f700 1 -- 172.21.15.79:0/1435199947 shutdown_connections 2023-10-19T08:38:25.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.804+0000 7f3564d4f700 1 -- 172.21.15.79:0/1435199947 wait complete. 2023-10-19T08:38:25.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.4 2023-10-19T08:38:25.820 DEBUG:teuthology.parallel:result is None 2023-10-19T08:38:25.820 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-19T08:38:25.821 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-19T08:38:25.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.976+0000 7f271ecf6700 1 Processor -- start 2023-10-19T08:38:25.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.976+0000 7f271ecf6700 1 -- start start 2023-10-19T08:38:25.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.977+0000 7f271ecf6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f27180af170 0x7f27180cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.977+0000 7f271ecf6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27180b1de0 0x7f27180b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.977+0000 7f271ecf6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27180cd800 0x7f27180cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.977+0000 7f271ecf6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27180af550 con 0x7f27180b1de0 2023-10-19T08:38:25.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.977+0000 7f271ecf6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27180b16b0 con 0x7f27180af170 2023-10-19T08:38:25.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.977+0000 7f271ecf6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271815de50 con 0x7f27180cd800 2023-10-19T08:38:25.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.977+0000 7f2717fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27180b1de0 0x7f27180b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.977+0000 7f2717fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27180b1de0 0x7f27180b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46598/0 (socket says 172.21.15.79:46598) 2023-10-19T08:38:25.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.977+0000 7f2717fff700 1 -- 172.21.15.79:0/2174336061 learned_addr learned my addr 172.21.15.79:0/2174336061 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:25.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.977+0000 7f271d293700 1 --2- 172.21.15.79:0/2174336061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27180cd800 0x7f27180cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.977+0000 7f271ca92700 1 --2- 172.21.15.79:0/2174336061 >> v2:172.21.15.89:3300/0 conn(0x7f27180af170 0x7f27180cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.977+0000 7f2717fff700 1 -- 172.21.15.79:0/2174336061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27180cd800 msgr2=0x7f27180cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:25.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.977+0000 7f2717fff700 1 --2- 172.21.15.79:0/2174336061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27180cd800 0x7f27180cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.977+0000 7f2717fff700 1 -- 172.21.15.79:0/2174336061 >> v2:172.21.15.89:3300/0 conn(0x7f27180af170 msgr2=0x7f27180cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:25.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.977+0000 7f2717fff700 1 --2- 172.21.15.79:0/2174336061 >> v2:172.21.15.89:3300/0 conn(0x7f27180af170 0x7f27180cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.977+0000 7f2717fff700 1 -- 172.21.15.79:0/2174336061 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271815e130 con 0x7f27180b1de0 2023-10-19T08:38:25.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.978+0000 7f2717fff700 1 --2- 172.21.15.79:0/2174336061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27180b1de0 0x7f27180b2270 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f27040098f0 tx=0x7f2704009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d187aaef7db35f25 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.978+0000 7f27177fe700 1 -- 172.21.15.79:0/2174336061 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270400b860 con 0x7f27180b1de0 2023-10-19T08:38:25.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.978+0000 7f27177fe700 1 -- 172.21.15.79:0/2174336061 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270400b9c0 con 0x7f27180b1de0 2023-10-19T08:38:25.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.978+0000 7f27177fe700 1 -- 172.21.15.79:0/2174336061 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270400bd50 con 0x7f27180b1de0 2023-10-19T08:38:25.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.978+0000 7f271ecf6700 1 -- 172.21.15.79:0/2174336061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27180b1de0 msgr2=0x7f27180b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.978+0000 7f271ecf6700 1 --2- 172.21.15.79:0/2174336061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27180b1de0 0x7f27180b2270 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f27040098f0 tx=0x7f2704009c00 comp rx=0 tx=0).stop 2023-10-19T08:38:25.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.978+0000 7f271ecf6700 1 -- 172.21.15.79:0/2174336061 shutdown_connections 2023-10-19T08:38:25.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.978+0000 7f271ecf6700 1 --2- 172.21.15.79:0/2174336061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27180cd800 0x7f27180cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.978+0000 7f271ecf6700 1 --2- 172.21.15.79:0/2174336061 >> v2:172.21.15.89:3300/0 conn(0x7f27180af170 0x7f27180cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.978+0000 7f271ecf6700 1 --2- 172.21.15.79:0/2174336061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27180b1de0 0x7f27180b2270 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.978+0000 7f271ecf6700 1 -- 172.21.15.79:0/2174336061 >> 172.21.15.79:0/2174336061 conn(0x7f271806dcc0 msgr2=0x7f271806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:25.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.978+0000 7f271ecf6700 1 -- 172.21.15.79:0/2174336061 shutdown_connections 2023-10-19T08:38:25.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.978+0000 7f271ecf6700 1 -- 172.21.15.79:0/2174336061 wait complete. 2023-10-19T08:38:25.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.979+0000 7f271ecf6700 1 Processor -- start 2023-10-19T08:38:25.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.979+0000 7f271ecf6700 1 -- start start 2023-10-19T08:38:25.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.980+0000 7f271ecf6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27180af170 0x7f27181e6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.980+0000 7f271ecf6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27180b1de0 0x7f271815f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.980+0000 7f271ecf6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27180cd800 0x7f27180b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:25.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.980+0000 7f271ecf6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180b4cd0 con 0x7f27180b1de0 2023-10-19T08:38:25.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.980+0000 7f271ecf6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27181e7160 con 0x7f27180cd800 2023-10-19T08:38:25.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.980+0000 7f271ecf6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27180b4050 con 0x7f27180af170 2023-10-19T08:38:25.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.980+0000 7f2717fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27180b1de0 0x7f271815f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.980+0000 7f2717fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27180b1de0 0x7f271815f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46604/0 (socket says 172.21.15.79:46604) 2023-10-19T08:38:25.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.980+0000 7f2717fff700 1 -- 172.21.15.79:0/1380718538 learned_addr learned my addr 172.21.15.79:0/1380718538 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:25.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.980+0000 7f271d293700 1 --2- 172.21.15.79:0/1380718538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27180cd800 0x7f27180b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.981+0000 7f271ca92700 1 --2- 172.21.15.79:0/1380718538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27180af170 0x7f27181e6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:25.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.981+0000 7f2717fff700 1 -- 172.21.15.79:0/1380718538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27180af170 msgr2=0x7f27181e6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.981+0000 7f2717fff700 1 --2- 172.21.15.79:0/1380718538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27180af170 0x7f27181e6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.981+0000 7f2717fff700 1 -- 172.21.15.79:0/1380718538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27180cd800 msgr2=0x7f27180b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:25.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.981+0000 7f2717fff700 1 --2- 172.21.15.79:0/1380718538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27180cd800 0x7f27180b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:25.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.981+0000 7f2717fff700 1 -- 172.21.15.79:0/1380718538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2704009550 con 0x7f27180b1de0 2023-10-19T08:38:25.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.981+0000 7f2717fff700 1 --2- 172.21.15.79:0/1380718538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27180b1de0 0x7f271815f910 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2718067670 tx=0x7f2704004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:25.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.981+0000 7f27157fa700 1 -- 172.21.15.79:0/1380718538 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704004240 con 0x7f27180b1de0 2023-10-19T08:38:25.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.981+0000 7f27157fa700 1 -- 172.21.15.79:0/1380718538 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270401f070 con 0x7f27180b1de0 2023-10-19T08:38:25.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.981+0000 7f271ecf6700 1 -- 172.21.15.79:0/1380718538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27180b4330 con 0x7f27180b1de0 2023-10-19T08:38:25.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.981+0000 7f27157fa700 1 -- 172.21.15.79:0/1380718538 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27040045c0 con 0x7f27180b1de0 2023-10-19T08:38:25.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.981+0000 7f271ecf6700 1 -- 172.21.15.79:0/1380718538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27180b48f0 con 0x7f27180b1de0 2023-10-19T08:38:26.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.982+0000 7f271ecf6700 1 -- 172.21.15.79:0/1380718538 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f271804ee70 con 0x7f27180b1de0 2023-10-19T08:38:26.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.982+0000 7f27157fa700 1 -- 172.21.15.79:0/1380718538 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2704021030 con 0x7f27180b1de0 2023-10-19T08:38:26.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.983+0000 7f27157fa700 1 --2- 172.21.15.79:0/1380718538 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f26fc06a0e0 0x7f26fc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:26.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.983+0000 7f27157fa700 1 -- 172.21.15.79:0/1380718538 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2704089a80 con 0x7f27180b1de0 2023-10-19T08:38:26.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.983+0000 7f271ca92700 1 --2- 172.21.15.79:0/1380718538 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f26fc06a0e0 0x7f26fc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:26.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.983+0000 7f271ca92700 1 --2- 172.21.15.79:0/1380718538 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f26fc06a0e0 0x7f26fc06c5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f270c009950 tx=0x7f270c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:26.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:25.987+0000 7f27157fa700 1 -- 172.21.15.79:0/1380718538 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2704054f10 con 0x7f27180b1de0 2023-10-19T08:38:26.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.174+0000 7f271ecf6700 1 -- 172.21.15.79:0/1380718538 --> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27180b18c0 con 0x7f26fc06a0e0 2023-10-19T08:38:26.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.183+0000 7f27157fa700 1 -- 172.21.15.79:0/1380718538 <== mgr.4113 v2:172.21.15.79:6832/316135984 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367344 (secure 0 0 0) 0x7f270c009e70 con 0x7f26fc06a0e0 2023-10-19T08:38:26.191 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:26.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.187+0000 7f271ecf6700 1 -- 172.21.15.79:0/1380718538 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f26fc06a0e0 msgr2=0x7f26fc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:26.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.187+0000 7f271ecf6700 1 --2- 172.21.15.79:0/1380718538 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f26fc06a0e0 0x7f26fc06c5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f270c009950 tx=0x7f270c008040 comp rx=0 tx=0).stop 2023-10-19T08:38:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.187+0000 7f271ecf6700 1 -- 172.21.15.79:0/1380718538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27180b1de0 msgr2=0x7f271815f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.187+0000 7f271ecf6700 1 --2- 172.21.15.79:0/1380718538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27180b1de0 0x7f271815f910 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2718067670 tx=0x7f2704004750 comp rx=0 tx=0).stop 2023-10-19T08:38:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.187+0000 7f271ecf6700 1 -- 172.21.15.79:0/1380718538 shutdown_connections 2023-10-19T08:38:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.187+0000 7f271ecf6700 1 --2- 172.21.15.79:0/1380718538 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27180cd800 0x7f27180b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.187+0000 7f271ecf6700 1 --2- 172.21.15.79:0/1380718538 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f26fc06a0e0 0x7f26fc06c5a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.187+0000 7f271ecf6700 1 --2- 172.21.15.79:0/1380718538 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27180af170 0x7f27181e6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.187+0000 7f271ecf6700 1 --2- 172.21.15.79:0/1380718538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27180b1de0 0x7f271815f910 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.187+0000 7f271ecf6700 1 -- 172.21.15.79:0/1380718538 >> 172.21.15.79:0/1380718538 conn(0x7f271806dcc0 msgr2=0x7f271806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.187+0000 7f271ecf6700 1 -- 172.21.15.79:0/1380718538 shutdown_connections 2023-10-19T08:38:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.187+0000 7f271ecf6700 1 -- 172.21.15.79:0/1380718538 wait complete. 2023-10-19T08:38:26.197 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-19T08:38:26.203 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-10-19T08:38:25.104077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219444,"kb_used_data":3292,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755276,"statfs":{"total":773094113280,"available":772869402624,"internally_reserved":0,"allocated":3371008,"data_stored":2067366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006622"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336361+0000","last_change":"2023-10-19T08:37:57.298197+0000","last_active":"2023-10-19T08:38:02.336361+0000","last_peered":"2023-10-19T08:38:02.336361+0000","last_clean":"2023-10-19T08:38:02.336361+0000","last_became_active":"2023-10-19T08:37:57.297874+0000","last_became_peered":"2023-10-19T08:37:57.297874+0000","last_unstale":"2023-10-19T08:38:02.336361+0000","last_undegraded":"2023-10-19T08:38:02.336361+0000","last_fullsized":"2023-10-19T08:38:02.336361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:29:22.588510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303213+0000","last_change":"2023-10-19T08:37:57.272011+0000","last_active":"2023-10-19T08:38:02.303213+0000","last_peered":"2023-10-19T08:38:02.303213+0000","last_clean":"2023-10-19T08:38:02.303213+0000","last_became_active":"2023-10-19T08:37:57.271773+0000","last_became_peered":"2023-10-19T08:37:57.271773+0000","last_unstale":"2023-10-19T08:38:02.303213+0000","last_undegraded":"2023-10-19T08:38:02.303213+0000","last_fullsized":"2023-10-19T08:38:02.303213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:04.184252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338528+0000","last_change":"2023-10-19T08:37:57.286551+0000","last_active":"2023-10-19T08:38:02.338528+0000","last_peered":"2023-10-19T08:38:02.338528+0000","last_clean":"2023-10-19T08:38:02.338528+0000","last_became_active":"2023-10-19T08:37:57.286151+0000","last_became_peered":"2023-10-19T08:37:57.286151+0000","last_unstale":"2023-10-19T08:38:02.338528+0000","last_undegraded":"2023-10-19T08:38:02.338528+0000","last_fullsized":"2023-10-19T08:38:02.338528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:06:59.905183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336888+0000","last_change":"2023-10-19T08:37:57.279635+0000","last_active":"2023-10-19T08:38:02.336888+0000","last_peered":"2023-10-19T08:38:02.336888+0000","last_clean":"2023-10-19T08:38:02.336888+0000","last_became_active":"2023-10-19T08:37:57.279358+0000","last_became_peered":"2023-10-19T08:37:57.279358+0000","last_unstale":"2023-10-19T08:38:02.336888+0000","last_undegraded":"2023-10-19T08:38:02.336888+0000","last_fullsized":"2023-10-19T08:38:02.336888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:11:03.215012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327987+0000","last_change":"2023-10-19T08:37:57.291593+0000","last_active":"2023-10-19T08:38:02.327987+0000","last_peered":"2023-10-19T08:38:02.327987+0000","last_clean":"2023-10-19T08:38:02.327987+0000","last_became_active":"2023-10-19T08:37:57.291321+0000","last_became_peered":"2023-10-19T08:37:57.291321+0000","last_unstale":"2023-10-19T08:38:02.327987+0000","last_undegraded":"2023-10-19T08:38:02.327987+0000","last_fullsized":"2023-10-19T08:38:02.327987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:52.465054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337282+0000","last_change":"2023-10-19T08:37:57.285508+0000","last_active":"2023-10-19T08:38:02.337282+0000","last_peered":"2023-10-19T08:38:02.337282+0000","last_clean":"2023-10-19T08:38:02.337282+0000","last_became_active":"2023-10-19T08:37:57.285110+0000","last_became_peered":"2023-10-19T08:37:57.285110+0000","last_unstale":"2023-10-19T08:38:02.337282+0000","last_undegraded":"2023-10-19T08:38:02.337282+0000","last_fullsized":"2023-10-19T08:38:02.337282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:36:45.197928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337337+0000","last_change":"2023-10-19T08:37:57.284428+0000","last_active":"2023-10-19T08:38:02.337337+0000","last_peered":"2023-10-19T08:38:02.337337+0000","last_clean":"2023-10-19T08:38:02.337337+0000","last_became_active":"2023-10-19T08:37:57.283626+0000","last_became_peered":"2023-10-19T08:37:57.283626+0000","last_unstale":"2023-10-19T08:38:02.337337+0000","last_undegraded":"2023-10-19T08:38:02.337337+0000","last_fullsized":"2023-10-19T08:38:02.337337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:43.028422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302532+0000","last_change":"2023-10-19T08:37:57.281050+0000","last_active":"2023-10-19T08:38:02.302532+0000","last_peered":"2023-10-19T08:38:02.302532+0000","last_clean":"2023-10-19T08:38:02.302532+0000","last_became_active":"2023-10-19T08:37:57.280763+0000","last_became_peered":"2023-10-19T08:37:57.280763+0000","last_unstale":"2023-10-19T08:38:02.302532+0000","last_undegraded":"2023-10-19T08:38:02.302532+0000","last_fullsized":"2023-10-19T08:38:02.302532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:23.560291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328470+0000","last_change":"2023-10-19T08:37:57.295958+0000","last_active":"2023-10-19T08:38:02.328470+0000","last_peered":"2023-10-19T08:38:02.328470+0000","last_clean":"2023-10-19T08:38:02.328470+0000","last_became_active":"2023-10-19T08:37:57.295552+0000","last_became_peered":"2023-10-19T08:37:57.295552+0000","last_unstale":"2023-10-19T08:38:02.328470+0000","last_undegraded":"2023-10-19T08:38:02.328470+0000","last_fullsized":"2023-10-19T08:38:02.328470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:09.106701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303592+0000","last_change":"2023-10-19T08:37:57.281702+0000","last_active":"2023-10-19T08:38:02.303592+0000","last_peered":"2023-10-19T08:38:02.303592+0000","last_clean":"2023-10-19T08:38:02.303592+0000","last_became_active":"2023-10-19T08:37:57.281458+0000","last_became_peered":"2023-10-19T08:37:57.281458+0000","last_unstale":"2023-10-19T08:38:02.303592+0000","last_undegraded":"2023-10-19T08:38:02.303592+0000","last_fullsized":"2023-10-19T08:38:02.303592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:50.116408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338336+0000","last_change":"2023-10-19T08:37:57.287060+0000","last_active":"2023-10-19T08:38:02.338336+0000","last_peered":"2023-10-19T08:38:02.338336+0000","last_clean":"2023-10-19T08:38:02.338336+0000","last_became_active":"2023-10-19T08:37:57.286457+0000","last_became_peered":"2023-10-19T08:37:57.286457+0000","last_unstale":"2023-10-19T08:38:02.338336+0000","last_undegraded":"2023-10-19T08:38:02.338336+0000","last_fullsized":"2023-10-19T08:38:02.338336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:42:12.580615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336291+0000","last_change":"2023-10-19T08:37:57.287153+0000","last_active":"2023-10-19T08:38:02.336291+0000","last_peered":"2023-10-19T08:38:02.336291+0000","last_clean":"2023-10-19T08:38:02.336291+0000","last_became_active":"2023-10-19T08:37:57.286892+0000","last_became_peered":"2023-10-19T08:37:57.286892+0000","last_unstale":"2023-10-19T08:38:02.336291+0000","last_undegraded":"2023-10-19T08:38:02.336291+0000","last_fullsized":"2023-10-19T08:38:02.336291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:15:28.529966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336795+0000","last_change":"2023-10-19T08:37:57.295506+0000","last_active":"2023-10-19T08:38:02.336795+0000","last_peered":"2023-10-19T08:38:02.336795+0000","last_clean":"2023-10-19T08:38:02.336795+0000","last_became_active":"2023-10-19T08:37:57.295228+0000","last_became_peered":"2023-10-19T08:37:57.295228+0000","last_unstale":"2023-10-19T08:38:02.336795+0000","last_undegraded":"2023-10-19T08:38:02.336795+0000","last_fullsized":"2023-10-19T08:38:02.336795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:50:11.458306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302667+0000","last_change":"2023-10-19T08:37:57.281958+0000","last_active":"2023-10-19T08:38:02.302667+0000","last_peered":"2023-10-19T08:38:02.302667+0000","last_clean":"2023-10-19T08:38:02.302667+0000","last_became_active":"2023-10-19T08:37:57.280798+0000","last_became_peered":"2023-10-19T08:37:57.280798+0000","last_unstale":"2023-10-19T08:38:02.302667+0000","last_undegraded":"2023-10-19T08:38:02.302667+0000","last_fullsized":"2023-10-19T08:38:02.302667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:52.465054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337080+0000","last_change":"2023-10-19T08:37:57.284152+0000","last_active":"2023-10-19T08:38:02.337080+0000","last_peered":"2023-10-19T08:38:02.337080+0000","last_clean":"2023-10-19T08:38:02.337080+0000","last_became_active":"2023-10-19T08:37:57.283958+0000","last_became_peered":"2023-10-19T08:37:57.283958+0000","last_unstale":"2023-10-19T08:38:02.337080+0000","last_undegraded":"2023-10-19T08:38:02.337080+0000","last_fullsized":"2023-10-19T08:38:02.337080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:21.864097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336495+0000","last_change":"2023-10-19T08:37:57.282193+0000","last_active":"2023-10-19T08:38:02.336495+0000","last_peered":"2023-10-19T08:38:02.336495+0000","last_clean":"2023-10-19T08:38:02.336495+0000","last_became_active":"2023-10-19T08:37:57.281902+0000","last_became_peered":"2023-10-19T08:37:57.281902+0000","last_unstale":"2023-10-19T08:38:02.336495+0000","last_undegraded":"2023-10-19T08:38:02.336495+0000","last_fullsized":"2023-10-19T08:38:02.336495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:28:55.738875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328478+0000","last_change":"2023-10-19T08:37:57.295795+0000","last_active":"2023-10-19T08:38:02.328478+0000","last_peered":"2023-10-19T08:38:02.328478+0000","last_clean":"2023-10-19T08:38:02.328478+0000","last_became_active":"2023-10-19T08:37:57.295248+0000","last_became_peered":"2023-10-19T08:37:57.295248+0000","last_unstale":"2023-10-19T08:38:02.328478+0000","last_undegraded":"2023-10-19T08:38:02.328478+0000","last_fullsized":"2023-10-19T08:38:02.328478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:30.738229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338681+0000","last_change":"2023-10-19T08:37:57.285995+0000","last_active":"2023-10-19T08:38:02.338681+0000","last_peered":"2023-10-19T08:38:02.338681+0000","last_clean":"2023-10-19T08:38:02.338681+0000","last_became_active":"2023-10-19T08:37:57.285508+0000","last_became_peered":"2023-10-19T08:37:57.285508+0000","last_unstale":"2023-10-19T08:38:02.338681+0000","last_undegraded":"2023-10-19T08:38:02.338681+0000","last_fullsized":"2023-10-19T08:38:02.338681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:47:25.178769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336266+0000","last_change":"2023-10-19T08:37:57.287058+0000","last_active":"2023-10-19T08:38:02.336266+0000","last_peered":"2023-10-19T08:38:02.336266+0000","last_clean":"2023-10-19T08:38:02.336266+0000","last_became_active":"2023-10-19T08:37:57.286444+0000","last_became_peered":"2023-10-19T08:37:57.286444+0000","last_unstale":"2023-10-19T08:38:02.336266+0000","last_undegraded":"2023-10-19T08:38:02.336266+0000","last_fullsized":"2023-10-19T08:38:02.336266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:00:25.346262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337609+0000","last_change":"2023-10-19T08:37:57.286561+0000","last_active":"2023-10-19T08:38:02.337609+0000","last_peered":"2023-10-19T08:38:02.337609+0000","last_clean":"2023-10-19T08:38:02.337609+0000","last_became_active":"2023-10-19T08:37:57.286258+0000","last_became_peered":"2023-10-19T08:37:57.286258+0000","last_unstale":"2023-10-19T08:38:02.337609+0000","last_undegraded":"2023-10-19T08:38:02.337609+0000","last_fullsized":"2023-10-19T08:38:02.337609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:36:37.342175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338298+0000","last_change":"2023-10-19T08:37:57.298841+0000","last_active":"2023-10-19T08:38:02.338298+0000","last_peered":"2023-10-19T08:38:02.338298+0000","last_clean":"2023-10-19T08:38:02.338298+0000","last_became_active":"2023-10-19T08:37:57.297120+0000","last_became_peered":"2023-10-19T08:37:57.297120+0000","last_unstale":"2023-10-19T08:38:02.338298+0000","last_undegraded":"2023-10-19T08:38:02.338298+0000","last_fullsized":"2023-10-19T08:38:02.338298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:45:25.612225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327349+0000","last_change":"2023-10-19T08:37:57.278547+0000","last_active":"2023-10-19T08:38:02.327349+0000","last_peered":"2023-10-19T08:38:02.327349+0000","last_clean":"2023-10-19T08:38:02.327349+0000","last_became_active":"2023-10-19T08:37:57.278248+0000","last_became_peered":"2023-10-19T08:37:57.278248+0000","last_unstale":"2023-10-19T08:38:02.327349+0000","last_undegraded":"2023-10-19T08:38:02.327349+0000","last_fullsized":"2023-10-19T08:38:02.327349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:57:26.558851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302205+0000","last_change":"2023-10-19T08:37:57.292075+0000","last_active":"2023-10-19T08:38:02.302205+0000","last_peered":"2023-10-19T08:38:02.302205+0000","last_clean":"2023-10-19T08:38:02.302205+0000","last_became_active":"2023-10-19T08:37:57.291577+0000","last_became_peered":"2023-10-19T08:37:57.291577+0000","last_unstale":"2023-10-19T08:38:02.302205+0000","last_undegraded":"2023-10-19T08:38:02.302205+0000","last_fullsized":"2023-10-19T08:38:02.302205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:02.310273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336592+0000","last_change":"2023-10-19T08:37:57.297303+0000","last_active":"2023-10-19T08:38:02.336592+0000","last_peered":"2023-10-19T08:38:02.336592+0000","last_clean":"2023-10-19T08:38:02.336592+0000","last_became_active":"2023-10-19T08:37:57.297038+0000","last_became_peered":"2023-10-19T08:37:57.297038+0000","last_unstale":"2023-10-19T08:38:02.336592+0000","last_undegraded":"2023-10-19T08:38:02.336592+0000","last_fullsized":"2023-10-19T08:38:02.336592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:52.465054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337263+0000","last_change":"2023-10-19T08:37:57.283306+0000","last_active":"2023-10-19T08:38:02.337263+0000","last_peered":"2023-10-19T08:38:02.337263+0000","last_clean":"2023-10-19T08:38:02.337263+0000","last_became_active":"2023-10-19T08:37:57.282978+0000","last_became_peered":"2023-10-19T08:37:57.282978+0000","last_unstale":"2023-10-19T08:38:02.337263+0000","last_undegraded":"2023-10-19T08:38:02.337263+0000","last_fullsized":"2023-10-19T08:38:02.337263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:30.738229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337108+0000","last_change":"2023-10-19T08:37:57.280269+0000","last_active":"2023-10-19T08:38:02.337108+0000","last_peered":"2023-10-19T08:38:02.337108+0000","last_clean":"2023-10-19T08:38:02.337108+0000","last_became_active":"2023-10-19T08:37:57.279940+0000","last_became_peered":"2023-10-19T08:37:57.279940+0000","last_unstale":"2023-10-19T08:38:02.337108+0000","last_undegraded":"2023-10-19T08:38:02.337108+0000","last_fullsized":"2023-10-19T08:38:02.337108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:40.165807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303297+0000","last_change":"2023-10-19T08:37:57.285132+0000","last_active":"2023-10-19T08:38:02.303297+0000","last_peered":"2023-10-19T08:38:02.303297+0000","last_clean":"2023-10-19T08:38:02.303297+0000","last_became_active":"2023-10-19T08:37:57.284701+0000","last_became_peered":"2023-10-19T08:37:57.284701+0000","last_unstale":"2023-10-19T08:38:02.303297+0000","last_undegraded":"2023-10-19T08:38:02.303297+0000","last_fullsized":"2023-10-19T08:38:02.303297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:16.370875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337879+0000","last_change":"2023-10-19T08:38:01.340490+0000","last_active":"2023-10-19T08:38:02.337879+0000","last_peered":"2023-10-19T08:38:02.337879+0000","last_clean":"2023-10-19T08:38:02.337879+0000","last_became_active":"2023-10-19T08:38:01.340119+0000","last_became_peered":"2023-10-19T08:38:01.340119+0000","last_unstale":"2023-10-19T08:38:02.337879+0000","last_undegraded":"2023-10-19T08:38:02.337879+0000","last_fullsized":"2023-10-19T08:38:02.337879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:28:51.111704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336413+0000","last_change":"2023-10-19T08:37:56.283885+0000","last_active":"2023-10-19T08:38:02.336413+0000","last_peered":"2023-10-19T08:38:02.336413+0000","last_clean":"2023-10-19T08:38:02.336413+0000","last_became_active":"2023-10-19T08:37:56.283591+0000","last_became_peered":"2023-10-19T08:37:56.283591+0000","last_unstale":"2023-10-19T08:38:02.336413+0000","last_undegraded":"2023-10-19T08:38:02.336413+0000","last_fullsized":"2023-10-19T08:38:02.336413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:15:58.663548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303063+0000","last_change":"2023-10-19T08:37:57.291292+0000","last_active":"2023-10-19T08:38:02.303063+0000","last_peered":"2023-10-19T08:38:02.303063+0000","last_clean":"2023-10-19T08:38:02.303063+0000","last_became_active":"2023-10-19T08:37:57.291007+0000","last_became_peered":"2023-10-19T08:37:57.291007+0000","last_unstale":"2023-10-19T08:38:02.303063+0000","last_undegraded":"2023-10-19T08:38:02.303063+0000","last_fullsized":"2023-10-19T08:38:02.303063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:48.642240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337486+0000","last_change":"2023-10-19T08:38:01.346131+0000","last_active":"2023-10-19T08:38:02.337486+0000","last_peered":"2023-10-19T08:38:02.337486+0000","last_clean":"2023-10-19T08:38:02.337486+0000","last_became_active":"2023-10-19T08:38:01.345770+0000","last_became_peered":"2023-10-19T08:38:01.345770+0000","last_unstale":"2023-10-19T08:38:02.337486+0000","last_undegraded":"2023-10-19T08:38:02.337486+0000","last_fullsized":"2023-10-19T08:38:02.337486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:36:36.064644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336120+0000","last_change":"2023-10-19T08:37:56.285233+0000","last_active":"2023-10-19T08:38:02.336120+0000","last_peered":"2023-10-19T08:38:02.336120+0000","last_clean":"2023-10-19T08:38:02.336120+0000","last_became_active":"2023-10-19T08:37:56.284954+0000","last_became_peered":"2023-10-19T08:37:56.284954+0000","last_unstale":"2023-10-19T08:38:02.336120+0000","last_undegraded":"2023-10-19T08:38:02.336120+0000","last_fullsized":"2023-10-19T08:38:02.336120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:40.083342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328472+0000","last_change":"2023-10-19T08:37:57.285760+0000","last_active":"2023-10-19T08:38:02.328472+0000","last_peered":"2023-10-19T08:38:02.328472+0000","last_clean":"2023-10-19T08:38:02.328472+0000","last_became_active":"2023-10-19T08:37:57.285420+0000","last_became_peered":"2023-10-19T08:37:57.285420+0000","last_unstale":"2023-10-19T08:38:02.328472+0000","last_undegraded":"2023-10-19T08:38:02.328472+0000","last_fullsized":"2023-10-19T08:38:02.328472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:43.028422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328649+0000","last_change":"2023-10-19T08:38:01.343224+0000","last_active":"2023-10-19T08:38:02.328649+0000","last_peered":"2023-10-19T08:38:02.328649+0000","last_clean":"2023-10-19T08:38:02.328649+0000","last_became_active":"2023-10-19T08:38:01.341932+0000","last_became_peered":"2023-10-19T08:38:01.341932+0000","last_unstale":"2023-10-19T08:38:02.328649+0000","last_undegraded":"2023-10-19T08:38:02.328649+0000","last_fullsized":"2023-10-19T08:38:02.328649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:08.237484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302526+0000","last_change":"2023-10-19T08:37:56.279221+0000","last_active":"2023-10-19T08:38:02.302526+0000","last_peered":"2023-10-19T08:38:02.302526+0000","last_clean":"2023-10-19T08:38:02.302526+0000","last_became_active":"2023-10-19T08:37:56.278945+0000","last_became_peered":"2023-10-19T08:37:56.278945+0000","last_unstale":"2023-10-19T08:38:02.302526+0000","last_undegraded":"2023-10-19T08:38:02.302526+0000","last_fullsized":"2023-10-19T08:38:02.302526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:15.152471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337264+0000","last_change":"2023-10-19T08:37:57.286458+0000","last_active":"2023-10-19T08:38:02.337264+0000","last_peered":"2023-10-19T08:38:02.337264+0000","last_clean":"2023-10-19T08:38:02.337264+0000","last_became_active":"2023-10-19T08:37:57.286202+0000","last_became_peered":"2023-10-19T08:37:57.286202+0000","last_unstale":"2023-10-19T08:38:02.337264+0000","last_undegraded":"2023-10-19T08:38:02.337264+0000","last_fullsized":"2023-10-19T08:38:02.337264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:03:17.001375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336640+0000","last_change":"2023-10-19T08:38:01.345314+0000","last_active":"2023-10-19T08:38:02.336640+0000","last_peered":"2023-10-19T08:38:02.336640+0000","last_clean":"2023-10-19T08:38:02.336640+0000","last_became_active":"2023-10-19T08:38:01.344867+0000","last_became_peered":"2023-10-19T08:38:01.344867+0000","last_unstale":"2023-10-19T08:38:02.336640+0000","last_undegraded":"2023-10-19T08:38:02.336640+0000","last_fullsized":"2023-10-19T08:38:02.336640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:14:55.301418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328589+0000","last_change":"2023-10-19T08:37:56.284935+0000","last_active":"2023-10-19T08:38:02.328589+0000","last_peered":"2023-10-19T08:38:02.328589+0000","last_clean":"2023-10-19T08:38:02.328589+0000","last_became_active":"2023-10-19T08:37:56.284622+0000","last_became_peered":"2023-10-19T08:37:56.284622+0000","last_unstale":"2023-10-19T08:38:02.328589+0000","last_undegraded":"2023-10-19T08:38:02.328589+0000","last_fullsized":"2023-10-19T08:38:02.328589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:43:07.850875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302488+0000","last_change":"2023-10-19T08:37:57.291320+0000","last_active":"2023-10-19T08:38:02.302488+0000","last_peered":"2023-10-19T08:38:02.302488+0000","last_clean":"2023-10-19T08:38:02.302488+0000","last_became_active":"2023-10-19T08:37:57.290894+0000","last_became_peered":"2023-10-19T08:37:57.290894+0000","last_unstale":"2023-10-19T08:38:02.302488+0000","last_undegraded":"2023-10-19T08:38:02.302488+0000","last_fullsized":"2023-10-19T08:38:02.302488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:30.738229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336048+0000","last_change":"2023-10-19T08:38:01.340374+0000","last_active":"2023-10-19T08:38:02.336048+0000","last_peered":"2023-10-19T08:38:02.336048+0000","last_clean":"2023-10-19T08:38:02.336048+0000","last_became_active":"2023-10-19T08:38:01.339982+0000","last_became_peered":"2023-10-19T08:38:01.339982+0000","last_unstale":"2023-10-19T08:38:02.336048+0000","last_undegraded":"2023-10-19T08:38:02.336048+0000","last_fullsized":"2023-10-19T08:38:02.336048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:06.363506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303440+0000","last_change":"2023-10-19T08:37:56.286352+0000","last_active":"2023-10-19T08:38:02.303440+0000","last_peered":"2023-10-19T08:38:02.303440+0000","last_clean":"2023-10-19T08:38:02.303440+0000","last_became_active":"2023-10-19T08:37:56.286038+0000","last_became_peered":"2023-10-19T08:37:56.286038+0000","last_unstale":"2023-10-19T08:38:02.303440+0000","last_undegraded":"2023-10-19T08:38:02.303440+0000","last_fullsized":"2023-10-19T08:38:02.303440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:47.634992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302226+0000","last_change":"2023-10-19T08:37:57.291702+0000","last_active":"2023-10-19T08:38:02.302226+0000","last_peered":"2023-10-19T08:38:02.302226+0000","last_clean":"2023-10-19T08:38:02.302226+0000","last_became_active":"2023-10-19T08:37:57.290849+0000","last_became_peered":"2023-10-19T08:37:57.290849+0000","last_unstale":"2023-10-19T08:38:02.302226+0000","last_undegraded":"2023-10-19T08:38:02.302226+0000","last_fullsized":"2023-10-19T08:38:02.302226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:43:08.858123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302757+0000","last_change":"2023-10-19T08:38:01.345973+0000","last_active":"2023-10-19T08:38:02.302757+0000","last_peered":"2023-10-19T08:38:02.302757+0000","last_clean":"2023-10-19T08:38:02.302757+0000","last_became_active":"2023-10-19T08:38:01.345569+0000","last_became_peered":"2023-10-19T08:38:01.345569+0000","last_unstale":"2023-10-19T08:38:02.302757+0000","last_undegraded":"2023-10-19T08:38:02.302757+0000","last_fullsized":"2023-10-19T08:38:02.302757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:20.424108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338312+0000","last_change":"2023-10-19T08:37:56.284648+0000","last_active":"2023-10-19T08:38:02.338312+0000","last_peered":"2023-10-19T08:38:02.338312+0000","last_clean":"2023-10-19T08:38:02.338312+0000","last_became_active":"2023-10-19T08:37:56.284377+0000","last_became_peered":"2023-10-19T08:37:56.284377+0000","last_unstale":"2023-10-19T08:38:02.338312+0000","last_undegraded":"2023-10-19T08:38:02.338312+0000","last_fullsized":"2023-10-19T08:38:02.338312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:03.177003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336475+0000","last_change":"2023-10-19T08:37:57.283545+0000","last_active":"2023-10-19T08:38:02.336475+0000","last_peered":"2023-10-19T08:38:02.336475+0000","last_clean":"2023-10-19T08:38:02.336475+0000","last_became_active":"2023-10-19T08:37:57.283287+0000","last_became_peered":"2023-10-19T08:37:57.283287+0000","last_unstale":"2023-10-19T08:38:02.336475+0000","last_undegraded":"2023-10-19T08:38:02.336475+0000","last_fullsized":"2023-10-19T08:38:02.336475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:13.404733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336264+0000","last_change":"2023-10-19T08:38:01.353317+0000","last_active":"2023-10-19T08:38:02.336264+0000","last_peered":"2023-10-19T08:38:02.336264+0000","last_clean":"2023-10-19T08:38:02.336264+0000","last_became_active":"2023-10-19T08:38:01.352964+0000","last_became_peered":"2023-10-19T08:38:01.352964+0000","last_unstale":"2023-10-19T08:38:02.336264+0000","last_undegraded":"2023-10-19T08:38:02.336264+0000","last_fullsized":"2023-10-19T08:38:02.336264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:29:16.804794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:07.165443+0000","last_change":"2023-10-19T08:37:56.285044+0000","last_active":"2023-10-19T08:38:07.165443+0000","last_peered":"2023-10-19T08:38:07.165443+0000","last_clean":"2023-10-19T08:38:07.165443+0000","last_became_active":"2023-10-19T08:37:56.284729+0000","last_became_peered":"2023-10-19T08:37:56.284729+0000","last_unstale":"2023-10-19T08:38:07.165443+0000","last_undegraded":"2023-10-19T08:38:07.165443+0000","last_fullsized":"2023-10-19T08:38:07.165443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:55:11.490980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337780+0000","last_change":"2023-10-19T08:37:57.289683+0000","last_active":"2023-10-19T08:38:02.337780+0000","last_peered":"2023-10-19T08:38:02.337780+0000","last_clean":"2023-10-19T08:38:02.337780+0000","last_became_active":"2023-10-19T08:37:57.289339+0000","last_became_peered":"2023-10-19T08:37:57.289339+0000","last_unstale":"2023-10-19T08:38:02.337780+0000","last_undegraded":"2023-10-19T08:38:02.337780+0000","last_fullsized":"2023-10-19T08:38:02.337780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:57:38.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303603+0000","last_change":"2023-10-19T08:38:01.344790+0000","last_active":"2023-10-19T08:38:02.303603+0000","last_peered":"2023-10-19T08:38:02.303603+0000","last_clean":"2023-10-19T08:38:02.303603+0000","last_became_active":"2023-10-19T08:38:01.344405+0000","last_became_peered":"2023-10-19T08:38:01.344405+0000","last_unstale":"2023-10-19T08:38:02.303603+0000","last_undegraded":"2023-10-19T08:38:02.303603+0000","last_fullsized":"2023-10-19T08:38:02.303603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:22:22.893691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338184+0000","last_change":"2023-10-19T08:37:56.286506+0000","last_active":"2023-10-19T08:38:02.338184+0000","last_peered":"2023-10-19T08:38:02.338184+0000","last_clean":"2023-10-19T08:38:02.338184+0000","last_became_active":"2023-10-19T08:37:56.286246+0000","last_became_peered":"2023-10-19T08:37:56.286246+0000","last_unstale":"2023-10-19T08:38:02.338184+0000","last_undegraded":"2023-10-19T08:38:02.338184+0000","last_fullsized":"2023-10-19T08:38:02.338184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:43:07.850875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302485+0000","last_change":"2023-10-19T08:37:57.291345+0000","last_active":"2023-10-19T08:38:02.302485+0000","last_peered":"2023-10-19T08:38:02.302485+0000","last_clean":"2023-10-19T08:38:02.302485+0000","last_became_active":"2023-10-19T08:37:57.291061+0000","last_became_peered":"2023-10-19T08:37:57.291061+0000","last_unstale":"2023-10-19T08:38:02.302485+0000","last_undegraded":"2023-10-19T08:38:02.302485+0000","last_fullsized":"2023-10-19T08:38:02.302485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:43.028422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302758+0000","last_change":"2023-10-19T08:38:01.347178+0000","last_active":"2023-10-19T08:38:02.302758+0000","last_peered":"2023-10-19T08:38:02.302758+0000","last_clean":"2023-10-19T08:38:02.302758+0000","last_became_active":"2023-10-19T08:38:01.346237+0000","last_became_peered":"2023-10-19T08:38:01.346237+0000","last_unstale":"2023-10-19T08:38:02.302758+0000","last_undegraded":"2023-10-19T08:38:02.302758+0000","last_fullsized":"2023-10-19T08:38:02.302758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:25.917329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327204+0000","last_change":"2023-10-19T08:37:56.284660+0000","last_active":"2023-10-19T08:38:02.327204+0000","last_peered":"2023-10-19T08:38:02.327204+0000","last_clean":"2023-10-19T08:38:02.327204+0000","last_became_active":"2023-10-19T08:37:56.284426+0000","last_became_peered":"2023-10-19T08:37:56.284426+0000","last_unstale":"2023-10-19T08:38:02.327204+0000","last_undegraded":"2023-10-19T08:38:02.327204+0000","last_fullsized":"2023-10-19T08:38:02.327204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:12.397484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303242+0000","last_change":"2023-10-19T08:37:57.284960+0000","last_active":"2023-10-19T08:38:02.303242+0000","last_peered":"2023-10-19T08:38:02.303242+0000","last_clean":"2023-10-19T08:38:02.303242+0000","last_became_active":"2023-10-19T08:37:57.284360+0000","last_became_peered":"2023-10-19T08:37:57.284360+0000","last_unstale":"2023-10-19T08:38:02.303242+0000","last_undegraded":"2023-10-19T08:38:02.303242+0000","last_fullsized":"2023-10-19T08:38:02.303242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:45:25.612225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303233+0000","last_change":"2023-10-19T08:38:01.346877+0000","last_active":"2023-10-19T08:38:02.303233+0000","last_peered":"2023-10-19T08:38:02.303233+0000","last_clean":"2023-10-19T08:38:02.303233+0000","last_became_active":"2023-10-19T08:38:01.346460+0000","last_became_peered":"2023-10-19T08:38:01.346460+0000","last_unstale":"2023-10-19T08:38:02.303233+0000","last_undegraded":"2023-10-19T08:38:02.303233+0000","last_fullsized":"2023-10-19T08:38:02.303233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:24:52.905240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337215+0000","last_change":"2023-10-19T08:37:56.285689+0000","last_active":"2023-10-19T08:38:02.337215+0000","last_peered":"2023-10-19T08:38:02.337215+0000","last_clean":"2023-10-19T08:38:02.337215+0000","last_became_active":"2023-10-19T08:37:56.285284+0000","last_became_peered":"2023-10-19T08:37:56.285284+0000","last_unstale":"2023-10-19T08:38:02.337215+0000","last_undegraded":"2023-10-19T08:38:02.337215+0000","last_fullsized":"2023-10-19T08:38:02.337215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:39.158559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328527+0000","last_change":"2023-10-19T08:37:57.293680+0000","last_active":"2023-10-19T08:38:02.328527+0000","last_peered":"2023-10-19T08:38:02.328527+0000","last_clean":"2023-10-19T08:38:02.328527+0000","last_became_active":"2023-10-19T08:37:57.293401+0000","last_became_peered":"2023-10-19T08:37:57.293401+0000","last_unstale":"2023-10-19T08:38:02.328527+0000","last_undegraded":"2023-10-19T08:38:02.328527+0000","last_fullsized":"2023-10-19T08:38:02.328527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:16.159720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303448+0000","last_change":"2023-10-19T08:38:01.342623+0000","last_active":"2023-10-19T08:38:02.303448+0000","last_peered":"2023-10-19T08:38:02.303448+0000","last_clean":"2023-10-19T08:38:02.303448+0000","last_became_active":"2023-10-19T08:38:01.342009+0000","last_became_peered":"2023-10-19T08:38:01.342009+0000","last_unstale":"2023-10-19T08:38:02.303448+0000","last_undegraded":"2023-10-19T08:38:02.303448+0000","last_fullsized":"2023-10-19T08:38:02.303448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:24:52.905240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336100+0000","last_change":"2023-10-19T08:37:56.281800+0000","last_active":"2023-10-19T08:38:02.336100+0000","last_peered":"2023-10-19T08:38:02.336100+0000","last_clean":"2023-10-19T08:38:02.336100+0000","last_became_active":"2023-10-19T08:37:56.281533+0000","last_became_peered":"2023-10-19T08:37:56.281533+0000","last_unstale":"2023-10-19T08:38:02.336100+0000","last_undegraded":"2023-10-19T08:38:02.336100+0000","last_fullsized":"2023-10-19T08:38:02.336100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:08:05.598870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303187+0000","last_change":"2023-10-19T08:37:57.295506+0000","last_active":"2023-10-19T08:38:02.303187+0000","last_peered":"2023-10-19T08:38:02.303187+0000","last_clean":"2023-10-19T08:38:02.303187+0000","last_became_active":"2023-10-19T08:37:57.295267+0000","last_became_peered":"2023-10-19T08:37:57.295267+0000","last_unstale":"2023-10-19T08:38:02.303187+0000","last_undegraded":"2023-10-19T08:38:02.303187+0000","last_fullsized":"2023-10-19T08:38:02.303187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:22:18.840459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337512+0000","last_change":"2023-10-19T08:38:01.349967+0000","last_active":"2023-10-19T08:38:02.337512+0000","last_peered":"2023-10-19T08:38:02.337512+0000","last_clean":"2023-10-19T08:38:02.337512+0000","last_became_active":"2023-10-19T08:38:01.349632+0000","last_became_peered":"2023-10-19T08:38:01.349632+0000","last_unstale":"2023-10-19T08:38:02.337512+0000","last_undegraded":"2023-10-19T08:38:02.337512+0000","last_fullsized":"2023-10-19T08:38:02.337512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:34.791461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338637+0000","last_change":"2023-10-19T08:37:56.287543+0000","last_active":"2023-10-19T08:38:02.338637+0000","last_peered":"2023-10-19T08:38:02.338637+0000","last_clean":"2023-10-19T08:38:02.338637+0000","last_became_active":"2023-10-19T08:37:56.287018+0000","last_became_peered":"2023-10-19T08:37:56.287018+0000","last_unstale":"2023-10-19T08:38:02.338637+0000","last_undegraded":"2023-10-19T08:38:02.338637+0000","last_fullsized":"2023-10-19T08:38:02.338637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:47.634992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302382+0000","last_change":"2023-10-19T08:37:57.289156+0000","last_active":"2023-10-19T08:38:02.302382+0000","last_peered":"2023-10-19T08:38:02.302382+0000","last_clean":"2023-10-19T08:38:02.302382+0000","last_became_active":"2023-10-19T08:37:57.288736+0000","last_became_peered":"2023-10-19T08:37:57.288736+0000","last_unstale":"2023-10-19T08:38:02.302382+0000","last_undegraded":"2023-10-19T08:38:02.302382+0000","last_fullsized":"2023-10-19T08:38:02.302382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:02.310273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.335829+0000","last_change":"2023-10-19T08:38:01.332463+0000","last_active":"2023-10-19T08:38:02.335829+0000","last_peered":"2023-10-19T08:38:02.335829+0000","last_clean":"2023-10-19T08:38:02.335829+0000","last_became_active":"2023-10-19T08:38:01.330857+0000","last_became_peered":"2023-10-19T08:38:01.330857+0000","last_unstale":"2023-10-19T08:38:02.335829+0000","last_undegraded":"2023-10-19T08:38:02.335829+0000","last_fullsized":"2023-10-19T08:38:02.335829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:27:27.393059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338367+0000","last_change":"2023-10-19T08:37:56.285623+0000","last_active":"2023-10-19T08:38:02.338367+0000","last_peered":"2023-10-19T08:38:02.338367+0000","last_clean":"2023-10-19T08:38:02.338367+0000","last_became_active":"2023-10-19T08:37:56.285324+0000","last_became_peered":"2023-10-19T08:37:56.285324+0000","last_unstale":"2023-10-19T08:38:02.338367+0000","last_undegraded":"2023-10-19T08:38:02.338367+0000","last_fullsized":"2023-10-19T08:38:02.338367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:58:27.340847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336799+0000","last_change":"2023-10-19T08:37:57.283094+0000","last_active":"2023-10-19T08:38:02.336799+0000","last_peered":"2023-10-19T08:38:02.336799+0000","last_clean":"2023-10-19T08:38:02.336799+0000","last_became_active":"2023-10-19T08:37:57.282824+0000","last_became_peered":"2023-10-19T08:37:57.282824+0000","last_unstale":"2023-10-19T08:38:02.336799+0000","last_undegraded":"2023-10-19T08:38:02.336799+0000","last_fullsized":"2023-10-19T08:38:02.336799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:23:48.860817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336247+0000","last_change":"2023-10-19T08:38:01.331969+0000","last_active":"2023-10-19T08:38:02.336247+0000","last_peered":"2023-10-19T08:38:02.336247+0000","last_clean":"2023-10-19T08:38:02.336247+0000","last_became_active":"2023-10-19T08:38:01.331538+0000","last_became_peered":"2023-10-19T08:38:01.331538+0000","last_unstale":"2023-10-19T08:38:02.336247+0000","last_undegraded":"2023-10-19T08:38:02.336247+0000","last_fullsized":"2023-10-19T08:38:02.336247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:19:38.947409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338570+0000","last_change":"2023-10-19T08:37:56.287547+0000","last_active":"2023-10-19T08:38:02.338570+0000","last_peered":"2023-10-19T08:38:02.338570+0000","last_clean":"2023-10-19T08:38:02.338570+0000","last_became_active":"2023-10-19T08:37:56.287249+0000","last_became_peered":"2023-10-19T08:37:56.287249+0000","last_unstale":"2023-10-19T08:38:02.338570+0000","last_undegraded":"2023-10-19T08:38:02.338570+0000","last_fullsized":"2023-10-19T08:38:02.338570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:24:47.844759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336329+0000","last_change":"2023-10-19T08:37:57.282999+0000","last_active":"2023-10-19T08:38:02.336329+0000","last_peered":"2023-10-19T08:38:02.336329+0000","last_clean":"2023-10-19T08:38:02.336329+0000","last_became_active":"2023-10-19T08:37:57.282689+0000","last_became_peered":"2023-10-19T08:37:57.282689+0000","last_unstale":"2023-10-19T08:38:02.336329+0000","last_undegraded":"2023-10-19T08:38:02.336329+0000","last_fullsized":"2023-10-19T08:38:02.336329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:07:15.629005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336395+0000","last_change":"2023-10-19T08:38:01.346058+0000","last_active":"2023-10-19T08:38:02.336395+0000","last_peered":"2023-10-19T08:38:02.336395+0000","last_clean":"2023-10-19T08:38:02.336395+0000","last_became_active":"2023-10-19T08:38:01.345734+0000","last_became_peered":"2023-10-19T08:38:01.345734+0000","last_unstale":"2023-10-19T08:38:02.336395+0000","last_undegraded":"2023-10-19T08:38:02.336395+0000","last_fullsized":"2023-10-19T08:38:02.336395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:24:06.589136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302825+0000","last_change":"2023-10-19T08:37:56.281540+0000","last_active":"2023-10-19T08:38:02.302825+0000","last_peered":"2023-10-19T08:38:02.302825+0000","last_clean":"2023-10-19T08:38:02.302825+0000","last_became_active":"2023-10-19T08:37:56.281201+0000","last_became_peered":"2023-10-19T08:37:56.281201+0000","last_unstale":"2023-10-19T08:38:02.302825+0000","last_undegraded":"2023-10-19T08:38:02.302825+0000","last_fullsized":"2023-10-19T08:38:02.302825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:40.083342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328158+0000","last_change":"2023-10-19T08:37:57.281817+0000","last_active":"2023-10-19T08:38:02.328158+0000","last_peered":"2023-10-19T08:38:02.328158+0000","last_clean":"2023-10-19T08:38:02.328158+0000","last_became_active":"2023-10-19T08:37:57.281565+0000","last_became_peered":"2023-10-19T08:37:57.281565+0000","last_unstale":"2023-10-19T08:38:02.328158+0000","last_undegraded":"2023-10-19T08:38:02.328158+0000","last_fullsized":"2023-10-19T08:38:02.328158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:41.090590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336532+0000","last_change":"2023-10-19T08:38:01.334333+0000","last_active":"2023-10-19T08:38:02.336532+0000","last_peered":"2023-10-19T08:38:02.336532+0000","last_clean":"2023-10-19T08:38:02.336532+0000","last_became_active":"2023-10-19T08:38:01.333865+0000","last_became_peered":"2023-10-19T08:38:01.333865+0000","last_unstale":"2023-10-19T08:38:02.336532+0000","last_undegraded":"2023-10-19T08:38:02.336532+0000","last_fullsized":"2023-10-19T08:38:02.336532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:34:35.198286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302576+0000","last_change":"2023-10-19T08:37:56.281808+0000","last_active":"2023-10-19T08:38:02.302576+0000","last_peered":"2023-10-19T08:38:02.302576+0000","last_clean":"2023-10-19T08:38:02.302576+0000","last_became_active":"2023-10-19T08:37:56.281530+0000","last_became_peered":"2023-10-19T08:37:56.281530+0000","last_unstale":"2023-10-19T08:38:02.302576+0000","last_undegraded":"2023-10-19T08:38:02.302576+0000","last_fullsized":"2023-10-19T08:38:02.302576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:03.177003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337444+0000","last_change":"2023-10-19T08:37:57.291709+0000","last_active":"2023-10-19T08:38:02.337444+0000","last_peered":"2023-10-19T08:38:02.337444+0000","last_clean":"2023-10-19T08:38:02.337444+0000","last_became_active":"2023-10-19T08:37:57.291449+0000","last_became_peered":"2023-10-19T08:37:57.291449+0000","last_unstale":"2023-10-19T08:38:02.337444+0000","last_undegraded":"2023-10-19T08:38:02.337444+0000","last_fullsized":"2023-10-19T08:38:02.337444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:44:52.511554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336558+0000","last_change":"2023-10-19T08:38:01.347589+0000","last_active":"2023-10-19T08:38:02.336558+0000","last_peered":"2023-10-19T08:38:02.336558+0000","last_clean":"2023-10-19T08:38:02.336558+0000","last_became_active":"2023-10-19T08:38:01.347219+0000","last_became_peered":"2023-10-19T08:38:01.347219+0000","last_unstale":"2023-10-19T08:38:02.336558+0000","last_undegraded":"2023-10-19T08:38:02.336558+0000","last_fullsized":"2023-10-19T08:38:02.336558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:57:30.612083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336383+0000","last_change":"2023-10-19T08:37:56.280035+0000","last_active":"2023-10-19T08:38:02.336383+0000","last_peered":"2023-10-19T08:38:02.336383+0000","last_clean":"2023-10-19T08:38:02.336383+0000","last_became_active":"2023-10-19T08:37:56.279742+0000","last_became_peered":"2023-10-19T08:37:56.279742+0000","last_unstale":"2023-10-19T08:38:02.336383+0000","last_undegraded":"2023-10-19T08:38:02.336383+0000","last_fullsized":"2023-10-19T08:38:02.336383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:21:53.831892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338051+0000","last_change":"2023-10-19T08:37:57.286021+0000","last_active":"2023-10-19T08:38:02.338051+0000","last_peered":"2023-10-19T08:38:02.338051+0000","last_clean":"2023-10-19T08:38:02.338051+0000","last_became_active":"2023-10-19T08:37:57.285166+0000","last_became_peered":"2023-10-19T08:37:57.285166+0000","last_unstale":"2023-10-19T08:38:02.338051+0000","last_undegraded":"2023-10-19T08:38:02.338051+0000","last_fullsized":"2023-10-19T08:38:02.338051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:59:24.110607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303417+0000","last_change":"2023-10-19T08:38:01.342875+0000","last_active":"2023-10-19T08:38:02.303417+0000","last_peered":"2023-10-19T08:38:02.303417+0000","last_clean":"2023-10-19T08:38:02.303417+0000","last_became_active":"2023-10-19T08:38:01.341788+0000","last_became_peered":"2023-10-19T08:38:01.341788+0000","last_unstale":"2023-10-19T08:38:02.303417+0000","last_undegraded":"2023-10-19T08:38:02.303417+0000","last_fullsized":"2023-10-19T08:38:02.303417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:58:32.401327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336598+0000","last_change":"2023-10-19T08:37:56.283990+0000","last_active":"2023-10-19T08:38:02.336598+0000","last_peered":"2023-10-19T08:38:02.336598+0000","last_clean":"2023-10-19T08:38:02.336598+0000","last_became_active":"2023-10-19T08:37:56.283678+0000","last_became_peered":"2023-10-19T08:37:56.283678+0000","last_unstale":"2023-10-19T08:38:02.336598+0000","last_undegraded":"2023-10-19T08:38:02.336598+0000","last_fullsized":"2023-10-19T08:38:02.336598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:33:10.909410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338725+0000","last_change":"2023-10-19T08:37:57.289730+0000","last_active":"2023-10-19T08:38:02.338725+0000","last_peered":"2023-10-19T08:38:02.338725+0000","last_clean":"2023-10-19T08:38:02.338725+0000","last_became_active":"2023-10-19T08:37:57.289411+0000","last_became_peered":"2023-10-19T08:37:57.289411+0000","last_unstale":"2023-10-19T08:38:02.338725+0000","last_undegraded":"2023-10-19T08:38:02.338725+0000","last_fullsized":"2023-10-19T08:38:02.338725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:55:07.829465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338629+0000","last_change":"2023-10-19T08:38:01.341111+0000","last_active":"2023-10-19T08:38:02.338629+0000","last_peered":"2023-10-19T08:38:02.338629+0000","last_clean":"2023-10-19T08:38:02.338629+0000","last_became_active":"2023-10-19T08:38:01.340717+0000","last_became_peered":"2023-10-19T08:38:01.340717+0000","last_unstale":"2023-10-19T08:38:02.338629+0000","last_undegraded":"2023-10-19T08:38:02.338629+0000","last_fullsized":"2023-10-19T08:38:02.338629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:04:48.063590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302334+0000","last_change":"2023-10-19T08:37:56.286850+0000","last_active":"2023-10-19T08:38:02.302334+0000","last_peered":"2023-10-19T08:38:02.302334+0000","last_clean":"2023-10-19T08:38:02.302334+0000","last_became_active":"2023-10-19T08:37:56.286593+0000","last_became_peered":"2023-10-19T08:37:56.286593+0000","last_unstale":"2023-10-19T08:38:02.302334+0000","last_undegraded":"2023-10-19T08:38:02.302334+0000","last_fullsized":"2023-10-19T08:38:02.302334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:22.553042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337352+0000","last_change":"2023-10-19T08:37:57.296081+0000","last_active":"2023-10-19T08:38:02.337352+0000","last_peered":"2023-10-19T08:38:02.337352+0000","last_clean":"2023-10-19T08:38:02.337352+0000","last_became_active":"2023-10-19T08:37:57.295834+0000","last_became_peered":"2023-10-19T08:37:57.295834+0000","last_unstale":"2023-10-19T08:38:02.337352+0000","last_undegraded":"2023-10-19T08:38:02.337352+0000","last_fullsized":"2023-10-19T08:38:02.337352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:16.159720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327643+0000","last_change":"2023-10-19T08:38:01.344908+0000","last_active":"2023-10-19T08:38:02.327643+0000","last_peered":"2023-10-19T08:38:02.327643+0000","last_clean":"2023-10-19T08:38:02.327643+0000","last_became_active":"2023-10-19T08:38:01.342061+0000","last_became_peered":"2023-10-19T08:38:01.342061+0000","last_unstale":"2023-10-19T08:38:02.327643+0000","last_undegraded":"2023-10-19T08:38:02.327643+0000","last_fullsized":"2023-10-19T08:38:02.327643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:58:38.199370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336703+0000","last_change":"2023-10-19T08:37:51.153209+0000","last_active":"2023-10-19T08:38:02.336703+0000","last_peered":"2023-10-19T08:38:02.336703+0000","last_clean":"2023-10-19T08:38:02.336703+0000","last_became_active":"2023-10-19T08:37:51.152844+0000","last_became_peered":"2023-10-19T08:37:51.152844+0000","last_unstale":"2023-10-19T08:38:02.336703+0000","last_undegraded":"2023-10-19T08:38:02.336703+0000","last_fullsized":"2023-10-19T08:38:02.336703+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:58:27.990585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303140+0000","last_change":"2023-10-19T08:37:56.283202+0000","last_active":"2023-10-19T08:38:02.303140+0000","last_peered":"2023-10-19T08:38:02.303140+0000","last_clean":"2023-10-19T08:38:02.303140+0000","last_became_active":"2023-10-19T08:37:56.282930+0000","last_became_peered":"2023-10-19T08:37:56.282930+0000","last_unstale":"2023-10-19T08:38:02.303140+0000","last_undegraded":"2023-10-19T08:38:02.303140+0000","last_fullsized":"2023-10-19T08:38:02.303140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:43:07.850875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336384+0000","last_change":"2023-10-19T08:37:57.273005+0000","last_active":"2023-10-19T08:38:02.336384+0000","last_peered":"2023-10-19T08:38:02.336384+0000","last_clean":"2023-10-19T08:38:02.336384+0000","last_became_active":"2023-10-19T08:37:57.272159+0000","last_became_peered":"2023-10-19T08:37:57.272159+0000","last_unstale":"2023-10-19T08:38:02.336384+0000","last_undegraded":"2023-10-19T08:38:02.336384+0000","last_fullsized":"2023-10-19T08:38:02.336384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:49.381912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327478+0000","last_change":"2023-10-19T08:38:01.342853+0000","last_active":"2023-10-19T08:38:02.327478+0000","last_peered":"2023-10-19T08:38:02.327478+0000","last_clean":"2023-10-19T08:38:02.327478+0000","last_became_active":"2023-10-19T08:38:01.342166+0000","last_became_peered":"2023-10-19T08:38:01.342166+0000","last_unstale":"2023-10-19T08:38:02.327478+0000","last_undegraded":"2023-10-19T08:38:02.327478+0000","last_fullsized":"2023-10-19T08:38:02.327478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:50:56.650312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302902+0000","last_change":"2023-10-19T08:37:51.116743+0000","last_active":"2023-10-19T08:38:02.302902+0000","last_peered":"2023-10-19T08:38:02.302902+0000","last_clean":"2023-10-19T08:38:02.302902+0000","last_became_active":"2023-10-19T08:37:51.116511+0000","last_became_peered":"2023-10-19T08:37:51.116511+0000","last_unstale":"2023-10-19T08:38:02.302902+0000","last_undegraded":"2023-10-19T08:38:02.302902+0000","last_fullsized":"2023-10-19T08:38:02.302902+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:36.872869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337533+0000","last_change":"2023-10-19T08:37:56.280470+0000","last_active":"2023-10-19T08:38:02.337533+0000","last_peered":"2023-10-19T08:38:02.337533+0000","last_clean":"2023-10-19T08:38:02.337533+0000","last_became_active":"2023-10-19T08:37:56.280178+0000","last_became_peered":"2023-10-19T08:37:56.280178+0000","last_unstale":"2023-10-19T08:38:02.337533+0000","last_undegraded":"2023-10-19T08:38:02.337533+0000","last_fullsized":"2023-10-19T08:38:02.337533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:58:02.145386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336644+0000","last_change":"2023-10-19T08:37:57.283444+0000","last_active":"2023-10-19T08:38:02.336644+0000","last_peered":"2023-10-19T08:38:02.336644+0000","last_clean":"2023-10-19T08:38:02.336644+0000","last_became_active":"2023-10-19T08:37:57.283153+0000","last_became_peered":"2023-10-19T08:37:57.283153+0000","last_unstale":"2023-10-19T08:38:02.336644+0000","last_undegraded":"2023-10-19T08:38:02.336644+0000","last_fullsized":"2023-10-19T08:38:02.336644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:50:52.597080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336583+0000","last_change":"2023-10-19T08:38:01.342565+0000","last_active":"2023-10-19T08:38:02.336583+0000","last_peered":"2023-10-19T08:38:02.336583+0000","last_clean":"2023-10-19T08:38:02.336583+0000","last_became_active":"2023-10-19T08:38:01.341889+0000","last_became_peered":"2023-10-19T08:38:01.341889+0000","last_unstale":"2023-10-19T08:38:02.336583+0000","last_undegraded":"2023-10-19T08:38:02.336583+0000","last_fullsized":"2023-10-19T08:38:02.336583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:02:48.585528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336488+0000","last_change":"2023-10-19T08:37:51.114782+0000","last_active":"2023-10-19T08:38:02.336488+0000","last_peered":"2023-10-19T08:38:02.336488+0000","last_clean":"2023-10-19T08:38:02.336488+0000","last_became_active":"2023-10-19T08:37:51.114388+0000","last_became_peered":"2023-10-19T08:37:51.114388+0000","last_unstale":"2023-10-19T08:38:02.336488+0000","last_undegraded":"2023-10-19T08:38:02.336488+0000","last_fullsized":"2023-10-19T08:38:02.336488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:36:18.887665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.335983+0000","last_change":"2023-10-19T08:37:56.283345+0000","last_active":"2023-10-19T08:38:02.335983+0000","last_peered":"2023-10-19T08:38:02.335983+0000","last_clean":"2023-10-19T08:38:02.335983+0000","last_became_active":"2023-10-19T08:37:56.283066+0000","last_became_peered":"2023-10-19T08:37:56.283066+0000","last_unstale":"2023-10-19T08:38:02.335983+0000","last_undegraded":"2023-10-19T08:38:02.335983+0000","last_fullsized":"2023-10-19T08:38:02.335983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:00:05.442442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337299+0000","last_change":"2023-10-19T08:37:57.272609+0000","last_active":"2023-10-19T08:38:02.337299+0000","last_peered":"2023-10-19T08:38:02.337299+0000","last_clean":"2023-10-19T08:38:02.337299+0000","last_became_active":"2023-10-19T08:37:57.272328+0000","last_became_peered":"2023-10-19T08:37:57.272328+0000","last_unstale":"2023-10-19T08:38:02.337299+0000","last_undegraded":"2023-10-19T08:38:02.337299+0000","last_fullsized":"2023-10-19T08:38:02.337299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:09.106701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338110+0000","last_change":"2023-10-19T08:38:01.350479+0000","last_active":"2023-10-19T08:38:02.338110+0000","last_peered":"2023-10-19T08:38:02.338110+0000","last_clean":"2023-10-19T08:38:02.338110+0000","last_became_active":"2023-10-19T08:38:01.350030+0000","last_became_peered":"2023-10-19T08:38:01.350030+0000","last_unstale":"2023-10-19T08:38:02.338110+0000","last_undegraded":"2023-10-19T08:38:02.338110+0000","last_fullsized":"2023-10-19T08:38:02.338110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:20.212952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302863+0000","last_change":"2023-10-19T08:37:51.115141+0000","last_active":"2023-10-19T08:38:02.302863+0000","last_peered":"2023-10-19T08:38:02.302863+0000","last_clean":"2023-10-19T08:38:02.302863+0000","last_became_active":"2023-10-19T08:37:51.114829+0000","last_became_peered":"2023-10-19T08:37:51.114829+0000","last_unstale":"2023-10-19T08:38:02.302863+0000","last_undegraded":"2023-10-19T08:38:02.302863+0000","last_fullsized":"2023-10-19T08:38:02.302863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:34.010255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336533+0000","last_change":"2023-10-19T08:37:51.153453+0000","last_active":"2023-10-19T08:38:02.336533+0000","last_peered":"2023-10-19T08:38:02.336533+0000","last_clean":"2023-10-19T08:38:02.336533+0000","last_became_active":"2023-10-19T08:37:51.153093+0000","last_became_peered":"2023-10-19T08:37:51.153093+0000","last_unstale":"2023-10-19T08:38:02.336533+0000","last_undegraded":"2023-10-19T08:38:02.336533+0000","last_fullsized":"2023-10-19T08:38:02.336533+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:17.404738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302485+0000","last_change":"2023-10-19T08:37:56.285142+0000","last_active":"2023-10-19T08:38:02.302485+0000","last_peered":"2023-10-19T08:38:02.302485+0000","last_clean":"2023-10-19T08:38:02.302485+0000","last_became_active":"2023-10-19T08:37:56.284717+0000","last_became_peered":"2023-10-19T08:37:56.284717+0000","last_unstale":"2023-10-19T08:38:02.302485+0000","last_undegraded":"2023-10-19T08:38:02.302485+0000","last_fullsized":"2023-10-19T08:38:02.302485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:08.099452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337159+0000","last_change":"2023-10-19T08:37:57.287714+0000","last_active":"2023-10-19T08:38:02.337159+0000","last_peered":"2023-10-19T08:38:02.337159+0000","last_clean":"2023-10-19T08:38:02.337159+0000","last_became_active":"2023-10-19T08:37:57.287427+0000","last_became_peered":"2023-10-19T08:37:57.287427+0000","last_unstale":"2023-10-19T08:38:02.337159+0000","last_undegraded":"2023-10-19T08:38:02.337159+0000","last_fullsized":"2023-10-19T08:38:02.337159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:55:59.475158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303093+0000","last_change":"2023-10-19T08:38:01.343223+0000","last_active":"2023-10-19T08:38:02.303093+0000","last_peered":"2023-10-19T08:38:02.303093+0000","last_clean":"2023-10-19T08:38:02.303093+0000","last_became_active":"2023-10-19T08:38:01.342425+0000","last_became_peered":"2023-10-19T08:38:01.342425+0000","last_unstale":"2023-10-19T08:38:02.303093+0000","last_undegraded":"2023-10-19T08:38:02.303093+0000","last_fullsized":"2023-10-19T08:38:02.303093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:13.159933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336674+0000","last_change":"2023-10-19T08:37:51.118439+0000","last_active":"2023-10-19T08:38:02.336674+0000","last_peered":"2023-10-19T08:38:02.336674+0000","last_clean":"2023-10-19T08:38:02.336674+0000","last_became_active":"2023-10-19T08:37:51.118146+0000","last_became_peered":"2023-10-19T08:37:51.118146+0000","last_unstale":"2023-10-19T08:38:02.336674+0000","last_undegraded":"2023-10-19T08:38:02.336674+0000","last_fullsized":"2023-10-19T08:38:02.336674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:34.935038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327100+0000","last_change":"2023-10-19T08:37:56.275735+0000","last_active":"2023-10-19T08:38:02.327100+0000","last_peered":"2023-10-19T08:38:02.327100+0000","last_clean":"2023-10-19T08:38:02.327100+0000","last_became_active":"2023-10-19T08:37:56.275386+0000","last_became_peered":"2023-10-19T08:37:56.275386+0000","last_unstale":"2023-10-19T08:38:02.327100+0000","last_undegraded":"2023-10-19T08:38:02.327100+0000","last_fullsized":"2023-10-19T08:38:02.327100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:48.374663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328345+0000","last_change":"2023-10-19T08:37:57.280800+0000","last_active":"2023-10-19T08:38:02.328345+0000","last_peered":"2023-10-19T08:38:02.328345+0000","last_clean":"2023-10-19T08:38:02.328345+0000","last_became_active":"2023-10-19T08:37:57.280464+0000","last_became_peered":"2023-10-19T08:37:57.280464+0000","last_unstale":"2023-10-19T08:38:02.328345+0000","last_undegraded":"2023-10-19T08:38:02.328345+0000","last_fullsized":"2023-10-19T08:38:02.328345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:21.864097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336567+0000","last_change":"2023-10-19T08:38:01.335275+0000","last_active":"2023-10-19T08:38:02.336567+0000","last_peered":"2023-10-19T08:38:02.336567+0000","last_clean":"2023-10-19T08:38:02.336567+0000","last_became_active":"2023-10-19T08:38:01.334707+0000","last_became_peered":"2023-10-19T08:38:01.334707+0000","last_unstale":"2023-10-19T08:38:02.336567+0000","last_undegraded":"2023-10-19T08:38:02.336567+0000","last_fullsized":"2023-10-19T08:38:02.336567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:03.691358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338327+0000","last_change":"2023-10-19T08:37:51.153416+0000","last_active":"2023-10-19T08:38:02.338327+0000","last_peered":"2023-10-19T08:38:02.338327+0000","last_clean":"2023-10-19T08:38:02.338327+0000","last_became_active":"2023-10-19T08:37:51.152844+0000","last_became_peered":"2023-10-19T08:37:51.152844+0000","last_unstale":"2023-10-19T08:38:02.338327+0000","last_undegraded":"2023-10-19T08:38:02.338327+0000","last_fullsized":"2023-10-19T08:38:02.338327+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:10.215323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336833+0000","last_change":"2023-10-19T08:37:56.284323+0000","last_active":"2023-10-19T08:38:02.336833+0000","last_peered":"2023-10-19T08:38:02.336833+0000","last_clean":"2023-10-19T08:38:02.336833+0000","last_became_active":"2023-10-19T08:37:56.283556+0000","last_became_peered":"2023-10-19T08:37:56.283556+0000","last_unstale":"2023-10-19T08:38:02.336833+0000","last_undegraded":"2023-10-19T08:38:02.336833+0000","last_fullsized":"2023-10-19T08:38:02.336833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:22.553042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327868+0000","last_change":"2023-10-19T08:37:57.283892+0000","last_active":"2023-10-19T08:38:02.327868+0000","last_peered":"2023-10-19T08:38:02.327868+0000","last_clean":"2023-10-19T08:38:02.327868+0000","last_became_active":"2023-10-19T08:37:57.283605+0000","last_became_peered":"2023-10-19T08:37:57.283605+0000","last_unstale":"2023-10-19T08:38:02.327868+0000","last_undegraded":"2023-10-19T08:38:02.327868+0000","last_fullsized":"2023-10-19T08:38:02.327868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:23.560291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336875+0000","last_change":"2023-10-19T08:38:01.348839+0000","last_active":"2023-10-19T08:38:02.336875+0000","last_peered":"2023-10-19T08:38:02.336875+0000","last_clean":"2023-10-19T08:38:02.336875+0000","last_became_active":"2023-10-19T08:38:01.348383+0000","last_became_peered":"2023-10-19T08:38:01.348383+0000","last_unstale":"2023-10-19T08:38:02.336875+0000","last_undegraded":"2023-10-19T08:38:02.336875+0000","last_fullsized":"2023-10-19T08:38:02.336875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:28:33.114633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303327+0000","last_change":"2023-10-19T08:37:56.285043+0000","last_active":"2023-10-19T08:38:02.303327+0000","last_peered":"2023-10-19T08:38:02.303327+0000","last_clean":"2023-10-19T08:38:02.303327+0000","last_became_active":"2023-10-19T08:37:56.284744+0000","last_became_peered":"2023-10-19T08:37:56.284744+0000","last_unstale":"2023-10-19T08:38:02.303327+0000","last_undegraded":"2023-10-19T08:38:02.303327+0000","last_fullsized":"2023-10-19T08:38:02.303327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:49.109159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336864+0000","last_change":"2023-10-19T08:37:51.124188+0000","last_active":"2023-10-19T08:38:02.336864+0000","last_peered":"2023-10-19T08:38:02.336864+0000","last_clean":"2023-10-19T08:38:02.336864+0000","last_became_active":"2023-10-19T08:37:51.123944+0000","last_became_peered":"2023-10-19T08:37:51.123944+0000","last_unstale":"2023-10-19T08:38:02.336864+0000","last_undegraded":"2023-10-19T08:38:02.336864+0000","last_fullsized":"2023-10-19T08:38:02.336864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:15.708544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302239+0000","last_change":"2023-10-19T08:37:57.292133+0000","last_active":"2023-10-19T08:38:02.302239+0000","last_peered":"2023-10-19T08:38:02.302239+0000","last_clean":"2023-10-19T08:38:02.302239+0000","last_became_active":"2023-10-19T08:37:57.291516+0000","last_became_peered":"2023-10-19T08:37:57.291516+0000","last_unstale":"2023-10-19T08:38:02.302239+0000","last_undegraded":"2023-10-19T08:38:02.302239+0000","last_fullsized":"2023-10-19T08:38:02.302239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:41.090590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302236+0000","last_change":"2023-10-19T08:38:01.346818+0000","last_active":"2023-10-19T08:38:02.302236+0000","last_peered":"2023-10-19T08:38:02.302236+0000","last_clean":"2023-10-19T08:38:02.302236+0000","last_became_active":"2023-10-19T08:38:01.346160+0000","last_became_peered":"2023-10-19T08:38:01.346160+0000","last_unstale":"2023-10-19T08:38:02.302236+0000","last_undegraded":"2023-10-19T08:38:02.302236+0000","last_fullsized":"2023-10-19T08:38:02.302236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:58:38.199370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337121+0000","last_change":"2023-10-19T08:37:52.296732+0000","last_active":"2023-10-19T08:38:02.337121+0000","last_peered":"2023-10-19T08:38:02.337121+0000","last_clean":"2023-10-19T08:38:02.337121+0000","last_became_active":"2023-10-19T08:37:52.296445+0000","last_became_peered":"2023-10-19T08:37:52.296445+0000","last_unstale":"2023-10-19T08:38:02.337121+0000","last_undegraded":"2023-10-19T08:38:02.337121+0000","last_fullsized":"2023-10-19T08:38:02.337121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:06:03.911706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328377+0000","last_change":"2023-10-19T08:37:56.284122+0000","last_active":"2023-10-19T08:38:02.328377+0000","last_peered":"2023-10-19T08:38:02.328377+0000","last_clean":"2023-10-19T08:38:02.328377+0000","last_became_active":"2023-10-19T08:37:56.283849+0000","last_became_peered":"2023-10-19T08:37:56.283849+0000","last_unstale":"2023-10-19T08:38:02.328377+0000","last_undegraded":"2023-10-19T08:38:02.328377+0000","last_fullsized":"2023-10-19T08:38:02.328377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:39.158559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336659+0000","last_change":"2023-10-19T08:37:57.285543+0000","last_active":"2023-10-19T08:38:02.336659+0000","last_peered":"2023-10-19T08:38:02.336659+0000","last_clean":"2023-10-19T08:38:02.336659+0000","last_became_active":"2023-10-19T08:37:57.284966+0000","last_became_peered":"2023-10-19T08:37:57.284966+0000","last_unstale":"2023-10-19T08:38:02.336659+0000","last_undegraded":"2023-10-19T08:38:02.336659+0000","last_fullsized":"2023-10-19T08:38:02.336659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:07:16.162389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336877+0000","last_change":"2023-10-19T08:38:01.351967+0000","last_active":"2023-10-19T08:38:02.336877+0000","last_peered":"2023-10-19T08:38:02.336877+0000","last_clean":"2023-10-19T08:38:02.336877+0000","last_became_active":"2023-10-19T08:38:01.351672+0000","last_became_peered":"2023-10-19T08:38:01.351672+0000","last_unstale":"2023-10-19T08:38:02.336877+0000","last_undegraded":"2023-10-19T08:38:02.336877+0000","last_fullsized":"2023-10-19T08:38:02.336877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:56.518286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327742+0000","last_change":"2023-10-19T08:37:56.276005+0000","last_active":"2023-10-19T08:38:02.327742+0000","last_peered":"2023-10-19T08:38:02.327742+0000","last_clean":"2023-10-19T08:38:02.327742+0000","last_became_active":"2023-10-19T08:37:56.275738+0000","last_became_peered":"2023-10-19T08:37:56.275738+0000","last_unstale":"2023-10-19T08:38:02.327742+0000","last_undegraded":"2023-10-19T08:38:02.327742+0000","last_fullsized":"2023-10-19T08:38:02.327742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:01.303025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336641+0000","last_change":"2023-10-19T08:37:57.282141+0000","last_active":"2023-10-19T08:38:02.336641+0000","last_peered":"2023-10-19T08:38:02.336641+0000","last_clean":"2023-10-19T08:38:02.336641+0000","last_became_active":"2023-10-19T08:37:57.281854+0000","last_became_peered":"2023-10-19T08:37:57.281854+0000","last_unstale":"2023-10-19T08:38:02.336641+0000","last_undegraded":"2023-10-19T08:38:02.336641+0000","last_fullsized":"2023-10-19T08:38:02.336641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:08:06.606119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337880+0000","last_change":"2023-10-19T08:38:01.345085+0000","last_active":"2023-10-19T08:38:02.337880+0000","last_peered":"2023-10-19T08:38:02.337880+0000","last_clean":"2023-10-19T08:38:02.337880+0000","last_became_active":"2023-10-19T08:38:01.344682+0000","last_became_peered":"2023-10-19T08:38:01.344682+0000","last_unstale":"2023-10-19T08:38:02.337880+0000","last_undegraded":"2023-10-19T08:38:02.337880+0000","last_fullsized":"2023-10-19T08:38:02.337880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:13.159933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302932+0000","last_change":"2023-10-19T08:37:56.279226+0000","last_active":"2023-10-19T08:38:02.302932+0000","last_peered":"2023-10-19T08:38:02.302932+0000","last_clean":"2023-10-19T08:38:02.302932+0000","last_became_active":"2023-10-19T08:37:56.278922+0000","last_became_peered":"2023-10-19T08:37:56.278922+0000","last_unstale":"2023-10-19T08:38:02.302932+0000","last_undegraded":"2023-10-19T08:38:02.302932+0000","last_fullsized":"2023-10-19T08:38:02.302932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:29.730980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337314+0000","last_change":"2023-10-19T08:37:57.295005+0000","last_active":"2023-10-19T08:38:02.337314+0000","last_peered":"2023-10-19T08:38:02.337314+0000","last_clean":"2023-10-19T08:38:02.337314+0000","last_became_active":"2023-10-19T08:37:57.294608+0000","last_became_peered":"2023-10-19T08:37:57.294608+0000","last_unstale":"2023-10-19T08:38:02.337314+0000","last_undegraded":"2023-10-19T08:38:02.337314+0000","last_fullsized":"2023-10-19T08:38:02.337314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:49:06.947549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302938+0000","last_change":"2023-10-19T08:38:01.340671+0000","last_active":"2023-10-19T08:38:02.302938+0000","last_peered":"2023-10-19T08:38:02.302938+0000","last_clean":"2023-10-19T08:38:02.302938+0000","last_became_active":"2023-10-19T08:38:01.340227+0000","last_became_peered":"2023-10-19T08:38:01.340227+0000","last_unstale":"2023-10-19T08:38:02.302938+0000","last_undegraded":"2023-10-19T08:38:02.302938+0000","last_fullsized":"2023-10-19T08:38:02.302938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:25.917329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303068+0000","last_change":"2023-10-19T08:37:56.279662+0000","last_active":"2023-10-19T08:38:02.303068+0000","last_peered":"2023-10-19T08:38:02.303068+0000","last_clean":"2023-10-19T08:38:02.303068+0000","last_became_active":"2023-10-19T08:37:56.279082+0000","last_became_peered":"2023-10-19T08:37:56.279082+0000","last_unstale":"2023-10-19T08:38:02.303068+0000","last_undegraded":"2023-10-19T08:38:02.303068+0000","last_fullsized":"2023-10-19T08:38:02.303068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:15.152471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336105+0000","last_change":"2023-10-19T08:37:57.291366+0000","last_active":"2023-10-19T08:38:02.336105+0000","last_peered":"2023-10-19T08:38:02.336105+0000","last_clean":"2023-10-19T08:38:02.336105+0000","last_became_active":"2023-10-19T08:37:57.291122+0000","last_became_peered":"2023-10-19T08:37:57.291122+0000","last_unstale":"2023-10-19T08:38:02.336105+0000","last_undegraded":"2023-10-19T08:38:02.336105+0000","last_fullsized":"2023-10-19T08:38:02.336105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:10:57.605170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336071+0000","last_change":"2023-10-19T08:38:01.343824+0000","last_active":"2023-10-19T08:38:02.336071+0000","last_peered":"2023-10-19T08:38:02.336071+0000","last_clean":"2023-10-19T08:38:02.336071+0000","last_became_active":"2023-10-19T08:38:01.343411+0000","last_became_peered":"2023-10-19T08:38:01.343411+0000","last_unstale":"2023-10-19T08:38:02.336071+0000","last_undegraded":"2023-10-19T08:38:02.336071+0000","last_fullsized":"2023-10-19T08:38:02.336071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:18:50.610592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302995+0000","last_change":"2023-10-19T08:37:56.279882+0000","last_active":"2023-10-19T08:38:02.302995+0000","last_peered":"2023-10-19T08:38:02.302995+0000","last_clean":"2023-10-19T08:38:02.302995+0000","last_became_active":"2023-10-19T08:37:56.279620+0000","last_became_peered":"2023-10-19T08:37:56.279620+0000","last_unstale":"2023-10-19T08:38:02.302995+0000","last_undegraded":"2023-10-19T08:38:02.302995+0000","last_fullsized":"2023-10-19T08:38:02.302995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:58:27.340847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302471+0000","last_change":"2023-10-19T08:37:57.291911+0000","last_active":"2023-10-19T08:38:02.302471+0000","last_peered":"2023-10-19T08:38:02.302471+0000","last_clean":"2023-10-19T08:38:02.302471+0000","last_became_active":"2023-10-19T08:37:57.291157+0000","last_became_peered":"2023-10-19T08:37:57.291157+0000","last_unstale":"2023-10-19T08:38:02.302471+0000","last_undegraded":"2023-10-19T08:38:02.302471+0000","last_fullsized":"2023-10-19T08:38:02.302471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:40.165807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337238+0000","last_change":"2023-10-19T08:38:01.350894+0000","last_active":"2023-10-19T08:38:02.337238+0000","last_peered":"2023-10-19T08:38:02.337238+0000","last_clean":"2023-10-19T08:38:02.337238+0000","last_became_active":"2023-10-19T08:38:01.347794+0000","last_became_peered":"2023-10-19T08:38:01.347794+0000","last_unstale":"2023-10-19T08:38:02.337238+0000","last_undegraded":"2023-10-19T08:38:02.337238+0000","last_fullsized":"2023-10-19T08:38:02.337238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:47.081654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328719+0000","last_change":"2023-10-19T08:37:56.285044+0000","last_active":"2023-10-19T08:38:02.328719+0000","last_peered":"2023-10-19T08:38:02.328719+0000","last_clean":"2023-10-19T08:38:02.328719+0000","last_became_active":"2023-10-19T08:37:56.284825+0000","last_became_peered":"2023-10-19T08:37:56.284825+0000","last_unstale":"2023-10-19T08:38:02.328719+0000","last_undegraded":"2023-10-19T08:38:02.328719+0000","last_fullsized":"2023-10-19T08:38:02.328719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:15.363627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336251+0000","last_change":"2023-10-19T08:37:57.287724+0000","last_active":"2023-10-19T08:38:02.336251+0000","last_peered":"2023-10-19T08:38:02.336251+0000","last_clean":"2023-10-19T08:38:02.336251+0000","last_became_active":"2023-10-19T08:37:57.287402+0000","last_became_peered":"2023-10-19T08:37:57.287402+0000","last_unstale":"2023-10-19T08:38:02.336251+0000","last_undegraded":"2023-10-19T08:38:02.336251+0000","last_fullsized":"2023-10-19T08:38:02.336251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:11:01.726937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336321+0000","last_change":"2023-10-19T08:37:57.280610+0000","last_active":"2023-10-19T08:38:02.336321+0000","last_peered":"2023-10-19T08:38:02.336321+0000","last_clean":"2023-10-19T08:38:02.336321+0000","last_became_active":"2023-10-19T08:37:57.280180+0000","last_became_peered":"2023-10-19T08:37:57.280180+0000","last_unstale":"2023-10-19T08:38:02.336321+0000","last_undegraded":"2023-10-19T08:38:02.336321+0000","last_fullsized":"2023-10-19T08:38:02.336321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:50:11.458306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302739+0000","last_change":"2023-10-19T08:37:57.292317+0000","last_active":"2023-10-19T08:38:02.302739+0000","last_peered":"2023-10-19T08:38:02.302739+0000","last_clean":"2023-10-19T08:38:02.302739+0000","last_became_active":"2023-10-19T08:37:57.291863+0000","last_became_peered":"2023-10-19T08:37:57.291863+0000","last_unstale":"2023-10-19T08:38:02.302739+0000","last_undegraded":"2023-10-19T08:38:02.302739+0000","last_fullsized":"2023-10-19T08:38:02.302739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:45:25.612225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337065+0000","last_change":"2023-10-19T08:37:57.289937+0000","last_active":"2023-10-19T08:38:02.337065+0000","last_peered":"2023-10-19T08:38:02.337065+0000","last_clean":"2023-10-19T08:38:02.337065+0000","last_became_active":"2023-10-19T08:37:57.289356+0000","last_became_peered":"2023-10-19T08:37:57.289356+0000","last_unstale":"2023-10-19T08:38:02.337065+0000","last_undegraded":"2023-10-19T08:38:02.337065+0000","last_fullsized":"2023-10-19T08:38:02.337065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:46.461250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302347+0000","last_change":"2023-10-19T08:37:57.292611+0000","last_active":"2023-10-19T08:38:02.302347+0000","last_peered":"2023-10-19T08:38:02.302347+0000","last_clean":"2023-10-19T08:38:02.302347+0000","last_became_active":"2023-10-19T08:37:57.291906+0000","last_became_peered":"2023-10-19T08:37:57.291906+0000","last_unstale":"2023-10-19T08:38:02.302347+0000","last_undegraded":"2023-10-19T08:38:02.302347+0000","last_fullsized":"2023-10-19T08:38:02.302347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:52.465054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336760+0000","last_change":"2023-10-19T08:37:57.288360+0000","last_active":"2023-10-19T08:38:02.336760+0000","last_peered":"2023-10-19T08:38:02.336760+0000","last_clean":"2023-10-19T08:38:02.336760+0000","last_became_active":"2023-10-19T08:37:57.288107+0000","last_became_peered":"2023-10-19T08:37:57.288107+0000","last_unstale":"2023-10-19T08:38:02.336760+0000","last_undegraded":"2023-10-19T08:38:02.336760+0000","last_fullsized":"2023-10-19T08:38:02.336760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:02.310273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":888832,"data_stored":704558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":110132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":110132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":699721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":109148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":110222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":112669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":110784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-19T08:38:26.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-19T08:38:26.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.359+0000 7f3519326700 1 Processor -- start 2023-10-19T08:38:26.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.359+0000 7f3519326700 1 -- start start 2023-10-19T08:38:26.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.360+0000 7f3519326700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f35140d0890 0x7f35140d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:26.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.360+0000 7f3519326700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35140cedf0 0x7f35140b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:26.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.360+0000 7f3519326700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35140cfd90 con 0x7f351415af90 2023-10-19T08:38:26.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.360+0000 7f3519326700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35140b3f20 con 0x7f35140d0890 2023-10-19T08:38:26.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.360+0000 7f3519326700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35140cf2a0 con 0x7f35140cedf0 2023-10-19T08:38:26.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.360+0000 7f35127fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f35140d0890 0x7f35140d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:26.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.360+0000 7f35127fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f35140d0890 0x7f35140d1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46612/0 (socket says 172.21.15.79:46612) 2023-10-19T08:38:26.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.360+0000 7f35127fc700 1 -- 172.21.15.79:0/2983362204 learned_addr learned my addr 172.21.15.79:0/2983362204 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:26.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.360+0000 7f35137fe700 1 --2- 172.21.15.79:0/2983362204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35140cedf0 0x7f35140b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:26.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.360+0000 7f35127fc700 1 -- 172.21.15.79:0/2983362204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35140cedf0 msgr2=0x7f35140b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:26.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.360+0000 7f35127fc700 1 --2- 172.21.15.79:0/2983362204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35140cedf0 0x7f35140b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.360+0000 7f35127fc700 1 -- 172.21.15.79:0/2983362204 >> v1:172.21.15.89:6789/0 conn(0x7f351415af90 legacy=0x7f35140d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:26.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.360+0000 7f35127fc700 1 -- 172.21.15.79:0/2983362204 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35140cf4f0 con 0x7f35140d0890 2023-10-19T08:38:26.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.360+0000 7f35137fe700 1 --2- 172.21.15.79:0/2983362204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35140cedf0 0x7f35140b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:26.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.360+0000 7f35127fc700 1 --2- 172.21.15.79:0/2983362204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35140d0890 0x7f35140d1680 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f35040098f0 tx=0x7f3504009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0e5d96ea0eb680 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:26.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.360+0000 7f3511ffb700 1 -- 172.21.15.79:0/2983362204 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3504004230 con 0x7f35140d0890 2023-10-19T08:38:26.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.360+0000 7f3511ffb700 1 -- 172.21.15.79:0/2983362204 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3504004390 con 0x7f35140d0890 2023-10-19T08:38:26.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.360+0000 7f3511ffb700 1 -- 172.21.15.79:0/2983362204 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35040036a0 con 0x7f35140d0890 2023-10-19T08:38:26.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.361+0000 7f3519326700 1 -- 172.21.15.79:0/2983362204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35140d0890 msgr2=0x7f35140d1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:26.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.361+0000 7f3519326700 1 --2- 172.21.15.79:0/2983362204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35140d0890 0x7f35140d1680 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f35040098f0 tx=0x7f3504009c00 comp rx=0 tx=0).stop 2023-10-19T08:38:26.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.361+0000 7f3519326700 1 -- 172.21.15.79:0/2983362204 shutdown_connections 2023-10-19T08:38:26.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.361+0000 7f3519326700 1 --2- 172.21.15.79:0/2983362204 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35140cedf0 0x7f35140b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.361+0000 7f3519326700 1 --2- 172.21.15.79:0/2983362204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35140d0890 0x7f35140d1680 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.361+0000 7f3519326700 1 -- 172.21.15.79:0/2983362204 >> 172.21.15.79:0/2983362204 conn(0x7f351406a400 msgr2=0x7f351406a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:26.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.361+0000 7f3519326700 1 -- 172.21.15.79:0/2983362204 shutdown_connections 2023-10-19T08:38:26.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.361+0000 7f3519326700 1 -- 172.21.15.79:0/2983362204 wait complete. 2023-10-19T08:38:26.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.363+0000 7f3519326700 1 Processor -- start 2023-10-19T08:38:26.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.363+0000 7f3519326700 1 -- start start 2023-10-19T08:38:26.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f3519326700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35140cedf0 0x7f35141f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:26.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f3519326700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35140d0890 0x7f35141577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:26.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f3519326700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351415af90 0x7f35140ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:26.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f3519326700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3514157d10 con 0x7f351415af90 2023-10-19T08:38:26.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f3519326700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3514154930 con 0x7f35140d0890 2023-10-19T08:38:26.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f3519326700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3514154c10 con 0x7f35140cedf0 2023-10-19T08:38:26.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f35137fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351415af90 0x7f35140ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:26.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f35137fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351415af90 0x7f35140ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46620/0 (socket says 172.21.15.79:46620) 2023-10-19T08:38:26.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f35137fe700 1 -- 172.21.15.79:0/94112650 learned_addr learned my addr 172.21.15.79:0/94112650 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:26.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f35127fc700 1 --2- 172.21.15.79:0/94112650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35140d0890 0x7f35141577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:26.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f3512ffd700 1 --2- 172.21.15.79:0/94112650 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35140cedf0 0x7f35141f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:26.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f35137fe700 1 -- 172.21.15.79:0/94112650 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35140cedf0 msgr2=0x7f35141f4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:26.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f35137fe700 1 --2- 172.21.15.79:0/94112650 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35140cedf0 0x7f35141f4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f35137fe700 1 -- 172.21.15.79:0/94112650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35140d0890 msgr2=0x7f35141577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f35137fe700 1 --2- 172.21.15.79:0/94112650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35140d0890 0x7f35141577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f35137fe700 1 -- 172.21.15.79:0/94112650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3504009550 con 0x7f351415af90 2023-10-19T08:38:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f3512ffd700 1 --2- 172.21.15.79:0/94112650 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35140cedf0 0x7f35141f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:26.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f35127fc700 1 --2- 172.21.15.79:0/94112650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35140d0890 0x7f35141577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f35137fe700 1 --2- 172.21.15.79:0/94112650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351415af90 0x7f35140ca040 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f350c00cef0 tx=0x7f350c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f34fb7fe700 1 -- 172.21.15.79:0/94112650 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c00ae50 con 0x7f351415af90 2023-10-19T08:38:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f34fb7fe700 1 -- 172.21.15.79:0/94112650 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c015440 con 0x7f351415af90 2023-10-19T08:38:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f3519326700 1 -- 172.21.15.79:0/94112650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3514154ef0 con 0x7f351415af90 2023-10-19T08:38:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.364+0000 7f34fb7fe700 1 -- 172.21.15.79:0/94112650 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c0157f0 con 0x7f351415af90 2023-10-19T08:38:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.365+0000 7f3519326700 1 -- 172.21.15.79:0/94112650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35141f3a70 con 0x7f351415af90 2023-10-19T08:38:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.366+0000 7f3519326700 1 -- 172.21.15.79:0/94112650 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351404ee70 con 0x7f351415af90 2023-10-19T08:38:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.366+0000 7f34fb7fe700 1 -- 172.21.15.79:0/94112650 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f350c00d430 con 0x7f351415af90 2023-10-19T08:38:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.366+0000 7f34fb7fe700 1 --2- 172.21.15.79:0/94112650 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f350006a0e0 0x7f350006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:26.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.366+0000 7f34fb7fe700 1 -- 172.21.15.79:0/94112650 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f350c088e50 con 0x7f351415af90 2023-10-19T08:38:26.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.366+0000 7f3512ffd700 1 --2- 172.21.15.79:0/94112650 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f350006a0e0 0x7f350006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:26.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.367+0000 7f3512ffd700 1 --2- 172.21.15.79:0/94112650 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f350006a0e0 0x7f350006c5a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3508009930 tx=0x7f3508008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:26.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.371+0000 7f34fb7fe700 1 -- 172.21.15.79:0/94112650 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f350c054250 con 0x7f351415af90 2023-10-19T08:38:26.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.555+0000 7f3519326700 1 -- 172.21.15.79:0/94112650 --> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35140cfab0 con 0x7f350006a0e0 2023-10-19T08:38:26.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.564+0000 7f34fb7fe700 1 -- 172.21.15.79:0/94112650 <== mgr.4113 v2:172.21.15.79:6832/316135984 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367344 (secure 0 0 0) 0x7f3508009e00 con 0x7f350006a0e0 2023-10-19T08:38:26.572 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:26.575 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.568+0000 7f3519326700 1 -- 172.21.15.79:0/94112650 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f350006a0e0 msgr2=0x7f350006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:26.575 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.568+0000 7f3519326700 1 --2- 172.21.15.79:0/94112650 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f350006a0e0 0x7f350006c5a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3508009930 tx=0x7f3508008040 comp rx=0 tx=0).stop 2023-10-19T08:38:26.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.568+0000 7f3519326700 1 -- 172.21.15.79:0/94112650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351415af90 msgr2=0x7f35140ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:26.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.568+0000 7f3519326700 1 --2- 172.21.15.79:0/94112650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351415af90 0x7f35140ca040 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f350c00cef0 tx=0x7f350c00a340 comp rx=0 tx=0).stop 2023-10-19T08:38:26.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.568+0000 7f3519326700 1 -- 172.21.15.79:0/94112650 shutdown_connections 2023-10-19T08:38:26.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.568+0000 7f3519326700 1 --2- 172.21.15.79:0/94112650 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f351415af90 0x7f35140ca040 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.568+0000 7f3519326700 1 --2- 172.21.15.79:0/94112650 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f350006a0e0 0x7f350006c5a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.568+0000 7f3519326700 1 --2- 172.21.15.79:0/94112650 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35140cedf0 0x7f35141f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.568+0000 7f3519326700 1 --2- 172.21.15.79:0/94112650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35140d0890 0x7f35141577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.568+0000 7f3519326700 1 -- 172.21.15.79:0/94112650 >> 172.21.15.79:0/94112650 conn(0x7f351406a400 msgr2=0x7f351415a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:26.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.568+0000 7f3519326700 1 -- 172.21.15.79:0/94112650 shutdown_connections 2023-10-19T08:38:26.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.568+0000 7f3519326700 1 -- 172.21.15.79:0/94112650 wait complete. 2023-10-19T08:38:26.578 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-19T08:38:26.583 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-10-19T08:38:25.104077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219444,"kb_used_data":3292,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755276,"statfs":{"total":773094113280,"available":772869402624,"internally_reserved":0,"allocated":3371008,"data_stored":2067366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006622"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336361+0000","last_change":"2023-10-19T08:37:57.298197+0000","last_active":"2023-10-19T08:38:02.336361+0000","last_peered":"2023-10-19T08:38:02.336361+0000","last_clean":"2023-10-19T08:38:02.336361+0000","last_became_active":"2023-10-19T08:37:57.297874+0000","last_became_peered":"2023-10-19T08:37:57.297874+0000","last_unstale":"2023-10-19T08:38:02.336361+0000","last_undegraded":"2023-10-19T08:38:02.336361+0000","last_fullsized":"2023-10-19T08:38:02.336361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:29:22.588510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303213+0000","last_change":"2023-10-19T08:37:57.272011+0000","last_active":"2023-10-19T08:38:02.303213+0000","last_peered":"2023-10-19T08:38:02.303213+0000","last_clean":"2023-10-19T08:38:02.303213+0000","last_became_active":"2023-10-19T08:37:57.271773+0000","last_became_peered":"2023-10-19T08:37:57.271773+0000","last_unstale":"2023-10-19T08:38:02.303213+0000","last_undegraded":"2023-10-19T08:38:02.303213+0000","last_fullsized":"2023-10-19T08:38:02.303213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:04.184252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338528+0000","last_change":"2023-10-19T08:37:57.286551+0000","last_active":"2023-10-19T08:38:02.338528+0000","last_peered":"2023-10-19T08:38:02.338528+0000","last_clean":"2023-10-19T08:38:02.338528+0000","last_became_active":"2023-10-19T08:37:57.286151+0000","last_became_peered":"2023-10-19T08:37:57.286151+0000","last_unstale":"2023-10-19T08:38:02.338528+0000","last_undegraded":"2023-10-19T08:38:02.338528+0000","last_fullsized":"2023-10-19T08:38:02.338528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:06:59.905183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336888+0000","last_change":"2023-10-19T08:37:57.279635+0000","last_active":"2023-10-19T08:38:02.336888+0000","last_peered":"2023-10-19T08:38:02.336888+0000","last_clean":"2023-10-19T08:38:02.336888+0000","last_became_active":"2023-10-19T08:37:57.279358+0000","last_became_peered":"2023-10-19T08:37:57.279358+0000","last_unstale":"2023-10-19T08:38:02.336888+0000","last_undegraded":"2023-10-19T08:38:02.336888+0000","last_fullsized":"2023-10-19T08:38:02.336888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:11:03.215012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327987+0000","last_change":"2023-10-19T08:37:57.291593+0000","last_active":"2023-10-19T08:38:02.327987+0000","last_peered":"2023-10-19T08:38:02.327987+0000","last_clean":"2023-10-19T08:38:02.327987+0000","last_became_active":"2023-10-19T08:37:57.291321+0000","last_became_peered":"2023-10-19T08:37:57.291321+0000","last_unstale":"2023-10-19T08:38:02.327987+0000","last_undegraded":"2023-10-19T08:38:02.327987+0000","last_fullsized":"2023-10-19T08:38:02.327987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:52.465054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337282+0000","last_change":"2023-10-19T08:37:57.285508+0000","last_active":"2023-10-19T08:38:02.337282+0000","last_peered":"2023-10-19T08:38:02.337282+0000","last_clean":"2023-10-19T08:38:02.337282+0000","last_became_active":"2023-10-19T08:37:57.285110+0000","last_became_peered":"2023-10-19T08:37:57.285110+0000","last_unstale":"2023-10-19T08:38:02.337282+0000","last_undegraded":"2023-10-19T08:38:02.337282+0000","last_fullsized":"2023-10-19T08:38:02.337282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:36:45.197928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337337+0000","last_change":"2023-10-19T08:37:57.284428+0000","last_active":"2023-10-19T08:38:02.337337+0000","last_peered":"2023-10-19T08:38:02.337337+0000","last_clean":"2023-10-19T08:38:02.337337+0000","last_became_active":"2023-10-19T08:37:57.283626+0000","last_became_peered":"2023-10-19T08:37:57.283626+0000","last_unstale":"2023-10-19T08:38:02.337337+0000","last_undegraded":"2023-10-19T08:38:02.337337+0000","last_fullsized":"2023-10-19T08:38:02.337337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:43.028422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302532+0000","last_change":"2023-10-19T08:37:57.281050+0000","last_active":"2023-10-19T08:38:02.302532+0000","last_peered":"2023-10-19T08:38:02.302532+0000","last_clean":"2023-10-19T08:38:02.302532+0000","last_became_active":"2023-10-19T08:37:57.280763+0000","last_became_peered":"2023-10-19T08:37:57.280763+0000","last_unstale":"2023-10-19T08:38:02.302532+0000","last_undegraded":"2023-10-19T08:38:02.302532+0000","last_fullsized":"2023-10-19T08:38:02.302532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:23.560291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328470+0000","last_change":"2023-10-19T08:37:57.295958+0000","last_active":"2023-10-19T08:38:02.328470+0000","last_peered":"2023-10-19T08:38:02.328470+0000","last_clean":"2023-10-19T08:38:02.328470+0000","last_became_active":"2023-10-19T08:37:57.295552+0000","last_became_peered":"2023-10-19T08:37:57.295552+0000","last_unstale":"2023-10-19T08:38:02.328470+0000","last_undegraded":"2023-10-19T08:38:02.328470+0000","last_fullsized":"2023-10-19T08:38:02.328470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:09.106701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303592+0000","last_change":"2023-10-19T08:37:57.281702+0000","last_active":"2023-10-19T08:38:02.303592+0000","last_peered":"2023-10-19T08:38:02.303592+0000","last_clean":"2023-10-19T08:38:02.303592+0000","last_became_active":"2023-10-19T08:37:57.281458+0000","last_became_peered":"2023-10-19T08:37:57.281458+0000","last_unstale":"2023-10-19T08:38:02.303592+0000","last_undegraded":"2023-10-19T08:38:02.303592+0000","last_fullsized":"2023-10-19T08:38:02.303592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:50.116408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338336+0000","last_change":"2023-10-19T08:37:57.287060+0000","last_active":"2023-10-19T08:38:02.338336+0000","last_peered":"2023-10-19T08:38:02.338336+0000","last_clean":"2023-10-19T08:38:02.338336+0000","last_became_active":"2023-10-19T08:37:57.286457+0000","last_became_peered":"2023-10-19T08:37:57.286457+0000","last_unstale":"2023-10-19T08:38:02.338336+0000","last_undegraded":"2023-10-19T08:38:02.338336+0000","last_fullsized":"2023-10-19T08:38:02.338336+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:42:12.580615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336291+0000","last_change":"2023-10-19T08:37:57.287153+0000","last_active":"2023-10-19T08:38:02.336291+0000","last_peered":"2023-10-19T08:38:02.336291+0000","last_clean":"2023-10-19T08:38:02.336291+0000","last_became_active":"2023-10-19T08:37:57.286892+0000","last_became_peered":"2023-10-19T08:37:57.286892+0000","last_unstale":"2023-10-19T08:38:02.336291+0000","last_undegraded":"2023-10-19T08:38:02.336291+0000","last_fullsized":"2023-10-19T08:38:02.336291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:15:28.529966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336795+0000","last_change":"2023-10-19T08:37:57.295506+0000","last_active":"2023-10-19T08:38:02.336795+0000","last_peered":"2023-10-19T08:38:02.336795+0000","last_clean":"2023-10-19T08:38:02.336795+0000","last_became_active":"2023-10-19T08:37:57.295228+0000","last_became_peered":"2023-10-19T08:37:57.295228+0000","last_unstale":"2023-10-19T08:38:02.336795+0000","last_undegraded":"2023-10-19T08:38:02.336795+0000","last_fullsized":"2023-10-19T08:38:02.336795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:50:11.458306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302667+0000","last_change":"2023-10-19T08:37:57.281958+0000","last_active":"2023-10-19T08:38:02.302667+0000","last_peered":"2023-10-19T08:38:02.302667+0000","last_clean":"2023-10-19T08:38:02.302667+0000","last_became_active":"2023-10-19T08:37:57.280798+0000","last_became_peered":"2023-10-19T08:37:57.280798+0000","last_unstale":"2023-10-19T08:38:02.302667+0000","last_undegraded":"2023-10-19T08:38:02.302667+0000","last_fullsized":"2023-10-19T08:38:02.302667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:52.465054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337080+0000","last_change":"2023-10-19T08:37:57.284152+0000","last_active":"2023-10-19T08:38:02.337080+0000","last_peered":"2023-10-19T08:38:02.337080+0000","last_clean":"2023-10-19T08:38:02.337080+0000","last_became_active":"2023-10-19T08:37:57.283958+0000","last_became_peered":"2023-10-19T08:37:57.283958+0000","last_unstale":"2023-10-19T08:38:02.337080+0000","last_undegraded":"2023-10-19T08:38:02.337080+0000","last_fullsized":"2023-10-19T08:38:02.337080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:21.864097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336495+0000","last_change":"2023-10-19T08:37:57.282193+0000","last_active":"2023-10-19T08:38:02.336495+0000","last_peered":"2023-10-19T08:38:02.336495+0000","last_clean":"2023-10-19T08:38:02.336495+0000","last_became_active":"2023-10-19T08:37:57.281902+0000","last_became_peered":"2023-10-19T08:37:57.281902+0000","last_unstale":"2023-10-19T08:38:02.336495+0000","last_undegraded":"2023-10-19T08:38:02.336495+0000","last_fullsized":"2023-10-19T08:38:02.336495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:28:55.738875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328478+0000","last_change":"2023-10-19T08:37:57.295795+0000","last_active":"2023-10-19T08:38:02.328478+0000","last_peered":"2023-10-19T08:38:02.328478+0000","last_clean":"2023-10-19T08:38:02.328478+0000","last_became_active":"2023-10-19T08:37:57.295248+0000","last_became_peered":"2023-10-19T08:37:57.295248+0000","last_unstale":"2023-10-19T08:38:02.328478+0000","last_undegraded":"2023-10-19T08:38:02.328478+0000","last_fullsized":"2023-10-19T08:38:02.328478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:30.738229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338681+0000","last_change":"2023-10-19T08:37:57.285995+0000","last_active":"2023-10-19T08:38:02.338681+0000","last_peered":"2023-10-19T08:38:02.338681+0000","last_clean":"2023-10-19T08:38:02.338681+0000","last_became_active":"2023-10-19T08:37:57.285508+0000","last_became_peered":"2023-10-19T08:37:57.285508+0000","last_unstale":"2023-10-19T08:38:02.338681+0000","last_undegraded":"2023-10-19T08:38:02.338681+0000","last_fullsized":"2023-10-19T08:38:02.338681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:47:25.178769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336266+0000","last_change":"2023-10-19T08:37:57.287058+0000","last_active":"2023-10-19T08:38:02.336266+0000","last_peered":"2023-10-19T08:38:02.336266+0000","last_clean":"2023-10-19T08:38:02.336266+0000","last_became_active":"2023-10-19T08:37:57.286444+0000","last_became_peered":"2023-10-19T08:37:57.286444+0000","last_unstale":"2023-10-19T08:38:02.336266+0000","last_undegraded":"2023-10-19T08:38:02.336266+0000","last_fullsized":"2023-10-19T08:38:02.336266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:00:25.346262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337609+0000","last_change":"2023-10-19T08:37:57.286561+0000","last_active":"2023-10-19T08:38:02.337609+0000","last_peered":"2023-10-19T08:38:02.337609+0000","last_clean":"2023-10-19T08:38:02.337609+0000","last_became_active":"2023-10-19T08:37:57.286258+0000","last_became_peered":"2023-10-19T08:37:57.286258+0000","last_unstale":"2023-10-19T08:38:02.337609+0000","last_undegraded":"2023-10-19T08:38:02.337609+0000","last_fullsized":"2023-10-19T08:38:02.337609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:36:37.342175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338298+0000","last_change":"2023-10-19T08:37:57.298841+0000","last_active":"2023-10-19T08:38:02.338298+0000","last_peered":"2023-10-19T08:38:02.338298+0000","last_clean":"2023-10-19T08:38:02.338298+0000","last_became_active":"2023-10-19T08:37:57.297120+0000","last_became_peered":"2023-10-19T08:37:57.297120+0000","last_unstale":"2023-10-19T08:38:02.338298+0000","last_undegraded":"2023-10-19T08:38:02.338298+0000","last_fullsized":"2023-10-19T08:38:02.338298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:45:25.612225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327349+0000","last_change":"2023-10-19T08:37:57.278547+0000","last_active":"2023-10-19T08:38:02.327349+0000","last_peered":"2023-10-19T08:38:02.327349+0000","last_clean":"2023-10-19T08:38:02.327349+0000","last_became_active":"2023-10-19T08:37:57.278248+0000","last_became_peered":"2023-10-19T08:37:57.278248+0000","last_unstale":"2023-10-19T08:38:02.327349+0000","last_undegraded":"2023-10-19T08:38:02.327349+0000","last_fullsized":"2023-10-19T08:38:02.327349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:57:26.558851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302205+0000","last_change":"2023-10-19T08:37:57.292075+0000","last_active":"2023-10-19T08:38:02.302205+0000","last_peered":"2023-10-19T08:38:02.302205+0000","last_clean":"2023-10-19T08:38:02.302205+0000","last_became_active":"2023-10-19T08:37:57.291577+0000","last_became_peered":"2023-10-19T08:37:57.291577+0000","last_unstale":"2023-10-19T08:38:02.302205+0000","last_undegraded":"2023-10-19T08:38:02.302205+0000","last_fullsized":"2023-10-19T08:38:02.302205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:02.310273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336592+0000","last_change":"2023-10-19T08:37:57.297303+0000","last_active":"2023-10-19T08:38:02.336592+0000","last_peered":"2023-10-19T08:38:02.336592+0000","last_clean":"2023-10-19T08:38:02.336592+0000","last_became_active":"2023-10-19T08:37:57.297038+0000","last_became_peered":"2023-10-19T08:37:57.297038+0000","last_unstale":"2023-10-19T08:38:02.336592+0000","last_undegraded":"2023-10-19T08:38:02.336592+0000","last_fullsized":"2023-10-19T08:38:02.336592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:52.465054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337263+0000","last_change":"2023-10-19T08:37:57.283306+0000","last_active":"2023-10-19T08:38:02.337263+0000","last_peered":"2023-10-19T08:38:02.337263+0000","last_clean":"2023-10-19T08:38:02.337263+0000","last_became_active":"2023-10-19T08:37:57.282978+0000","last_became_peered":"2023-10-19T08:37:57.282978+0000","last_unstale":"2023-10-19T08:38:02.337263+0000","last_undegraded":"2023-10-19T08:38:02.337263+0000","last_fullsized":"2023-10-19T08:38:02.337263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:30.738229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337108+0000","last_change":"2023-10-19T08:37:57.280269+0000","last_active":"2023-10-19T08:38:02.337108+0000","last_peered":"2023-10-19T08:38:02.337108+0000","last_clean":"2023-10-19T08:38:02.337108+0000","last_became_active":"2023-10-19T08:37:57.279940+0000","last_became_peered":"2023-10-19T08:37:57.279940+0000","last_unstale":"2023-10-19T08:38:02.337108+0000","last_undegraded":"2023-10-19T08:38:02.337108+0000","last_fullsized":"2023-10-19T08:38:02.337108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:40.165807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303297+0000","last_change":"2023-10-19T08:37:57.285132+0000","last_active":"2023-10-19T08:38:02.303297+0000","last_peered":"2023-10-19T08:38:02.303297+0000","last_clean":"2023-10-19T08:38:02.303297+0000","last_became_active":"2023-10-19T08:37:57.284701+0000","last_became_peered":"2023-10-19T08:37:57.284701+0000","last_unstale":"2023-10-19T08:38:02.303297+0000","last_undegraded":"2023-10-19T08:38:02.303297+0000","last_fullsized":"2023-10-19T08:38:02.303297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:16.370875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337879+0000","last_change":"2023-10-19T08:38:01.340490+0000","last_active":"2023-10-19T08:38:02.337879+0000","last_peered":"2023-10-19T08:38:02.337879+0000","last_clean":"2023-10-19T08:38:02.337879+0000","last_became_active":"2023-10-19T08:38:01.340119+0000","last_became_peered":"2023-10-19T08:38:01.340119+0000","last_unstale":"2023-10-19T08:38:02.337879+0000","last_undegraded":"2023-10-19T08:38:02.337879+0000","last_fullsized":"2023-10-19T08:38:02.337879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:28:51.111704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336413+0000","last_change":"2023-10-19T08:37:56.283885+0000","last_active":"2023-10-19T08:38:02.336413+0000","last_peered":"2023-10-19T08:38:02.336413+0000","last_clean":"2023-10-19T08:38:02.336413+0000","last_became_active":"2023-10-19T08:37:56.283591+0000","last_became_peered":"2023-10-19T08:37:56.283591+0000","last_unstale":"2023-10-19T08:38:02.336413+0000","last_undegraded":"2023-10-19T08:38:02.336413+0000","last_fullsized":"2023-10-19T08:38:02.336413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:15:58.663548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303063+0000","last_change":"2023-10-19T08:37:57.291292+0000","last_active":"2023-10-19T08:38:02.303063+0000","last_peered":"2023-10-19T08:38:02.303063+0000","last_clean":"2023-10-19T08:38:02.303063+0000","last_became_active":"2023-10-19T08:37:57.291007+0000","last_became_peered":"2023-10-19T08:37:57.291007+0000","last_unstale":"2023-10-19T08:38:02.303063+0000","last_undegraded":"2023-10-19T08:38:02.303063+0000","last_fullsized":"2023-10-19T08:38:02.303063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:48.642240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337486+0000","last_change":"2023-10-19T08:38:01.346131+0000","last_active":"2023-10-19T08:38:02.337486+0000","last_peered":"2023-10-19T08:38:02.337486+0000","last_clean":"2023-10-19T08:38:02.337486+0000","last_became_active":"2023-10-19T08:38:01.345770+0000","last_became_peered":"2023-10-19T08:38:01.345770+0000","last_unstale":"2023-10-19T08:38:02.337486+0000","last_undegraded":"2023-10-19T08:38:02.337486+0000","last_fullsized":"2023-10-19T08:38:02.337486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:36:36.064644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336120+0000","last_change":"2023-10-19T08:37:56.285233+0000","last_active":"2023-10-19T08:38:02.336120+0000","last_peered":"2023-10-19T08:38:02.336120+0000","last_clean":"2023-10-19T08:38:02.336120+0000","last_became_active":"2023-10-19T08:37:56.284954+0000","last_became_peered":"2023-10-19T08:37:56.284954+0000","last_unstale":"2023-10-19T08:38:02.336120+0000","last_undegraded":"2023-10-19T08:38:02.336120+0000","last_fullsized":"2023-10-19T08:38:02.336120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:40.083342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328472+0000","last_change":"2023-10-19T08:37:57.285760+0000","last_active":"2023-10-19T08:38:02.328472+0000","last_peered":"2023-10-19T08:38:02.328472+0000","last_clean":"2023-10-19T08:38:02.328472+0000","last_became_active":"2023-10-19T08:37:57.285420+0000","last_became_peered":"2023-10-19T08:37:57.285420+0000","last_unstale":"2023-10-19T08:38:02.328472+0000","last_undegraded":"2023-10-19T08:38:02.328472+0000","last_fullsized":"2023-10-19T08:38:02.328472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:43.028422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328649+0000","last_change":"2023-10-19T08:38:01.343224+0000","last_active":"2023-10-19T08:38:02.328649+0000","last_peered":"2023-10-19T08:38:02.328649+0000","last_clean":"2023-10-19T08:38:02.328649+0000","last_became_active":"2023-10-19T08:38:01.341932+0000","last_became_peered":"2023-10-19T08:38:01.341932+0000","last_unstale":"2023-10-19T08:38:02.328649+0000","last_undegraded":"2023-10-19T08:38:02.328649+0000","last_fullsized":"2023-10-19T08:38:02.328649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:08.237484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302526+0000","last_change":"2023-10-19T08:37:56.279221+0000","last_active":"2023-10-19T08:38:02.302526+0000","last_peered":"2023-10-19T08:38:02.302526+0000","last_clean":"2023-10-19T08:38:02.302526+0000","last_became_active":"2023-10-19T08:37:56.278945+0000","last_became_peered":"2023-10-19T08:37:56.278945+0000","last_unstale":"2023-10-19T08:38:02.302526+0000","last_undegraded":"2023-10-19T08:38:02.302526+0000","last_fullsized":"2023-10-19T08:38:02.302526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:15.152471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337264+0000","last_change":"2023-10-19T08:37:57.286458+0000","last_active":"2023-10-19T08:38:02.337264+0000","last_peered":"2023-10-19T08:38:02.337264+0000","last_clean":"2023-10-19T08:38:02.337264+0000","last_became_active":"2023-10-19T08:37:57.286202+0000","last_became_peered":"2023-10-19T08:37:57.286202+0000","last_unstale":"2023-10-19T08:38:02.337264+0000","last_undegraded":"2023-10-19T08:38:02.337264+0000","last_fullsized":"2023-10-19T08:38:02.337264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:03:17.001375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336640+0000","last_change":"2023-10-19T08:38:01.345314+0000","last_active":"2023-10-19T08:38:02.336640+0000","last_peered":"2023-10-19T08:38:02.336640+0000","last_clean":"2023-10-19T08:38:02.336640+0000","last_became_active":"2023-10-19T08:38:01.344867+0000","last_became_peered":"2023-10-19T08:38:01.344867+0000","last_unstale":"2023-10-19T08:38:02.336640+0000","last_undegraded":"2023-10-19T08:38:02.336640+0000","last_fullsized":"2023-10-19T08:38:02.336640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:14:55.301418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328589+0000","last_change":"2023-10-19T08:37:56.284935+0000","last_active":"2023-10-19T08:38:02.328589+0000","last_peered":"2023-10-19T08:38:02.328589+0000","last_clean":"2023-10-19T08:38:02.328589+0000","last_became_active":"2023-10-19T08:37:56.284622+0000","last_became_peered":"2023-10-19T08:37:56.284622+0000","last_unstale":"2023-10-19T08:38:02.328589+0000","last_undegraded":"2023-10-19T08:38:02.328589+0000","last_fullsized":"2023-10-19T08:38:02.328589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:43:07.850875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302488+0000","last_change":"2023-10-19T08:37:57.291320+0000","last_active":"2023-10-19T08:38:02.302488+0000","last_peered":"2023-10-19T08:38:02.302488+0000","last_clean":"2023-10-19T08:38:02.302488+0000","last_became_active":"2023-10-19T08:37:57.290894+0000","last_became_peered":"2023-10-19T08:37:57.290894+0000","last_unstale":"2023-10-19T08:38:02.302488+0000","last_undegraded":"2023-10-19T08:38:02.302488+0000","last_fullsized":"2023-10-19T08:38:02.302488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:30.738229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336048+0000","last_change":"2023-10-19T08:38:01.340374+0000","last_active":"2023-10-19T08:38:02.336048+0000","last_peered":"2023-10-19T08:38:02.336048+0000","last_clean":"2023-10-19T08:38:02.336048+0000","last_became_active":"2023-10-19T08:38:01.339982+0000","last_became_peered":"2023-10-19T08:38:01.339982+0000","last_unstale":"2023-10-19T08:38:02.336048+0000","last_undegraded":"2023-10-19T08:38:02.336048+0000","last_fullsized":"2023-10-19T08:38:02.336048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:06.363506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303440+0000","last_change":"2023-10-19T08:37:56.286352+0000","last_active":"2023-10-19T08:38:02.303440+0000","last_peered":"2023-10-19T08:38:02.303440+0000","last_clean":"2023-10-19T08:38:02.303440+0000","last_became_active":"2023-10-19T08:37:56.286038+0000","last_became_peered":"2023-10-19T08:37:56.286038+0000","last_unstale":"2023-10-19T08:38:02.303440+0000","last_undegraded":"2023-10-19T08:38:02.303440+0000","last_fullsized":"2023-10-19T08:38:02.303440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:47.634992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302226+0000","last_change":"2023-10-19T08:37:57.291702+0000","last_active":"2023-10-19T08:38:02.302226+0000","last_peered":"2023-10-19T08:38:02.302226+0000","last_clean":"2023-10-19T08:38:02.302226+0000","last_became_active":"2023-10-19T08:37:57.290849+0000","last_became_peered":"2023-10-19T08:37:57.290849+0000","last_unstale":"2023-10-19T08:38:02.302226+0000","last_undegraded":"2023-10-19T08:38:02.302226+0000","last_fullsized":"2023-10-19T08:38:02.302226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:43:08.858123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302757+0000","last_change":"2023-10-19T08:38:01.345973+0000","last_active":"2023-10-19T08:38:02.302757+0000","last_peered":"2023-10-19T08:38:02.302757+0000","last_clean":"2023-10-19T08:38:02.302757+0000","last_became_active":"2023-10-19T08:38:01.345569+0000","last_became_peered":"2023-10-19T08:38:01.345569+0000","last_unstale":"2023-10-19T08:38:02.302757+0000","last_undegraded":"2023-10-19T08:38:02.302757+0000","last_fullsized":"2023-10-19T08:38:02.302757+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:20.424108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338312+0000","last_change":"2023-10-19T08:37:56.284648+0000","last_active":"2023-10-19T08:38:02.338312+0000","last_peered":"2023-10-19T08:38:02.338312+0000","last_clean":"2023-10-19T08:38:02.338312+0000","last_became_active":"2023-10-19T08:37:56.284377+0000","last_became_peered":"2023-10-19T08:37:56.284377+0000","last_unstale":"2023-10-19T08:38:02.338312+0000","last_undegraded":"2023-10-19T08:38:02.338312+0000","last_fullsized":"2023-10-19T08:38:02.338312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:03.177003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336475+0000","last_change":"2023-10-19T08:37:57.283545+0000","last_active":"2023-10-19T08:38:02.336475+0000","last_peered":"2023-10-19T08:38:02.336475+0000","last_clean":"2023-10-19T08:38:02.336475+0000","last_became_active":"2023-10-19T08:37:57.283287+0000","last_became_peered":"2023-10-19T08:37:57.283287+0000","last_unstale":"2023-10-19T08:38:02.336475+0000","last_undegraded":"2023-10-19T08:38:02.336475+0000","last_fullsized":"2023-10-19T08:38:02.336475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:13.404733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336264+0000","last_change":"2023-10-19T08:38:01.353317+0000","last_active":"2023-10-19T08:38:02.336264+0000","last_peered":"2023-10-19T08:38:02.336264+0000","last_clean":"2023-10-19T08:38:02.336264+0000","last_became_active":"2023-10-19T08:38:01.352964+0000","last_became_peered":"2023-10-19T08:38:01.352964+0000","last_unstale":"2023-10-19T08:38:02.336264+0000","last_undegraded":"2023-10-19T08:38:02.336264+0000","last_fullsized":"2023-10-19T08:38:02.336264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:29:16.804794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:07.165443+0000","last_change":"2023-10-19T08:37:56.285044+0000","last_active":"2023-10-19T08:38:07.165443+0000","last_peered":"2023-10-19T08:38:07.165443+0000","last_clean":"2023-10-19T08:38:07.165443+0000","last_became_active":"2023-10-19T08:37:56.284729+0000","last_became_peered":"2023-10-19T08:37:56.284729+0000","last_unstale":"2023-10-19T08:38:07.165443+0000","last_undegraded":"2023-10-19T08:38:07.165443+0000","last_fullsized":"2023-10-19T08:38:07.165443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:55:11.490980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337780+0000","last_change":"2023-10-19T08:37:57.289683+0000","last_active":"2023-10-19T08:38:02.337780+0000","last_peered":"2023-10-19T08:38:02.337780+0000","last_clean":"2023-10-19T08:38:02.337780+0000","last_became_active":"2023-10-19T08:37:57.289339+0000","last_became_peered":"2023-10-19T08:37:57.289339+0000","last_unstale":"2023-10-19T08:38:02.337780+0000","last_undegraded":"2023-10-19T08:38:02.337780+0000","last_fullsized":"2023-10-19T08:38:02.337780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:57:38.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303603+0000","last_change":"2023-10-19T08:38:01.344790+0000","last_active":"2023-10-19T08:38:02.303603+0000","last_peered":"2023-10-19T08:38:02.303603+0000","last_clean":"2023-10-19T08:38:02.303603+0000","last_became_active":"2023-10-19T08:38:01.344405+0000","last_became_peered":"2023-10-19T08:38:01.344405+0000","last_unstale":"2023-10-19T08:38:02.303603+0000","last_undegraded":"2023-10-19T08:38:02.303603+0000","last_fullsized":"2023-10-19T08:38:02.303603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:22:22.893691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338184+0000","last_change":"2023-10-19T08:37:56.286506+0000","last_active":"2023-10-19T08:38:02.338184+0000","last_peered":"2023-10-19T08:38:02.338184+0000","last_clean":"2023-10-19T08:38:02.338184+0000","last_became_active":"2023-10-19T08:37:56.286246+0000","last_became_peered":"2023-10-19T08:37:56.286246+0000","last_unstale":"2023-10-19T08:38:02.338184+0000","last_undegraded":"2023-10-19T08:38:02.338184+0000","last_fullsized":"2023-10-19T08:38:02.338184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:43:07.850875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302485+0000","last_change":"2023-10-19T08:37:57.291345+0000","last_active":"2023-10-19T08:38:02.302485+0000","last_peered":"2023-10-19T08:38:02.302485+0000","last_clean":"2023-10-19T08:38:02.302485+0000","last_became_active":"2023-10-19T08:37:57.291061+0000","last_became_peered":"2023-10-19T08:37:57.291061+0000","last_unstale":"2023-10-19T08:38:02.302485+0000","last_undegraded":"2023-10-19T08:38:02.302485+0000","last_fullsized":"2023-10-19T08:38:02.302485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:43.028422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302758+0000","last_change":"2023-10-19T08:38:01.347178+0000","last_active":"2023-10-19T08:38:02.302758+0000","last_peered":"2023-10-19T08:38:02.302758+0000","last_clean":"2023-10-19T08:38:02.302758+0000","last_became_active":"2023-10-19T08:38:01.346237+0000","last_became_peered":"2023-10-19T08:38:01.346237+0000","last_unstale":"2023-10-19T08:38:02.302758+0000","last_undegraded":"2023-10-19T08:38:02.302758+0000","last_fullsized":"2023-10-19T08:38:02.302758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:25.917329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327204+0000","last_change":"2023-10-19T08:37:56.284660+0000","last_active":"2023-10-19T08:38:02.327204+0000","last_peered":"2023-10-19T08:38:02.327204+0000","last_clean":"2023-10-19T08:38:02.327204+0000","last_became_active":"2023-10-19T08:37:56.284426+0000","last_became_peered":"2023-10-19T08:37:56.284426+0000","last_unstale":"2023-10-19T08:38:02.327204+0000","last_undegraded":"2023-10-19T08:38:02.327204+0000","last_fullsized":"2023-10-19T08:38:02.327204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:12.397484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303242+0000","last_change":"2023-10-19T08:37:57.284960+0000","last_active":"2023-10-19T08:38:02.303242+0000","last_peered":"2023-10-19T08:38:02.303242+0000","last_clean":"2023-10-19T08:38:02.303242+0000","last_became_active":"2023-10-19T08:37:57.284360+0000","last_became_peered":"2023-10-19T08:37:57.284360+0000","last_unstale":"2023-10-19T08:38:02.303242+0000","last_undegraded":"2023-10-19T08:38:02.303242+0000","last_fullsized":"2023-10-19T08:38:02.303242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:45:25.612225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303233+0000","last_change":"2023-10-19T08:38:01.346877+0000","last_active":"2023-10-19T08:38:02.303233+0000","last_peered":"2023-10-19T08:38:02.303233+0000","last_clean":"2023-10-19T08:38:02.303233+0000","last_became_active":"2023-10-19T08:38:01.346460+0000","last_became_peered":"2023-10-19T08:38:01.346460+0000","last_unstale":"2023-10-19T08:38:02.303233+0000","last_undegraded":"2023-10-19T08:38:02.303233+0000","last_fullsized":"2023-10-19T08:38:02.303233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:24:52.905240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337215+0000","last_change":"2023-10-19T08:37:56.285689+0000","last_active":"2023-10-19T08:38:02.337215+0000","last_peered":"2023-10-19T08:38:02.337215+0000","last_clean":"2023-10-19T08:38:02.337215+0000","last_became_active":"2023-10-19T08:37:56.285284+0000","last_became_peered":"2023-10-19T08:37:56.285284+0000","last_unstale":"2023-10-19T08:38:02.337215+0000","last_undegraded":"2023-10-19T08:38:02.337215+0000","last_fullsized":"2023-10-19T08:38:02.337215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:39.158559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328527+0000","last_change":"2023-10-19T08:37:57.293680+0000","last_active":"2023-10-19T08:38:02.328527+0000","last_peered":"2023-10-19T08:38:02.328527+0000","last_clean":"2023-10-19T08:38:02.328527+0000","last_became_active":"2023-10-19T08:37:57.293401+0000","last_became_peered":"2023-10-19T08:37:57.293401+0000","last_unstale":"2023-10-19T08:38:02.328527+0000","last_undegraded":"2023-10-19T08:38:02.328527+0000","last_fullsized":"2023-10-19T08:38:02.328527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:16.159720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303448+0000","last_change":"2023-10-19T08:38:01.342623+0000","last_active":"2023-10-19T08:38:02.303448+0000","last_peered":"2023-10-19T08:38:02.303448+0000","last_clean":"2023-10-19T08:38:02.303448+0000","last_became_active":"2023-10-19T08:38:01.342009+0000","last_became_peered":"2023-10-19T08:38:01.342009+0000","last_unstale":"2023-10-19T08:38:02.303448+0000","last_undegraded":"2023-10-19T08:38:02.303448+0000","last_fullsized":"2023-10-19T08:38:02.303448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:24:52.905240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336100+0000","last_change":"2023-10-19T08:37:56.281800+0000","last_active":"2023-10-19T08:38:02.336100+0000","last_peered":"2023-10-19T08:38:02.336100+0000","last_clean":"2023-10-19T08:38:02.336100+0000","last_became_active":"2023-10-19T08:37:56.281533+0000","last_became_peered":"2023-10-19T08:37:56.281533+0000","last_unstale":"2023-10-19T08:38:02.336100+0000","last_undegraded":"2023-10-19T08:38:02.336100+0000","last_fullsized":"2023-10-19T08:38:02.336100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:08:05.598870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303187+0000","last_change":"2023-10-19T08:37:57.295506+0000","last_active":"2023-10-19T08:38:02.303187+0000","last_peered":"2023-10-19T08:38:02.303187+0000","last_clean":"2023-10-19T08:38:02.303187+0000","last_became_active":"2023-10-19T08:37:57.295267+0000","last_became_peered":"2023-10-19T08:37:57.295267+0000","last_unstale":"2023-10-19T08:38:02.303187+0000","last_undegraded":"2023-10-19T08:38:02.303187+0000","last_fullsized":"2023-10-19T08:38:02.303187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:22:18.840459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337512+0000","last_change":"2023-10-19T08:38:01.349967+0000","last_active":"2023-10-19T08:38:02.337512+0000","last_peered":"2023-10-19T08:38:02.337512+0000","last_clean":"2023-10-19T08:38:02.337512+0000","last_became_active":"2023-10-19T08:38:01.349632+0000","last_became_peered":"2023-10-19T08:38:01.349632+0000","last_unstale":"2023-10-19T08:38:02.337512+0000","last_undegraded":"2023-10-19T08:38:02.337512+0000","last_fullsized":"2023-10-19T08:38:02.337512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:34.791461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338637+0000","last_change":"2023-10-19T08:37:56.287543+0000","last_active":"2023-10-19T08:38:02.338637+0000","last_peered":"2023-10-19T08:38:02.338637+0000","last_clean":"2023-10-19T08:38:02.338637+0000","last_became_active":"2023-10-19T08:37:56.287018+0000","last_became_peered":"2023-10-19T08:37:56.287018+0000","last_unstale":"2023-10-19T08:38:02.338637+0000","last_undegraded":"2023-10-19T08:38:02.338637+0000","last_fullsized":"2023-10-19T08:38:02.338637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:33:47.634992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302382+0000","last_change":"2023-10-19T08:37:57.289156+0000","last_active":"2023-10-19T08:38:02.302382+0000","last_peered":"2023-10-19T08:38:02.302382+0000","last_clean":"2023-10-19T08:38:02.302382+0000","last_became_active":"2023-10-19T08:37:57.288736+0000","last_became_peered":"2023-10-19T08:37:57.288736+0000","last_unstale":"2023-10-19T08:38:02.302382+0000","last_undegraded":"2023-10-19T08:38:02.302382+0000","last_fullsized":"2023-10-19T08:38:02.302382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:02.310273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.335829+0000","last_change":"2023-10-19T08:38:01.332463+0000","last_active":"2023-10-19T08:38:02.335829+0000","last_peered":"2023-10-19T08:38:02.335829+0000","last_clean":"2023-10-19T08:38:02.335829+0000","last_became_active":"2023-10-19T08:38:01.330857+0000","last_became_peered":"2023-10-19T08:38:01.330857+0000","last_unstale":"2023-10-19T08:38:02.335829+0000","last_undegraded":"2023-10-19T08:38:02.335829+0000","last_fullsized":"2023-10-19T08:38:02.335829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:27:27.393059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338367+0000","last_change":"2023-10-19T08:37:56.285623+0000","last_active":"2023-10-19T08:38:02.338367+0000","last_peered":"2023-10-19T08:38:02.338367+0000","last_clean":"2023-10-19T08:38:02.338367+0000","last_became_active":"2023-10-19T08:37:56.285324+0000","last_became_peered":"2023-10-19T08:37:56.285324+0000","last_unstale":"2023-10-19T08:38:02.338367+0000","last_undegraded":"2023-10-19T08:38:02.338367+0000","last_fullsized":"2023-10-19T08:38:02.338367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:58:27.340847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336799+0000","last_change":"2023-10-19T08:37:57.283094+0000","last_active":"2023-10-19T08:38:02.336799+0000","last_peered":"2023-10-19T08:38:02.336799+0000","last_clean":"2023-10-19T08:38:02.336799+0000","last_became_active":"2023-10-19T08:37:57.282824+0000","last_became_peered":"2023-10-19T08:37:57.282824+0000","last_unstale":"2023-10-19T08:38:02.336799+0000","last_undegraded":"2023-10-19T08:38:02.336799+0000","last_fullsized":"2023-10-19T08:38:02.336799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:23:48.860817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336247+0000","last_change":"2023-10-19T08:38:01.331969+0000","last_active":"2023-10-19T08:38:02.336247+0000","last_peered":"2023-10-19T08:38:02.336247+0000","last_clean":"2023-10-19T08:38:02.336247+0000","last_became_active":"2023-10-19T08:38:01.331538+0000","last_became_peered":"2023-10-19T08:38:01.331538+0000","last_unstale":"2023-10-19T08:38:02.336247+0000","last_undegraded":"2023-10-19T08:38:02.336247+0000","last_fullsized":"2023-10-19T08:38:02.336247+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:19:38.947409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338570+0000","last_change":"2023-10-19T08:37:56.287547+0000","last_active":"2023-10-19T08:38:02.338570+0000","last_peered":"2023-10-19T08:38:02.338570+0000","last_clean":"2023-10-19T08:38:02.338570+0000","last_became_active":"2023-10-19T08:37:56.287249+0000","last_became_peered":"2023-10-19T08:37:56.287249+0000","last_unstale":"2023-10-19T08:38:02.338570+0000","last_undegraded":"2023-10-19T08:38:02.338570+0000","last_fullsized":"2023-10-19T08:38:02.338570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:24:47.844759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336329+0000","last_change":"2023-10-19T08:37:57.282999+0000","last_active":"2023-10-19T08:38:02.336329+0000","last_peered":"2023-10-19T08:38:02.336329+0000","last_clean":"2023-10-19T08:38:02.336329+0000","last_became_active":"2023-10-19T08:37:57.282689+0000","last_became_peered":"2023-10-19T08:37:57.282689+0000","last_unstale":"2023-10-19T08:38:02.336329+0000","last_undegraded":"2023-10-19T08:38:02.336329+0000","last_fullsized":"2023-10-19T08:38:02.336329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:07:15.629005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336395+0000","last_change":"2023-10-19T08:38:01.346058+0000","last_active":"2023-10-19T08:38:02.336395+0000","last_peered":"2023-10-19T08:38:02.336395+0000","last_clean":"2023-10-19T08:38:02.336395+0000","last_became_active":"2023-10-19T08:38:01.345734+0000","last_became_peered":"2023-10-19T08:38:01.345734+0000","last_unstale":"2023-10-19T08:38:02.336395+0000","last_undegraded":"2023-10-19T08:38:02.336395+0000","last_fullsized":"2023-10-19T08:38:02.336395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:24:06.589136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302825+0000","last_change":"2023-10-19T08:37:56.281540+0000","last_active":"2023-10-19T08:38:02.302825+0000","last_peered":"2023-10-19T08:38:02.302825+0000","last_clean":"2023-10-19T08:38:02.302825+0000","last_became_active":"2023-10-19T08:37:56.281201+0000","last_became_peered":"2023-10-19T08:37:56.281201+0000","last_unstale":"2023-10-19T08:38:02.302825+0000","last_undegraded":"2023-10-19T08:38:02.302825+0000","last_fullsized":"2023-10-19T08:38:02.302825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:40.083342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328158+0000","last_change":"2023-10-19T08:37:57.281817+0000","last_active":"2023-10-19T08:38:02.328158+0000","last_peered":"2023-10-19T08:38:02.328158+0000","last_clean":"2023-10-19T08:38:02.328158+0000","last_became_active":"2023-10-19T08:37:57.281565+0000","last_became_peered":"2023-10-19T08:37:57.281565+0000","last_unstale":"2023-10-19T08:38:02.328158+0000","last_undegraded":"2023-10-19T08:38:02.328158+0000","last_fullsized":"2023-10-19T08:38:02.328158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:41.090590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336532+0000","last_change":"2023-10-19T08:38:01.334333+0000","last_active":"2023-10-19T08:38:02.336532+0000","last_peered":"2023-10-19T08:38:02.336532+0000","last_clean":"2023-10-19T08:38:02.336532+0000","last_became_active":"2023-10-19T08:38:01.333865+0000","last_became_peered":"2023-10-19T08:38:01.333865+0000","last_unstale":"2023-10-19T08:38:02.336532+0000","last_undegraded":"2023-10-19T08:38:02.336532+0000","last_fullsized":"2023-10-19T08:38:02.336532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:34:35.198286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302576+0000","last_change":"2023-10-19T08:37:56.281808+0000","last_active":"2023-10-19T08:38:02.302576+0000","last_peered":"2023-10-19T08:38:02.302576+0000","last_clean":"2023-10-19T08:38:02.302576+0000","last_became_active":"2023-10-19T08:37:56.281530+0000","last_became_peered":"2023-10-19T08:37:56.281530+0000","last_unstale":"2023-10-19T08:38:02.302576+0000","last_undegraded":"2023-10-19T08:38:02.302576+0000","last_fullsized":"2023-10-19T08:38:02.302576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:03.177003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337444+0000","last_change":"2023-10-19T08:37:57.291709+0000","last_active":"2023-10-19T08:38:02.337444+0000","last_peered":"2023-10-19T08:38:02.337444+0000","last_clean":"2023-10-19T08:38:02.337444+0000","last_became_active":"2023-10-19T08:37:57.291449+0000","last_became_peered":"2023-10-19T08:37:57.291449+0000","last_unstale":"2023-10-19T08:38:02.337444+0000","last_undegraded":"2023-10-19T08:38:02.337444+0000","last_fullsized":"2023-10-19T08:38:02.337444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:44:52.511554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336558+0000","last_change":"2023-10-19T08:38:01.347589+0000","last_active":"2023-10-19T08:38:02.336558+0000","last_peered":"2023-10-19T08:38:02.336558+0000","last_clean":"2023-10-19T08:38:02.336558+0000","last_became_active":"2023-10-19T08:38:01.347219+0000","last_became_peered":"2023-10-19T08:38:01.347219+0000","last_unstale":"2023-10-19T08:38:02.336558+0000","last_undegraded":"2023-10-19T08:38:02.336558+0000","last_fullsized":"2023-10-19T08:38:02.336558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:57:30.612083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336383+0000","last_change":"2023-10-19T08:37:56.280035+0000","last_active":"2023-10-19T08:38:02.336383+0000","last_peered":"2023-10-19T08:38:02.336383+0000","last_clean":"2023-10-19T08:38:02.336383+0000","last_became_active":"2023-10-19T08:37:56.279742+0000","last_became_peered":"2023-10-19T08:37:56.279742+0000","last_unstale":"2023-10-19T08:38:02.336383+0000","last_undegraded":"2023-10-19T08:38:02.336383+0000","last_fullsized":"2023-10-19T08:38:02.336383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:21:53.831892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338051+0000","last_change":"2023-10-19T08:37:57.286021+0000","last_active":"2023-10-19T08:38:02.338051+0000","last_peered":"2023-10-19T08:38:02.338051+0000","last_clean":"2023-10-19T08:38:02.338051+0000","last_became_active":"2023-10-19T08:37:57.285166+0000","last_became_peered":"2023-10-19T08:37:57.285166+0000","last_unstale":"2023-10-19T08:38:02.338051+0000","last_undegraded":"2023-10-19T08:38:02.338051+0000","last_fullsized":"2023-10-19T08:38:02.338051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:59:24.110607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303417+0000","last_change":"2023-10-19T08:38:01.342875+0000","last_active":"2023-10-19T08:38:02.303417+0000","last_peered":"2023-10-19T08:38:02.303417+0000","last_clean":"2023-10-19T08:38:02.303417+0000","last_became_active":"2023-10-19T08:38:01.341788+0000","last_became_peered":"2023-10-19T08:38:01.341788+0000","last_unstale":"2023-10-19T08:38:02.303417+0000","last_undegraded":"2023-10-19T08:38:02.303417+0000","last_fullsized":"2023-10-19T08:38:02.303417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:58:32.401327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336598+0000","last_change":"2023-10-19T08:37:56.283990+0000","last_active":"2023-10-19T08:38:02.336598+0000","last_peered":"2023-10-19T08:38:02.336598+0000","last_clean":"2023-10-19T08:38:02.336598+0000","last_became_active":"2023-10-19T08:37:56.283678+0000","last_became_peered":"2023-10-19T08:37:56.283678+0000","last_unstale":"2023-10-19T08:38:02.336598+0000","last_undegraded":"2023-10-19T08:38:02.336598+0000","last_fullsized":"2023-10-19T08:38:02.336598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:33:10.909410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338725+0000","last_change":"2023-10-19T08:37:57.289730+0000","last_active":"2023-10-19T08:38:02.338725+0000","last_peered":"2023-10-19T08:38:02.338725+0000","last_clean":"2023-10-19T08:38:02.338725+0000","last_became_active":"2023-10-19T08:37:57.289411+0000","last_became_peered":"2023-10-19T08:37:57.289411+0000","last_unstale":"2023-10-19T08:38:02.338725+0000","last_undegraded":"2023-10-19T08:38:02.338725+0000","last_fullsized":"2023-10-19T08:38:02.338725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:55:07.829465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338629+0000","last_change":"2023-10-19T08:38:01.341111+0000","last_active":"2023-10-19T08:38:02.338629+0000","last_peered":"2023-10-19T08:38:02.338629+0000","last_clean":"2023-10-19T08:38:02.338629+0000","last_became_active":"2023-10-19T08:38:01.340717+0000","last_became_peered":"2023-10-19T08:38:01.340717+0000","last_unstale":"2023-10-19T08:38:02.338629+0000","last_undegraded":"2023-10-19T08:38:02.338629+0000","last_fullsized":"2023-10-19T08:38:02.338629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:04:48.063590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302334+0000","last_change":"2023-10-19T08:37:56.286850+0000","last_active":"2023-10-19T08:38:02.302334+0000","last_peered":"2023-10-19T08:38:02.302334+0000","last_clean":"2023-10-19T08:38:02.302334+0000","last_became_active":"2023-10-19T08:37:56.286593+0000","last_became_peered":"2023-10-19T08:37:56.286593+0000","last_unstale":"2023-10-19T08:38:02.302334+0000","last_undegraded":"2023-10-19T08:38:02.302334+0000","last_fullsized":"2023-10-19T08:38:02.302334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:22.553042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337352+0000","last_change":"2023-10-19T08:37:57.296081+0000","last_active":"2023-10-19T08:38:02.337352+0000","last_peered":"2023-10-19T08:38:02.337352+0000","last_clean":"2023-10-19T08:38:02.337352+0000","last_became_active":"2023-10-19T08:37:57.295834+0000","last_became_peered":"2023-10-19T08:37:57.295834+0000","last_unstale":"2023-10-19T08:38:02.337352+0000","last_undegraded":"2023-10-19T08:38:02.337352+0000","last_fullsized":"2023-10-19T08:38:02.337352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:16.159720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327643+0000","last_change":"2023-10-19T08:38:01.344908+0000","last_active":"2023-10-19T08:38:02.327643+0000","last_peered":"2023-10-19T08:38:02.327643+0000","last_clean":"2023-10-19T08:38:02.327643+0000","last_became_active":"2023-10-19T08:38:01.342061+0000","last_became_peered":"2023-10-19T08:38:01.342061+0000","last_unstale":"2023-10-19T08:38:02.327643+0000","last_undegraded":"2023-10-19T08:38:02.327643+0000","last_fullsized":"2023-10-19T08:38:02.327643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:58:38.199370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336703+0000","last_change":"2023-10-19T08:37:51.153209+0000","last_active":"2023-10-19T08:38:02.336703+0000","last_peered":"2023-10-19T08:38:02.336703+0000","last_clean":"2023-10-19T08:38:02.336703+0000","last_became_active":"2023-10-19T08:37:51.152844+0000","last_became_peered":"2023-10-19T08:37:51.152844+0000","last_unstale":"2023-10-19T08:38:02.336703+0000","last_undegraded":"2023-10-19T08:38:02.336703+0000","last_fullsized":"2023-10-19T08:38:02.336703+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:58:27.990585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303140+0000","last_change":"2023-10-19T08:37:56.283202+0000","last_active":"2023-10-19T08:38:02.303140+0000","last_peered":"2023-10-19T08:38:02.303140+0000","last_clean":"2023-10-19T08:38:02.303140+0000","last_became_active":"2023-10-19T08:37:56.282930+0000","last_became_peered":"2023-10-19T08:37:56.282930+0000","last_unstale":"2023-10-19T08:38:02.303140+0000","last_undegraded":"2023-10-19T08:38:02.303140+0000","last_fullsized":"2023-10-19T08:38:02.303140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:43:07.850875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336384+0000","last_change":"2023-10-19T08:37:57.273005+0000","last_active":"2023-10-19T08:38:02.336384+0000","last_peered":"2023-10-19T08:38:02.336384+0000","last_clean":"2023-10-19T08:38:02.336384+0000","last_became_active":"2023-10-19T08:37:57.272159+0000","last_became_peered":"2023-10-19T08:37:57.272159+0000","last_unstale":"2023-10-19T08:38:02.336384+0000","last_undegraded":"2023-10-19T08:38:02.336384+0000","last_fullsized":"2023-10-19T08:38:02.336384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:49.381912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327478+0000","last_change":"2023-10-19T08:38:01.342853+0000","last_active":"2023-10-19T08:38:02.327478+0000","last_peered":"2023-10-19T08:38:02.327478+0000","last_clean":"2023-10-19T08:38:02.327478+0000","last_became_active":"2023-10-19T08:38:01.342166+0000","last_became_peered":"2023-10-19T08:38:01.342166+0000","last_unstale":"2023-10-19T08:38:02.327478+0000","last_undegraded":"2023-10-19T08:38:02.327478+0000","last_fullsized":"2023-10-19T08:38:02.327478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:50:56.650312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302902+0000","last_change":"2023-10-19T08:37:51.116743+0000","last_active":"2023-10-19T08:38:02.302902+0000","last_peered":"2023-10-19T08:38:02.302902+0000","last_clean":"2023-10-19T08:38:02.302902+0000","last_became_active":"2023-10-19T08:37:51.116511+0000","last_became_peered":"2023-10-19T08:37:51.116511+0000","last_unstale":"2023-10-19T08:38:02.302902+0000","last_undegraded":"2023-10-19T08:38:02.302902+0000","last_fullsized":"2023-10-19T08:38:02.302902+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:36.872869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337533+0000","last_change":"2023-10-19T08:37:56.280470+0000","last_active":"2023-10-19T08:38:02.337533+0000","last_peered":"2023-10-19T08:38:02.337533+0000","last_clean":"2023-10-19T08:38:02.337533+0000","last_became_active":"2023-10-19T08:37:56.280178+0000","last_became_peered":"2023-10-19T08:37:56.280178+0000","last_unstale":"2023-10-19T08:38:02.337533+0000","last_undegraded":"2023-10-19T08:38:02.337533+0000","last_fullsized":"2023-10-19T08:38:02.337533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:58:02.145386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336644+0000","last_change":"2023-10-19T08:37:57.283444+0000","last_active":"2023-10-19T08:38:02.336644+0000","last_peered":"2023-10-19T08:38:02.336644+0000","last_clean":"2023-10-19T08:38:02.336644+0000","last_became_active":"2023-10-19T08:37:57.283153+0000","last_became_peered":"2023-10-19T08:37:57.283153+0000","last_unstale":"2023-10-19T08:38:02.336644+0000","last_undegraded":"2023-10-19T08:38:02.336644+0000","last_fullsized":"2023-10-19T08:38:02.336644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:50:52.597080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336583+0000","last_change":"2023-10-19T08:38:01.342565+0000","last_active":"2023-10-19T08:38:02.336583+0000","last_peered":"2023-10-19T08:38:02.336583+0000","last_clean":"2023-10-19T08:38:02.336583+0000","last_became_active":"2023-10-19T08:38:01.341889+0000","last_became_peered":"2023-10-19T08:38:01.341889+0000","last_unstale":"2023-10-19T08:38:02.336583+0000","last_undegraded":"2023-10-19T08:38:02.336583+0000","last_fullsized":"2023-10-19T08:38:02.336583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:02:48.585528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336488+0000","last_change":"2023-10-19T08:37:51.114782+0000","last_active":"2023-10-19T08:38:02.336488+0000","last_peered":"2023-10-19T08:38:02.336488+0000","last_clean":"2023-10-19T08:38:02.336488+0000","last_became_active":"2023-10-19T08:37:51.114388+0000","last_became_peered":"2023-10-19T08:37:51.114388+0000","last_unstale":"2023-10-19T08:38:02.336488+0000","last_undegraded":"2023-10-19T08:38:02.336488+0000","last_fullsized":"2023-10-19T08:38:02.336488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:36:18.887665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.335983+0000","last_change":"2023-10-19T08:37:56.283345+0000","last_active":"2023-10-19T08:38:02.335983+0000","last_peered":"2023-10-19T08:38:02.335983+0000","last_clean":"2023-10-19T08:38:02.335983+0000","last_became_active":"2023-10-19T08:37:56.283066+0000","last_became_peered":"2023-10-19T08:37:56.283066+0000","last_unstale":"2023-10-19T08:38:02.335983+0000","last_undegraded":"2023-10-19T08:38:02.335983+0000","last_fullsized":"2023-10-19T08:38:02.335983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:00:05.442442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337299+0000","last_change":"2023-10-19T08:37:57.272609+0000","last_active":"2023-10-19T08:38:02.337299+0000","last_peered":"2023-10-19T08:38:02.337299+0000","last_clean":"2023-10-19T08:38:02.337299+0000","last_became_active":"2023-10-19T08:37:57.272328+0000","last_became_peered":"2023-10-19T08:37:57.272328+0000","last_unstale":"2023-10-19T08:38:02.337299+0000","last_undegraded":"2023-10-19T08:38:02.337299+0000","last_fullsized":"2023-10-19T08:38:02.337299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:09.106701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338110+0000","last_change":"2023-10-19T08:38:01.350479+0000","last_active":"2023-10-19T08:38:02.338110+0000","last_peered":"2023-10-19T08:38:02.338110+0000","last_clean":"2023-10-19T08:38:02.338110+0000","last_became_active":"2023-10-19T08:38:01.350030+0000","last_became_peered":"2023-10-19T08:38:01.350030+0000","last_unstale":"2023-10-19T08:38:02.338110+0000","last_undegraded":"2023-10-19T08:38:02.338110+0000","last_fullsized":"2023-10-19T08:38:02.338110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:20.212952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302863+0000","last_change":"2023-10-19T08:37:51.115141+0000","last_active":"2023-10-19T08:38:02.302863+0000","last_peered":"2023-10-19T08:38:02.302863+0000","last_clean":"2023-10-19T08:38:02.302863+0000","last_became_active":"2023-10-19T08:37:51.114829+0000","last_became_peered":"2023-10-19T08:37:51.114829+0000","last_unstale":"2023-10-19T08:38:02.302863+0000","last_undegraded":"2023-10-19T08:38:02.302863+0000","last_fullsized":"2023-10-19T08:38:02.302863+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:34.010255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":179,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336533+0000","last_change":"2023-10-19T08:37:51.153453+0000","last_active":"2023-10-19T08:38:02.336533+0000","last_peered":"2023-10-19T08:38:02.336533+0000","last_clean":"2023-10-19T08:38:02.336533+0000","last_became_active":"2023-10-19T08:37:51.153093+0000","last_became_peered":"2023-10-19T08:37:51.153093+0000","last_unstale":"2023-10-19T08:38:02.336533+0000","last_undegraded":"2023-10-19T08:38:02.336533+0000","last_fullsized":"2023-10-19T08:38:02.336533+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:17.404738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302485+0000","last_change":"2023-10-19T08:37:56.285142+0000","last_active":"2023-10-19T08:38:02.302485+0000","last_peered":"2023-10-19T08:38:02.302485+0000","last_clean":"2023-10-19T08:38:02.302485+0000","last_became_active":"2023-10-19T08:37:56.284717+0000","last_became_peered":"2023-10-19T08:37:56.284717+0000","last_unstale":"2023-10-19T08:38:02.302485+0000","last_undegraded":"2023-10-19T08:38:02.302485+0000","last_fullsized":"2023-10-19T08:38:02.302485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:08.099452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337159+0000","last_change":"2023-10-19T08:37:57.287714+0000","last_active":"2023-10-19T08:38:02.337159+0000","last_peered":"2023-10-19T08:38:02.337159+0000","last_clean":"2023-10-19T08:38:02.337159+0000","last_became_active":"2023-10-19T08:37:57.287427+0000","last_became_peered":"2023-10-19T08:37:57.287427+0000","last_unstale":"2023-10-19T08:38:02.337159+0000","last_undegraded":"2023-10-19T08:38:02.337159+0000","last_fullsized":"2023-10-19T08:38:02.337159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:55:59.475158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303093+0000","last_change":"2023-10-19T08:38:01.343223+0000","last_active":"2023-10-19T08:38:02.303093+0000","last_peered":"2023-10-19T08:38:02.303093+0000","last_clean":"2023-10-19T08:38:02.303093+0000","last_became_active":"2023-10-19T08:38:01.342425+0000","last_became_peered":"2023-10-19T08:38:01.342425+0000","last_unstale":"2023-10-19T08:38:02.303093+0000","last_undegraded":"2023-10-19T08:38:02.303093+0000","last_fullsized":"2023-10-19T08:38:02.303093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:13.159933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336674+0000","last_change":"2023-10-19T08:37:51.118439+0000","last_active":"2023-10-19T08:38:02.336674+0000","last_peered":"2023-10-19T08:38:02.336674+0000","last_clean":"2023-10-19T08:38:02.336674+0000","last_became_active":"2023-10-19T08:37:51.118146+0000","last_became_peered":"2023-10-19T08:37:51.118146+0000","last_unstale":"2023-10-19T08:38:02.336674+0000","last_undegraded":"2023-10-19T08:38:02.336674+0000","last_fullsized":"2023-10-19T08:38:02.336674+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:34.935038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327100+0000","last_change":"2023-10-19T08:37:56.275735+0000","last_active":"2023-10-19T08:38:02.327100+0000","last_peered":"2023-10-19T08:38:02.327100+0000","last_clean":"2023-10-19T08:38:02.327100+0000","last_became_active":"2023-10-19T08:37:56.275386+0000","last_became_peered":"2023-10-19T08:37:56.275386+0000","last_unstale":"2023-10-19T08:38:02.327100+0000","last_undegraded":"2023-10-19T08:38:02.327100+0000","last_fullsized":"2023-10-19T08:38:02.327100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:48.374663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328345+0000","last_change":"2023-10-19T08:37:57.280800+0000","last_active":"2023-10-19T08:38:02.328345+0000","last_peered":"2023-10-19T08:38:02.328345+0000","last_clean":"2023-10-19T08:38:02.328345+0000","last_became_active":"2023-10-19T08:37:57.280464+0000","last_became_peered":"2023-10-19T08:37:57.280464+0000","last_unstale":"2023-10-19T08:38:02.328345+0000","last_undegraded":"2023-10-19T08:38:02.328345+0000","last_fullsized":"2023-10-19T08:38:02.328345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:21.864097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336567+0000","last_change":"2023-10-19T08:38:01.335275+0000","last_active":"2023-10-19T08:38:02.336567+0000","last_peered":"2023-10-19T08:38:02.336567+0000","last_clean":"2023-10-19T08:38:02.336567+0000","last_became_active":"2023-10-19T08:38:01.334707+0000","last_became_peered":"2023-10-19T08:38:01.334707+0000","last_unstale":"2023-10-19T08:38:02.336567+0000","last_undegraded":"2023-10-19T08:38:02.336567+0000","last_fullsized":"2023-10-19T08:38:02.336567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:03.691358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.338327+0000","last_change":"2023-10-19T08:37:51.153416+0000","last_active":"2023-10-19T08:38:02.338327+0000","last_peered":"2023-10-19T08:38:02.338327+0000","last_clean":"2023-10-19T08:38:02.338327+0000","last_became_active":"2023-10-19T08:37:51.152844+0000","last_became_peered":"2023-10-19T08:37:51.152844+0000","last_unstale":"2023-10-19T08:38:02.338327+0000","last_undegraded":"2023-10-19T08:38:02.338327+0000","last_fullsized":"2023-10-19T08:38:02.338327+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:10.215323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336833+0000","last_change":"2023-10-19T08:37:56.284323+0000","last_active":"2023-10-19T08:38:02.336833+0000","last_peered":"2023-10-19T08:38:02.336833+0000","last_clean":"2023-10-19T08:38:02.336833+0000","last_became_active":"2023-10-19T08:37:56.283556+0000","last_became_peered":"2023-10-19T08:37:56.283556+0000","last_unstale":"2023-10-19T08:38:02.336833+0000","last_undegraded":"2023-10-19T08:38:02.336833+0000","last_fullsized":"2023-10-19T08:38:02.336833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:22.553042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327868+0000","last_change":"2023-10-19T08:37:57.283892+0000","last_active":"2023-10-19T08:38:02.327868+0000","last_peered":"2023-10-19T08:38:02.327868+0000","last_clean":"2023-10-19T08:38:02.327868+0000","last_became_active":"2023-10-19T08:37:57.283605+0000","last_became_peered":"2023-10-19T08:37:57.283605+0000","last_unstale":"2023-10-19T08:38:02.327868+0000","last_undegraded":"2023-10-19T08:38:02.327868+0000","last_fullsized":"2023-10-19T08:38:02.327868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:56:23.560291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336875+0000","last_change":"2023-10-19T08:38:01.348839+0000","last_active":"2023-10-19T08:38:02.336875+0000","last_peered":"2023-10-19T08:38:02.336875+0000","last_clean":"2023-10-19T08:38:02.336875+0000","last_became_active":"2023-10-19T08:38:01.348383+0000","last_became_peered":"2023-10-19T08:38:01.348383+0000","last_unstale":"2023-10-19T08:38:02.336875+0000","last_undegraded":"2023-10-19T08:38:02.336875+0000","last_fullsized":"2023-10-19T08:38:02.336875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:28:33.114633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303327+0000","last_change":"2023-10-19T08:37:56.285043+0000","last_active":"2023-10-19T08:38:02.303327+0000","last_peered":"2023-10-19T08:38:02.303327+0000","last_clean":"2023-10-19T08:38:02.303327+0000","last_became_active":"2023-10-19T08:37:56.284744+0000","last_became_peered":"2023-10-19T08:37:56.284744+0000","last_unstale":"2023-10-19T08:38:02.303327+0000","last_undegraded":"2023-10-19T08:38:02.303327+0000","last_fullsized":"2023-10-19T08:38:02.303327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:32:49.109159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336864+0000","last_change":"2023-10-19T08:37:51.124188+0000","last_active":"2023-10-19T08:38:02.336864+0000","last_peered":"2023-10-19T08:38:02.336864+0000","last_clean":"2023-10-19T08:38:02.336864+0000","last_became_active":"2023-10-19T08:37:51.123944+0000","last_became_peered":"2023-10-19T08:37:51.123944+0000","last_unstale":"2023-10-19T08:38:02.336864+0000","last_undegraded":"2023-10-19T08:38:02.336864+0000","last_fullsized":"2023-10-19T08:38:02.336864+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:15.708544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302239+0000","last_change":"2023-10-19T08:37:57.292133+0000","last_active":"2023-10-19T08:38:02.302239+0000","last_peered":"2023-10-19T08:38:02.302239+0000","last_clean":"2023-10-19T08:38:02.302239+0000","last_became_active":"2023-10-19T08:37:57.291516+0000","last_became_peered":"2023-10-19T08:37:57.291516+0000","last_unstale":"2023-10-19T08:38:02.302239+0000","last_undegraded":"2023-10-19T08:38:02.302239+0000","last_fullsized":"2023-10-19T08:38:02.302239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:29:41.090590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302236+0000","last_change":"2023-10-19T08:38:01.346818+0000","last_active":"2023-10-19T08:38:02.302236+0000","last_peered":"2023-10-19T08:38:02.302236+0000","last_clean":"2023-10-19T08:38:02.302236+0000","last_became_active":"2023-10-19T08:38:01.346160+0000","last_became_peered":"2023-10-19T08:38:01.346160+0000","last_unstale":"2023-10-19T08:38:02.302236+0000","last_undegraded":"2023-10-19T08:38:02.302236+0000","last_fullsized":"2023-10-19T08:38:02.302236+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:58:38.199370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337121+0000","last_change":"2023-10-19T08:37:52.296732+0000","last_active":"2023-10-19T08:38:02.337121+0000","last_peered":"2023-10-19T08:38:02.337121+0000","last_clean":"2023-10-19T08:38:02.337121+0000","last_became_active":"2023-10-19T08:37:52.296445+0000","last_became_peered":"2023-10-19T08:37:52.296445+0000","last_unstale":"2023-10-19T08:38:02.337121+0000","last_undegraded":"2023-10-19T08:38:02.337121+0000","last_fullsized":"2023-10-19T08:38:02.337121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:06:03.911706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328377+0000","last_change":"2023-10-19T08:37:56.284122+0000","last_active":"2023-10-19T08:38:02.328377+0000","last_peered":"2023-10-19T08:38:02.328377+0000","last_clean":"2023-10-19T08:38:02.328377+0000","last_became_active":"2023-10-19T08:37:56.283849+0000","last_became_peered":"2023-10-19T08:37:56.283849+0000","last_unstale":"2023-10-19T08:38:02.328377+0000","last_undegraded":"2023-10-19T08:38:02.328377+0000","last_fullsized":"2023-10-19T08:38:02.328377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:39.158559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336659+0000","last_change":"2023-10-19T08:37:57.285543+0000","last_active":"2023-10-19T08:38:02.336659+0000","last_peered":"2023-10-19T08:38:02.336659+0000","last_clean":"2023-10-19T08:38:02.336659+0000","last_became_active":"2023-10-19T08:37:57.284966+0000","last_became_peered":"2023-10-19T08:37:57.284966+0000","last_unstale":"2023-10-19T08:38:02.336659+0000","last_undegraded":"2023-10-19T08:38:02.336659+0000","last_fullsized":"2023-10-19T08:38:02.336659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:07:16.162389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336877+0000","last_change":"2023-10-19T08:38:01.351967+0000","last_active":"2023-10-19T08:38:02.336877+0000","last_peered":"2023-10-19T08:38:02.336877+0000","last_clean":"2023-10-19T08:38:02.336877+0000","last_became_active":"2023-10-19T08:38:01.351672+0000","last_became_peered":"2023-10-19T08:38:01.351672+0000","last_unstale":"2023-10-19T08:38:02.336877+0000","last_undegraded":"2023-10-19T08:38:02.336877+0000","last_fullsized":"2023-10-19T08:38:02.336877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:56.518286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.327742+0000","last_change":"2023-10-19T08:37:56.276005+0000","last_active":"2023-10-19T08:38:02.327742+0000","last_peered":"2023-10-19T08:38:02.327742+0000","last_clean":"2023-10-19T08:38:02.327742+0000","last_became_active":"2023-10-19T08:37:56.275738+0000","last_became_peered":"2023-10-19T08:37:56.275738+0000","last_unstale":"2023-10-19T08:38:02.327742+0000","last_undegraded":"2023-10-19T08:38:02.327742+0000","last_fullsized":"2023-10-19T08:38:02.327742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:01.303025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336641+0000","last_change":"2023-10-19T08:37:57.282141+0000","last_active":"2023-10-19T08:38:02.336641+0000","last_peered":"2023-10-19T08:38:02.336641+0000","last_clean":"2023-10-19T08:38:02.336641+0000","last_became_active":"2023-10-19T08:37:57.281854+0000","last_became_peered":"2023-10-19T08:37:57.281854+0000","last_unstale":"2023-10-19T08:38:02.336641+0000","last_undegraded":"2023-10-19T08:38:02.336641+0000","last_fullsized":"2023-10-19T08:38:02.336641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:08:06.606119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337880+0000","last_change":"2023-10-19T08:38:01.345085+0000","last_active":"2023-10-19T08:38:02.337880+0000","last_peered":"2023-10-19T08:38:02.337880+0000","last_clean":"2023-10-19T08:38:02.337880+0000","last_became_active":"2023-10-19T08:38:01.344682+0000","last_became_peered":"2023-10-19T08:38:01.344682+0000","last_unstale":"2023-10-19T08:38:02.337880+0000","last_undegraded":"2023-10-19T08:38:02.337880+0000","last_fullsized":"2023-10-19T08:38:02.337880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:16:13.159933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302932+0000","last_change":"2023-10-19T08:37:56.279226+0000","last_active":"2023-10-19T08:38:02.302932+0000","last_peered":"2023-10-19T08:38:02.302932+0000","last_clean":"2023-10-19T08:38:02.302932+0000","last_became_active":"2023-10-19T08:37:56.278922+0000","last_became_peered":"2023-10-19T08:37:56.278922+0000","last_unstale":"2023-10-19T08:38:02.302932+0000","last_undegraded":"2023-10-19T08:38:02.302932+0000","last_fullsized":"2023-10-19T08:38:02.302932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:22:29.730980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337314+0000","last_change":"2023-10-19T08:37:57.295005+0000","last_active":"2023-10-19T08:38:02.337314+0000","last_peered":"2023-10-19T08:38:02.337314+0000","last_clean":"2023-10-19T08:38:02.337314+0000","last_became_active":"2023-10-19T08:37:57.294608+0000","last_became_peered":"2023-10-19T08:37:57.294608+0000","last_unstale":"2023-10-19T08:38:02.337314+0000","last_undegraded":"2023-10-19T08:38:02.337314+0000","last_fullsized":"2023-10-19T08:38:02.337314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:49:06.947549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302938+0000","last_change":"2023-10-19T08:38:01.340671+0000","last_active":"2023-10-19T08:38:02.302938+0000","last_peered":"2023-10-19T08:38:02.302938+0000","last_clean":"2023-10-19T08:38:02.302938+0000","last_became_active":"2023-10-19T08:38:01.340227+0000","last_became_peered":"2023-10-19T08:38:01.340227+0000","last_unstale":"2023-10-19T08:38:02.302938+0000","last_undegraded":"2023-10-19T08:38:02.302938+0000","last_fullsized":"2023-10-19T08:38:02.302938+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:40:25.917329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.303068+0000","last_change":"2023-10-19T08:37:56.279662+0000","last_active":"2023-10-19T08:38:02.303068+0000","last_peered":"2023-10-19T08:38:02.303068+0000","last_clean":"2023-10-19T08:38:02.303068+0000","last_became_active":"2023-10-19T08:37:56.279082+0000","last_became_peered":"2023-10-19T08:37:56.279082+0000","last_unstale":"2023-10-19T08:38:02.303068+0000","last_undegraded":"2023-10-19T08:38:02.303068+0000","last_fullsized":"2023-10-19T08:38:02.303068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:43:15.152471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336105+0000","last_change":"2023-10-19T08:37:57.291366+0000","last_active":"2023-10-19T08:38:02.336105+0000","last_peered":"2023-10-19T08:38:02.336105+0000","last_clean":"2023-10-19T08:38:02.336105+0000","last_became_active":"2023-10-19T08:37:57.291122+0000","last_became_peered":"2023-10-19T08:37:57.291122+0000","last_unstale":"2023-10-19T08:38:02.336105+0000","last_undegraded":"2023-10-19T08:38:02.336105+0000","last_fullsized":"2023-10-19T08:38:02.336105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:10:57.605170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336071+0000","last_change":"2023-10-19T08:38:01.343824+0000","last_active":"2023-10-19T08:38:02.336071+0000","last_peered":"2023-10-19T08:38:02.336071+0000","last_clean":"2023-10-19T08:38:02.336071+0000","last_became_active":"2023-10-19T08:38:01.343411+0000","last_became_peered":"2023-10-19T08:38:01.343411+0000","last_unstale":"2023-10-19T08:38:02.336071+0000","last_undegraded":"2023-10-19T08:38:02.336071+0000","last_fullsized":"2023-10-19T08:38:02.336071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:18:50.610592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302995+0000","last_change":"2023-10-19T08:37:56.279882+0000","last_active":"2023-10-19T08:38:02.302995+0000","last_peered":"2023-10-19T08:38:02.302995+0000","last_clean":"2023-10-19T08:38:02.302995+0000","last_became_active":"2023-10-19T08:37:56.279620+0000","last_became_peered":"2023-10-19T08:37:56.279620+0000","last_unstale":"2023-10-19T08:38:02.302995+0000","last_undegraded":"2023-10-19T08:38:02.302995+0000","last_fullsized":"2023-10-19T08:38:02.302995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:58:27.340847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302471+0000","last_change":"2023-10-19T08:37:57.291911+0000","last_active":"2023-10-19T08:38:02.302471+0000","last_peered":"2023-10-19T08:38:02.302471+0000","last_clean":"2023-10-19T08:38:02.302471+0000","last_became_active":"2023-10-19T08:37:57.291157+0000","last_became_peered":"2023-10-19T08:37:57.291157+0000","last_unstale":"2023-10-19T08:38:02.302471+0000","last_undegraded":"2023-10-19T08:38:02.302471+0000","last_fullsized":"2023-10-19T08:38:02.302471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:08:40.165807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337238+0000","last_change":"2023-10-19T08:38:01.350894+0000","last_active":"2023-10-19T08:38:02.337238+0000","last_peered":"2023-10-19T08:38:02.337238+0000","last_clean":"2023-10-19T08:38:02.337238+0000","last_became_active":"2023-10-19T08:38:01.347794+0000","last_became_peered":"2023-10-19T08:38:01.347794+0000","last_unstale":"2023-10-19T08:38:02.337238+0000","last_undegraded":"2023-10-19T08:38:02.337238+0000","last_fullsized":"2023-10-19T08:38:02.337238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:38:00.313202+0000","last_clean_scrub_stamp":"2023-10-19T08:38:00.313202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:00:47.081654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.328719+0000","last_change":"2023-10-19T08:37:56.285044+0000","last_active":"2023-10-19T08:38:02.328719+0000","last_peered":"2023-10-19T08:38:02.328719+0000","last_clean":"2023-10-19T08:38:02.328719+0000","last_became_active":"2023-10-19T08:37:56.284825+0000","last_became_peered":"2023-10-19T08:37:56.284825+0000","last_unstale":"2023-10-19T08:38:02.328719+0000","last_undegraded":"2023-10-19T08:38:02.328719+0000","last_fullsized":"2023-10-19T08:38:02.328719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:55.252721+0000","last_clean_scrub_stamp":"2023-10-19T08:37:55.252721+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:15:15.363627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336251+0000","last_change":"2023-10-19T08:37:57.287724+0000","last_active":"2023-10-19T08:38:02.336251+0000","last_peered":"2023-10-19T08:38:02.336251+0000","last_clean":"2023-10-19T08:38:02.336251+0000","last_became_active":"2023-10-19T08:37:57.287402+0000","last_became_peered":"2023-10-19T08:37:57.287402+0000","last_unstale":"2023-10-19T08:38:02.336251+0000","last_undegraded":"2023-10-19T08:38:02.336251+0000","last_fullsized":"2023-10-19T08:38:02.336251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:11:01.726937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336321+0000","last_change":"2023-10-19T08:37:57.280610+0000","last_active":"2023-10-19T08:38:02.336321+0000","last_peered":"2023-10-19T08:38:02.336321+0000","last_clean":"2023-10-19T08:38:02.336321+0000","last_became_active":"2023-10-19T08:37:57.280180+0000","last_became_peered":"2023-10-19T08:37:57.280180+0000","last_unstale":"2023-10-19T08:38:02.336321+0000","last_undegraded":"2023-10-19T08:38:02.336321+0000","last_fullsized":"2023-10-19T08:38:02.336321+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:50:11.458306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302739+0000","last_change":"2023-10-19T08:37:57.292317+0000","last_active":"2023-10-19T08:38:02.302739+0000","last_peered":"2023-10-19T08:38:02.302739+0000","last_clean":"2023-10-19T08:38:02.302739+0000","last_became_active":"2023-10-19T08:37:57.291863+0000","last_became_peered":"2023-10-19T08:37:57.291863+0000","last_unstale":"2023-10-19T08:38:02.302739+0000","last_undegraded":"2023-10-19T08:38:02.302739+0000","last_fullsized":"2023-10-19T08:38:02.302739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:45:25.612225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.337065+0000","last_change":"2023-10-19T08:37:57.289937+0000","last_active":"2023-10-19T08:38:02.337065+0000","last_peered":"2023-10-19T08:38:02.337065+0000","last_clean":"2023-10-19T08:38:02.337065+0000","last_became_active":"2023-10-19T08:37:57.289356+0000","last_became_peered":"2023-10-19T08:37:57.289356+0000","last_unstale":"2023-10-19T08:38:02.337065+0000","last_undegraded":"2023-10-19T08:38:02.337065+0000","last_fullsized":"2023-10-19T08:38:02.337065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:26:46.461250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.302347+0000","last_change":"2023-10-19T08:37:57.292611+0000","last_active":"2023-10-19T08:38:02.302347+0000","last_peered":"2023-10-19T08:38:02.302347+0000","last_clean":"2023-10-19T08:38:02.302347+0000","last_became_active":"2023-10-19T08:37:57.291906+0000","last_became_peered":"2023-10-19T08:37:57.291906+0000","last_unstale":"2023-10-19T08:38:02.302347+0000","last_undegraded":"2023-10-19T08:38:02.302347+0000","last_fullsized":"2023-10-19T08:38:02.302347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:46:52.465054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-10-19T08:38:02.336760+0000","last_change":"2023-10-19T08:37:57.288360+0000","last_active":"2023-10-19T08:38:02.336760+0000","last_peered":"2023-10-19T08:38:02.336760+0000","last_clean":"2023-10-19T08:38:02.336760+0000","last_became_active":"2023-10-19T08:37:57.288107+0000","last_became_peered":"2023-10-19T08:37:57.288107+0000","last_unstale":"2023-10-19T08:38:02.336760+0000","last_undegraded":"2023-10-19T08:38:02.336760+0000","last_fullsized":"2023-10-19T08:38:02.336760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:56.259970+0000","last_clean_scrub_stamp":"2023-10-19T08:37:56.259970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:56:02.310273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":888832,"data_stored":704558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":110132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":110132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":699721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":109148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":110222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":112669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":110784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-19T08:38:26.590 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-19T08:38:26.591 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-19T08:38:26.591 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-19T08:38:26.591 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-19T08:38:26.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.739+0000 7ffa3d305700 1 Processor -- start 2023-10-19T08:38:26.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.739+0000 7ffa3d305700 1 -- start start 2023-10-19T08:38:26.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa3d305700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa380cfcf0 0x7ffa380d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:26.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa3d305700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa380d0610 con 0x7ffa380b2180 2023-10-19T08:38:26.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa3d305700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa380d1120 con 0x7ffa380b5f20 2023-10-19T08:38:26.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa3d305700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380d2b20 con 0x7ffa380cfcf0 2023-10-19T08:38:26.750 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa367fc700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ffa380b2180 0x7ffa380d2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56696/0 (socket says 172.21.15.79:56696) 2023-10-19T08:38:26.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa367fc700 1 -- 172.21.15.79:0/3054576250 learned_addr learned my addr 172.21.15.79:0/3054576250 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:26.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa36ffd700 1 --2- 172.21.15.79:0/3054576250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa380cfcf0 0x7ffa380d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:26.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa35ffb700 1 -- 172.21.15.79:0/3054576250 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4219292341 0 0) 0x7ffa380d0610 con 0x7ffa380b2180 2023-10-19T08:38:26.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa35ffb700 1 -- 172.21.15.79:0/3054576250 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa200035b0 con 0x7ffa380b2180 2023-10-19T08:38:26.751 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa35ffb700 1 -- 172.21.15.79:0/3054576250 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679141528 0 0) 0x7ffa380d1120 con 0x7ffa380b5f20 2023-10-19T08:38:26.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa35ffb700 1 -- 172.21.15.79:0/3054576250 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa380d0610 con 0x7ffa380b5f20 2023-10-19T08:38:26.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa35ffb700 1 -- 172.21.15.79:0/3054576250 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3214035385 0 0) 0x7ffa200035b0 con 0x7ffa380b2180 2023-10-19T08:38:26.752 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa35ffb700 1 -- 172.21.15.79:0/3054576250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa380cfcf0 msgr2=0x7ffa380d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:26.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa35ffb700 1 --2- 172.21.15.79:0/3054576250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa380cfcf0 0x7ffa380d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa35ffb700 1 -- 172.21.15.79:0/3054576250 >> v1:172.21.15.89:6789/0 conn(0x7ffa380b5f20 legacy=0x7ffa380b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:26.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa35ffb700 1 -- 172.21.15.79:0/3054576250 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa380d1400 con 0x7ffa380b2180 2023-10-19T08:38:26.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa35ffb700 1 -- 172.21.15.79:0/3054576250 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7ffa2c001670 con 0x7ffa380b2180 2023-10-19T08:38:26.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa35ffb700 1 -- 172.21.15.79:0/3054576250 >> v1:172.21.15.79:6789/0 conn(0x7ffa380b2180 legacy=0x7ffa380d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:26.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa35ffb700 1 --2- 172.21.15.79:0/3054576250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa20003bc0 0x7ffa20003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:26.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa35ffb700 1 --2- 172.21.15.79:0/3054576250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa380cfcf0 0x7ffa20004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:26.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa35ffb700 1 --2- 172.21.15.79:0/3054576250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa20004d90 0x7ffa20005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:26.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa35ffb700 1 -- 172.21.15.79:0/3054576250 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2000bac0 con 0x7ffa20003bc0 2023-10-19T08:38:26.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa35ffb700 1 -- 172.21.15.79:0/3054576250 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2000bc00 con 0x7ffa20004d90 2023-10-19T08:38:26.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.740+0000 7ffa35ffb700 1 -- 172.21.15.79:0/3054576250 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2000bd70 con 0x7ffa380cfcf0 2023-10-19T08:38:26.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.741+0000 7ffa36ffd700 1 --2- 172.21.15.79:0/3054576250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa20003bc0 0x7ffa20003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:26.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.741+0000 7ffa367fc700 1 --2- 172.21.15.79:0/3054576250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa380cfcf0 0x7ffa20004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:26.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.741+0000 7ffa377fe700 1 --2- 172.21.15.79:0/3054576250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa20004d90 0x7ffa20005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:26.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.741+0000 7ffa36ffd700 1 -- 172.21.15.79:0/3054576250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa380cfcf0 msgr2=0x7ffa20004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:26.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.741+0000 7ffa36ffd700 1 --2- 172.21.15.79:0/3054576250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa380cfcf0 0x7ffa20004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.741+0000 7ffa36ffd700 1 -- 172.21.15.79:0/3054576250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa20004d90 msgr2=0x7ffa20005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:26.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.741+0000 7ffa36ffd700 1 --2- 172.21.15.79:0/3054576250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa20004d90 0x7ffa20005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.741+0000 7ffa36ffd700 1 -- 172.21.15.79:0/3054576250 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa200035b0 con 0x7ffa20003bc0 2023-10-19T08:38:26.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.741+0000 7ffa36ffd700 1 --2- 172.21.15.79:0/3054576250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa20003bc0 0x7ffa20003fc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009b60 tx=0x7ffa20005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f97b337a2bbe36 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:26.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.741+0000 7ffa35ffb700 1 -- 172.21.15.79:0/3054576250 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2800e6c0 con 0x7ffa20003bc0 2023-10-19T08:38:26.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.741+0000 7ffa35ffb700 1 -- 172.21.15.79:0/3054576250 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2800e820 con 0x7ffa20003bc0 2023-10-19T08:38:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.741+0000 7ffa35ffb700 1 -- 172.21.15.79:0/3054576250 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2800eb90 con 0x7ffa20003bc0 2023-10-19T08:38:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.741+0000 7ffa3d305700 1 -- 172.21.15.79:0/3054576250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa20003bc0 msgr2=0x7ffa20003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.741+0000 7ffa3d305700 1 --2- 172.21.15.79:0/3054576250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa20003bc0 0x7ffa20003fc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009b60 tx=0x7ffa20005880 comp rx=0 tx=0).stop 2023-10-19T08:38:26.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.741+0000 7ffa377fe700 1 -- 172.21.15.79:0/3054576250 reap_dead start 2023-10-19T08:38:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.741+0000 7ffa3d305700 1 -- 172.21.15.79:0/3054576250 shutdown_connections 2023-10-19T08:38:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.741+0000 7ffa3d305700 1 -- 172.21.15.79:0/3054576250 >> 172.21.15.79:0/3054576250 conn(0x7ffa38071b30 msgr2=0x7ffa38071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.742+0000 7ffa3d305700 1 -- 172.21.15.79:0/3054576250 shutdown_connections 2023-10-19T08:38:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.742+0000 7ffa3d305700 1 -- 172.21.15.79:0/3054576250 wait complete. 2023-10-19T08:38:26.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.743+0000 7ffa3d305700 1 Processor -- start 2023-10-19T08:38:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.743+0000 7ffa3d305700 1 -- start start 2023-10-19T08:38:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa3d305700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa20003bc0 0x7ffa3815b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa3d305700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa380b1640 0x7ffa380b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa3d305700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa3815f800 0x7ffa380b6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:26.761 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa3d305700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3815e420 con 0x7ffa380b1640 2023-10-19T08:38:26.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa3d305700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3815e700 con 0x7ffa20003bc0 2023-10-19T08:38:26.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa3d305700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3815e9e0 con 0x7ffa3815f800 2023-10-19T08:38:26.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa367fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa380b1640 0x7ffa380b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:26.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa367fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa380b1640 0x7ffa380b63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46638/0 (socket says 172.21.15.79:46638) 2023-10-19T08:38:26.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa367fc700 1 -- 172.21.15.79:0/3137175572 learned_addr learned my addr 172.21.15.79:0/3137175572 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:26.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa36ffd700 1 --2- 172.21.15.79:0/3137175572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa20003bc0 0x7ffa3815b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:26.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa377fe700 1 --2- 172.21.15.79:0/3137175572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa3815f800 0x7ffa380b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:26.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa367fc700 1 -- 172.21.15.79:0/3137175572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa3815f800 msgr2=0x7ffa380b6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:26.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa367fc700 1 --2- 172.21.15.79:0/3137175572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa3815f800 0x7ffa380b6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa367fc700 1 -- 172.21.15.79:0/3137175572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa20003bc0 msgr2=0x7ffa3815b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:26.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa367fc700 1 --2- 172.21.15.79:0/3137175572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa20003bc0 0x7ffa3815b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa367fc700 1 -- 172.21.15.79:0/3137175572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3815ecc0 con 0x7ffa380b1640 2023-10-19T08:38:26.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa367fc700 1 --2- 172.21.15.79:0/3137175572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa380b1640 0x7ffa380b63c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00e7f0 tx=0x7ffa2c00ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:26.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa1f7fe700 1 -- 172.21.15.79:0/3137175572 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c00c5f0 con 0x7ffa380b1640 2023-10-19T08:38:26.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa1f7fe700 1 -- 172.21.15.79:0/3137175572 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2c00c750 con 0x7ffa380b1640 2023-10-19T08:38:26.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa1f7fe700 1 -- 172.21.15.79:0/3137175572 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c00cb00 con 0x7ffa380b1640 2023-10-19T08:38:26.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa3d305700 1 -- 172.21.15.79:0/3137175572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3815efa0 con 0x7ffa380b1640 2023-10-19T08:38:26.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.744+0000 7ffa3d305700 1 -- 172.21.15.79:0/3137175572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3815b8f0 con 0x7ffa380b1640 2023-10-19T08:38:26.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.745+0000 7ffa3d305700 1 -- 172.21.15.79:0/3137175572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa380a9920 con 0x7ffa380b1640 2023-10-19T08:38:26.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.746+0000 7ffa1f7fe700 1 -- 172.21.15.79:0/3137175572 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffa2c00cc60 con 0x7ffa380b1640 2023-10-19T08:38:26.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.746+0000 7ffa1f7fe700 1 --2- 172.21.15.79:0/3137175572 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ffa2406a0e0 0x7ffa2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:26.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.746+0000 7ffa1f7fe700 1 -- 172.21.15.79:0/3137175572 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffa2c088660 con 0x7ffa380b1640 2023-10-19T08:38:26.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.746+0000 7ffa36ffd700 1 --2- 172.21.15.79:0/3137175572 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ffa2406a0e0 0x7ffa2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:26.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.746+0000 7ffa36ffd700 1 --2- 172.21.15.79:0/3137175572 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ffa2406a0e0 0x7ffa2406c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffa28000c00 tx=0x7ffa28008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:26.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.750+0000 7ffa1f7fe700 1 -- 172.21.15.79:0/3137175572 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ffa2c053a60 con 0x7ffa380b1640 2023-10-19T08:38:26.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.982+0000 7ffa3d305700 1 -- 172.21.15.79:0/3137175572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ffa380d16c0 con 0x7ffa380b1640 2023-10-19T08:38:26.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.982+0000 7ffa1f7fe700 1 -- 172.21.15.79:0/3137175572 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ffa380d16c0 con 0x7ffa380b1640 2023-10-19T08:38:26.986 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:26.986 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-19T08:38:26.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.984+0000 7ffa3d305700 1 -- 172.21.15.79:0/3137175572 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ffa2406a0e0 msgr2=0x7ffa2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:26.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.984+0000 7ffa3d305700 1 --2- 172.21.15.79:0/3137175572 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ffa2406a0e0 0x7ffa2406c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffa28000c00 tx=0x7ffa28008030 comp rx=0 tx=0).stop 2023-10-19T08:38:26.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.984+0000 7ffa3d305700 1 -- 172.21.15.79:0/3137175572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa380b1640 msgr2=0x7ffa380b63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:26.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.984+0000 7ffa3d305700 1 --2- 172.21.15.79:0/3137175572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa380b1640 0x7ffa380b63c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c00e7f0 tx=0x7ffa2c00ebb0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.984+0000 7ffa3d305700 1 -- 172.21.15.79:0/3137175572 shutdown_connections 2023-10-19T08:38:26.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.984+0000 7ffa3d305700 1 --2- 172.21.15.79:0/3137175572 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ffa2406a0e0 0x7ffa2406c5a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.984+0000 7ffa3d305700 1 --2- 172.21.15.79:0/3137175572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa3815f800 0x7ffa380b6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.984+0000 7ffa3d305700 1 --2- 172.21.15.79:0/3137175572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa20003bc0 0x7ffa3815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.984+0000 7ffa3d305700 1 --2- 172.21.15.79:0/3137175572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa380b1640 0x7ffa380b63c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:26.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.984+0000 7ffa3d305700 1 -- 172.21.15.79:0/3137175572 >> 172.21.15.79:0/3137175572 conn(0x7ffa38071b30 msgr2=0x7ffa380b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:26.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.985+0000 7ffa3d305700 1 -- 172.21.15.79:0/3137175572 shutdown_connections 2023-10-19T08:38:26.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:26.985+0000 7ffa3d305700 1 -- 172.21.15.79:0/3137175572 wait complete. 2023-10-19T08:38:27.000 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-19T08:38:27.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:27.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.117+0000 7feba5e68700 1 Processor -- start 2023-10-19T08:38:27.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.117+0000 7feba5e68700 1 -- start start 2023-10-19T08:38:27.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.118+0000 7feba5e68700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feba00cfcf0 0x7feba00d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:27.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.118+0000 7feba5e68700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba00d0610 con 0x7feba00b5f20 2023-10-19T08:38:27.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.118+0000 7feba5e68700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba00d1120 con 0x7feba00b2180 2023-10-19T08:38:27.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.118+0000 7feba5e68700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba00d2b20 con 0x7feba00cfcf0 2023-10-19T08:38:27.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.118+0000 7feb9f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feba00cfcf0 0x7feba00d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:27.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.118+0000 7feb9ffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7feba00b5f20 0x7feba00b6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56720/0 (socket says 172.21.15.79:56720) 2023-10-19T08:38:27.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.118+0000 7feb9ffff700 1 -- 172.21.15.79:0/2075154667 learned_addr learned my addr 172.21.15.79:0/2075154667 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:27.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.119+0000 7feb9f7fe700 1 -- 172.21.15.79:0/2075154667 >> v1:172.21.15.89:6789/0 conn(0x7feba00b2180 legacy=0x7feba00d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:27.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.119+0000 7feb9f7fe700 1 -- 172.21.15.79:0/2075154667 >> v1:172.21.15.79:6789/0 conn(0x7feba00b5f20 legacy=0x7feba00b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:27.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.119+0000 7feb9f7fe700 1 -- 172.21.15.79:0/2075154667 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba00d1400 con 0x7feba00cfcf0 2023-10-19T08:38:27.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.119+0000 7feb9e7fc700 1 -- 172.21.15.79:0/2075154667 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1091701800 0 0) 0x7feba00d0610 con 0x7feba00b5f20 2023-10-19T08:38:27.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.119+0000 7feb9f7fe700 1 --2- 172.21.15.79:0/2075154667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feba00cfcf0 0x7feba00d00d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7feb94009840 tx=0x7feb94009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80666dab07bc83ae server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:27.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.119+0000 7feb9e7fc700 1 -- 172.21.15.79:0/2075154667 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94004230 con 0x7feba00cfcf0 2023-10-19T08:38:27.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.119+0000 7feb9e7fc700 1 -- 172.21.15.79:0/2075154667 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb94004390 con 0x7feba00cfcf0 2023-10-19T08:38:27.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.119+0000 7feb9e7fc700 1 -- 172.21.15.79:0/2075154667 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb940036a0 con 0x7feba00cfcf0 2023-10-19T08:38:27.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.119+0000 7feba5e68700 1 -- 172.21.15.79:0/2075154667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feba00cfcf0 msgr2=0x7feba00d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:27.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.119+0000 7feba5e68700 1 --2- 172.21.15.79:0/2075154667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feba00cfcf0 0x7feba00d00d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7feb94009840 tx=0x7feb94009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:27.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.119+0000 7feba5e68700 1 -- 172.21.15.79:0/2075154667 shutdown_connections 2023-10-19T08:38:27.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.119+0000 7feba5e68700 1 --2- 172.21.15.79:0/2075154667 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feba00cfcf0 0x7feba00d00d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.119+0000 7feba5e68700 1 -- 172.21.15.79:0/2075154667 >> 172.21.15.79:0/2075154667 conn(0x7feba0071b30 msgr2=0x7feba0071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:27.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.119+0000 7feba5e68700 1 -- 172.21.15.79:0/2075154667 shutdown_connections 2023-10-19T08:38:27.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.119+0000 7feba5e68700 1 -- 172.21.15.79:0/2075154667 wait complete. 2023-10-19T08:38:27.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.121+0000 7feba5e68700 1 Processor -- start 2023-10-19T08:38:27.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.121+0000 7feba5e68700 1 -- start start 2023-10-19T08:38:27.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.121+0000 7feba5e68700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba00b2180 0x7feba00aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:27.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.121+0000 7feba5e68700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feba00b5f20 0x7feba01601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:27.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.121+0000 7feba5e68700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feba00cfcf0 0x7feba00b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:27.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.122+0000 7feba5e68700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba00aa660 con 0x7feba00cfcf0 2023-10-19T08:38:27.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.122+0000 7feba5e68700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba00a9d50 con 0x7feba00b5f20 2023-10-19T08:38:27.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.122+0000 7feba5e68700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba00c9820 con 0x7feba00b2180 2023-10-19T08:38:27.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.122+0000 7feb9ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feba00cfcf0 0x7feba00b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:27.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.122+0000 7feb9ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feba00cfcf0 0x7feba00b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46654/0 (socket says 172.21.15.79:46654) 2023-10-19T08:38:27.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.122+0000 7feb9ffff700 1 -- 172.21.15.79:0/2543882018 learned_addr learned my addr 172.21.15.79:0/2543882018 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:27.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.122+0000 7feb9f7fe700 1 --2- 172.21.15.79:0/2543882018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba00b2180 0x7feba00aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:27.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.122+0000 7feb9effd700 1 --2- 172.21.15.79:0/2543882018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feba00b5f20 0x7feba01601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:27.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.122+0000 7feb9ffff700 1 -- 172.21.15.79:0/2543882018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba00b2180 msgr2=0x7feba00aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:27.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.122+0000 7feb9ffff700 1 --2- 172.21.15.79:0/2543882018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba00b2180 0x7feba00aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.122+0000 7feb9ffff700 1 -- 172.21.15.79:0/2543882018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feba00b5f20 msgr2=0x7feba01601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:27.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.122+0000 7feb9ffff700 1 --2- 172.21.15.79:0/2543882018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feba00b5f20 0x7feba01601c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.122+0000 7feb9ffff700 1 -- 172.21.15.79:0/2543882018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb940094a0 con 0x7feba00cfcf0 2023-10-19T08:38:27.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.122+0000 7feb9ffff700 1 --2- 172.21.15.79:0/2543882018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feba00cfcf0 0x7feba00b6390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7feb9800cca0 tx=0x7feb9800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:27.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.122+0000 7feb87fff700 1 -- 172.21.15.79:0/2543882018 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800cea0 con 0x7feba00cfcf0 2023-10-19T08:38:27.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.122+0000 7feb87fff700 1 -- 172.21.15.79:0/2543882018 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9800ade0 con 0x7feba00cfcf0 2023-10-19T08:38:27.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.122+0000 7feba5e68700 1 -- 172.21.15.79:0/2543882018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba00a9fa0 con 0x7feba00cfcf0 2023-10-19T08:38:27.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.122+0000 7feb87fff700 1 -- 172.21.15.79:0/2543882018 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98007310 con 0x7feba00cfcf0 2023-10-19T08:38:27.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.122+0000 7feba5e68700 1 -- 172.21.15.79:0/2543882018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba0160700 con 0x7feba00cfcf0 2023-10-19T08:38:27.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.123+0000 7feba5e68700 1 -- 172.21.15.79:0/2543882018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba00aa7a0 con 0x7feba00cfcf0 2023-10-19T08:38:27.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.123+0000 7feb87fff700 1 -- 172.21.15.79:0/2543882018 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feb98007470 con 0x7feba00cfcf0 2023-10-19T08:38:27.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.124+0000 7feb87fff700 1 --2- 172.21.15.79:0/2543882018 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7feb8c06a0e0 0x7feb8c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:27.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.124+0000 7feb87fff700 1 -- 172.21.15.79:0/2543882018 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feb98088490 con 0x7feba00cfcf0 2023-10-19T08:38:27.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.124+0000 7feb9f7fe700 1 --2- 172.21.15.79:0/2543882018 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7feb8c06a0e0 0x7feb8c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:27.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.124+0000 7feb9f7fe700 1 --2- 172.21.15.79:0/2543882018 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7feb8c06a0e0 0x7feb8c06c5a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7feb940090b0 tx=0x7feb94008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:27.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.128+0000 7feb87fff700 1 -- 172.21.15.79:0/2543882018 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7feba00aa7a0 con 0x7feba00cfcf0 2023-10-19T08:38:27.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.321+0000 7feba5e68700 1 -- 172.21.15.79:0/2543882018 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feba00aa7a0 con 0x7feba00cfcf0 2023-10-19T08:38:27.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.322+0000 7feb87fff700 1 -- 172.21.15.79:0/2543882018 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20060 (secure 0 0 0) 0x7feba00aa7a0 con 0x7feba00cfcf0 2023-10-19T08:38:27.326 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:27.326 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":25,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:01.725914+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:27.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.324+0000 7feba5e68700 1 -- 172.21.15.79:0/2543882018 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7feb8c06a0e0 msgr2=0x7feb8c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:27.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.324+0000 7feba5e68700 1 --2- 172.21.15.79:0/2543882018 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7feb8c06a0e0 0x7feb8c06c5a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7feb940090b0 tx=0x7feb94008030 comp rx=0 tx=0).stop 2023-10-19T08:38:27.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.324+0000 7feba5e68700 1 -- 172.21.15.79:0/2543882018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feba00cfcf0 msgr2=0x7feba00b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:27.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.324+0000 7feba5e68700 1 --2- 172.21.15.79:0/2543882018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feba00cfcf0 0x7feba00b6390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7feb9800cca0 tx=0x7feb9800a340 comp rx=0 tx=0).stop 2023-10-19T08:38:27.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.324+0000 7feba5e68700 1 -- 172.21.15.79:0/2543882018 shutdown_connections 2023-10-19T08:38:27.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.324+0000 7feba5e68700 1 --2- 172.21.15.79:0/2543882018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feba00cfcf0 0x7feba00b6390 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.324+0000 7feba5e68700 1 --2- 172.21.15.79:0/2543882018 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7feb8c06a0e0 0x7feb8c06c5a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.324+0000 7feba5e68700 1 --2- 172.21.15.79:0/2543882018 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feba00b2180 0x7feba00aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.324+0000 7feba5e68700 1 --2- 172.21.15.79:0/2543882018 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feba00b5f20 0x7feba01601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.324+0000 7feba5e68700 1 -- 172.21.15.79:0/2543882018 >> 172.21.15.79:0/2543882018 conn(0x7feba0071b30 msgr2=0x7feba00b2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:27.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.325+0000 7feba5e68700 1 -- 172.21.15.79:0/2543882018 shutdown_connections 2023-10-19T08:38:27.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.325+0000 7feba5e68700 1 -- 172.21.15.79:0/2543882018 wait complete. 2023-10-19T08:38:27.340 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T08:37:54.318159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T08:37:55.629862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T08:37:59.333062+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T08:38:27.341 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:38:27.465 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.462+0000 7fe2f6943700 1 Processor -- start 2023-10-19T08:38:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.462+0000 7fe2f6943700 1 -- start start 2023-10-19T08:38:27.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.463+0000 7fe2f6943700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe2f015e570 0x7fe2f00d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:27.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.463+0000 7fe2f6943700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f00cb6f0 0x7fe2f00b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:27.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.463+0000 7fe2f6943700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f00afd60 con 0x7fe2f00b0a30 2023-10-19T08:38:27.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.463+0000 7fe2f6943700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f00b0ec0 con 0x7fe2f015e570 2023-10-19T08:38:27.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.463+0000 7fe2f6943700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00af810 con 0x7fe2f00cb6f0 2023-10-19T08:38:27.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.463+0000 7fe2effff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe2f015e570 0x7fe2f00d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:27.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.463+0000 7fe2effff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe2f015e570 0x7fe2f00d1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46658/0 (socket says 172.21.15.79:46658) 2023-10-19T08:38:27.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.463+0000 7fe2effff700 1 -- 172.21.15.79:0/1887754212 learned_addr learned my addr 172.21.15.79:0/1887754212 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:27.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.463+0000 7fe2effff700 1 -- 172.21.15.79:0/1887754212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f00cb6f0 msgr2=0x7fe2f00b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:27.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.463+0000 7fe2ef7fe700 1 --2- 172.21.15.79:0/1887754212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f00cb6f0 0x7fe2f00b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:27.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.463+0000 7fe2effff700 1 --2- 172.21.15.79:0/1887754212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f00cb6f0 0x7fe2f00b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.463+0000 7fe2effff700 1 -- 172.21.15.79:0/1887754212 >> v1:172.21.15.89:6789/0 conn(0x7fe2f00b0a30 legacy=0x7fe2f00b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:27.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.463+0000 7fe2effff700 1 -- 172.21.15.79:0/1887754212 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f00aef70 con 0x7fe2f015e570 2023-10-19T08:38:27.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.463+0000 7fe2ef7fe700 1 --2- 172.21.15.79:0/1887754212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f00cb6f0 0x7fe2f00b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:27.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.463+0000 7fe2effff700 1 --2- 172.21.15.79:0/1887754212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2f015e570 0x7fe2f00d1990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40098f0 tx=0x7fe2e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3456fc65a51a84 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:27.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.464+0000 7fe2eeffd700 1 -- 172.21.15.79:0/1887754212 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4004230 con 0x7fe2f015e570 2023-10-19T08:38:27.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.464+0000 7fe2eeffd700 1 -- 172.21.15.79:0/1887754212 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e4004390 con 0x7fe2f015e570 2023-10-19T08:38:27.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.464+0000 7fe2eeffd700 1 -- 172.21.15.79:0/1887754212 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e40036a0 con 0x7fe2f015e570 2023-10-19T08:38:27.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.464+0000 7fe2f6943700 1 -- 172.21.15.79:0/1887754212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2f015e570 msgr2=0x7fe2f00d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:27.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.464+0000 7fe2f6943700 1 --2- 172.21.15.79:0/1887754212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2f015e570 0x7fe2f00d1990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe2e40098f0 tx=0x7fe2e4009c00 comp rx=0 tx=0).stop 2023-10-19T08:38:27.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.464+0000 7fe2f6943700 1 -- 172.21.15.79:0/1887754212 shutdown_connections 2023-10-19T08:38:27.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.464+0000 7fe2f6943700 1 --2- 172.21.15.79:0/1887754212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2f015e570 0x7fe2f00d1990 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.464+0000 7fe2f6943700 1 --2- 172.21.15.79:0/1887754212 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f00cb6f0 0x7fe2f00b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.464+0000 7fe2f6943700 1 -- 172.21.15.79:0/1887754212 >> 172.21.15.79:0/1887754212 conn(0x7fe2f009a0b0 msgr2=0x7fe2f00d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:27.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.464+0000 7fe2f6943700 1 -- 172.21.15.79:0/1887754212 shutdown_connections 2023-10-19T08:38:27.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.464+0000 7fe2f6943700 1 -- 172.21.15.79:0/1887754212 wait complete. 2023-10-19T08:38:27.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.465+0000 7fe2f6943700 1 Processor -- start 2023-10-19T08:38:27.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.466+0000 7fe2f6943700 1 -- start start 2023-10-19T08:38:27.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.466+0000 7fe2f6943700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2f00b0a30 0x7fe2f00c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:27.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.466+0000 7fe2f6943700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f00cb6f0 0x7fe2f00ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:27.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.466+0000 7fe2f6943700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2f015e570 0x7fe2f00caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:27.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.466+0000 7fe2f6943700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00c9d70 con 0x7fe2f00b0a30 2023-10-19T08:38:27.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.466+0000 7fe2f6943700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f00c9a90 con 0x7fe2f015e570 2023-10-19T08:38:27.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.466+0000 7fe2f6943700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f006b3d0 con 0x7fe2f00cb6f0 2023-10-19T08:38:27.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.466+0000 7fe2effff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2f00b0a30 0x7fe2f00c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:27.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.466+0000 7fe2effff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2f00b0a30 0x7fe2f00c8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46664/0 (socket says 172.21.15.79:46664) 2023-10-19T08:38:27.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.466+0000 7fe2effff700 1 -- 172.21.15.79:0/631475747 learned_addr learned my addr 172.21.15.79:0/631475747 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:27.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.467+0000 7fe2ef7fe700 1 --2- 172.21.15.79:0/631475747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f00cb6f0 0x7fe2f00ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:27.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.467+0000 7fe2f4ee0700 1 --2- 172.21.15.79:0/631475747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2f015e570 0x7fe2f00caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:27.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.467+0000 7fe2effff700 1 -- 172.21.15.79:0/631475747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f00cb6f0 msgr2=0x7fe2f00ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:27.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.467+0000 7fe2effff700 1 --2- 172.21.15.79:0/631475747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f00cb6f0 0x7fe2f00ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.467+0000 7fe2effff700 1 -- 172.21.15.79:0/631475747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2f015e570 msgr2=0x7fe2f00caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:27.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.467+0000 7fe2effff700 1 --2- 172.21.15.79:0/631475747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2f015e570 0x7fe2f00caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.467+0000 7fe2effff700 1 -- 172.21.15.79:0/631475747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e4009550 con 0x7fe2f00b0a30 2023-10-19T08:38:27.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.467+0000 7fe2ef7fe700 1 --2- 172.21.15.79:0/631475747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f00cb6f0 0x7fe2f00ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:27.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.467+0000 7fe2f4ee0700 1 --2- 172.21.15.79:0/631475747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2f015e570 0x7fe2f00caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:27.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.467+0000 7fe2effff700 1 --2- 172.21.15.79:0/631475747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2f00b0a30 0x7fe2f00c8fa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00727f0 tx=0x7fe2e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:27.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.467+0000 7fe2ecff9700 1 -- 172.21.15.79:0/631475747 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e400b860 con 0x7fe2f00b0a30 2023-10-19T08:38:27.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.467+0000 7fe2ecff9700 1 -- 172.21.15.79:0/631475747 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e400b9e0 con 0x7fe2f00b0a30 2023-10-19T08:38:27.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.467+0000 7fe2f6943700 1 -- 172.21.15.79:0/631475747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f006b6b0 con 0x7fe2f00b0a30 2023-10-19T08:38:27.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.467+0000 7fe2ecff9700 1 -- 172.21.15.79:0/631475747 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e400bd90 con 0x7fe2f00b0a30 2023-10-19T08:38:27.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.467+0000 7fe2f6943700 1 -- 172.21.15.79:0/631475747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f00b4230 con 0x7fe2f00b0a30 2023-10-19T08:38:27.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.468+0000 7fe2f6943700 1 -- 172.21.15.79:0/631475747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f006bbd0 con 0x7fe2f00b0a30 2023-10-19T08:38:27.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.469+0000 7fe2ecff9700 1 -- 172.21.15.79:0/631475747 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe2e401b440 con 0x7fe2f00b0a30 2023-10-19T08:38:27.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.469+0000 7fe2ecff9700 1 --2- 172.21.15.79:0/631475747 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe2dc06a0e0 0x7fe2dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:27.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.469+0000 7fe2ecff9700 1 -- 172.21.15.79:0/631475747 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe2e408a220 con 0x7fe2f00b0a30 2023-10-19T08:38:27.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.469+0000 7fe2ef7fe700 1 --2- 172.21.15.79:0/631475747 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe2dc06a0e0 0x7fe2dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:27.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.469+0000 7fe2ef7fe700 1 --2- 172.21.15.79:0/631475747 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe2dc06a0e0 0x7fe2dc06c5a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe2f01f5c80 tx=0x7fe2e0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:27.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.473+0000 7fe2ecff9700 1 -- 172.21.15.79:0/631475747 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fe2f006bbd0 con 0x7fe2f00b0a30 2023-10-19T08:38:27.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.663+0000 7fe2f6943700 1 -- 172.21.15.79:0/631475747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2f006bbd0 con 0x7fe2f00b0a30 2023-10-19T08:38:27.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.664+0000 7fe2ecff9700 1 -- 172.21.15.79:0/631475747 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2f006bbd0 con 0x7fe2f00b0a30 2023-10-19T08:38:27.668 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:38:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.666+0000 7fe2f6943700 1 -- 172.21.15.79:0/631475747 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe2dc06a0e0 msgr2=0x7fe2dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.666+0000 7fe2f6943700 1 --2- 172.21.15.79:0/631475747 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe2dc06a0e0 0x7fe2dc06c5a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe2f01f5c80 tx=0x7fe2e0008040 comp rx=0 tx=0).stop 2023-10-19T08:38:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.666+0000 7fe2f6943700 1 -- 172.21.15.79:0/631475747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2f00b0a30 msgr2=0x7fe2f00c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.666+0000 7fe2f6943700 1 --2- 172.21.15.79:0/631475747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2f00b0a30 0x7fe2f00c8fa0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00727f0 tx=0x7fe2e4004750 comp rx=0 tx=0).stop 2023-10-19T08:38:27.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.666+0000 7fe2f6943700 1 -- 172.21.15.79:0/631475747 shutdown_connections 2023-10-19T08:38:27.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.666+0000 7fe2f6943700 1 --2- 172.21.15.79:0/631475747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2f015e570 0x7fe2f00caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.666+0000 7fe2f6943700 1 --2- 172.21.15.79:0/631475747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2f00b0a30 0x7fe2f00c8fa0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.666+0000 7fe2f6943700 1 --2- 172.21.15.79:0/631475747 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe2dc06a0e0 0x7fe2dc06c5a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.666+0000 7fe2f6943700 1 --2- 172.21.15.79:0/631475747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2f00cb6f0 0x7fe2f00ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.666+0000 7fe2f6943700 1 -- 172.21.15.79:0/631475747 >> 172.21.15.79:0/631475747 conn(0x7fe2f009a0b0 msgr2=0x7fe2f00cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:27.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.666+0000 7fe2f6943700 1 -- 172.21.15.79:0/631475747 shutdown_connections 2023-10-19T08:38:27.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.666+0000 7fe2f6943700 1 -- 172.21.15.79:0/631475747 wait complete. 2023-10-19T08:38:27.682 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:38:27.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.800+0000 7f752d711700 1 Processor -- start 2023-10-19T08:38:27.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.801+0000 7f752d711700 1 -- start start 2023-10-19T08:38:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.801+0000 7f752d711700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f75280ce270 0x7f75280b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.801+0000 7f752d711700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f752815d580 0x7f75280ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.801+0000 7f752d711700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7528161490 con 0x7f7528160f30 2023-10-19T08:38:27.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.801+0000 7f752d711700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7528161770 con 0x7f75280ce270 2023-10-19T08:38:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.801+0000 7f752d711700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7528161a50 con 0x7f752815d580 2023-10-19T08:38:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.802+0000 7f75277fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f752815d580 0x7f75280ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.802+0000 7f7526ffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f75280ce270 0x7f75280b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.802+0000 7f7526ffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f75280ce270 0x7f75280b1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:32918/0 (socket says 172.21.15.79:32918) 2023-10-19T08:38:27.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.802+0000 7f75277fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f752815d580 0x7f75280ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:49300/0 (socket says 172.21.15.79:49300) 2023-10-19T08:38:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.802+0000 7f7526ffd700 1 -- 172.21.15.79:0/2951422663 learned_addr learned my addr 172.21.15.79:0/2951422663 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.802+0000 7f7526ffd700 1 -- 172.21.15.79:0/2951422663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f752815d580 msgr2=0x7f75280ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.802+0000 7f7526ffd700 1 --2- 172.21.15.79:0/2951422663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f752815d580 0x7f75280ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.802+0000 7f7526ffd700 1 -- 172.21.15.79:0/2951422663 >> v1:172.21.15.89:6789/0 conn(0x7f7528160f30 legacy=0x7f752815ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:27.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.802+0000 7f7526ffd700 1 -- 172.21.15.79:0/2951422663 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7528161d30 con 0x7f75280ce270 2023-10-19T08:38:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.802+0000 7f7525ffb700 1 -- 172.21.15.79:0/2951422663 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009263174 0 0) 0x7f7528161490 con 0x7f7528160f30 2023-10-19T08:38:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.802+0000 7f75277fe700 1 --2- 172.21.15.79:0/2951422663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f752815d580 0x7f75280ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:38:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.802+0000 7f7526ffd700 1 --2- 172.21.15.79:0/2951422663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75280ce270 0x7f75280b1f70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f751c0098f0 tx=0x7f751c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f1f17fca8442a2e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.802+0000 7f7525ffb700 1 -- 172.21.15.79:0/2951422663 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c011830 con 0x7f75280ce270 2023-10-19T08:38:27.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.802+0000 7f7525ffb700 1 -- 172.21.15.79:0/2951422663 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c011990 con 0x7f75280ce270 2023-10-19T08:38:27.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.802+0000 7f7525ffb700 1 -- 172.21.15.79:0/2951422663 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c011d20 con 0x7f75280ce270 2023-10-19T08:38:27.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.803+0000 7f752d711700 1 -- 172.21.15.79:0/2951422663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75280ce270 msgr2=0x7f75280b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:27.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.803+0000 7f752d711700 1 --2- 172.21.15.79:0/2951422663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75280ce270 0x7f75280b1f70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f751c0098f0 tx=0x7f751c009c00 comp rx=0 tx=0).stop 2023-10-19T08:38:27.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.803+0000 7f752d711700 1 -- 172.21.15.79:0/2951422663 shutdown_connections 2023-10-19T08:38:27.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.803+0000 7f752d711700 1 --2- 172.21.15.79:0/2951422663 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f752815d580 0x7f75280ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.803+0000 7f752d711700 1 --2- 172.21.15.79:0/2951422663 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75280ce270 0x7f75280b1f70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.803+0000 7f752d711700 1 -- 172.21.15.79:0/2951422663 >> 172.21.15.79:0/2951422663 conn(0x7f75280cc560 msgr2=0x7f75280cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:27.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.803+0000 7f752d711700 1 -- 172.21.15.79:0/2951422663 shutdown_connections 2023-10-19T08:38:27.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.803+0000 7f752d711700 1 -- 172.21.15.79:0/2951422663 wait complete. 2023-10-19T08:38:27.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.804+0000 7f752d711700 1 Processor -- start 2023-10-19T08:38:27.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.804+0000 7f752d711700 1 -- start start 2023-10-19T08:38:27.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.805+0000 7f752d711700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75280ce270 0x7f7528159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:27.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.805+0000 7f752d711700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f752815d580 0x7f75281f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:27.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.805+0000 7f752d711700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7528160f30 0x7f75280ac420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:27.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.805+0000 7f752d711700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7528159970 con 0x7f75280ce270 2023-10-19T08:38:27.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.805+0000 7f752d711700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75281f3e10 con 0x7f752815d580 2023-10-19T08:38:27.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.805+0000 7f752d711700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75280b02d0 con 0x7f7528160f30 2023-10-19T08:38:27.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.805+0000 7f7526ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75280ce270 0x7f7528159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:27.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.805+0000 7f7526ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75280ce270 0x7f7528159430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46678/0 (socket says 172.21.15.79:46678) 2023-10-19T08:38:27.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.805+0000 7f7526ffd700 1 -- 172.21.15.79:0/1500290766 learned_addr learned my addr 172.21.15.79:0/1500290766 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:27.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.805+0000 7f75277fe700 1 --2- 172.21.15.79:0/1500290766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7528160f30 0x7f75280ac420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:27.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.805+0000 7f75267fc700 1 --2- 172.21.15.79:0/1500290766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f752815d580 0x7f75281f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:27.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.806+0000 7f7526ffd700 1 -- 172.21.15.79:0/1500290766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7528160f30 msgr2=0x7f75280ac420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:27.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.806+0000 7f7526ffd700 1 --2- 172.21.15.79:0/1500290766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7528160f30 0x7f75280ac420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.806+0000 7f7526ffd700 1 -- 172.21.15.79:0/1500290766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f752815d580 msgr2=0x7f75281f38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:27.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.806+0000 7f7526ffd700 1 --2- 172.21.15.79:0/1500290766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f752815d580 0x7f75281f38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:27.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.806+0000 7f7526ffd700 1 -- 172.21.15.79:0/1500290766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7520009a70 con 0x7f75280ce270 2023-10-19T08:38:27.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.806+0000 7f75267fc700 1 --2- 172.21.15.79:0/1500290766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f752815d580 0x7f75281f38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:27.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.806+0000 7f7526ffd700 1 --2- 172.21.15.79:0/1500290766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75280ce270 0x7f7528159430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f751c009c40 tx=0x7f751c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:27.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.806+0000 7f750f7fe700 1 -- 172.21.15.79:0/1500290766 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c0043c0 con 0x7f75280ce270 2023-10-19T08:38:27.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.806+0000 7f750f7fe700 1 -- 172.21.15.79:0/1500290766 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c01f070 con 0x7f75280ce270 2023-10-19T08:38:27.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.806+0000 7f752d711700 1 -- 172.21.15.79:0/1500290766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751c009550 con 0x7f75280ce270 2023-10-19T08:38:27.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.806+0000 7f750f7fe700 1 -- 172.21.15.79:0/1500290766 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c0036a0 con 0x7f75280ce270 2023-10-19T08:38:27.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.806+0000 7f752d711700 1 -- 172.21.15.79:0/1500290766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75280b0890 con 0x7f75280ce270 2023-10-19T08:38:27.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.807+0000 7f752d711700 1 -- 172.21.15.79:0/1500290766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752804ee70 con 0x7f75280ce270 2023-10-19T08:38:27.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.807+0000 7f750f7fe700 1 -- 172.21.15.79:0/1500290766 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f751c021030 con 0x7f75280ce270 2023-10-19T08:38:27.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.808+0000 7f750f7fe700 1 --2- 172.21.15.79:0/1500290766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f751406a0e0 0x7f751406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:27.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.808+0000 7f750f7fe700 1 -- 172.21.15.79:0/1500290766 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f751c089d40 con 0x7f75280ce270 2023-10-19T08:38:27.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.808+0000 7f75267fc700 1 --2- 172.21.15.79:0/1500290766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f751406a0e0 0x7f751406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:27.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.808+0000 7f75267fc700 1 --2- 172.21.15.79:0/1500290766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f751406a0e0 0x7f751406c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f752815d550 tx=0x7f7518009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:27.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:27.812+0000 7f750f7fe700 1 -- 172.21.15.79:0/1500290766 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f751c0551d0 con 0x7f75280ce270 2023-10-19T08:38:28.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.000+0000 7f752d711700 1 -- 172.21.15.79:0/1500290766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f75280aedf0 con 0x7f75280ce270 2023-10-19T08:38:28.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.000+0000 7f750f7fe700 1 -- 172.21.15.79:0/1500290766 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f751c015020 con 0x7f75280ce270 2023-10-19T08:38:28.004 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:38:28.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.002+0000 7f752d711700 1 -- 172.21.15.79:0/1500290766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f751406a0e0 msgr2=0x7f751406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:28.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.002+0000 7f752d711700 1 --2- 172.21.15.79:0/1500290766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f751406a0e0 0x7f751406c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f752815d550 tx=0x7f7518009040 comp rx=0 tx=0).stop 2023-10-19T08:38:28.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.002+0000 7f752d711700 1 -- 172.21.15.79:0/1500290766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75280ce270 msgr2=0x7f7528159430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:28.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.002+0000 7f752d711700 1 --2- 172.21.15.79:0/1500290766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75280ce270 0x7f7528159430 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f751c009c40 tx=0x7f751c004750 comp rx=0 tx=0).stop 2023-10-19T08:38:28.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.002+0000 7f752d711700 1 -- 172.21.15.79:0/1500290766 shutdown_connections 2023-10-19T08:38:28.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.002+0000 7f752d711700 1 --2- 172.21.15.79:0/1500290766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f751406a0e0 0x7f751406c5a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.002+0000 7f752d711700 1 --2- 172.21.15.79:0/1500290766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7528160f30 0x7f75280ac420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.002+0000 7f752d711700 1 --2- 172.21.15.79:0/1500290766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75280ce270 0x7f7528159430 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.002+0000 7f752d711700 1 --2- 172.21.15.79:0/1500290766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f752815d580 0x7f75281f38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.002+0000 7f752d711700 1 -- 172.21.15.79:0/1500290766 >> 172.21.15.79:0/1500290766 conn(0x7f75280cc560 msgr2=0x7f752815a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:28.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.002+0000 7f752d711700 1 -- 172.21.15.79:0/1500290766 shutdown_connections 2023-10-19T08:38:28.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.002+0000 7f752d711700 1 -- 172.21.15.79:0/1500290766 wait complete. 2023-10-19T08:38:28.018 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T08:38:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.139+0000 7fcb0b6e9700 1 Processor -- start 2023-10-19T08:38:28.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.139+0000 7fcb0b6e9700 1 -- start start 2023-10-19T08:38:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.139+0000 7fcb0b6e9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb040cd270 0x7fcb0406a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.140+0000 7fcb0b6e9700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb04161a90 con 0x7fcb040703b0 2023-10-19T08:38:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.140+0000 7fcb0b6e9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb040b1fe0 con 0x7fcb040cc2a0 2023-10-19T08:38:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.140+0000 7fcb0b6e9700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb04160a80 con 0x7fcb040cd270 2023-10-19T08:38:28.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.140+0000 7fcb09485700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb040cd270 0x7fcb0406a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.140+0000 7fcb08c84700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcb040703b0 0x7fcb04160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56758/0 (socket says 172.21.15.79:56758) 2023-10-19T08:38:28.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.140+0000 7fcb09485700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb040cd270 0x7fcb0406a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46686/0 (socket says 172.21.15.79:46686) 2023-10-19T08:38:28.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.140+0000 7fcb08c84700 1 -- 172.21.15.79:0/3199233639 learned_addr learned my addr 172.21.15.79:0/3199233639 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:28.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.140+0000 7fcb09485700 1 -- 172.21.15.79:0/3199233639 >> v1:172.21.15.89:6789/0 conn(0x7fcb040cc2a0 legacy=0x7fcb04161380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:28.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.140+0000 7fcb09485700 1 -- 172.21.15.79:0/3199233639 >> v1:172.21.15.79:6789/0 conn(0x7fcb040703b0 legacy=0x7fcb04160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:28.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.140+0000 7fcafbfff700 1 -- 172.21.15.79:0/3199233639 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247150795 0 0) 0x7fcb04161a90 con 0x7fcb040703b0 2023-10-19T08:38:28.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.140+0000 7fcb09485700 1 -- 172.21.15.79:0/3199233639 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb040ce2b0 con 0x7fcb040cd270 2023-10-19T08:38:28.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.140+0000 7fcb09485700 1 --2- 172.21.15.79:0/3199233639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb040cd270 0x7fcb0406a220 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009840 tx=0x7fcaf4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d57c50305647e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:28.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.140+0000 7fcafbfff700 1 -- 172.21.15.79:0/3199233639 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4011830 con 0x7fcb040cd270 2023-10-19T08:38:28.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.140+0000 7fcafbfff700 1 -- 172.21.15.79:0/3199233639 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf4011990 con 0x7fcb040cd270 2023-10-19T08:38:28.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.140+0000 7fcafbfff700 1 -- 172.21.15.79:0/3199233639 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4011d20 con 0x7fcb040cd270 2023-10-19T08:38:28.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.141+0000 7fcb0b6e9700 1 -- 172.21.15.79:0/3199233639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb040cd270 msgr2=0x7fcb0406a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:28.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.141+0000 7fcb0b6e9700 1 --2- 172.21.15.79:0/3199233639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb040cd270 0x7fcb0406a220 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009840 tx=0x7fcaf4009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:28.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.141+0000 7fcb0b6e9700 1 -- 172.21.15.79:0/3199233639 shutdown_connections 2023-10-19T08:38:28.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.141+0000 7fcb0b6e9700 1 --2- 172.21.15.79:0/3199233639 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb040cd270 0x7fcb0406a220 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.141+0000 7fcb0b6e9700 1 -- 172.21.15.79:0/3199233639 >> 172.21.15.79:0/3199233639 conn(0x7fcb0406dcc0 msgr2=0x7fcb0406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:28.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.141+0000 7fcb0b6e9700 1 -- 172.21.15.79:0/3199233639 shutdown_connections 2023-10-19T08:38:28.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.141+0000 7fcb0b6e9700 1 -- 172.21.15.79:0/3199233639 wait complete. 2023-10-19T08:38:28.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.142+0000 7fcb0b6e9700 1 Processor -- start 2023-10-19T08:38:28.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.142+0000 7fcb0b6e9700 1 -- start start 2023-10-19T08:38:28.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.143+0000 7fcb0b6e9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb040703b0 0x7fcb04155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.143+0000 7fcb0b6e9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb040cc2a0 0x7fcb041560a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.143+0000 7fcb0b6e9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb040cd270 0x7fcb04146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.143+0000 7fcb0b6e9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb04157a70 con 0x7fcb040cc2a0 2023-10-19T08:38:28.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.143+0000 7fcb0b6e9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb041f6ad0 con 0x7fcb040703b0 2023-10-19T08:38:28.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.143+0000 7fcb0b6e9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb04157c80 con 0x7fcb040cd270 2023-10-19T08:38:28.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.143+0000 7fcb08c84700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb040cc2a0 0x7fcb041560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.143+0000 7fcb08c84700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb040cc2a0 0x7fcb041560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46692/0 (socket says 172.21.15.79:46692) 2023-10-19T08:38:28.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.143+0000 7fcb08c84700 1 -- 172.21.15.79:0/1332678118 learned_addr learned my addr 172.21.15.79:0/1332678118 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:28.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.143+0000 7fcb09485700 1 --2- 172.21.15.79:0/1332678118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb040703b0 0x7fcb04155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.143+0000 7fcb09c86700 1 --2- 172.21.15.79:0/1332678118 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb040cd270 0x7fcb04146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.143+0000 7fcb08c84700 1 -- 172.21.15.79:0/1332678118 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb040cd270 msgr2=0x7fcb04146340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:28.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.143+0000 7fcb08c84700 1 --2- 172.21.15.79:0/1332678118 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb040cd270 0x7fcb04146340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.143+0000 7fcb08c84700 1 -- 172.21.15.79:0/1332678118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb040703b0 msgr2=0x7fcb04155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:28.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.143+0000 7fcb08c84700 1 --2- 172.21.15.79:0/1332678118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb040703b0 0x7fcb04155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.143+0000 7fcb08c84700 1 -- 172.21.15.79:0/1332678118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf40094a0 con 0x7fcb040cc2a0 2023-10-19T08:38:28.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.143+0000 7fcb09c86700 1 --2- 172.21.15.79:0/1332678118 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb040cd270 0x7fcb04146340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:28.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.143+0000 7fcb09485700 1 --2- 172.21.15.79:0/1332678118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb040703b0 0x7fcb04155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:28.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.143+0000 7fcb08c84700 1 --2- 172.21.15.79:0/1332678118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb040cc2a0 0x7fcb041560a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000c520 tx=0x7fcb0000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:28.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.144+0000 7fcaf9ffb700 1 -- 172.21.15.79:0/1332678118 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00004c80 con 0x7fcb040cc2a0 2023-10-19T08:38:28.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.144+0000 7fcaf9ffb700 1 -- 172.21.15.79:0/1332678118 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb00004e00 con 0x7fcb040cc2a0 2023-10-19T08:38:28.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.144+0000 7fcb0b6e9700 1 -- 172.21.15.79:0/1332678118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb04157f60 con 0x7fcb040cc2a0 2023-10-19T08:38:28.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.144+0000 7fcaf9ffb700 1 -- 172.21.15.79:0/1332678118 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb00007310 con 0x7fcb040cc2a0 2023-10-19T08:38:28.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.144+0000 7fcb0b6e9700 1 -- 172.21.15.79:0/1332678118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb04158520 con 0x7fcb040cc2a0 2023-10-19T08:38:28.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.145+0000 7fcb0b6e9700 1 -- 172.21.15.79:0/1332678118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb04158740 con 0x7fcb040cc2a0 2023-10-19T08:38:28.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.145+0000 7fcaf9ffb700 1 -- 172.21.15.79:0/1332678118 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcb00007470 con 0x7fcb040cc2a0 2023-10-19T08:38:28.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.145+0000 7fcaf9ffb700 1 --2- 172.21.15.79:0/1332678118 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fcae806a0e0 0x7fcae806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.146+0000 7fcaf9ffb700 1 -- 172.21.15.79:0/1332678118 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcb000885a0 con 0x7fcb040cc2a0 2023-10-19T08:38:28.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.146+0000 7fcb09485700 1 --2- 172.21.15.79:0/1332678118 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fcae806a0e0 0x7fcae806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.146+0000 7fcb09485700 1 --2- 172.21.15.79:0/1332678118 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fcae806a0e0 0x7fcae806c5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcb040b5710 tx=0x7fcaf401c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:28.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.150+0000 7fcaf9ffb700 1 -- 172.21.15.79:0/1332678118 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fcb00053990 con 0x7fcb040cc2a0 2023-10-19T08:38:28.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.340+0000 7fcb0b6e9700 1 -- 172.21.15.79:0/1332678118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb0404ee70 con 0x7fcb040cc2a0 2023-10-19T08:38:28.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.340+0000 7fcaf9ffb700 1 -- 172.21.15.79:0/1332678118 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb00056fb0 con 0x7fcb040cc2a0 2023-10-19T08:38:28.344 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:28.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.342+0000 7fcb0b6e9700 1 -- 172.21.15.79:0/1332678118 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fcae806a0e0 msgr2=0x7fcae806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:28.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.342+0000 7fcb0b6e9700 1 --2- 172.21.15.79:0/1332678118 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fcae806a0e0 0x7fcae806c5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcb040b5710 tx=0x7fcaf401c040 comp rx=0 tx=0).stop 2023-10-19T08:38:28.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.342+0000 7fcb0b6e9700 1 -- 172.21.15.79:0/1332678118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb040cc2a0 msgr2=0x7fcb041560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:28.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.342+0000 7fcb0b6e9700 1 --2- 172.21.15.79:0/1332678118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb040cc2a0 0x7fcb041560a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcb0000c520 tx=0x7fcb0000c8e0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.342+0000 7fcb0b6e9700 1 -- 172.21.15.79:0/1332678118 shutdown_connections 2023-10-19T08:38:28.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.342+0000 7fcb0b6e9700 1 --2- 172.21.15.79:0/1332678118 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fcae806a0e0 0x7fcae806c5a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.342+0000 7fcb0b6e9700 1 --2- 172.21.15.79:0/1332678118 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb040cd270 0x7fcb04146340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.342+0000 7fcb0b6e9700 1 --2- 172.21.15.79:0/1332678118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb040703b0 0x7fcb04155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.342+0000 7fcb0b6e9700 1 --2- 172.21.15.79:0/1332678118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb040cc2a0 0x7fcb041560a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.342+0000 7fcb0b6e9700 1 -- 172.21.15.79:0/1332678118 >> 172.21.15.79:0/1332678118 conn(0x7fcb0406dcc0 msgr2=0x7fcb040cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:28.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.342+0000 7fcb0b6e9700 1 -- 172.21.15.79:0/1332678118 shutdown_connections 2023-10-19T08:38:28.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.342+0000 7fcb0b6e9700 1 -- 172.21.15.79:0/1332678118 wait complete. 2023-10-19T08:38:28.357 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T08:38:28.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.478+0000 7fe33a025700 1 Processor -- start 2023-10-19T08:38:28.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.478+0000 7fe33a025700 1 -- start start 2023-10-19T08:38:28.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.478+0000 7fe33a025700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe33415e570 0x7fe3340d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.478+0000 7fe33a025700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3340b25f0 con 0x7fe3340b0c00 2023-10-19T08:38:28.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.478+0000 7fe33a025700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3340afd60 con 0x7fe3340cb6f0 2023-10-19T08:38:28.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.478+0000 7fe33a025700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3340af810 con 0x7fe33415e570 2023-10-19T08:38:28.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe333fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe3340b0c00 0x7fe3340ad9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56774/0 (socket says 172.21.15.79:56774) 2023-10-19T08:38:28.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe333fff700 1 -- 172.21.15.79:0/3188793354 learned_addr learned my addr 172.21.15.79:0/3188793354 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:28.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe3327fc700 1 -- 172.21.15.79:0/3188793354 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465069148 0 0) 0x7fe3340b25f0 con 0x7fe3340b0c00 2023-10-19T08:38:28.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe3337fe700 1 --2- 172.21.15.79:0/3188793354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe33415e570 0x7fe3340d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe3327fc700 1 -- 172.21.15.79:0/3188793354 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3200035b0 con 0x7fe3340b0c00 2023-10-19T08:38:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe3327fc700 1 -- 172.21.15.79:0/3188793354 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1396532240 0 0) 0x7fe3200035b0 con 0x7fe3340b0c00 2023-10-19T08:38:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe3327fc700 1 -- 172.21.15.79:0/3188793354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe33415e570 msgr2=0x7fe3340d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe3327fc700 1 --2- 172.21.15.79:0/3188793354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe33415e570 0x7fe3340d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe3327fc700 1 -- 172.21.15.79:0/3188793354 >> v1:172.21.15.89:6789/0 conn(0x7fe3340cb6f0 legacy=0x7fe3340b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:28.487 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe3327fc700 1 -- 172.21.15.79:0/3188793354 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3340aef70 con 0x7fe3340b0c00 2023-10-19T08:38:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe3327fc700 1 -- 172.21.15.79:0/3188793354 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7fe32c0019f0 con 0x7fe3340b0c00 2023-10-19T08:38:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe3327fc700 1 -- 172.21.15.79:0/3188793354 >> v1:172.21.15.79:6789/0 conn(0x7fe3340b0c00 legacy=0x7fe3340ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe3327fc700 1 --2- 172.21.15.79:0/3188793354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe33415e570 0x7fe320003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe3327fc700 1 --2- 172.21.15.79:0/3188793354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe320004020 0x7fe320004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe3327fc700 1 --2- 172.21.15.79:0/3188793354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe320004d90 0x7fe320005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe3327fc700 1 -- 172.21.15.79:0/3188793354 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3340af810 con 0x7fe320004d90 2023-10-19T08:38:28.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe3327fc700 1 -- 172.21.15.79:0/3188793354 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32000bb70 con 0x7fe320004020 2023-10-19T08:38:28.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe3327fc700 1 -- 172.21.15.79:0/3188793354 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32000bd30 con 0x7fe33415e570 2023-10-19T08:38:28.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe333fff700 1 --2- 172.21.15.79:0/3188793354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe320004d90 0x7fe320005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe332ffd700 1 --2- 172.21.15.79:0/3188793354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe320004020 0x7fe320004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe3337fe700 1 --2- 172.21.15.79:0/3188793354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe33415e570 0x7fe320003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe333fff700 1 -- 172.21.15.79:0/3188793354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe33415e570 msgr2=0x7fe320003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:28.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.479+0000 7fe333fff700 1 --2- 172.21.15.79:0/3188793354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe33415e570 0x7fe320003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.480+0000 7fe333fff700 1 -- 172.21.15.79:0/3188793354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe320004020 msgr2=0x7fe320004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:28.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.480+0000 7fe333fff700 1 --2- 172.21.15.79:0/3188793354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe320004020 0x7fe320004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.480+0000 7fe333fff700 1 -- 172.21.15.79:0/3188793354 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3200035b0 con 0x7fe320004d90 2023-10-19T08:38:28.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.480+0000 7fe333fff700 1 --2- 172.21.15.79:0/3188793354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe320004d90 0x7fe320005210 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe32c00a800 tx=0x7fe320005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73313abc7d4b2e64 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:28.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.480+0000 7fe3327fc700 1 -- 172.21.15.79:0/3188793354 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c00a2f0 con 0x7fe320004d90 2023-10-19T08:38:28.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.480+0000 7fe3327fc700 1 -- 172.21.15.79:0/3188793354 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32c012600 con 0x7fe320004d90 2023-10-19T08:38:28.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.480+0000 7fe3327fc700 1 -- 172.21.15.79:0/3188793354 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c0129b0 con 0x7fe320004d90 2023-10-19T08:38:28.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.480+0000 7fe33a025700 1 -- 172.21.15.79:0/3188793354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe320004d90 msgr2=0x7fe320005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:28.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.480+0000 7fe33a025700 1 --2- 172.21.15.79:0/3188793354 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe320004d90 0x7fe320005210 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe32c00a800 tx=0x7fe320005880 comp rx=0 tx=0).stop 2023-10-19T08:38:28.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.480+0000 7fe333fff700 1 -- 172.21.15.79:0/3188793354 reap_dead start 2023-10-19T08:38:28.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.480+0000 7fe33a025700 1 -- 172.21.15.79:0/3188793354 shutdown_connections 2023-10-19T08:38:28.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.480+0000 7fe33a025700 1 -- 172.21.15.79:0/3188793354 >> 172.21.15.79:0/3188793354 conn(0x7fe33409a0b0 msgr2=0x7fe3340d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:28.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.480+0000 7fe33a025700 1 -- 172.21.15.79:0/3188793354 shutdown_connections 2023-10-19T08:38:28.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.480+0000 7fe33a025700 1 -- 172.21.15.79:0/3188793354 wait complete. 2023-10-19T08:38:28.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.481+0000 7fe33a025700 1 Processor -- start 2023-10-19T08:38:28.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.482+0000 7fe33a025700 1 -- start start 2023-10-19T08:38:28.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.482+0000 7fe33a025700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe334155230 0x7fe3340c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.482+0000 7fe33a025700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe334155610 0x7fe3341e72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.482+0000 7fe33a025700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3341e5e00 0x7fe3341e62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.482+0000 7fe33a025700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3341e77e0 con 0x7fe334155230 2023-10-19T08:38:28.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.482+0000 7fe33a025700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3341e4df0 con 0x7fe334155610 2023-10-19T08:38:28.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.482+0000 7fe33a025700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3341e5040 con 0x7fe3341e5e00 2023-10-19T08:38:28.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.483+0000 7fe3337fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe334155230 0x7fe3340c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.483+0000 7fe3337fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe334155230 0x7fe3340c7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46710/0 (socket says 172.21.15.79:46710) 2023-10-19T08:38:28.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.483+0000 7fe3337fe700 1 -- 172.21.15.79:0/2771464356 learned_addr learned my addr 172.21.15.79:0/2771464356 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:28.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.483+0000 7fe332ffd700 1 --2- 172.21.15.79:0/2771464356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe334155610 0x7fe3341e72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.483+0000 7fe333fff700 1 --2- 172.21.15.79:0/2771464356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3341e5e00 0x7fe3341e62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.483+0000 7fe3337fe700 1 -- 172.21.15.79:0/2771464356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3341e5e00 msgr2=0x7fe3341e62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:28.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.483+0000 7fe3337fe700 1 --2- 172.21.15.79:0/2771464356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3341e5e00 0x7fe3341e62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.483+0000 7fe3337fe700 1 -- 172.21.15.79:0/2771464356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe334155610 msgr2=0x7fe3341e72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:28.498 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.483+0000 7fe3337fe700 1 --2- 172.21.15.79:0/2771464356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe334155610 0x7fe3341e72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.483+0000 7fe3337fe700 1 -- 172.21.15.79:0/2771464356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3341e5320 con 0x7fe334155230 2023-10-19T08:38:28.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.483+0000 7fe3337fe700 1 --2- 172.21.15.79:0/2771464356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe334155230 0x7fe3340c7830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe324011aa0 tx=0x7fe324011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:28.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.483+0000 7fe32bfff700 1 -- 172.21.15.79:0/2771464356 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe324011ee0 con 0x7fe334155230 2023-10-19T08:38:28.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.483+0000 7fe32bfff700 1 -- 172.21.15.79:0/2771464356 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32400f940 con 0x7fe334155230 2023-10-19T08:38:28.499 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.483+0000 7fe33a025700 1 -- 172.21.15.79:0/2771464356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3341e5600 con 0x7fe334155230 2023-10-19T08:38:28.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.483+0000 7fe32bfff700 1 -- 172.21.15.79:0/2771464356 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32400fcf0 con 0x7fe334155230 2023-10-19T08:38:28.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.483+0000 7fe33a025700 1 -- 172.21.15.79:0/2771464356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33406ee80 con 0x7fe334155230 2023-10-19T08:38:28.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.484+0000 7fe33a025700 1 -- 172.21.15.79:0/2771464356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe33404ee70 con 0x7fe334155230 2023-10-19T08:38:28.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.484+0000 7fe32bfff700 1 -- 172.21.15.79:0/2771464356 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe324014440 con 0x7fe334155230 2023-10-19T08:38:28.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.485+0000 7fe32bfff700 1 --2- 172.21.15.79:0/2771464356 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe31406a0e0 0x7fe31406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.485+0000 7fe32bfff700 1 -- 172.21.15.79:0/2771464356 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe324088ee0 con 0x7fe334155230 2023-10-19T08:38:28.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.485+0000 7fe332ffd700 1 --2- 172.21.15.79:0/2771464356 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe31406a0e0 0x7fe31406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.485+0000 7fe332ffd700 1 --2- 172.21.15.79:0/2771464356 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe31406a0e0 0x7fe31406c5a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe3341f6160 tx=0x7fe31c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:28.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.489+0000 7fe32bfff700 1 -- 172.21.15.79:0/2771464356 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fe324057e30 con 0x7fe334155230 2023-10-19T08:38:28.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.680+0000 7fe33a025700 1 -- 172.21.15.79:0/2771464356 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe3340adb30 con 0x7fe334155230 2023-10-19T08:38:28.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.680+0000 7fe32bfff700 1 -- 172.21.15.79:0/2771464356 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe3240579c0 con 0x7fe334155230 2023-10-19T08:38:28.684 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-19T08:38:28.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.682+0000 7fe33a025700 1 -- 172.21.15.79:0/2771464356 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe31406a0e0 msgr2=0x7fe31406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:28.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.682+0000 7fe33a025700 1 --2- 172.21.15.79:0/2771464356 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe31406a0e0 0x7fe31406c5a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe3341f6160 tx=0x7fe31c009040 comp rx=0 tx=0).stop 2023-10-19T08:38:28.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.682+0000 7fe33a025700 1 -- 172.21.15.79:0/2771464356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe334155230 msgr2=0x7fe3340c7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:28.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.682+0000 7fe33a025700 1 --2- 172.21.15.79:0/2771464356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe334155230 0x7fe3340c7830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe324011aa0 tx=0x7fe324011db0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.682+0000 7fe33a025700 1 -- 172.21.15.79:0/2771464356 shutdown_connections 2023-10-19T08:38:28.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.682+0000 7fe33a025700 1 --2- 172.21.15.79:0/2771464356 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe31406a0e0 0x7fe31406c5a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.682+0000 7fe33a025700 1 --2- 172.21.15.79:0/2771464356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3341e5e00 0x7fe3341e62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.682+0000 7fe33a025700 1 --2- 172.21.15.79:0/2771464356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe334155230 0x7fe3340c7830 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.682+0000 7fe33a025700 1 --2- 172.21.15.79:0/2771464356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe334155610 0x7fe3341e72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.682+0000 7fe33a025700 1 -- 172.21.15.79:0/2771464356 >> 172.21.15.79:0/2771464356 conn(0x7fe33409a0b0 msgr2=0x7fe3340cdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:28.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.682+0000 7fe33a025700 1 -- 172.21.15.79:0/2771464356 shutdown_connections 2023-10-19T08:38:28.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.682+0000 7fe33a025700 1 -- 172.21.15.79:0/2771464356 wait complete. 2023-10-19T08:38:28.698 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T08:38:28.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.817+0000 7f27ffc18700 1 Processor -- start 2023-10-19T08:38:28.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.817+0000 7f27ffc18700 1 -- start start 2023-10-19T08:38:28.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.818+0000 7f27ffc18700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f27f80cd270 0x7f27f806a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.818+0000 7f27ffc18700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f80703b0 0x7f27f806a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.818+0000 7f27ffc18700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27f806f910 0x7f27f8160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.818+0000 7f27ffc18700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f8160a80 con 0x7f27f806f910 2023-10-19T08:38:28.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.818+0000 7f27ffc18700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f80b1fe0 con 0x7f27f80cd270 2023-10-19T08:38:28.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.818+0000 7f27ffc18700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80ce2b0 con 0x7f27f80703b0 2023-10-19T08:38:28.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.818+0000 7f27fe1b5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27f806f910 0x7f27f8160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.818+0000 7f27fe1b5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f27f806f910 0x7f27f8160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46722/0 (socket says 172.21.15.79:46722) 2023-10-19T08:38:28.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.818+0000 7f27fe1b5700 1 -- 172.21.15.79:0/2448333585 learned_addr learned my addr 172.21.15.79:0/2448333585 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:28.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.819+0000 7f27fd1b3700 1 --2- 172.21.15.79:0/2448333585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f80703b0 0x7f27f806a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.819+0000 7f27fd9b4700 1 --2- 172.21.15.79:0/2448333585 >> v2:172.21.15.89:3300/0 conn(0x7f27f80cd270 0x7f27f806a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.819+0000 7f27fe1b5700 1 -- 172.21.15.79:0/2448333585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f80703b0 msgr2=0x7f27f806a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:28.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.819+0000 7f27fe1b5700 1 --2- 172.21.15.79:0/2448333585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f80703b0 0x7f27f806a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.819+0000 7f27fe1b5700 1 -- 172.21.15.79:0/2448333585 >> v2:172.21.15.89:3300/0 conn(0x7f27f80cd270 msgr2=0x7f27f806a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:28.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.819+0000 7f27fe1b5700 1 --2- 172.21.15.79:0/2448333585 >> v2:172.21.15.89:3300/0 conn(0x7f27f80cd270 0x7f27f806a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.819+0000 7f27fe1b5700 1 -- 172.21.15.79:0/2448333585 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f80ce550 con 0x7f27f806f910 2023-10-19T08:38:28.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.819+0000 7f27fe1b5700 1 --2- 172.21.15.79:0/2448333585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f806f910 0x7f27f8160c70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f27f80717c0 tx=0x7f27f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a390bde0591cdc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:28.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.819+0000 7f27fc9b2700 1 -- 172.21.15.79:0/2448333585 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f000e070 con 0x7f27f806f910 2023-10-19T08:38:28.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.819+0000 7f27fc9b2700 1 -- 172.21.15.79:0/2448333585 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f000b9c0 con 0x7f27f806f910 2023-10-19T08:38:28.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.819+0000 7f27fc9b2700 1 -- 172.21.15.79:0/2448333585 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f000bd70 con 0x7f27f806f910 2023-10-19T08:38:28.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.819+0000 7f27ffc18700 1 -- 172.21.15.79:0/2448333585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f806f910 msgr2=0x7f27f8160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:28.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.819+0000 7f27ffc18700 1 --2- 172.21.15.79:0/2448333585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f806f910 0x7f27f8160c70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f27f80717c0 tx=0x7f27f000b330 comp rx=0 tx=0).stop 2023-10-19T08:38:28.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.820+0000 7f27ffc18700 1 -- 172.21.15.79:0/2448333585 shutdown_connections 2023-10-19T08:38:28.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.820+0000 7f27ffc18700 1 --2- 172.21.15.79:0/2448333585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f806f910 0x7f27f8160c70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.820+0000 7f27ffc18700 1 --2- 172.21.15.79:0/2448333585 >> v2:172.21.15.89:3300/0 conn(0x7f27f80cd270 0x7f27f806a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.820+0000 7f27ffc18700 1 --2- 172.21.15.79:0/2448333585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f80703b0 0x7f27f806a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.820+0000 7f27ffc18700 1 -- 172.21.15.79:0/2448333585 >> 172.21.15.79:0/2448333585 conn(0x7f27f806dcc0 msgr2=0x7f27f806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:28.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.820+0000 7f27ffc18700 1 -- 172.21.15.79:0/2448333585 shutdown_connections 2023-10-19T08:38:28.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.820+0000 7f27ffc18700 1 -- 172.21.15.79:0/2448333585 wait complete. 2023-10-19T08:38:28.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.821+0000 7f27ffc18700 1 Processor -- start 2023-10-19T08:38:28.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.821+0000 7f27ffc18700 1 -- start start 2023-10-19T08:38:28.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.821+0000 7f27ffc18700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f806f910 0x7f27f815b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.821+0000 7f27ffc18700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f80703b0 0x7f27f80ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.821+0000 7f27ffc18700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27f80cd270 0x7f27f80c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.821+0000 7f27ffc18700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80c6250 con 0x7f27f806f910 2023-10-19T08:38:28.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.821+0000 7f27ffc18700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80c6e10 con 0x7f27f80cd270 2023-10-19T08:38:28.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.821+0000 7f27ffc18700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80c70f0 con 0x7f27f80703b0 2023-10-19T08:38:28.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.822+0000 7f27fd9b4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f806f910 0x7f27f815b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.822+0000 7f27fd9b4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f806f910 0x7f27f815b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46724/0 (socket says 172.21.15.79:46724) 2023-10-19T08:38:28.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.822+0000 7f27fd9b4700 1 -- 172.21.15.79:0/1644844 learned_addr learned my addr 172.21.15.79:0/1644844 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:28.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.822+0000 7f27fd1b3700 1 --2- 172.21.15.79:0/1644844 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f80703b0 0x7f27f80ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.822+0000 7f27fe1b5700 1 --2- 172.21.15.79:0/1644844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27f80cd270 0x7f27f80c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.834 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.822+0000 7f27fd9b4700 1 -- 172.21.15.79:0/1644844 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f80703b0 msgr2=0x7f27f80ace50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:28.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.822+0000 7f27fd9b4700 1 --2- 172.21.15.79:0/1644844 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f80703b0 0x7f27f80ace50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.822+0000 7f27fd9b4700 1 -- 172.21.15.79:0/1644844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27f80cd270 msgr2=0x7f27f80c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:28.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.822+0000 7f27fd9b4700 1 --2- 172.21.15.79:0/1644844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27f80cd270 0x7f27f80c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:28.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.822+0000 7f27fd9b4700 1 -- 172.21.15.79:0/1644844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f0009b30 con 0x7f27f806f910 2023-10-19T08:38:28.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.822+0000 7f27fe1b5700 1 --2- 172.21.15.79:0/1644844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27f80cd270 0x7f27f80c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:28.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.822+0000 7f27fd9b4700 1 --2- 172.21.15.79:0/1644844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f806f910 0x7f27f815b110 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f27f400d800 tx=0x7f27f400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:28.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.822+0000 7f27ee7fc700 1 -- 172.21.15.79:0/1644844 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f40125f0 con 0x7f27f806f910 2023-10-19T08:38:28.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.822+0000 7f27ee7fc700 1 -- 172.21.15.79:0/1644844 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f4012750 con 0x7f27f806f910 2023-10-19T08:38:28.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.822+0000 7f27ee7fc700 1 -- 172.21.15.79:0/1644844 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f4012b00 con 0x7f27f806f910 2023-10-19T08:38:28.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.822+0000 7f27ffc18700 1 -- 172.21.15.79:0/1644844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f80c73d0 con 0x7f27f806f910 2023-10-19T08:38:28.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.822+0000 7f27ffc18700 1 -- 172.21.15.79:0/1644844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f80c4aa0 con 0x7f27f806f910 2023-10-19T08:38:28.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.823+0000 7f27ffc18700 1 -- 172.21.15.79:0/1644844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f80c4c30 con 0x7f27f806f910 2023-10-19T08:38:28.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.823+0000 7f27ee7fc700 1 -- 172.21.15.79:0/1644844 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f27f4012c60 con 0x7f27f806f910 2023-10-19T08:38:28.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.824+0000 7f27ee7fc700 1 --2- 172.21.15.79:0/1644844 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f27dc06a0e0 0x7f27dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:28.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.824+0000 7f27ee7fc700 1 -- 172.21.15.79:0/1644844 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f27f4088be0 con 0x7f27f806f910 2023-10-19T08:38:28.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.824+0000 7f27fd1b3700 1 --2- 172.21.15.79:0/1644844 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f27dc06a0e0 0x7f27dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:28.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.824+0000 7f27fd1b3700 1 --2- 172.21.15.79:0/1644844 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f27dc06a0e0 0x7f27dc06c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f27f81f5fb0 tx=0x7f27e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:28.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:28.828+0000 7f27ee7fc700 1 -- 172.21.15.79:0/1644844 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f27f4053fe0 con 0x7f27f806f910 2023-10-19T08:38:29.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.018+0000 7f27ffc18700 1 -- 172.21.15.79:0/1644844 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f27f80c7a20 con 0x7f27f806f910 2023-10-19T08:38:29.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.018+0000 7f27ee7fc700 1 -- 172.21.15.79:0/1644844 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f27f4057600 con 0x7f27f806f910 2023-10-19T08:38:29.022 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:29.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.020+0000 7f27ffc18700 1 -- 172.21.15.79:0/1644844 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f27dc06a0e0 msgr2=0x7f27dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:29.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.020+0000 7f27ffc18700 1 --2- 172.21.15.79:0/1644844 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f27dc06a0e0 0x7f27dc06c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f27f81f5fb0 tx=0x7f27e8008040 comp rx=0 tx=0).stop 2023-10-19T08:38:29.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.020+0000 7f27ffc18700 1 -- 172.21.15.79:0/1644844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f806f910 msgr2=0x7f27f815b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:29.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.020+0000 7f27ffc18700 1 --2- 172.21.15.79:0/1644844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f806f910 0x7f27f815b110 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f27f400d800 tx=0x7f27f400dbc0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.020+0000 7f27ffc18700 1 -- 172.21.15.79:0/1644844 shutdown_connections 2023-10-19T08:38:29.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.020+0000 7f27ffc18700 1 --2- 172.21.15.79:0/1644844 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27f80cd270 0x7f27f80c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.020+0000 7f27ffc18700 1 --2- 172.21.15.79:0/1644844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f806f910 0x7f27f815b110 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.020+0000 7f27ffc18700 1 --2- 172.21.15.79:0/1644844 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f27dc06a0e0 0x7f27dc06c5a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.020+0000 7f27ffc18700 1 --2- 172.21.15.79:0/1644844 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27f80703b0 0x7f27f80ace50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.020+0000 7f27ffc18700 1 -- 172.21.15.79:0/1644844 >> 172.21.15.79:0/1644844 conn(0x7f27f806dcc0 msgr2=0x7f27f80cbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:29.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.020+0000 7f27ffc18700 1 -- 172.21.15.79:0/1644844 shutdown_connections 2023-10-19T08:38:29.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.020+0000 7f27ffc18700 1 -- 172.21.15.79:0/1644844 wait complete. 2023-10-19T08:38:29.035 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T08:38:29.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.153+0000 7f25f9177700 1 Processor -- start 2023-10-19T08:38:29.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.153+0000 7f25f9177700 1 -- start start 2023-10-19T08:38:29.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.154+0000 7f25f9177700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25f415af30 0x7f25f406a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.154+0000 7f25f9177700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f25f406e7e0 0x7f25f406a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.154+0000 7f25f9177700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25f40b2d90 con 0x7f25f415b310 2023-10-19T08:38:29.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.154+0000 7f25f9177700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f40ca630 con 0x7f25f406e7e0 2023-10-19T08:38:29.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.154+0000 7f25f9177700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f40ca910 con 0x7f25f415af30 2023-10-19T08:38:29.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.154+0000 7f25f359e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f25f406e7e0 0x7f25f406a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.154+0000 7f25f259c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f25f415b310 0x7f25f40cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56804/0 (socket says 172.21.15.79:56804) 2023-10-19T08:38:29.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.154+0000 7f25f259c700 1 -- 172.21.15.79:0/3222038458 learned_addr learned my addr 172.21.15.79:0/3222038458 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:29.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.155+0000 7f25f2d9d700 1 --2- 172.21.15.79:0/3222038458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25f415af30 0x7f25f406a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.155+0000 7f25f359e700 1 -- 172.21.15.79:0/3222038458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25f415af30 msgr2=0x7f25f406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:29.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.155+0000 7f25f359e700 1 --2- 172.21.15.79:0/3222038458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25f415af30 0x7f25f406a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.155+0000 7f25f359e700 1 -- 172.21.15.79:0/3222038458 >> v1:172.21.15.79:6789/0 conn(0x7f25f415b310 legacy=0x7f25f40cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:29.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.155+0000 7f25f359e700 1 -- 172.21.15.79:0/3222038458 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f40b20d0 con 0x7f25f406e7e0 2023-10-19T08:38:29.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.155+0000 7f25f1d9b700 1 -- 172.21.15.79:0/3222038458 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2858706180 0 0) 0x7f25f40b2d90 con 0x7f25f415b310 2023-10-19T08:38:29.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.155+0000 7f25f359e700 1 --2- 172.21.15.79:0/3222038458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25f406e7e0 0x7f25f406a760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009d90 tx=0x7f25ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8ec5cfce815f65 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:29.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.155+0000 7f25f1d9b700 1 -- 172.21.15.79:0/3222038458 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec00e070 con 0x7f25f406e7e0 2023-10-19T08:38:29.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.155+0000 7f25f1d9b700 1 -- 172.21.15.79:0/3222038458 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ec00bbd0 con 0x7f25f406e7e0 2023-10-19T08:38:29.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.155+0000 7f25f1d9b700 1 -- 172.21.15.79:0/3222038458 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ec012430 con 0x7f25f406e7e0 2023-10-19T08:38:29.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.155+0000 7f25f9177700 1 -- 172.21.15.79:0/3222038458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25f406e7e0 msgr2=0x7f25f406a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:29.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.155+0000 7f25f9177700 1 --2- 172.21.15.79:0/3222038458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25f406e7e0 0x7f25f406a760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f25ec009d90 tx=0x7f25ec00b330 comp rx=0 tx=0).stop 2023-10-19T08:38:29.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.155+0000 7f25f9177700 1 -- 172.21.15.79:0/3222038458 shutdown_connections 2023-10-19T08:38:29.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.155+0000 7f25f9177700 1 --2- 172.21.15.79:0/3222038458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25f406e7e0 0x7f25f406a760 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.155+0000 7f25f9177700 1 --2- 172.21.15.79:0/3222038458 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25f415af30 0x7f25f406a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.156+0000 7f25f9177700 1 -- 172.21.15.79:0/3222038458 >> 172.21.15.79:0/3222038458 conn(0x7f25f406dcc0 msgr2=0x7f25f406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:29.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.156+0000 7f25f9177700 1 -- 172.21.15.79:0/3222038458 shutdown_connections 2023-10-19T08:38:29.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.156+0000 7f25f9177700 1 -- 172.21.15.79:0/3222038458 wait complete. 2023-10-19T08:38:29.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.157+0000 7f25f9177700 1 Processor -- start 2023-10-19T08:38:29.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.157+0000 7f25f9177700 1 -- start start 2023-10-19T08:38:29.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.158+0000 7f25f9177700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25f406e7e0 0x7f25f40cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.158+0000 7f25f9177700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25f415af30 0x7f25f40c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.158+0000 7f25f9177700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25f4154180 0x7f25f4157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.158+0000 7f25f9177700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f40c9380 con 0x7f25f415af30 2023-10-19T08:38:29.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.158+0000 7f25f9177700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f40c9660 con 0x7f25f406e7e0 2023-10-19T08:38:29.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.158+0000 7f25f9177700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f40c9940 con 0x7f25f4154180 2023-10-19T08:38:29.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.158+0000 7f25f259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25f415af30 0x7f25f40c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.158+0000 7f25f259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25f415af30 0x7f25f40c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46740/0 (socket says 172.21.15.79:46740) 2023-10-19T08:38:29.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.158+0000 7f25f259c700 1 -- 172.21.15.79:0/1868782128 learned_addr learned my addr 172.21.15.79:0/1868782128 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:29.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.158+0000 7f25f2d9d700 1 --2- 172.21.15.79:0/1868782128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25f406e7e0 0x7f25f40cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.158+0000 7f25f359e700 1 --2- 172.21.15.79:0/1868782128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25f4154180 0x7f25f4157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.158+0000 7f25f259c700 1 -- 172.21.15.79:0/1868782128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25f4154180 msgr2=0x7f25f4157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:29.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.158+0000 7f25f259c700 1 --2- 172.21.15.79:0/1868782128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25f4154180 0x7f25f4157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.158+0000 7f25f259c700 1 -- 172.21.15.79:0/1868782128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25f406e7e0 msgr2=0x7f25f40cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:29.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.158+0000 7f25f259c700 1 --2- 172.21.15.79:0/1868782128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25f406e7e0 0x7f25f40cf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.158+0000 7f25f259c700 1 -- 172.21.15.79:0/1868782128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ec009a70 con 0x7f25f415af30 2023-10-19T08:38:29.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.158+0000 7f25f359e700 1 --2- 172.21.15.79:0/1868782128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25f4154180 0x7f25f4157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:29.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.158+0000 7f25f259c700 1 --2- 172.21.15.79:0/1868782128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25f415af30 0x7f25f40c8b50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f25e400c550 tx=0x7f25e400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:29.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.158+0000 7f25db7fe700 1 -- 172.21.15.79:0/1868782128 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e4004c80 con 0x7f25f415af30 2023-10-19T08:38:29.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.159+0000 7f25db7fe700 1 -- 172.21.15.79:0/1868782128 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e4004e00 con 0x7f25f415af30 2023-10-19T08:38:29.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.159+0000 7f25f9177700 1 -- 172.21.15.79:0/1868782128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f415bd30 con 0x7f25f415af30 2023-10-19T08:38:29.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.159+0000 7f25db7fe700 1 -- 172.21.15.79:0/1868782128 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e4007310 con 0x7f25f415af30 2023-10-19T08:38:29.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.159+0000 7f25f9177700 1 -- 172.21.15.79:0/1868782128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f4154610 con 0x7f25f415af30 2023-10-19T08:38:29.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.159+0000 7f25f9177700 1 -- 172.21.15.79:0/1868782128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f415bb90 con 0x7f25f415af30 2023-10-19T08:38:29.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.160+0000 7f25db7fe700 1 -- 172.21.15.79:0/1868782128 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f25e4007470 con 0x7f25f415af30 2023-10-19T08:38:29.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.160+0000 7f25db7fe700 1 --2- 172.21.15.79:0/1868782128 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f25e006a0e0 0x7f25e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.160+0000 7f25db7fe700 1 -- 172.21.15.79:0/1868782128 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f25e4088480 con 0x7f25f415af30 2023-10-19T08:38:29.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.160+0000 7f25f2d9d700 1 --2- 172.21.15.79:0/1868782128 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f25e006a0e0 0x7f25e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.161+0000 7f25f2d9d700 1 --2- 172.21.15.79:0/1868782128 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f25e006a0e0 0x7f25e006c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f25e8006b20 tx=0x7f25e8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:29.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.165+0000 7f25db7fe700 1 -- 172.21.15.79:0/1868782128 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f25f415bb90 con 0x7f25f415af30 2023-10-19T08:38:29.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.401+0000 7f25f9177700 1 -- 172.21.15.79:0/1868782128 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25f415bb90 con 0x7f25f415af30 2023-10-19T08:38:29.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.401+0000 7f25db7fe700 1 -- 172.21.15.79:0/1868782128 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4865 (secure 0 0 0) 0x7f25f415bb90 con 0x7f25f415af30 2023-10-19T08:38:29.405 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:29.405 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3710906518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3710906518},{"type":"v1","addr":"172.21.15.89:6835","nonce":3710906518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3037310614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3037310614},{"type":"v1","addr":"172.21.15.79:6835","nonce":3037310614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/79656061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":79656061},{"type":"v1","addr":"172.21.15.79:6837","nonce":79656061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-19T08:37:56.667105+0000","modified":"2023-10-19T08:38:20.379674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6833/3076620199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3076620199},{"type":"v1","addr":"172.21.15.89:6833","nonce":3076620199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-19T08:38:29.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.403+0000 7f25f9177700 1 -- 172.21.15.79:0/1868782128 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f25e006a0e0 msgr2=0x7f25e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:29.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.403+0000 7f25f9177700 1 --2- 172.21.15.79:0/1868782128 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f25e006a0e0 0x7f25e006c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f25e8006b20 tx=0x7f25e8008040 comp rx=0 tx=0).stop 2023-10-19T08:38:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.403+0000 7f25f9177700 1 -- 172.21.15.79:0/1868782128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25f415af30 msgr2=0x7f25f40c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.403+0000 7f25f9177700 1 --2- 172.21.15.79:0/1868782128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25f415af30 0x7f25f40c8b50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f25e400c550 tx=0x7f25e400c860 comp rx=0 tx=0).stop 2023-10-19T08:38:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.403+0000 7f25f9177700 1 -- 172.21.15.79:0/1868782128 shutdown_connections 2023-10-19T08:38:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.403+0000 7f25f9177700 1 --2- 172.21.15.79:0/1868782128 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f25e006a0e0 0x7f25e006c5a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.403+0000 7f25f9177700 1 --2- 172.21.15.79:0/1868782128 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25f4154180 0x7f25f4157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.403+0000 7f25f9177700 1 --2- 172.21.15.79:0/1868782128 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25f406e7e0 0x7f25f40cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.404+0000 7f25f9177700 1 --2- 172.21.15.79:0/1868782128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25f415af30 0x7f25f40c8b50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.404+0000 7f25f9177700 1 -- 172.21.15.79:0/1868782128 >> 172.21.15.79:0/1868782128 conn(0x7f25f406dcc0 msgr2=0x7f25f4155030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:29.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.404+0000 7f25f9177700 1 -- 172.21.15.79:0/1868782128 shutdown_connections 2023-10-19T08:38:29.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.404+0000 7f25f9177700 1 -- 172.21.15.79:0/1868782128 wait complete. 2023-10-19T08:38:29.410 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 9 2023-10-19T08:38:29.419 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:29.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.536+0000 7f3bcafbd700 1 Processor -- start 2023-10-19T08:38:29.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.536+0000 7f3bcafbd700 1 -- start start 2023-10-19T08:38:29.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.537+0000 7f3bcafbd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3bc40cf710 0x7f3bc4164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.537+0000 7f3bcafbd700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc40cc870 con 0x7f3bc40b5610 2023-10-19T08:38:29.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.537+0000 7f3bcafbd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc40b5aa0 con 0x7f3bc4159f40 2023-10-19T08:38:29.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.537+0000 7f3bcafbd700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc40cd800 con 0x7f3bc40cf710 2023-10-19T08:38:29.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.537+0000 7f3bc3fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3bc40b5610 0x7f3bc40cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56818/0 (socket says 172.21.15.79:56818) 2023-10-19T08:38:29.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.537+0000 7f3bc3fff700 1 -- 172.21.15.79:0/2931597409 learned_addr learned my addr 172.21.15.79:0/2931597409 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:29.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.537+0000 7f3bc955a700 1 --2- 172.21.15.79:0/2931597409 >> v2:172.21.15.89:3300/0 conn(0x7f3bc40cf710 0x7f3bc4164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.537+0000 7f3bc37fe700 1 -- 172.21.15.79:0/2931597409 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063467184 0 0) 0x7f3bb0001110 con 0x7f3bc40b5610 2023-10-19T08:38:29.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.537+0000 7f3bc37fe700 1 -- 172.21.15.79:0/2931597409 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bb40035b0 con 0x7f3bc40b5610 2023-10-19T08:38:29.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.537+0000 7f3bc37fe700 1 -- 172.21.15.79:0/2931597409 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232889502 0 0) 0x7f3bc40b5aa0 con 0x7f3bc4159f40 2023-10-19T08:38:29.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.537+0000 7f3bc37fe700 1 -- 172.21.15.79:0/2931597409 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bb0001110 con 0x7f3bc4159f40 2023-10-19T08:38:29.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.537+0000 7f3bc37fe700 1 -- 172.21.15.79:0/2931597409 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 825498307 0 0) 0x7f3bb40035b0 con 0x7f3bc40b5610 2023-10-19T08:38:29.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.537+0000 7f3bc37fe700 1 -- 172.21.15.79:0/2931597409 >> v2:172.21.15.89:3300/0 conn(0x7f3bc40cf710 msgr2=0x7f3bc4164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:29.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.537+0000 7f3bc37fe700 1 --2- 172.21.15.79:0/2931597409 >> v2:172.21.15.89:3300/0 conn(0x7f3bc40cf710 0x7f3bc4164cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.537+0000 7f3bc37fe700 1 -- 172.21.15.79:0/2931597409 >> v1:172.21.15.89:6789/0 conn(0x7f3bc4159f40 legacy=0x7f3bc415e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:29.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc37fe700 1 -- 172.21.15.79:0/2931597409 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc40cdae0 con 0x7f3bc40b5610 2023-10-19T08:38:29.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc37fe700 1 -- 172.21.15.79:0/2931597409 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f3bb0001800 con 0x7f3bc40b5610 2023-10-19T08:38:29.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc37fe700 1 -- 172.21.15.79:0/2931597409 >> v1:172.21.15.79:6789/0 conn(0x7f3bc40b5610 legacy=0x7f3bc40cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:29.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc37fe700 1 --2- 172.21.15.79:0/2931597409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bb4003be0 0x7f3bb4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc37fe700 1 --2- 172.21.15.79:0/2931597409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bb4004850 0x7f3bb4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc37fe700 1 --2- 172.21.15.79:0/2931597409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bb4005210 0x7f3bb400dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc37fe700 1 -- 172.21.15.79:0/2931597409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc40cd800 con 0x7f3bb4005210 2023-10-19T08:38:29.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc37fe700 1 -- 172.21.15.79:0/2931597409 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb400e2f0 con 0x7f3bb4004850 2023-10-19T08:38:29.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc37fe700 1 -- 172.21.15.79:0/2931597409 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb400e4b0 con 0x7f3bb4003be0 2023-10-19T08:38:29.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc955a700 1 --2- 172.21.15.79:0/2931597409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bb4005210 0x7f3bb400dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc8d59700 1 --2- 172.21.15.79:0/2931597409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bb4003be0 0x7f3bb4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc3fff700 1 --2- 172.21.15.79:0/2931597409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bb4004850 0x7f3bb4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc955a700 1 -- 172.21.15.79:0/2931597409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bb4003be0 msgr2=0x7f3bb4003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:29.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc955a700 1 --2- 172.21.15.79:0/2931597409 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bb4003be0 0x7f3bb4003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc955a700 1 -- 172.21.15.79:0/2931597409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bb4004850 msgr2=0x7f3bb4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:29.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc955a700 1 --2- 172.21.15.79:0/2931597409 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bb4004850 0x7f3bb4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc955a700 1 -- 172.21.15.79:0/2931597409 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb40035b0 con 0x7f3bb4005210 2023-10-19T08:38:29.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc955a700 1 -- 172.21.15.79:0/2931597409 reap_dead start 2023-10-19T08:38:29.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc955a700 1 --2- 172.21.15.79:0/2931597409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bb4005210 0x7f3bb400dc20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40b26e0 tx=0x7f3bb4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d032f5c643a48b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:29.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc37fe700 1 -- 172.21.15.79:0/2931597409 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc018070 con 0x7f3bb4005210 2023-10-19T08:38:29.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc37fe700 1 -- 172.21.15.79:0/2931597409 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bbc00f040 con 0x7f3bb4005210 2023-10-19T08:38:29.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.538+0000 7f3bc37fe700 1 -- 172.21.15.79:0/2931597409 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00ec10 con 0x7f3bb4005210 2023-10-19T08:38:29.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.539+0000 7f3bcafbd700 1 -- 172.21.15.79:0/2931597409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bb4005210 msgr2=0x7f3bb400dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:29.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.539+0000 7f3bcafbd700 1 --2- 172.21.15.79:0/2931597409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bb4005210 0x7f3bb400dc20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40b26e0 tx=0x7f3bb4005880 comp rx=0 tx=0).stop 2023-10-19T08:38:29.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.539+0000 7f3bcafbd700 1 -- 172.21.15.79:0/2931597409 shutdown_connections 2023-10-19T08:38:29.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.539+0000 7f3bcafbd700 1 --2- 172.21.15.79:0/2931597409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bb4005210 0x7f3bb400dc20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.539+0000 7f3bcafbd700 1 -- 172.21.15.79:0/2931597409 >> 172.21.15.79:0/2931597409 conn(0x7f3bc406dcc0 msgr2=0x7f3bc406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:29.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.539+0000 7f3bcafbd700 1 -- 172.21.15.79:0/2931597409 shutdown_connections 2023-10-19T08:38:29.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.539+0000 7f3bcafbd700 1 -- 172.21.15.79:0/2931597409 wait complete. 2023-10-19T08:38:29.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.540+0000 7f3bcafbd700 1 Processor -- start 2023-10-19T08:38:29.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.540+0000 7f3bcafbd700 1 -- start start 2023-10-19T08:38:29.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.541+0000 7f3bcafbd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bb4005210 0x7f3bc41e3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bcafbd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bc4147cb0 0x7f3bc4148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bcafbd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bc40c3760 0x7f3bc40c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bcafbd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc40c7280 con 0x7f3bb4005210 2023-10-19T08:38:29.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bcafbd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc40c4930 con 0x7f3bc4147cb0 2023-10-19T08:38:29.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bcafbd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc4155ac0 con 0x7f3bc40c3760 2023-10-19T08:38:29.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bc8d59700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bb4005210 0x7f3bc41e3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bc8d59700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bb4005210 0x7f3bc41e3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46758/0 (socket says 172.21.15.79:46758) 2023-10-19T08:38:29.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bc8d59700 1 -- 172.21.15.79:0/3712413021 learned_addr learned my addr 172.21.15.79:0/3712413021 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:29.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bc3fff700 1 --2- 172.21.15.79:0/3712413021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bc4147cb0 0x7f3bc4148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bc955a700 1 --2- 172.21.15.79:0/3712413021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bc40c3760 0x7f3bc40c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bc8d59700 1 -- 172.21.15.79:0/3712413021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bc40c3760 msgr2=0x7f3bc40c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:29.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bc8d59700 1 --2- 172.21.15.79:0/3712413021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bc40c3760 0x7f3bc40c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bc8d59700 1 -- 172.21.15.79:0/3712413021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bc4147cb0 msgr2=0x7f3bc4148110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:29.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bc8d59700 1 --2- 172.21.15.79:0/3712413021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bc4147cb0 0x7f3bc4148110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bc8d59700 1 -- 172.21.15.79:0/3712413021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc40c4130 con 0x7f3bb4005210 2023-10-19T08:38:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bc3fff700 1 --2- 172.21.15.79:0/3712413021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bc4147cb0 0x7f3bc4148110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bc8d59700 1 --2- 172.21.15.79:0/3712413021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bb4005210 0x7f3bc41e3e00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800f7e0 tx=0x7f3bb800fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bc17fa700 1 -- 172.21.15.79:0/3712413021 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8005320 con 0x7f3bb4005210 2023-10-19T08:38:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bc17fa700 1 -- 172.21.15.79:0/3712413021 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb80054a0 con 0x7f3bb4005210 2023-10-19T08:38:29.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bcafbd700 1 -- 172.21.15.79:0/3712413021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc4148650 con 0x7f3bb4005210 2023-10-19T08:38:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bc17fa700 1 -- 172.21.15.79:0/3712413021 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8006aa0 con 0x7f3bb4005210 2023-10-19T08:38:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.542+0000 7f3bcafbd700 1 -- 172.21.15.79:0/3712413021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc40c4650 con 0x7f3bb4005210 2023-10-19T08:38:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.543+0000 7f3bcafbd700 1 -- 172.21.15.79:0/3712413021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc404ee70 con 0x7f3bb4005210 2023-10-19T08:38:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.544+0000 7f3bc17fa700 1 -- 172.21.15.79:0/3712413021 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3bb8006c00 con 0x7f3bb4005210 2023-10-19T08:38:29.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.544+0000 7f3bc17fa700 1 --2- 172.21.15.79:0/3712413021 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f3ba806a110 0x7f3ba806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.544+0000 7f3bc17fa700 1 -- 172.21.15.79:0/3712413021 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3bb8087f70 con 0x7f3bb4005210 2023-10-19T08:38:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.544+0000 7f3bc3fff700 1 --2- 172.21.15.79:0/3712413021 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f3ba806a110 0x7f3ba806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.545+0000 7f3bc3fff700 1 --2- 172.21.15.79:0/3712413021 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f3ba806a110 0x7f3ba806c5d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0000c00 tx=0x7f3bb0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:29.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.548+0000 7f3bc17fa700 1 -- 172.21.15.79:0/3712413021 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f3bb80ba940 con 0x7f3bb4005210 2023-10-19T08:38:29.742 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.738+0000 7f3bcafbd700 1 -- 172.21.15.79:0/3712413021 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bc40c4130 con 0x7f3bb4005210 2023-10-19T08:38:29.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.740+0000 7f3bc17fa700 1 -- 172.21.15.79:0/3712413021 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20060 (secure 0 0 0) 0x7f3bc40c4130 con 0x7f3bb4005210 2023-10-19T08:38:29.744 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:29.744 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":25,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:01.725914+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:29.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.742+0000 7f3bcafbd700 1 -- 172.21.15.79:0/3712413021 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f3ba806a110 msgr2=0x7f3ba806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:29.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.742+0000 7f3bcafbd700 1 --2- 172.21.15.79:0/3712413021 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f3ba806a110 0x7f3ba806c5d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0000c00 tx=0x7f3bb0009040 comp rx=0 tx=0).stop 2023-10-19T08:38:29.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.742+0000 7f3bcafbd700 1 -- 172.21.15.79:0/3712413021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bb4005210 msgr2=0x7f3bc41e3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:29.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.742+0000 7f3bcafbd700 1 --2- 172.21.15.79:0/3712413021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bb4005210 0x7f3bc41e3e00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3bb800f7e0 tx=0x7f3bb800fba0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.742+0000 7f3bcafbd700 1 -- 172.21.15.79:0/3712413021 shutdown_connections 2023-10-19T08:38:29.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.742+0000 7f3bcafbd700 1 --2- 172.21.15.79:0/3712413021 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f3ba806a110 0x7f3ba806c5d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.742+0000 7f3bcafbd700 1 --2- 172.21.15.79:0/3712413021 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3bc40c3760 0x7f3bc40c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.742+0000 7f3bcafbd700 1 --2- 172.21.15.79:0/3712413021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bb4005210 0x7f3bc41e3e00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.742+0000 7f3bcafbd700 1 --2- 172.21.15.79:0/3712413021 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3bc4147cb0 0x7f3bc4148110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.742+0000 7f3bcafbd700 1 -- 172.21.15.79:0/3712413021 >> 172.21.15.79:0/3712413021 conn(0x7f3bc406dcc0 msgr2=0x7f3bc406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:29.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.742+0000 7f3bcafbd700 1 -- 172.21.15.79:0/3712413021 shutdown_connections 2023-10-19T08:38:29.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.742+0000 7f3bcafbd700 1 -- 172.21.15.79:0/3712413021 wait complete. 2023-10-19T08:38:29.758 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T08:37:54.318159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T08:37:55.629862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T08:37:59.333062+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T08:38:29.759 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:38:29.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.878+0000 7f494925f700 1 Processor -- start 2023-10-19T08:38:29.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.878+0000 7f494925f700 1 -- start start 2023-10-19T08:38:29.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.879+0000 7f494925f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49440cd270 0x7f494406a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.879+0000 7f494925f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49440703b0 0x7f494406a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.879+0000 7f494925f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49440b1fe0 con 0x7f494406f910 2023-10-19T08:38:29.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.879+0000 7f494925f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4944160a80 con 0x7f49440cd270 2023-10-19T08:38:29.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.879+0000 7f494925f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49440ce2b0 con 0x7f49440703b0 2023-10-19T08:38:29.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.879+0000 7f4942d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49440cd270 0x7f494406a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.879+0000 7f4942d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49440cd270 0x7f494406a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46766/0 (socket says 172.21.15.79:46766) 2023-10-19T08:38:29.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.879+0000 7f4942d9d700 1 -- 172.21.15.79:0/2125963620 learned_addr learned my addr 172.21.15.79:0/2125963620 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:29.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.879+0000 7f494259c700 1 --2- 172.21.15.79:0/2125963620 >> v2:172.21.15.89:3300/0 conn(0x7f49440703b0 0x7f494406a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.880+0000 7f4942d9d700 1 -- 172.21.15.79:0/2125963620 >> v2:172.21.15.89:3300/0 conn(0x7f49440703b0 msgr2=0x7f494406a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:29.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.880+0000 7f4942d9d700 1 --2- 172.21.15.79:0/2125963620 >> v2:172.21.15.89:3300/0 conn(0x7f49440703b0 0x7f494406a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.880+0000 7f4942d9d700 1 -- 172.21.15.79:0/2125963620 >> v1:172.21.15.89:6789/0 conn(0x7f494406f910 legacy=0x7f4944160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:29.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.880+0000 7f4942d9d700 1 -- 172.21.15.79:0/2125963620 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49440ce550 con 0x7f49440cd270 2023-10-19T08:38:29.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.880+0000 7f4942d9d700 1 --2- 172.21.15.79:0/2125963620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440cd270 0x7f494406a220 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4944161d10 tx=0x7f4938009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce545688ccbdf2e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:29.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.880+0000 7f4941d9b700 1 -- 172.21.15.79:0/2125963620 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4938004230 con 0x7f49440cd270 2023-10-19T08:38:29.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.880+0000 7f4941d9b700 1 -- 172.21.15.79:0/2125963620 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4938004390 con 0x7f49440cd270 2023-10-19T08:38:29.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.880+0000 7f4941d9b700 1 -- 172.21.15.79:0/2125963620 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49380036a0 con 0x7f49440cd270 2023-10-19T08:38:29.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.880+0000 7f494925f700 1 -- 172.21.15.79:0/2125963620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440cd270 msgr2=0x7f494406a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:29.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.880+0000 7f494925f700 1 --2- 172.21.15.79:0/2125963620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440cd270 0x7f494406a220 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4944161d10 tx=0x7f4938009bd0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.880+0000 7f494925f700 1 -- 172.21.15.79:0/2125963620 shutdown_connections 2023-10-19T08:38:29.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.880+0000 7f494925f700 1 --2- 172.21.15.79:0/2125963620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440cd270 0x7f494406a220 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.880+0000 7f494925f700 1 --2- 172.21.15.79:0/2125963620 >> v2:172.21.15.89:3300/0 conn(0x7f49440703b0 0x7f494406a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.880+0000 7f494925f700 1 -- 172.21.15.79:0/2125963620 >> 172.21.15.79:0/2125963620 conn(0x7f494406dcc0 msgr2=0x7f494406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:29.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.880+0000 7f494925f700 1 -- 172.21.15.79:0/2125963620 shutdown_connections 2023-10-19T08:38:29.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.880+0000 7f494925f700 1 -- 172.21.15.79:0/2125963620 wait complete. 2023-10-19T08:38:29.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.882+0000 7f494925f700 1 Processor -- start 2023-10-19T08:38:29.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.882+0000 7f494925f700 1 -- start start 2023-10-19T08:38:29.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f494925f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f494406f910 0x7f494415a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f494925f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440703b0 0x7f49440c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f494925f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49440cd270 0x7f49441e8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f494925f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49440c73f0 con 0x7f49440703b0 2023-10-19T08:38:29.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f494925f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49441e7980 con 0x7f49440cd270 2023-10-19T08:38:29.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f494925f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49441e7c60 con 0x7f494406f910 2023-10-19T08:38:29.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f494259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440703b0 0x7f49440c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f494259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440703b0 0x7f49440c9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46776/0 (socket says 172.21.15.79:46776) 2023-10-19T08:38:29.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f494259c700 1 -- 172.21.15.79:0/1141145445 learned_addr learned my addr 172.21.15.79:0/1141145445 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:29.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f4942d9d700 1 --2- 172.21.15.79:0/1141145445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f494406f910 0x7f494415a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f494359e700 1 --2- 172.21.15.79:0/1141145445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49440cd270 0x7f49441e8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f494259c700 1 -- 172.21.15.79:0/1141145445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f494406f910 msgr2=0x7f494415a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:29.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f494259c700 1 --2- 172.21.15.79:0/1141145445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f494406f910 0x7f494415a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f494259c700 1 -- 172.21.15.79:0/1141145445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49440cd270 msgr2=0x7f49441e8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:29.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f494259c700 1 --2- 172.21.15.79:0/1141145445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49440cd270 0x7f49441e8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:29.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f494259c700 1 -- 172.21.15.79:0/1141145445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4938009550 con 0x7f49440703b0 2023-10-19T08:38:29.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f494259c700 1 --2- 172.21.15.79:0/1141145445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440703b0 0x7f49440c9670 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f493400d800 tx=0x7f493400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:29.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f492b7fe700 1 -- 172.21.15.79:0/1141145445 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49340125f0 con 0x7f49440703b0 2023-10-19T08:38:29.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f492b7fe700 1 -- 172.21.15.79:0/1141145445 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4934012750 con 0x7f49440703b0 2023-10-19T08:38:29.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f494925f700 1 -- 172.21.15.79:0/1141145445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49440c6da0 con 0x7f49440703b0 2023-10-19T08:38:29.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f492b7fe700 1 -- 172.21.15.79:0/1141145445 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934012b00 con 0x7f49440703b0 2023-10-19T08:38:29.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.883+0000 7f494925f700 1 -- 172.21.15.79:0/1141145445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49440c9190 con 0x7f49440703b0 2023-10-19T08:38:29.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.884+0000 7f494925f700 1 -- 172.21.15.79:0/1141145445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494406b0c0 con 0x7f49440703b0 2023-10-19T08:38:29.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.885+0000 7f492b7fe700 1 -- 172.21.15.79:0/1141145445 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4934012c60 con 0x7f49440703b0 2023-10-19T08:38:29.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.885+0000 7f492b7fe700 1 --2- 172.21.15.79:0/1141145445 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f493006a0e0 0x7f493006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:29.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.885+0000 7f492b7fe700 1 -- 172.21.15.79:0/1141145445 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4934088bc0 con 0x7f49440703b0 2023-10-19T08:38:29.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.885+0000 7f4942d9d700 1 --2- 172.21.15.79:0/1141145445 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f493006a0e0 0x7f493006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:29.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.886+0000 7f4942d9d700 1 --2- 172.21.15.79:0/1141145445 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f493006a0e0 0x7f493006c5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f49440c5b30 tx=0x7f4938008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:29.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:29.890+0000 7f492b7fe700 1 -- 172.21.15.79:0/1141145445 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4934053fc0 con 0x7f49440703b0 2023-10-19T08:38:30.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.077+0000 7f494925f700 1 -- 172.21.15.79:0/1141145445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f49440d0ba0 con 0x7f49440703b0 2023-10-19T08:38:30.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.077+0000 7f492b7fe700 1 -- 172.21.15.79:0/1141145445 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f49340575e0 con 0x7f49440703b0 2023-10-19T08:38:30.081 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:38:30.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.079+0000 7f494925f700 1 -- 172.21.15.79:0/1141145445 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f493006a0e0 msgr2=0x7f493006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:30.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.079+0000 7f494925f700 1 --2- 172.21.15.79:0/1141145445 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f493006a0e0 0x7f493006c5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f49440c5b30 tx=0x7f4938008030 comp rx=0 tx=0).stop 2023-10-19T08:38:30.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.079+0000 7f494925f700 1 -- 172.21.15.79:0/1141145445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440703b0 msgr2=0x7f49440c9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:30.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.079+0000 7f494925f700 1 --2- 172.21.15.79:0/1141145445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440703b0 0x7f49440c9670 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f493400d800 tx=0x7f493400dbc0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.079+0000 7f494925f700 1 -- 172.21.15.79:0/1141145445 shutdown_connections 2023-10-19T08:38:30.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.079+0000 7f494925f700 1 --2- 172.21.15.79:0/1141145445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49440cd270 0x7f49441e8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.079+0000 7f494925f700 1 --2- 172.21.15.79:0/1141145445 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f493006a0e0 0x7f493006c5a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.079+0000 7f494925f700 1 --2- 172.21.15.79:0/1141145445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f494406f910 0x7f494415a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.079+0000 7f494925f700 1 --2- 172.21.15.79:0/1141145445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49440703b0 0x7f49440c9670 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.079+0000 7f494925f700 1 -- 172.21.15.79:0/1141145445 >> 172.21.15.79:0/1141145445 conn(0x7f494406dcc0 msgr2=0x7f49440c3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:30.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.079+0000 7f494925f700 1 -- 172.21.15.79:0/1141145445 shutdown_connections 2023-10-19T08:38:30.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.079+0000 7f494925f700 1 -- 172.21.15.79:0/1141145445 wait complete. 2023-10-19T08:38:30.095 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:38:30.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.214+0000 7fec6ed22700 1 Processor -- start 2023-10-19T08:38:30.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.214+0000 7fec6ed22700 1 -- start start 2023-10-19T08:38:30.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.215+0000 7fec6ed22700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fec680b0710 0x7fec680b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.215+0000 7fec6ed22700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fec680b1d50 0x7fec680b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.215+0000 7fec6ed22700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6806c5a0 con 0x7fec680d14f0 2023-10-19T08:38:30.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.215+0000 7fec6ed22700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec68160cb0 con 0x7fec680b0710 2023-10-19T08:38:30.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.215+0000 7fec6ed22700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec6806bd40 con 0x7fec680b1d50 2023-10-19T08:38:30.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.215+0000 7fec6cabe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fec680b0710 0x7fec680b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.215+0000 7fec6cabe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fec680b0710 0x7fec680b0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46780/0 (socket says 172.21.15.79:46780) 2023-10-19T08:38:30.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.215+0000 7fec6cabe700 1 -- 172.21.15.79:0/2935305726 learned_addr learned my addr 172.21.15.79:0/2935305726 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:30.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.215+0000 7fec6d2bf700 1 --2- 172.21.15.79:0/2935305726 >> v2:172.21.15.89:3300/0 conn(0x7fec680b1d50 0x7fec680b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.215+0000 7fec6cabe700 1 -- 172.21.15.79:0/2935305726 >> v2:172.21.15.89:3300/0 conn(0x7fec680b1d50 msgr2=0x7fec680b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:30.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.215+0000 7fec6cabe700 1 --2- 172.21.15.79:0/2935305726 >> v2:172.21.15.89:3300/0 conn(0x7fec680b1d50 0x7fec680b21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.215+0000 7fec6cabe700 1 -- 172.21.15.79:0/2935305726 >> v1:172.21.15.89:6789/0 conn(0x7fec680d14f0 legacy=0x7fec680ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:30.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.215+0000 7fec6cabe700 1 -- 172.21.15.79:0/2935305726 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec680b1030 con 0x7fec680b0710 2023-10-19T08:38:30.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.215+0000 7fec6cabe700 1 --2- 172.21.15.79:0/2935305726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec680b0710 0x7fec680b0af0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fec6806d4f0 tx=0x7fec5c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a095d2e6963d9c0a server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:30.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.215+0000 7fec677fe700 1 -- 172.21.15.79:0/2935305726 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c00b870 con 0x7fec680b0710 2023-10-19T08:38:30.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.215+0000 7fec677fe700 1 -- 172.21.15.79:0/2935305726 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c00b9d0 con 0x7fec680b0710 2023-10-19T08:38:30.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.215+0000 7fec677fe700 1 -- 172.21.15.79:0/2935305726 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c00bd60 con 0x7fec680b0710 2023-10-19T08:38:30.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.216+0000 7fec6ed22700 1 -- 172.21.15.79:0/2935305726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec680b0710 msgr2=0x7fec680b0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:30.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.216+0000 7fec6ed22700 1 --2- 172.21.15.79:0/2935305726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec680b0710 0x7fec680b0af0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fec6806d4f0 tx=0x7fec5c009bd0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.216+0000 7fec6ed22700 1 -- 172.21.15.79:0/2935305726 shutdown_connections 2023-10-19T08:38:30.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.216+0000 7fec6ed22700 1 --2- 172.21.15.79:0/2935305726 >> v2:172.21.15.89:3300/0 conn(0x7fec680b1d50 0x7fec680b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.216+0000 7fec6ed22700 1 --2- 172.21.15.79:0/2935305726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec680b0710 0x7fec680b0af0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.216+0000 7fec6ed22700 1 -- 172.21.15.79:0/2935305726 >> 172.21.15.79:0/2935305726 conn(0x7fec6809a0b0 msgr2=0x7fec680d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:30.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.216+0000 7fec6ed22700 1 -- 172.21.15.79:0/2935305726 shutdown_connections 2023-10-19T08:38:30.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.216+0000 7fec6ed22700 1 -- 172.21.15.79:0/2935305726 wait complete. 2023-10-19T08:38:30.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.217+0000 7fec6ed22700 1 Processor -- start 2023-10-19T08:38:30.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.217+0000 7fec6ed22700 1 -- start start 2023-10-19T08:38:30.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.218+0000 7fec6ed22700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec680b0710 0x7fec681f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.218+0000 7fec6ed22700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec680b1d50 0x7fec6809d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.218+0000 7fec6ed22700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec680d14f0 0x7fec680cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.219+0000 7fec6ed22700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec681f3b70 con 0x7fec680d14f0 2023-10-19T08:38:30.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.219+0000 7fec6ed22700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec681f2ff0 con 0x7fec680b0710 2023-10-19T08:38:30.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.219+0000 7fec6ed22700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec681f32d0 con 0x7fec680b1d50 2023-10-19T08:38:30.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.219+0000 7fec6d2bf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec680d14f0 0x7fec680cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.219+0000 7fec6d2bf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec680d14f0 0x7fec680cd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46790/0 (socket says 172.21.15.79:46790) 2023-10-19T08:38:30.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.219+0000 7fec6d2bf700 1 -- 172.21.15.79:0/3738129348 learned_addr learned my addr 172.21.15.79:0/3738129348 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:30.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.219+0000 7fec6cabe700 1 --2- 172.21.15.79:0/3738129348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec680b0710 0x7fec681f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.219+0000 7fec67fff700 1 --2- 172.21.15.79:0/3738129348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec680b1d50 0x7fec6809d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.219+0000 7fec6d2bf700 1 -- 172.21.15.79:0/3738129348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec680b1d50 msgr2=0x7fec6809d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:30.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.219+0000 7fec6d2bf700 1 --2- 172.21.15.79:0/3738129348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec680b1d50 0x7fec6809d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.219+0000 7fec6d2bf700 1 -- 172.21.15.79:0/3738129348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec680b0710 msgr2=0x7fec681f3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:30.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.219+0000 7fec6d2bf700 1 --2- 172.21.15.79:0/3738129348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec680b0710 0x7fec681f3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.219+0000 7fec6d2bf700 1 -- 172.21.15.79:0/3738129348 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c009550 con 0x7fec680d14f0 2023-10-19T08:38:30.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.219+0000 7fec6d2bf700 1 --2- 172.21.15.79:0/3738129348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec680d14f0 0x7fec680cd5a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fec60007e40 tx=0x7fec6000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:30.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.219+0000 7fec657fa700 1 -- 172.21.15.79:0/3738129348 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6000ed30 con 0x7fec680d14f0 2023-10-19T08:38:30.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.219+0000 7fec657fa700 1 -- 172.21.15.79:0/3738129348 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec60014420 con 0x7fec680d14f0 2023-10-19T08:38:30.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.219+0000 7fec6ed22700 1 -- 172.21.15.79:0/3738129348 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec681f35b0 con 0x7fec680d14f0 2023-10-19T08:38:30.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.219+0000 7fec657fa700 1 -- 172.21.15.79:0/3738129348 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec600147d0 con 0x7fec680d14f0 2023-10-19T08:38:30.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.219+0000 7fec6ed22700 1 -- 172.21.15.79:0/3738129348 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec680b61a0 con 0x7fec680d14f0 2023-10-19T08:38:30.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.220+0000 7fec6ed22700 1 -- 172.21.15.79:0/3738129348 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6804ee70 con 0x7fec680d14f0 2023-10-19T08:38:30.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.221+0000 7fec657fa700 1 -- 172.21.15.79:0/3738129348 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fec60014930 con 0x7fec680d14f0 2023-10-19T08:38:30.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.221+0000 7fec657fa700 1 --2- 172.21.15.79:0/3738129348 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fec4c06a0e0 0x7fec4c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.221+0000 7fec657fa700 1 -- 172.21.15.79:0/3738129348 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fec60088e20 con 0x7fec680d14f0 2023-10-19T08:38:30.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.221+0000 7fec6cabe700 1 --2- 172.21.15.79:0/3738129348 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fec4c06a0e0 0x7fec4c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.221+0000 7fec6cabe700 1 --2- 172.21.15.79:0/3738129348 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fec4c06a0e0 0x7fec4c06c5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fec5c000c00 tx=0x7fec5c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:30.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.225+0000 7fec657fa700 1 -- 172.21.15.79:0/3738129348 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fec600542b0 con 0x7fec680d14f0 2023-10-19T08:38:30.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.412+0000 7fec6ed22700 1 -- 172.21.15.79:0/3738129348 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fec6806bb20 con 0x7fec680d14f0 2023-10-19T08:38:30.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.413+0000 7fec657fa700 1 -- 172.21.15.79:0/3738129348 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fec600578d0 con 0x7fec680d14f0 2023-10-19T08:38:30.417 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:38:30.418 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.415+0000 7fec6ed22700 1 -- 172.21.15.79:0/3738129348 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fec4c06a0e0 msgr2=0x7fec4c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:30.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.415+0000 7fec6ed22700 1 --2- 172.21.15.79:0/3738129348 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fec4c06a0e0 0x7fec4c06c5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fec5c000c00 tx=0x7fec5c008030 comp rx=0 tx=0).stop 2023-10-19T08:38:30.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.415+0000 7fec6ed22700 1 -- 172.21.15.79:0/3738129348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec680d14f0 msgr2=0x7fec680cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:30.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.415+0000 7fec6ed22700 1 --2- 172.21.15.79:0/3738129348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec680d14f0 0x7fec680cd5a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fec60007e40 tx=0x7fec6000e3c0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.415+0000 7fec6ed22700 1 -- 172.21.15.79:0/3738129348 shutdown_connections 2023-10-19T08:38:30.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.415+0000 7fec6ed22700 1 --2- 172.21.15.79:0/3738129348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec680d14f0 0x7fec680cd5a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.415+0000 7fec6ed22700 1 --2- 172.21.15.79:0/3738129348 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec680b0710 0x7fec681f3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.415+0000 7fec6ed22700 1 --2- 172.21.15.79:0/3738129348 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fec4c06a0e0 0x7fec4c06c5a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.415+0000 7fec6ed22700 1 --2- 172.21.15.79:0/3738129348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec680b1d50 0x7fec6809d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.415+0000 7fec6ed22700 1 -- 172.21.15.79:0/3738129348 >> 172.21.15.79:0/3738129348 conn(0x7fec6809a0b0 msgr2=0x7fec680c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:30.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.415+0000 7fec6ed22700 1 -- 172.21.15.79:0/3738129348 shutdown_connections 2023-10-19T08:38:30.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.415+0000 7fec6ed22700 1 -- 172.21.15.79:0/3738129348 wait complete. 2023-10-19T08:38:30.430 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T08:38:30.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.550+0000 7fa3c8e99700 1 Processor -- start 2023-10-19T08:38:30.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.550+0000 7fa3c8e99700 1 -- start start 2023-10-19T08:38:30.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.551+0000 7fa3c8e99700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3c4159db0 0x7fa3c40cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.551+0000 7fa3c8e99700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa3c406fdc0 0x7fa3c40ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.551+0000 7fa3c8e99700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c415d760 con 0x7fa3c40cc640 2023-10-19T08:38:30.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.551+0000 7fa3c8e99700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c415da40 con 0x7fa3c406fdc0 2023-10-19T08:38:30.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.551+0000 7fa3c8e99700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c415dd20 con 0x7fa3c4159db0 2023-10-19T08:38:30.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.551+0000 7fa3c259c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa3c40cc640 0x7fa3c40cca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56866/0 (socket says 172.21.15.79:56866) 2023-10-19T08:38:30.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.551+0000 7fa3c259c700 1 -- 172.21.15.79:0/1917142188 learned_addr learned my addr 172.21.15.79:0/1917142188 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:30.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.551+0000 7fa3c1d9b700 1 --2- 172.21.15.79:0/1917142188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3c4159db0 0x7fa3c40cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.551+0000 7fa3c2d9d700 1 --2- 172.21.15.79:0/1917142188 >> v2:172.21.15.89:3300/0 conn(0x7fa3c406fdc0 0x7fa3c40ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.551+0000 7fa3c159a700 1 -- 172.21.15.79:0/1917142188 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644574685 0 0) 0x7fa3c415d760 con 0x7fa3c40cc640 2023-10-19T08:38:30.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.551+0000 7fa3c159a700 1 -- 172.21.15.79:0/1917142188 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3ac0035b0 con 0x7fa3c40cc640 2023-10-19T08:38:30.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c159a700 1 -- 172.21.15.79:0/1917142188 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2287164446 0 0) 0x7fa3ac0035b0 con 0x7fa3c40cc640 2023-10-19T08:38:30.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c159a700 1 -- 172.21.15.79:0/1917142188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3c4159db0 msgr2=0x7fa3c40cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:30.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c159a700 1 --2- 172.21.15.79:0/1917142188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3c4159db0 0x7fa3c40cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c159a700 1 -- 172.21.15.79:0/1917142188 >> v2:172.21.15.89:3300/0 conn(0x7fa3c406fdc0 msgr2=0x7fa3c40ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:30.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c159a700 1 --2- 172.21.15.79:0/1917142188 >> v2:172.21.15.89:3300/0 conn(0x7fa3c406fdc0 0x7fa3c40ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c159a700 1 -- 172.21.15.79:0/1917142188 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c415e000 con 0x7fa3c40cc640 2023-10-19T08:38:30.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c159a700 1 -- 172.21.15.79:0/1917142188 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7fa3b4001670 con 0x7fa3c40cc640 2023-10-19T08:38:30.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c159a700 1 -- 172.21.15.79:0/1917142188 >> v1:172.21.15.79:6789/0 conn(0x7fa3c40cc640 legacy=0x7fa3c40cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:30.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c159a700 1 --2- 172.21.15.79:0/1917142188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3c4159db0 0x7fa3ac003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c159a700 1 --2- 172.21.15.79:0/1917142188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3ac003ff0 0x7fa3ac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c159a700 1 --2- 172.21.15.79:0/1917142188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3ac004d90 0x7fa3ac005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c159a700 1 -- 172.21.15.79:0/1917142188 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c415da40 con 0x7fa3ac003ff0 2023-10-19T08:38:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c159a700 1 -- 172.21.15.79:0/1917142188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c415dd20 con 0x7fa3ac004d90 2023-10-19T08:38:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c159a700 1 -- 172.21.15.79:0/1917142188 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac00ba40 con 0x7fa3c4159db0 2023-10-19T08:38:30.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c1d9b700 1 --2- 172.21.15.79:0/1917142188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3ac003ff0 0x7fa3ac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c259c700 1 --2- 172.21.15.79:0/1917142188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3c4159db0 0x7fa3ac003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c2d9d700 1 --2- 172.21.15.79:0/1917142188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3ac004d90 0x7fa3ac005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c1d9b700 1 -- 172.21.15.79:0/1917142188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3c4159db0 msgr2=0x7fa3ac003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:30.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c1d9b700 1 --2- 172.21.15.79:0/1917142188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3c4159db0 0x7fa3ac003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c1d9b700 1 -- 172.21.15.79:0/1917142188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3ac004d90 msgr2=0x7fa3ac005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:30.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c1d9b700 1 --2- 172.21.15.79:0/1917142188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3ac004d90 0x7fa3ac005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c1d9b700 1 -- 172.21.15.79:0/1917142188 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac0035b0 con 0x7fa3ac003ff0 2023-10-19T08:38:30.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.552+0000 7fa3c1d9b700 1 --2- 172.21.15.79:0/1917142188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3ac003ff0 0x7fa3ac004850 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8009b30 tx=0x7fa3ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5271da5017a47a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:30.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.553+0000 7fa3c159a700 1 -- 172.21.15.79:0/1917142188 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b800e6c0 con 0x7fa3ac003ff0 2023-10-19T08:38:30.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.553+0000 7fa3c159a700 1 -- 172.21.15.79:0/1917142188 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b800e820 con 0x7fa3ac003ff0 2023-10-19T08:38:30.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.553+0000 7fa3c159a700 1 -- 172.21.15.79:0/1917142188 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b800eb90 con 0x7fa3ac003ff0 2023-10-19T08:38:30.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.553+0000 7fa3c8e99700 1 -- 172.21.15.79:0/1917142188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3ac003ff0 msgr2=0x7fa3ac004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:30.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.553+0000 7fa3c8e99700 1 --2- 172.21.15.79:0/1917142188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3ac003ff0 0x7fa3ac004850 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8009b30 tx=0x7fa3ac005880 comp rx=0 tx=0).stop 2023-10-19T08:38:30.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.553+0000 7fa3c2d9d700 1 -- 172.21.15.79:0/1917142188 reap_dead start 2023-10-19T08:38:30.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.553+0000 7fa3c8e99700 1 -- 172.21.15.79:0/1917142188 shutdown_connections 2023-10-19T08:38:30.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.553+0000 7fa3c8e99700 1 -- 172.21.15.79:0/1917142188 >> 172.21.15.79:0/1917142188 conn(0x7fa3c406dcc0 msgr2=0x7fa3c406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:30.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.553+0000 7fa3c8e99700 1 -- 172.21.15.79:0/1917142188 shutdown_connections 2023-10-19T08:38:30.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.553+0000 7fa3c8e99700 1 -- 172.21.15.79:0/1917142188 wait complete. 2023-10-19T08:38:30.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.555+0000 7fa3c8e99700 1 Processor -- start 2023-10-19T08:38:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.555+0000 7fa3c8e99700 1 -- start start 2023-10-19T08:38:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.555+0000 7fa3c8e99700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3ac003ff0 0x7fa3c414cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.555+0000 7fa3c8e99700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3c40c6080 0x7fa3c415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.555+0000 7fa3c8e99700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3c415be60 0x7fa3c415c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.555+0000 7fa3c8e99700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c415b760 con 0x7fa3c40c6080 2023-10-19T08:38:30.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.555+0000 7fa3c8e99700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c415c810 con 0x7fa3ac003ff0 2023-10-19T08:38:30.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.555+0000 7fa3c8e99700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c414d190 con 0x7fa3c415be60 2023-10-19T08:38:30.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.555+0000 7fa3c1d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3c40c6080 0x7fa3c415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.555+0000 7fa3c1d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3c40c6080 0x7fa3c415a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46808/0 (socket says 172.21.15.79:46808) 2023-10-19T08:38:30.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.555+0000 7fa3c1d9b700 1 -- 172.21.15.79:0/1840357117 learned_addr learned my addr 172.21.15.79:0/1840357117 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:30.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.556+0000 7fa3c2d9d700 1 --2- 172.21.15.79:0/1840357117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3c415be60 0x7fa3c415c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.556+0000 7fa3c259c700 1 --2- 172.21.15.79:0/1840357117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3ac003ff0 0x7fa3c414cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.556+0000 7fa3c1d9b700 1 -- 172.21.15.79:0/1840357117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3c415be60 msgr2=0x7fa3c415c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:30.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.556+0000 7fa3c1d9b700 1 --2- 172.21.15.79:0/1840357117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3c415be60 0x7fa3c415c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.556+0000 7fa3c1d9b700 1 -- 172.21.15.79:0/1840357117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3ac003ff0 msgr2=0x7fa3c414cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:30.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.556+0000 7fa3c1d9b700 1 --2- 172.21.15.79:0/1840357117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3ac003ff0 0x7fa3c414cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.556+0000 7fa3c1d9b700 1 -- 172.21.15.79:0/1840357117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c40c9140 con 0x7fa3c40c6080 2023-10-19T08:38:30.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.556+0000 7fa3c1d9b700 1 --2- 172.21.15.79:0/1840357117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3c40c6080 0x7fa3c415a1e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800e4b0 tx=0x7fa3b80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:30.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.556+0000 7fa3b2ffd700 1 -- 172.21.15.79:0/1840357117 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8021070 con 0x7fa3c40c6080 2023-10-19T08:38:30.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.556+0000 7fa3b2ffd700 1 -- 172.21.15.79:0/1840357117 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b8004460 con 0x7fa3c40c6080 2023-10-19T08:38:30.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.556+0000 7fa3c8e99700 1 -- 172.21.15.79:0/1840357117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c415aae0 con 0x7fa3c40c6080 2023-10-19T08:38:30.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.556+0000 7fa3b2ffd700 1 -- 172.21.15.79:0/1840357117 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b800e6c0 con 0x7fa3c40c6080 2023-10-19T08:38:30.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.556+0000 7fa3c8e99700 1 -- 172.21.15.79:0/1840357117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c415b0a0 con 0x7fa3c40c6080 2023-10-19T08:38:30.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.557+0000 7fa3c8e99700 1 -- 172.21.15.79:0/1840357117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c404ee70 con 0x7fa3c40c6080 2023-10-19T08:38:30.575 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.558+0000 7fa3b2ffd700 1 -- 172.21.15.79:0/1840357117 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa3b8025070 con 0x7fa3c40c6080 2023-10-19T08:38:30.575 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.558+0000 7fa3b2ffd700 1 --2- 172.21.15.79:0/1840357117 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa3a406a0d0 0x7fa3a406c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.575 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.559+0000 7fa3b2ffd700 1 -- 172.21.15.79:0/1840357117 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa3b8089c50 con 0x7fa3c40c6080 2023-10-19T08:38:30.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.559+0000 7fa3c259c700 1 --2- 172.21.15.79:0/1840357117 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa3a406a0d0 0x7fa3a406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.559+0000 7fa3c259c700 1 --2- 172.21.15.79:0/1840357117 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa3a406a0d0 0x7fa3a406c590 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa3c41f1f10 tx=0x7fa3b4007980 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:30.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.562+0000 7fa3b2ffd700 1 -- 172.21.15.79:0/1840357117 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa3b8055170 con 0x7fa3c40c6080 2023-10-19T08:38:30.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.750+0000 7fa3c8e99700 1 -- 172.21.15.79:0/1840357117 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa3c40cf8b0 con 0x7fa3c40c6080 2023-10-19T08:38:30.754 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.750+0000 7fa3b2ffd700 1 -- 172.21.15.79:0/1840357117 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa3b8058790 con 0x7fa3c40c6080 2023-10-19T08:38:30.754 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:30.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.752+0000 7fa3c8e99700 1 -- 172.21.15.79:0/1840357117 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa3a406a0d0 msgr2=0x7fa3a406c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:30.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.752+0000 7fa3c8e99700 1 --2- 172.21.15.79:0/1840357117 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa3a406a0d0 0x7fa3a406c590 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa3c41f1f10 tx=0x7fa3b4007980 comp rx=0 tx=0).stop 2023-10-19T08:38:30.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.752+0000 7fa3c8e99700 1 -- 172.21.15.79:0/1840357117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3c40c6080 msgr2=0x7fa3c415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:30.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.752+0000 7fa3c8e99700 1 --2- 172.21.15.79:0/1840357117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3c40c6080 0x7fa3c415a1e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800e4b0 tx=0x7fa3b80047c0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.752+0000 7fa3c8e99700 1 -- 172.21.15.79:0/1840357117 shutdown_connections 2023-10-19T08:38:30.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.753+0000 7fa3c8e99700 1 --2- 172.21.15.79:0/1840357117 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa3a406a0d0 0x7fa3a406c590 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.753+0000 7fa3c8e99700 1 --2- 172.21.15.79:0/1840357117 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3c415be60 0x7fa3c415c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.753+0000 7fa3c8e99700 1 --2- 172.21.15.79:0/1840357117 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3ac003ff0 0x7fa3c414cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.753+0000 7fa3c8e99700 1 --2- 172.21.15.79:0/1840357117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3c40c6080 0x7fa3c415a1e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.753+0000 7fa3c8e99700 1 -- 172.21.15.79:0/1840357117 >> 172.21.15.79:0/1840357117 conn(0x7fa3c406dcc0 msgr2=0x7fa3c40cca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:30.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.753+0000 7fa3c8e99700 1 -- 172.21.15.79:0/1840357117 shutdown_connections 2023-10-19T08:38:30.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.753+0000 7fa3c8e99700 1 -- 172.21.15.79:0/1840357117 wait complete. 2023-10-19T08:38:30.768 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T08:38:30.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.888+0000 7f427219b700 1 Processor -- start 2023-10-19T08:38:30.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.888+0000 7f427219b700 1 -- start start 2023-10-19T08:38:30.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.889+0000 7f427219b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f426c0cc640 0x7f426c0cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.889+0000 7f427219b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426c0b24d0 con 0x7f426c0ceaf0 2023-10-19T08:38:30.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.889+0000 7f427219b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426c0ccf60 con 0x7f426c159db0 2023-10-19T08:38:30.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.889+0000 7f427219b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426c15d760 con 0x7f426c0cc640 2023-10-19T08:38:30.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.889+0000 7f426bfff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f426c0ceaf0 0x7f426c0b1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56890/0 (socket says 172.21.15.79:56890) 2023-10-19T08:38:30.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.889+0000 7f426bfff700 1 -- 172.21.15.79:0/334424289 learned_addr learned my addr 172.21.15.79:0/334424289 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:30.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.889+0000 7f426b7fe700 1 --2- 172.21.15.79:0/334424289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f426c0cc640 0x7f426c0cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.889+0000 7f426a7fc700 1 -- 172.21.15.79:0/334424289 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494599397 0 0) 0x7f426c0b24d0 con 0x7f426c0ceaf0 2023-10-19T08:38:30.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.889+0000 7f426a7fc700 1 -- 172.21.15.79:0/334424289 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42540035b0 con 0x7f426c0ceaf0 2023-10-19T08:38:30.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.889+0000 7f426a7fc700 1 -- 172.21.15.79:0/334424289 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1689817130 0 0) 0x7f42540035b0 con 0x7f426c0ceaf0 2023-10-19T08:38:30.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.889+0000 7f426a7fc700 1 -- 172.21.15.79:0/334424289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f426c0cc640 msgr2=0x7f426c0cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:30.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.889+0000 7f426a7fc700 1 --2- 172.21.15.79:0/334424289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f426c0cc640 0x7f426c0cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.889+0000 7f426a7fc700 1 -- 172.21.15.79:0/334424289 >> v1:172.21.15.89:6789/0 conn(0x7f426c159db0 legacy=0x7f426c0b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:30.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.889+0000 7f426a7fc700 1 -- 172.21.15.79:0/334424289 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c15da40 con 0x7f426c0ceaf0 2023-10-19T08:38:30.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426a7fc700 1 -- 172.21.15.79:0/334424289 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f42640019f0 con 0x7f426c0ceaf0 2023-10-19T08:38:30.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426a7fc700 1 -- 172.21.15.79:0/334424289 >> v1:172.21.15.79:6789/0 conn(0x7f426c0ceaf0 legacy=0x7f426c0b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:30.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426a7fc700 1 --2- 172.21.15.79:0/334424289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4254003aa0 0x7f4254003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426a7fc700 1 --2- 172.21.15.79:0/334424289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4254004850 0x7f4254004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426a7fc700 1 --2- 172.21.15.79:0/334424289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f426c0cc640 0x7f4254005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426a7fc700 1 -- 172.21.15.79:0/334424289 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c15d760 con 0x7f4254004850 2023-10-19T08:38:30.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426a7fc700 1 -- 172.21.15.79:0/334424289 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425400bac0 con 0x7f4254003aa0 2023-10-19T08:38:30.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426a7fc700 1 -- 172.21.15.79:0/334424289 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425400bc50 con 0x7f426c0cc640 2023-10-19T08:38:30.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426affd700 1 --2- 172.21.15.79:0/334424289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4254004850 0x7f4254004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426b7fe700 1 --2- 172.21.15.79:0/334424289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4254003aa0 0x7f4254003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426bfff700 1 --2- 172.21.15.79:0/334424289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f426c0cc640 0x7f4254005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426bfff700 1 -- 172.21.15.79:0/334424289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4254003aa0 msgr2=0x7f4254003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:30.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426bfff700 1 --2- 172.21.15.79:0/334424289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4254003aa0 0x7f4254003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426bfff700 1 -- 172.21.15.79:0/334424289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4254004850 msgr2=0x7f4254004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:30.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426bfff700 1 --2- 172.21.15.79:0/334424289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4254004850 0x7f4254004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426bfff700 1 -- 172.21.15.79:0/334424289 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42540035b0 con 0x7f426c0cc640 2023-10-19T08:38:30.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426b7fe700 1 --2- 172.21.15.79:0/334424289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4254003aa0 0x7f4254003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:38:30.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426affd700 1 --2- 172.21.15.79:0/334424289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4254004850 0x7f4254004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:38:30.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426bfff700 1 --2- 172.21.15.79:0/334424289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f426c0cc640 0x7f4254005210 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f426400a830 tx=0x7f4254005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b572712a0317932 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:30.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426a7fc700 1 -- 172.21.15.79:0/334424289 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264012600 con 0x7f426c0cc640 2023-10-19T08:38:30.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426a7fc700 1 -- 172.21.15.79:0/334424289 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4264012780 con 0x7f426c0cc640 2023-10-19T08:38:30.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.890+0000 7f426a7fc700 1 -- 172.21.15.79:0/334424289 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264012b30 con 0x7f426c0cc640 2023-10-19T08:38:30.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.891+0000 7f427219b700 1 -- 172.21.15.79:0/334424289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f426c0cc640 msgr2=0x7f4254005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:30.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.891+0000 7f427219b700 1 --2- 172.21.15.79:0/334424289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f426c0cc640 0x7f4254005210 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f426400a830 tx=0x7f4254005880 comp rx=0 tx=0).stop 2023-10-19T08:38:30.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.891+0000 7f426bfff700 1 -- 172.21.15.79:0/334424289 reap_dead start 2023-10-19T08:38:30.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.891+0000 7f427219b700 1 -- 172.21.15.79:0/334424289 shutdown_connections 2023-10-19T08:38:30.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.891+0000 7f427219b700 1 -- 172.21.15.79:0/334424289 >> 172.21.15.79:0/334424289 conn(0x7f426c06dcc0 msgr2=0x7f426c06e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:30.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.891+0000 7f427219b700 1 -- 172.21.15.79:0/334424289 shutdown_connections 2023-10-19T08:38:30.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.891+0000 7f427219b700 1 -- 172.21.15.79:0/334424289 wait complete. 2023-10-19T08:38:30.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.892+0000 7f427219b700 1 Processor -- start 2023-10-19T08:38:30.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.892+0000 7f427219b700 1 -- start start 2023-10-19T08:38:30.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.893+0000 7f427219b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f426c1f2690 0x7f426c15b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.893+0000 7f427219b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f426c15bc70 0x7f426c0b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.893+0000 7f427219b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f426c1f2a70 0x7f426c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.893+0000 7f427219b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c15cd20 con 0x7f426c1f2a70 2023-10-19T08:38:30.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.893+0000 7f427219b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c15d1b0 con 0x7f426c15bc70 2023-10-19T08:38:30.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.893+0000 7f427219b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426c15c110 con 0x7f426c1f2690 2023-10-19T08:38:30.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.893+0000 7f426bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f426c1f2a70 0x7f426c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.893+0000 7f426bfff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f426c1f2a70 0x7f426c0b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46830/0 (socket says 172.21.15.79:46830) 2023-10-19T08:38:30.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.893+0000 7f426bfff700 1 -- 172.21.15.79:0/3949742140 learned_addr learned my addr 172.21.15.79:0/3949742140 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:30.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.893+0000 7f426affd700 1 --2- 172.21.15.79:0/3949742140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f426c15bc70 0x7f426c0b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.893+0000 7f426b7fe700 1 --2- 172.21.15.79:0/3949742140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f426c1f2690 0x7f426c15b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.893+0000 7f426bfff700 1 -- 172.21.15.79:0/3949742140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f426c1f2690 msgr2=0x7f426c15b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:30.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.893+0000 7f426bfff700 1 --2- 172.21.15.79:0/3949742140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f426c1f2690 0x7f426c15b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.893+0000 7f426bfff700 1 -- 172.21.15.79:0/3949742140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f426c15bc70 msgr2=0x7f426c0b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:30.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.893+0000 7f426bfff700 1 --2- 172.21.15.79:0/3949742140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f426c15bc70 0x7f426c0b4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:30.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.893+0000 7f426bfff700 1 -- 172.21.15.79:0/3949742140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c15c3f0 con 0x7f426c1f2a70 2023-10-19T08:38:30.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.893+0000 7f426b7fe700 1 --2- 172.21.15.79:0/3949742140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f426c1f2690 0x7f426c15b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:30.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.894+0000 7f426bfff700 1 --2- 172.21.15.79:0/3949742140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f426c1f2a70 0x7f426c0b4740 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4264015040 tx=0x7f4264001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:30.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.894+0000 7f4253fff700 1 -- 172.21.15.79:0/3949742140 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264020070 con 0x7f426c1f2a70 2023-10-19T08:38:30.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.894+0000 7f4253fff700 1 -- 172.21.15.79:0/3949742140 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426400a2e0 con 0x7f426c1f2a70 2023-10-19T08:38:30.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.894+0000 7f427219b700 1 -- 172.21.15.79:0/3949742140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426c15c6d0 con 0x7f426c1f2a70 2023-10-19T08:38:30.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.894+0000 7f4253fff700 1 -- 172.21.15.79:0/3949742140 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264019640 con 0x7f426c1f2a70 2023-10-19T08:38:30.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.894+0000 7f427219b700 1 -- 172.21.15.79:0/3949742140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426c0c4e30 con 0x7f426c1f2a70 2023-10-19T08:38:30.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.895+0000 7f427219b700 1 -- 172.21.15.79:0/3949742140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426c15ce90 con 0x7f426c1f2a70 2023-10-19T08:38:30.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.895+0000 7f4253fff700 1 -- 172.21.15.79:0/3949742140 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f42640197a0 con 0x7f426c1f2a70 2023-10-19T08:38:30.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.896+0000 7f4253fff700 1 --2- 172.21.15.79:0/3949742140 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f425806a0e0 0x7f425806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:30.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.896+0000 7f4253fff700 1 -- 172.21.15.79:0/3949742140 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f426408ad40 con 0x7f426c1f2a70 2023-10-19T08:38:30.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.896+0000 7f426b7fe700 1 --2- 172.21.15.79:0/3949742140 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f425806a0e0 0x7f425806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:30.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.896+0000 7f426b7fe700 1 --2- 172.21.15.79:0/3949742140 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f425806a0e0 0x7f425806c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f425c009c60 tx=0x7f425c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:30.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:30.900+0000 7f4253fff700 1 -- 172.21.15.79:0/3949742140 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f42640561d0 con 0x7f426c1f2a70 2023-10-19T08:38:31.039 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-19T08:38:31.041 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-19T08:38:31.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.092+0000 7f427219b700 1 -- 172.21.15.79:0/3949742140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f426c0c4ff0 con 0x7f426c1f2a70 2023-10-19T08:38:31.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.093+0000 7f4253fff700 1 -- 172.21.15.79:0/3949742140 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f426401d020 con 0x7f426c1f2a70 2023-10-19T08:38:31.096 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-19T08:38:31.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.095+0000 7f427219b700 1 -- 172.21.15.79:0/3949742140 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f425806a0e0 msgr2=0x7f425806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:31.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.095+0000 7f427219b700 1 --2- 172.21.15.79:0/3949742140 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f425806a0e0 0x7f425806c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f425c009c60 tx=0x7f425c008040 comp rx=0 tx=0).stop 2023-10-19T08:38:31.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.095+0000 7f427219b700 1 -- 172.21.15.79:0/3949742140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f426c1f2a70 msgr2=0x7f426c0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:31.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.095+0000 7f427219b700 1 --2- 172.21.15.79:0/3949742140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f426c1f2a70 0x7f426c0b4740 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4264015040 tx=0x7f4264001d80 comp rx=0 tx=0).stop 2023-10-19T08:38:31.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.095+0000 7f427219b700 1 -- 172.21.15.79:0/3949742140 shutdown_connections 2023-10-19T08:38:31.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.095+0000 7f427219b700 1 --2- 172.21.15.79:0/3949742140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f426c1f2a70 0x7f426c0b4740 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.095+0000 7f427219b700 1 --2- 172.21.15.79:0/3949742140 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f425806a0e0 0x7f425806c5a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.095+0000 7f427219b700 1 --2- 172.21.15.79:0/3949742140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f426c1f2690 0x7f426c15b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.095+0000 7f427219b700 1 --2- 172.21.15.79:0/3949742140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f426c15bc70 0x7f426c0b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.095+0000 7f427219b700 1 -- 172.21.15.79:0/3949742140 >> 172.21.15.79:0/3949742140 conn(0x7f426c06dcc0 msgr2=0x7f426c0cb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:31.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.095+0000 7f427219b700 1 -- 172.21.15.79:0/3949742140 shutdown_connections 2023-10-19T08:38:31.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.095+0000 7f427219b700 1 -- 172.21.15.79:0/3949742140 wait complete. 2023-10-19T08:38:31.110 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T08:38:31.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.271+0000 7fec4d12c700 1 Processor -- start 2023-10-19T08:38:31.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.271+0000 7fec4d12c700 1 -- start start 2023-10-19T08:38:31.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.272+0000 7fec4d12c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fec480cd270 0x7fec4806a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:31.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.272+0000 7fec4d12c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fec480703b0 0x7fec4806a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:31.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.272+0000 7fec4d12c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec480b1fe0 con 0x7fec4806f910 2023-10-19T08:38:31.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.272+0000 7fec4d12c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec48160a80 con 0x7fec480703b0 2023-10-19T08:38:31.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.272+0000 7fec4d12c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec480ce2b0 con 0x7fec480cd270 2023-10-19T08:38:31.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.272+0000 7fec4659c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fec480703b0 0x7fec4806a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:31.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.272+0000 7fec4659c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fec480703b0 0x7fec4806a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46834/0 (socket says 172.21.15.79:46834) 2023-10-19T08:38:31.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.272+0000 7fec4659c700 1 -- 172.21.15.79:0/4123594987 learned_addr learned my addr 172.21.15.79:0/4123594987 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:31.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.272+0000 7fec4759e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fec4806f910 0x7fec48160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56910/0 (socket says 172.21.15.79:56910) 2023-10-19T08:38:31.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.272+0000 7fec46d9d700 1 --2- 172.21.15.79:0/4123594987 >> v2:172.21.15.89:3300/0 conn(0x7fec480cd270 0x7fec4806a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:31.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.272+0000 7fec4659c700 1 -- 172.21.15.79:0/4123594987 >> v2:172.21.15.89:3300/0 conn(0x7fec480cd270 msgr2=0x7fec4806a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:31.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.272+0000 7fec4659c700 1 --2- 172.21.15.79:0/4123594987 >> v2:172.21.15.89:3300/0 conn(0x7fec480cd270 0x7fec4806a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.272+0000 7fec4659c700 1 -- 172.21.15.79:0/4123594987 >> v1:172.21.15.79:6789/0 conn(0x7fec4806f910 legacy=0x7fec48160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:31.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.272+0000 7fec4659c700 1 -- 172.21.15.79:0/4123594987 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec480ce550 con 0x7fec480703b0 2023-10-19T08:38:31.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.272+0000 7fec4659c700 1 --2- 172.21.15.79:0/4123594987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec480703b0 0x7fec4806a760 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fec480717c0 tx=0x7fec38009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8eadb90424a3e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:31.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.272+0000 7fec45d9b700 1 -- 172.21.15.79:0/4123594987 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3800b870 con 0x7fec480703b0 2023-10-19T08:38:31.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.272+0000 7fec45d9b700 1 -- 172.21.15.79:0/4123594987 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3800b9d0 con 0x7fec480703b0 2023-10-19T08:38:31.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.272+0000 7fec45d9b700 1 -- 172.21.15.79:0/4123594987 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3800bd60 con 0x7fec480703b0 2023-10-19T08:38:31.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.273+0000 7fec4d12c700 1 -- 172.21.15.79:0/4123594987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec480703b0 msgr2=0x7fec4806a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:31.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.273+0000 7fec4d12c700 1 --2- 172.21.15.79:0/4123594987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec480703b0 0x7fec4806a760 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fec480717c0 tx=0x7fec38009bd0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.273+0000 7fec4d12c700 1 -- 172.21.15.79:0/4123594987 shutdown_connections 2023-10-19T08:38:31.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.273+0000 7fec4d12c700 1 --2- 172.21.15.79:0/4123594987 >> v2:172.21.15.89:3300/0 conn(0x7fec480cd270 0x7fec4806a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.273+0000 7fec4d12c700 1 --2- 172.21.15.79:0/4123594987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec480703b0 0x7fec4806a760 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.273+0000 7fec4d12c700 1 -- 172.21.15.79:0/4123594987 >> 172.21.15.79:0/4123594987 conn(0x7fec4806dcc0 msgr2=0x7fec4806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:31.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.273+0000 7fec4d12c700 1 -- 172.21.15.79:0/4123594987 shutdown_connections 2023-10-19T08:38:31.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.273+0000 7fec4d12c700 1 -- 172.21.15.79:0/4123594987 wait complete. 2023-10-19T08:38:31.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.274+0000 7fec4d12c700 1 Processor -- start 2023-10-19T08:38:31.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.274+0000 7fec4d12c700 1 -- start start 2023-10-19T08:38:31.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.275+0000 7fec4d12c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec4806f910 0x7fec4815b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:31.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.275+0000 7fec4d12c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec480703b0 0x7fec480b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:31.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.275+0000 7fec4d12c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec480cd270 0x7fec480b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:31.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.275+0000 7fec4d12c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec480c9190 con 0x7fec480703b0 2023-10-19T08:38:31.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.275+0000 7fec4d12c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec481f29f0 con 0x7fec4806f910 2023-10-19T08:38:31.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.275+0000 7fec4d12c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec480c9430 con 0x7fec480cd270 2023-10-19T08:38:31.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.275+0000 7fec4659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec480703b0 0x7fec480b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:31.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.275+0000 7fec4659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec480703b0 0x7fec480b01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46842/0 (socket says 172.21.15.79:46842) 2023-10-19T08:38:31.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.275+0000 7fec4659c700 1 -- 172.21.15.79:0/949832687 learned_addr learned my addr 172.21.15.79:0/949832687 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:31.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.275+0000 7fec46d9d700 1 --2- 172.21.15.79:0/949832687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec4806f910 0x7fec4815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:31.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.275+0000 7fec4759e700 1 --2- 172.21.15.79:0/949832687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec480cd270 0x7fec480b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:31.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.276+0000 7fec4659c700 1 -- 172.21.15.79:0/949832687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec480cd270 msgr2=0x7fec480b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:31.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.276+0000 7fec4659c700 1 --2- 172.21.15.79:0/949832687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec480cd270 0x7fec480b06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.276+0000 7fec4659c700 1 -- 172.21.15.79:0/949832687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec4806f910 msgr2=0x7fec4815b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:31.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.276+0000 7fec4659c700 1 --2- 172.21.15.79:0/949832687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec4806f910 0x7fec4815b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.276+0000 7fec4659c700 1 -- 172.21.15.79:0/949832687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec38009550 con 0x7fec480703b0 2023-10-19T08:38:31.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.276+0000 7fec46d9d700 1 --2- 172.21.15.79:0/949832687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec4806f910 0x7fec4815b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:31.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.276+0000 7fec4659c700 1 --2- 172.21.15.79:0/949832687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec480703b0 0x7fec480b01a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fec38000c00 tx=0x7fec38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:31.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.276+0000 7fec2f7fe700 1 -- 172.21.15.79:0/949832687 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec38004520 con 0x7fec480703b0 2023-10-19T08:38:31.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.276+0000 7fec2f7fe700 1 -- 172.21.15.79:0/949832687 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3801e070 con 0x7fec480703b0 2023-10-19T08:38:31.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.276+0000 7fec4d12c700 1 -- 172.21.15.79:0/949832687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec480c9710 con 0x7fec480703b0 2023-10-19T08:38:31.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.276+0000 7fec2f7fe700 1 -- 172.21.15.79:0/949832687 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec380038a0 con 0x7fec480703b0 2023-10-19T08:38:31.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.276+0000 7fec4d12c700 1 -- 172.21.15.79:0/949832687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec480ae2e0 con 0x7fec480703b0 2023-10-19T08:38:31.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.277+0000 7fec4d12c700 1 -- 172.21.15.79:0/949832687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4804ee70 con 0x7fec480703b0 2023-10-19T08:38:31.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.277+0000 7fec2f7fe700 1 -- 172.21.15.79:0/949832687 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fec38003a00 con 0x7fec480703b0 2023-10-19T08:38:31.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.278+0000 7fec2f7fe700 1 --2- 172.21.15.79:0/949832687 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fec3406a0e0 0x7fec3406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:31.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.278+0000 7fec2f7fe700 1 -- 172.21.15.79:0/949832687 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fec38020070 con 0x7fec480703b0 2023-10-19T08:38:31.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.278+0000 7fec46d9d700 1 --2- 172.21.15.79:0/949832687 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fec3406a0e0 0x7fec3406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:31.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.278+0000 7fec46d9d700 1 --2- 172.21.15.79:0/949832687 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fec3406a0e0 0x7fec3406c5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fec3c009a00 tx=0x7fec3c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:31.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.282+0000 7fec2f7fe700 1 -- 172.21.15.79:0/949832687 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fec38055260 con 0x7fec480703b0 2023-10-19T08:38:31.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.470+0000 7fec4d12c700 1 -- 172.21.15.79:0/949832687 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fec480cc0d0 con 0x7fec480703b0 2023-10-19T08:38:31.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.471+0000 7fec2f7fe700 1 -- 172.21.15.79:0/949832687 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fec380150a0 con 0x7fec480703b0 2023-10-19T08:38:31.475 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:31.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.473+0000 7fec4d12c700 1 -- 172.21.15.79:0/949832687 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fec3406a0e0 msgr2=0x7fec3406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:31.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.473+0000 7fec4d12c700 1 --2- 172.21.15.79:0/949832687 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fec3406a0e0 0x7fec3406c5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fec3c009a00 tx=0x7fec3c008040 comp rx=0 tx=0).stop 2023-10-19T08:38:31.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.473+0000 7fec4d12c700 1 -- 172.21.15.79:0/949832687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec480703b0 msgr2=0x7fec480b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.473+0000 7fec4d12c700 1 --2- 172.21.15.79:0/949832687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec480703b0 0x7fec480b01a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fec38000c00 tx=0x7fec38004750 comp rx=0 tx=0).stop 2023-10-19T08:38:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.473+0000 7fec4d12c700 1 -- 172.21.15.79:0/949832687 shutdown_connections 2023-10-19T08:38:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.473+0000 7fec4d12c700 1 --2- 172.21.15.79:0/949832687 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fec3406a0e0 0x7fec3406c5a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.473+0000 7fec4d12c700 1 --2- 172.21.15.79:0/949832687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec480cd270 0x7fec480b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.473+0000 7fec4d12c700 1 --2- 172.21.15.79:0/949832687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec4806f910 0x7fec4815b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.473+0000 7fec4d12c700 1 --2- 172.21.15.79:0/949832687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec480703b0 0x7fec480b01a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.473+0000 7fec4d12c700 1 -- 172.21.15.79:0/949832687 >> 172.21.15.79:0/949832687 conn(0x7fec4806dcc0 msgr2=0x7fec481600c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.473+0000 7fec4d12c700 1 -- 172.21.15.79:0/949832687 shutdown_connections 2023-10-19T08:38:31.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.473+0000 7fec4d12c700 1 -- 172.21.15.79:0/949832687 wait complete. 2023-10-19T08:38:31.489 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T08:38:31.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.606+0000 7fe3ad7c4700 1 Processor -- start 2023-10-19T08:38:31.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.606+0000 7fe3ad7c4700 1 -- start start 2023-10-19T08:38:31.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.607+0000 7fe3ad7c4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe3a8160380 0x7fe3a80cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:31.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.607+0000 7fe3ad7c4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a80cf7a0 0x7fe3a806b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:31.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.607+0000 7fe3ad7c4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe3a806b870 0x7fe3a80d1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:31.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.607+0000 7fe3ad7c4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a806c3f0 con 0x7fe3a8160380 2023-10-19T08:38:31.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.607+0000 7fe3ad7c4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a806be30 con 0x7fe3a806b870 2023-10-19T08:38:31.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.607+0000 7fe3ad7c4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a806c110 con 0x7fe3a80cf7a0 2023-10-19T08:38:31.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.607+0000 7fe3a6ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe3a8160380 0x7fe3a80cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:31.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.607+0000 7fe3a6ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe3a8160380 0x7fe3a80cf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46848/0 (socket says 172.21.15.79:46848) 2023-10-19T08:38:31.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.607+0000 7fe3a6ffd700 1 -- 172.21.15.79:0/2321014714 learned_addr learned my addr 172.21.15.79:0/2321014714 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:31.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.607+0000 7fe3a6ffd700 1 -- 172.21.15.79:0/2321014714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a80cf7a0 msgr2=0x7fe3a806b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:31.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.607+0000 7fe3a6ffd700 1 --2- 172.21.15.79:0/2321014714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a80cf7a0 0x7fe3a806b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.607+0000 7fe3a6ffd700 1 -- 172.21.15.79:0/2321014714 >> v2:172.21.15.89:3300/0 conn(0x7fe3a806b870 msgr2=0x7fe3a80d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:31.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.607+0000 7fe3a6ffd700 1 --2- 172.21.15.79:0/2321014714 >> v2:172.21.15.89:3300/0 conn(0x7fe3a806b870 0x7fe3a80d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.607+0000 7fe3a6ffd700 1 -- 172.21.15.79:0/2321014714 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a80cea60 con 0x7fe3a8160380 2023-10-19T08:38:31.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.607+0000 7fe3a6ffd700 1 --2- 172.21.15.79:0/2321014714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a8160380 0x7fe3a80cf260 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80c47f0 tx=0x7fe39c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5895e4064f3599c server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:31.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.607+0000 7fe3a5ffb700 1 -- 172.21.15.79:0/2321014714 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00b870 con 0x7fe3a8160380 2023-10-19T08:38:31.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.608+0000 7fe3a5ffb700 1 -- 172.21.15.79:0/2321014714 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c00b9d0 con 0x7fe3a8160380 2023-10-19T08:38:31.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.608+0000 7fe3a5ffb700 1 -- 172.21.15.79:0/2321014714 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00bd60 con 0x7fe3a8160380 2023-10-19T08:38:31.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.608+0000 7fe3ad7c4700 1 -- 172.21.15.79:0/2321014714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a8160380 msgr2=0x7fe3a80cf260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:31.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.608+0000 7fe3ad7c4700 1 --2- 172.21.15.79:0/2321014714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a8160380 0x7fe3a80cf260 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80c47f0 tx=0x7fe39c009bd0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.608+0000 7fe3ad7c4700 1 -- 172.21.15.79:0/2321014714 shutdown_connections 2023-10-19T08:38:31.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.608+0000 7fe3ad7c4700 1 --2- 172.21.15.79:0/2321014714 >> v2:172.21.15.89:3300/0 conn(0x7fe3a806b870 0x7fe3a80d1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.608+0000 7fe3ad7c4700 1 --2- 172.21.15.79:0/2321014714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a8160380 0x7fe3a80cf260 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.608+0000 7fe3ad7c4700 1 --2- 172.21.15.79:0/2321014714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a80cf7a0 0x7fe3a806b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.608+0000 7fe3ad7c4700 1 -- 172.21.15.79:0/2321014714 >> 172.21.15.79:0/2321014714 conn(0x7fe3a806a400 msgr2=0x7fe3a806a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:31.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.608+0000 7fe3ad7c4700 1 -- 172.21.15.79:0/2321014714 shutdown_connections 2023-10-19T08:38:31.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.608+0000 7fe3ad7c4700 1 -- 172.21.15.79:0/2321014714 wait complete. 2023-10-19T08:38:31.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.609+0000 7fe3ad7c4700 1 Processor -- start 2023-10-19T08:38:31.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.609+0000 7fe3ad7c4700 1 -- start start 2023-10-19T08:38:31.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.610+0000 7fe3ad7c4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a806b870 0x7fe3a815f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:31.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.610+0000 7fe3ad7c4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3a8160380 0x7fe3a815c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:31.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.610+0000 7fe3ad7c4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a8156270 0x7fe3a81f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:31.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.610+0000 7fe3ad7c4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a815d7d0 con 0x7fe3a806b870 2023-10-19T08:38:31.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.610+0000 7fe3ad7c4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a815cbc0 con 0x7fe3a8160380 2023-10-19T08:38:31.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.610+0000 7fe3ad7c4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a815cea0 con 0x7fe3a8156270 2023-10-19T08:38:31.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.610+0000 7fe3a6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a806b870 0x7fe3a815f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:31.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.610+0000 7fe3a6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a806b870 0x7fe3a815f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46852/0 (socket says 172.21.15.79:46852) 2023-10-19T08:38:31.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.610+0000 7fe3a6ffd700 1 -- 172.21.15.79:0/3273982565 learned_addr learned my addr 172.21.15.79:0/3273982565 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:31.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.610+0000 7fe3a6ffd700 1 -- 172.21.15.79:0/3273982565 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a8156270 msgr2=0x7fe3a81f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:31.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.610+0000 7fe3a6ffd700 1 --2- 172.21.15.79:0/3273982565 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a8156270 0x7fe3a81f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.610+0000 7fe3a6ffd700 1 -- 172.21.15.79:0/3273982565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3a8160380 msgr2=0x7fe3a815c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:31.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.610+0000 7fe3a6ffd700 1 --2- 172.21.15.79:0/3273982565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3a8160380 0x7fe3a815c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.610+0000 7fe3a6ffd700 1 -- 172.21.15.79:0/3273982565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c009550 con 0x7fe3a806b870 2023-10-19T08:38:31.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.611+0000 7fe3a6ffd700 1 --2- 172.21.15.79:0/3273982565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a806b870 0x7fe3a815f000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80d1df0 tx=0x7fe39c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:31.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.611+0000 7fe38f7fe700 1 -- 172.21.15.79:0/3273982565 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c004310 con 0x7fe3a806b870 2023-10-19T08:38:31.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.611+0000 7fe38f7fe700 1 -- 172.21.15.79:0/3273982565 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c01f070 con 0x7fe3a806b870 2023-10-19T08:38:31.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.611+0000 7fe3ad7c4700 1 -- 172.21.15.79:0/3273982565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a815d180 con 0x7fe3a806b870 2023-10-19T08:38:31.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.611+0000 7fe38f7fe700 1 -- 172.21.15.79:0/3273982565 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0036a0 con 0x7fe3a806b870 2023-10-19T08:38:31.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.611+0000 7fe3ad7c4700 1 -- 172.21.15.79:0/3273982565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a8156720 con 0x7fe3a806b870 2023-10-19T08:38:31.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.612+0000 7fe3ad7c4700 1 -- 172.21.15.79:0/3273982565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a804ee70 con 0x7fe3a806b870 2023-10-19T08:38:31.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.612+0000 7fe38f7fe700 1 -- 172.21.15.79:0/3273982565 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe39c021030 con 0x7fe3a806b870 2023-10-19T08:38:31.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.613+0000 7fe38f7fe700 1 --2- 172.21.15.79:0/3273982565 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe39406a110 0x7fe39406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:31.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.613+0000 7fe38f7fe700 1 -- 172.21.15.79:0/3273982565 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe39c089ce0 con 0x7fe3a806b870 2023-10-19T08:38:31.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.613+0000 7fe3a67fc700 1 --2- 172.21.15.79:0/3273982565 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe39406a110 0x7fe39406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:31.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.613+0000 7fe3a67fc700 1 --2- 172.21.15.79:0/3273982565 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe39406a110 0x7fe39406c5d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80c72b0 tx=0x7fe398006d20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:31.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.617+0000 7fe38f7fe700 1 -- 172.21.15.79:0/3273982565 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fe39c055170 con 0x7fe3a806b870 2023-10-19T08:38:31.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.847+0000 7fe3ad7c4700 1 -- 172.21.15.79:0/3273982565 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3a80c6c70 con 0x7fe3a806b870 2023-10-19T08:38:31.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.847+0000 7fe38f7fe700 1 -- 172.21.15.79:0/3273982565 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4865 (secure 0 0 0) 0x7fe39c058790 con 0x7fe3a806b870 2023-10-19T08:38:31.852 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:31.852 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3710906518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3710906518},{"type":"v1","addr":"172.21.15.89:6835","nonce":3710906518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3037310614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3037310614},{"type":"v1","addr":"172.21.15.79:6835","nonce":3037310614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/79656061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":79656061},{"type":"v1","addr":"172.21.15.79:6837","nonce":79656061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-19T08:37:56.667105+0000","modified":"2023-10-19T08:38:20.379674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6833/3076620199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3076620199},{"type":"v1","addr":"172.21.15.89:6833","nonce":3076620199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-19T08:38:31.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.850+0000 7fe3ad7c4700 1 -- 172.21.15.79:0/3273982565 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe39406a110 msgr2=0x7fe39406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:31.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.850+0000 7fe3ad7c4700 1 --2- 172.21.15.79:0/3273982565 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe39406a110 0x7fe39406c5d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80c72b0 tx=0x7fe398006d20 comp rx=0 tx=0).stop 2023-10-19T08:38:31.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.850+0000 7fe3ad7c4700 1 -- 172.21.15.79:0/3273982565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a806b870 msgr2=0x7fe3a815f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:31.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.850+0000 7fe3ad7c4700 1 --2- 172.21.15.79:0/3273982565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a806b870 0x7fe3a815f000 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe3a80d1df0 tx=0x7fe39c004750 comp rx=0 tx=0).stop 2023-10-19T08:38:31.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.850+0000 7fe3ad7c4700 1 -- 172.21.15.79:0/3273982565 shutdown_connections 2023-10-19T08:38:31.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.850+0000 7fe3ad7c4700 1 --2- 172.21.15.79:0/3273982565 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe39406a110 0x7fe39406c5d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.850+0000 7fe3ad7c4700 1 --2- 172.21.15.79:0/3273982565 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3a8156270 0x7fe3a81f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.850+0000 7fe3ad7c4700 1 --2- 172.21.15.79:0/3273982565 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe3a806b870 0x7fe3a815f000 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.850+0000 7fe3ad7c4700 1 --2- 172.21.15.79:0/3273982565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe3a8160380 0x7fe3a815c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.850+0000 7fe3ad7c4700 1 -- 172.21.15.79:0/3273982565 >> 172.21.15.79:0/3273982565 conn(0x7fe3a806a400 msgr2=0x7fe3a806c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:31.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.850+0000 7fe3ad7c4700 1 -- 172.21.15.79:0/3273982565 shutdown_connections 2023-10-19T08:38:31.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.850+0000 7fe3ad7c4700 1 -- 172.21.15.79:0/3273982565 wait complete. 2023-10-19T08:38:31.856 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 9 2023-10-19T08:38:31.865 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:31.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.981+0000 7f3954703700 1 Processor -- start 2023-10-19T08:38:31.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.981+0000 7f3954703700 1 -- start start 2023-10-19T08:38:31.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.982+0000 7f3954703700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f394c0af170 0x7f394c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:31.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.982+0000 7f3954703700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f394c0b2270 0x7f394c06a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:31.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.982+0000 7f3954703700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394c15de50 con 0x7f394c0b1de0 2023-10-19T08:38:31.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.982+0000 7f3954703700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394c0af550 con 0x7f394c0b2270 2023-10-19T08:38:31.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.982+0000 7f3954703700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394c0b26c0 con 0x7f394c0af170 2023-10-19T08:38:31.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.983+0000 7f3952ca0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f394c0b2270 0x7f394c06a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:31.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.983+0000 7f3952ca0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f394c0b2270 0x7f394c06a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46862/0 (socket says 172.21.15.79:46862) 2023-10-19T08:38:31.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.983+0000 7f3951c9e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f394c0b1de0 0x7f394c0cd800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56932/0 (socket says 172.21.15.79:56932) 2023-10-19T08:38:31.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.983+0000 7f3952ca0700 1 -- 172.21.15.79:0/486597366 learned_addr learned my addr 172.21.15.79:0/486597366 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:31.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.983+0000 7f395249f700 1 --2- 172.21.15.79:0/486597366 >> v2:172.21.15.89:3300/0 conn(0x7f394c0af170 0x7f394c0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:31.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.983+0000 7f3952ca0700 1 -- 172.21.15.79:0/486597366 >> v2:172.21.15.89:3300/0 conn(0x7f394c0af170 msgr2=0x7f394c0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:31.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.983+0000 7f3952ca0700 1 --2- 172.21.15.79:0/486597366 >> v2:172.21.15.89:3300/0 conn(0x7f394c0af170 0x7f394c0cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.983+0000 7f3952ca0700 1 -- 172.21.15.79:0/486597366 >> v1:172.21.15.79:6789/0 conn(0x7f394c0b1de0 legacy=0x7f394c0cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:31.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.983+0000 7f3952ca0700 1 -- 172.21.15.79:0/486597366 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c15e130 con 0x7f394c0b2270 2023-10-19T08:38:31.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.983+0000 7f395149d700 1 -- 172.21.15.79:0/486597366 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25309100 0 0) 0x7f394c15de50 con 0x7f394c0b1de0 2023-10-19T08:38:31.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.983+0000 7f395249f700 1 --2- 172.21.15.79:0/486597366 >> v2:172.21.15.89:3300/0 conn(0x7f394c0af170 0x7f394c0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:31.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.983+0000 7f3952ca0700 1 --2- 172.21.15.79:0/486597366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c0b2270 0x7f394c06a220 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3944009e50 tx=0x7f394400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62509be0ab129d7c server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:31.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.983+0000 7f395149d700 1 -- 172.21.15.79:0/486597366 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394400e070 con 0x7f394c0b2270 2023-10-19T08:38:31.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.983+0000 7f395149d700 1 -- 172.21.15.79:0/486597366 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394400b980 con 0x7f394c0b2270 2023-10-19T08:38:31.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.983+0000 7f395149d700 1 -- 172.21.15.79:0/486597366 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394400bd30 con 0x7f394c0b2270 2023-10-19T08:38:31.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.984+0000 7f3954703700 1 -- 172.21.15.79:0/486597366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c0b2270 msgr2=0x7f394c06a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:31.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.984+0000 7f3954703700 1 --2- 172.21.15.79:0/486597366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c0b2270 0x7f394c06a220 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3944009e50 tx=0x7f394400b330 comp rx=0 tx=0).stop 2023-10-19T08:38:31.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.984+0000 7f3954703700 1 -- 172.21.15.79:0/486597366 shutdown_connections 2023-10-19T08:38:31.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.984+0000 7f3954703700 1 --2- 172.21.15.79:0/486597366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c0b2270 0x7f394c06a220 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.984+0000 7f3954703700 1 --2- 172.21.15.79:0/486597366 >> v2:172.21.15.89:3300/0 conn(0x7f394c0af170 0x7f394c0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.984+0000 7f3954703700 1 -- 172.21.15.79:0/486597366 >> 172.21.15.79:0/486597366 conn(0x7f394c06dcc0 msgr2=0x7f394c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:31.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.984+0000 7f3954703700 1 -- 172.21.15.79:0/486597366 shutdown_connections 2023-10-19T08:38:31.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.984+0000 7f3954703700 1 -- 172.21.15.79:0/486597366 wait complete. 2023-10-19T08:38:31.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.985+0000 7f3954703700 1 Processor -- start 2023-10-19T08:38:31.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.985+0000 7f3954703700 1 -- start start 2023-10-19T08:38:31.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3954703700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c0af170 0x7f394c0b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:31.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3954703700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c0b1de0 0x7f394c1f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:31.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3954703700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c0b2270 0x7f394c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:31.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3954703700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0b5230 con 0x7f394c0b2270 2023-10-19T08:38:31.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3954703700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c1f2820 con 0x7f394c0b1de0 2023-10-19T08:38:31.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3954703700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c0b5650 con 0x7f394c0af170 2023-10-19T08:38:31.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3952ca0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c0b2270 0x7f394c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:31.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3952ca0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c0b2270 0x7f394c0b3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46868/0 (socket says 172.21.15.79:46868) 2023-10-19T08:38:31.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3952ca0700 1 -- 172.21.15.79:0/2060792497 learned_addr learned my addr 172.21.15.79:0/2060792497 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:31.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f395249f700 1 --2- 172.21.15.79:0/2060792497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c0af170 0x7f394c0b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:31.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3951c9e700 1 --2- 172.21.15.79:0/2060792497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c0b1de0 0x7f394c1f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:31.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3952ca0700 1 -- 172.21.15.79:0/2060792497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c0af170 msgr2=0x7f394c0b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:31.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3952ca0700 1 --2- 172.21.15.79:0/2060792497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c0af170 0x7f394c0b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3952ca0700 1 -- 172.21.15.79:0/2060792497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c0b1de0 msgr2=0x7f394c1f22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:31.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3952ca0700 1 --2- 172.21.15.79:0/2060792497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c0b1de0 0x7f394c1f22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:31.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3952ca0700 1 -- 172.21.15.79:0/2060792497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3944009b30 con 0x7f394c0b2270 2023-10-19T08:38:31.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f395249f700 1 --2- 172.21.15.79:0/2060792497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c0af170 0x7f394c0b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:31.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3952ca0700 1 --2- 172.21.15.79:0/2060792497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c0b2270 0x7f394c0b3da0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f394c067670 tx=0x7f3944004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:31.999 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3942ffd700 1 -- 172.21.15.79:0/2060792497 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39440099b0 con 0x7f394c0b2270 2023-10-19T08:38:32.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3942ffd700 1 -- 172.21.15.79:0/2060792497 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39440092e0 con 0x7f394c0b2270 2023-10-19T08:38:32.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3954703700 1 -- 172.21.15.79:0/2060792497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394c0b42e0 con 0x7f394c0b2270 2023-10-19T08:38:32.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3942ffd700 1 -- 172.21.15.79:0/2060792497 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394401b630 con 0x7f394c0b2270 2023-10-19T08:38:32.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.986+0000 7f3954703700 1 -- 172.21.15.79:0/2060792497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394c0b4890 con 0x7f394c0b2270 2023-10-19T08:38:32.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.987+0000 7f3954703700 1 -- 172.21.15.79:0/2060792497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394c0b5370 con 0x7f394c0b2270 2023-10-19T08:38:32.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.988+0000 7f3942ffd700 1 -- 172.21.15.79:0/2060792497 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f394401b790 con 0x7f394c0b2270 2023-10-19T08:38:32.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.988+0000 7f3942ffd700 1 --2- 172.21.15.79:0/2060792497 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f393006a0e0 0x7f393006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:32.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.988+0000 7f3942ffd700 1 -- 172.21.15.79:0/2060792497 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f394408a050 con 0x7f394c0b2270 2023-10-19T08:38:32.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.988+0000 7f395249f700 1 --2- 172.21.15.79:0/2060792497 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f393006a0e0 0x7f393006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:32.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.988+0000 7f395249f700 1 --2- 172.21.15.79:0/2060792497 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f393006a0e0 0x7f393006c5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f393c009a00 tx=0x7f393c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:32.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:31.993+0000 7f3942ffd700 1 -- 172.21.15.79:0/2060792497 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f394c0b5370 con 0x7f394c0b2270 2023-10-19T08:38:32.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.184+0000 7f3954703700 1 -- 172.21.15.79:0/2060792497 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f394c0b5370 con 0x7f394c0b2270 2023-10-19T08:38:32.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.185+0000 7f3942ffd700 1 -- 172.21.15.79:0/2060792497 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20060 (secure 0 0 0) 0x7f394c0b5370 con 0x7f394c0b2270 2023-10-19T08:38:32.189 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:32.189 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":25,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:01.725914+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:32.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.187+0000 7f3954703700 1 -- 172.21.15.79:0/2060792497 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f393006a0e0 msgr2=0x7f393006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:32.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.187+0000 7f3954703700 1 --2- 172.21.15.79:0/2060792497 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f393006a0e0 0x7f393006c5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f393c009a00 tx=0x7f393c008040 comp rx=0 tx=0).stop 2023-10-19T08:38:32.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.187+0000 7f3954703700 1 -- 172.21.15.79:0/2060792497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c0b2270 msgr2=0x7f394c0b3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:32.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.187+0000 7f3954703700 1 --2- 172.21.15.79:0/2060792497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c0b2270 0x7f394c0b3da0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f394c067670 tx=0x7f3944004ad0 comp rx=0 tx=0).stop 2023-10-19T08:38:32.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.187+0000 7f3954703700 1 -- 172.21.15.79:0/2060792497 shutdown_connections 2023-10-19T08:38:32.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.187+0000 7f3954703700 1 --2- 172.21.15.79:0/2060792497 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f394c0b2270 0x7f394c0b3da0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:32.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.187+0000 7f3954703700 1 --2- 172.21.15.79:0/2060792497 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f393006a0e0 0x7f393006c5a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:32.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.187+0000 7f3954703700 1 --2- 172.21.15.79:0/2060792497 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c0af170 0x7f394c0b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:32.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.187+0000 7f3954703700 1 --2- 172.21.15.79:0/2060792497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c0b1de0 0x7f394c1f22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:32.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.187+0000 7f3954703700 1 -- 172.21.15.79:0/2060792497 >> 172.21.15.79:0/2060792497 conn(0x7f394c06dcc0 msgr2=0x7f394c0caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:32.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.187+0000 7f3954703700 1 -- 172.21.15.79:0/2060792497 shutdown_connections 2023-10-19T08:38:32.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.187+0000 7f3954703700 1 -- 172.21.15.79:0/2060792497 wait complete. 2023-10-19T08:38:32.203 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T08:38:32.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.321+0000 7fbe7d8cb700 1 Processor -- start 2023-10-19T08:38:32.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.321+0000 7fbe7d8cb700 1 -- start start 2023-10-19T08:38:32.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.322+0000 7fbe7d8cb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbe780cfcf0 0x7fbe780d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:32.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.322+0000 7fbe7d8cb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe780b2180 0x7fbe780d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:32.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.322+0000 7fbe7d8cb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe780d0610 con 0x7fbe780d2eb0 2023-10-19T08:38:32.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.322+0000 7fbe7d8cb700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe780d1120 con 0x7fbe780cfcf0 2023-10-19T08:38:32.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.322+0000 7fbe7d8cb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe780d1400 con 0x7fbe780b2180 2023-10-19T08:38:32.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.322+0000 7fbe76ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbe780cfcf0 0x7fbe780d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:32.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.322+0000 7fbe76ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbe780cfcf0 0x7fbe780d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46872/0 (socket says 172.21.15.79:46872) 2023-10-19T08:38:32.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.322+0000 7fbe76ffd700 1 -- 172.21.15.79:0/1681364344 learned_addr learned my addr 172.21.15.79:0/1681364344 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:32.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.322+0000 7fbe767fc700 1 --2- 172.21.15.79:0/1681364344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe780b2180 0x7fbe780d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:32.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.322+0000 7fbe76ffd700 1 -- 172.21.15.79:0/1681364344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe780b2180 msgr2=0x7fbe780d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:32.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.322+0000 7fbe76ffd700 1 --2- 172.21.15.79:0/1681364344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe780b2180 0x7fbe780d2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:32.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.322+0000 7fbe76ffd700 1 -- 172.21.15.79:0/1681364344 >> v1:172.21.15.89:6789/0 conn(0x7fbe780d2eb0 legacy=0x7fbe780d3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:32.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.322+0000 7fbe76ffd700 1 -- 172.21.15.79:0/1681364344 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe780d16e0 con 0x7fbe780cfcf0 2023-10-19T08:38:32.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.322+0000 7fbe76ffd700 1 --2- 172.21.15.79:0/1681364344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe780cfcf0 0x7fbe780d00d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0098f0 tx=0x7fbe6c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb303d6dcb7e847 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:32.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.322+0000 7fbe75ffb700 1 -- 172.21.15.79:0/1681364344 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c00b8a0 con 0x7fbe780cfcf0 2023-10-19T08:38:32.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.322+0000 7fbe75ffb700 1 -- 172.21.15.79:0/1681364344 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c00ba00 con 0x7fbe780cfcf0 2023-10-19T08:38:32.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.322+0000 7fbe75ffb700 1 -- 172.21.15.79:0/1681364344 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c00bd90 con 0x7fbe780cfcf0 2023-10-19T08:38:32.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.323+0000 7fbe7d8cb700 1 -- 172.21.15.79:0/1681364344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe780cfcf0 msgr2=0x7fbe780d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:32.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.323+0000 7fbe7d8cb700 1 --2- 172.21.15.79:0/1681364344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe780cfcf0 0x7fbe780d00d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0098f0 tx=0x7fbe6c009c00 comp rx=0 tx=0).stop 2023-10-19T08:38:32.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.323+0000 7fbe7d8cb700 1 -- 172.21.15.79:0/1681364344 shutdown_connections 2023-10-19T08:38:32.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.323+0000 7fbe7d8cb700 1 --2- 172.21.15.79:0/1681364344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe780cfcf0 0x7fbe780d00d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:32.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.323+0000 7fbe7d8cb700 1 --2- 172.21.15.79:0/1681364344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe780b2180 0x7fbe780d2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:32.331 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.323+0000 7fbe7d8cb700 1 -- 172.21.15.79:0/1681364344 >> 172.21.15.79:0/1681364344 conn(0x7fbe78071b30 msgr2=0x7fbe78071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:32.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.323+0000 7fbe7d8cb700 1 -- 172.21.15.79:0/1681364344 shutdown_connections 2023-10-19T08:38:32.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.323+0000 7fbe7d8cb700 1 -- 172.21.15.79:0/1681364344 wait complete. 2023-10-19T08:38:32.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.324+0000 7fbe7d8cb700 1 Processor -- start 2023-10-19T08:38:32.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.324+0000 7fbe7d8cb700 1 -- start start 2023-10-19T08:38:32.334 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.325+0000 7fbe7d8cb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe780b2180 0x7fbe780ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.325+0000 7fbe7d8cb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe780cfcf0 0x7fbe780b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.325+0000 7fbe7d8cb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe780d2eb0 0x7fbe780b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.325+0000 7fbe7d8cb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe781f3aa0 con 0x7fbe780b2180 2023-10-19T08:38:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.325+0000 7fbe7d8cb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe781f3d10 con 0x7fbe780d2eb0 2023-10-19T08:38:32.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.325+0000 7fbe7d8cb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe781f3ff0 con 0x7fbe780cfcf0 2023-10-19T08:38:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.325+0000 7fbe76ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe780b2180 0x7fbe780ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.325+0000 7fbe76ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe780b2180 0x7fbe780ac0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46878/0 (socket says 172.21.15.79:46878) 2023-10-19T08:38:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.325+0000 7fbe76ffd700 1 -- 172.21.15.79:0/733856909 learned_addr learned my addr 172.21.15.79:0/733856909 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.325+0000 7fbe767fc700 1 --2- 172.21.15.79:0/733856909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe780cfcf0 0x7fbe780b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.325+0000 7fbe777fe700 1 --2- 172.21.15.79:0/733856909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe780d2eb0 0x7fbe780b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:32.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.325+0000 7fbe76ffd700 1 -- 172.21.15.79:0/733856909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe780cfcf0 msgr2=0x7fbe780b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.325+0000 7fbe76ffd700 1 --2- 172.21.15.79:0/733856909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe780cfcf0 0x7fbe780b6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.325+0000 7fbe76ffd700 1 -- 172.21.15.79:0/733856909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe780d2eb0 msgr2=0x7fbe780b68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.325+0000 7fbe76ffd700 1 --2- 172.21.15.79:0/733856909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe780d2eb0 0x7fbe780b68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:32.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.325+0000 7fbe76ffd700 1 -- 172.21.15.79:0/733856909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c009550 con 0x7fbe780b2180 2023-10-19T08:38:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.325+0000 7fbe777fe700 1 --2- 172.21.15.79:0/733856909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe780d2eb0 0x7fbe780b68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.326+0000 7fbe76ffd700 1 --2- 172.21.15.79:0/733856909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe780b2180 0x7fbe780ac0a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c000c00 tx=0x7fbe6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.326+0000 7fbe5ffff700 1 -- 172.21.15.79:0/733856909 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c004380 con 0x7fbe780b2180 2023-10-19T08:38:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.326+0000 7fbe5ffff700 1 -- 172.21.15.79:0/733856909 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c01f070 con 0x7fbe780b2180 2023-10-19T08:38:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.326+0000 7fbe7d8cb700 1 -- 172.21.15.79:0/733856909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe781f42d0 con 0x7fbe780b2180 2023-10-19T08:38:32.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.326+0000 7fbe5ffff700 1 -- 172.21.15.79:0/733856909 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c0036a0 con 0x7fbe780b2180 2023-10-19T08:38:32.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.326+0000 7fbe7d8cb700 1 -- 172.21.15.79:0/733856909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe780ac5e0 con 0x7fbe780b2180 2023-10-19T08:38:32.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.327+0000 7fbe7d8cb700 1 -- 172.21.15.79:0/733856909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe781f44e0 con 0x7fbe780b2180 2023-10-19T08:38:32.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.327+0000 7fbe5ffff700 1 -- 172.21.15.79:0/733856909 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbe6c021030 con 0x7fbe780b2180 2023-10-19T08:38:32.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.327+0000 7fbe5ffff700 1 --2- 172.21.15.79:0/733856909 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbe6406a0e0 0x7fbe6406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:32.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.328+0000 7fbe5ffff700 1 -- 172.21.15.79:0/733856909 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbe6c089c20 con 0x7fbe780b2180 2023-10-19T08:38:32.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.328+0000 7fbe767fc700 1 --2- 172.21.15.79:0/733856909 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbe6406a0e0 0x7fbe6406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:32.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.328+0000 7fbe767fc700 1 --2- 172.21.15.79:0/733856909 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbe6406a0e0 0x7fbe6406c5a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbe781f5d90 tx=0x7fbe68008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:32.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.332+0000 7fbe5ffff700 1 -- 172.21.15.79:0/733856909 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fbe6c055020 con 0x7fbe780b2180 2023-10-19T08:38:32.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.565+0000 7fbe7d8cb700 1 -- 172.21.15.79:0/733856909 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe7804ee70 con 0x7fbe780b2180 2023-10-19T08:38:32.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.565+0000 7fbe5ffff700 1 -- 172.21.15.79:0/733856909 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4865 (secure 0 0 0) 0x7fbe6c058640 con 0x7fbe780b2180 2023-10-19T08:38:32.569 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:32.570 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3710906518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3710906518},{"type":"v1","addr":"172.21.15.89:6835","nonce":3710906518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3037310614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3037310614},{"type":"v1","addr":"172.21.15.79:6835","nonce":3037310614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/79656061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":79656061},{"type":"v1","addr":"172.21.15.79:6837","nonce":79656061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-19T08:37:56.667105+0000","modified":"2023-10-19T08:38:20.379674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6833/3076620199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3076620199},{"type":"v1","addr":"172.21.15.89:6833","nonce":3076620199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-19T08:38:32.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.568+0000 7fbe7d8cb700 1 -- 172.21.15.79:0/733856909 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbe6406a0e0 msgr2=0x7fbe6406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.568+0000 7fbe7d8cb700 1 --2- 172.21.15.79:0/733856909 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbe6406a0e0 0x7fbe6406c5a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbe781f5d90 tx=0x7fbe68008040 comp rx=0 tx=0).stop 2023-10-19T08:38:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.568+0000 7fbe7d8cb700 1 -- 172.21.15.79:0/733856909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe780b2180 msgr2=0x7fbe780ac0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.568+0000 7fbe7d8cb700 1 --2- 172.21.15.79:0/733856909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe780b2180 0x7fbe780ac0a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c000c00 tx=0x7fbe6c004750 comp rx=0 tx=0).stop 2023-10-19T08:38:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.568+0000 7fbe7d8cb700 1 -- 172.21.15.79:0/733856909 shutdown_connections 2023-10-19T08:38:32.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.568+0000 7fbe7d8cb700 1 --2- 172.21.15.79:0/733856909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe780d2eb0 0x7fbe780b68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.568+0000 7fbe7d8cb700 1 --2- 172.21.15.79:0/733856909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe780b2180 0x7fbe780ac0a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.568+0000 7fbe7d8cb700 1 --2- 172.21.15.79:0/733856909 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbe6406a0e0 0x7fbe6406c5a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.568+0000 7fbe7d8cb700 1 --2- 172.21.15.79:0/733856909 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe780cfcf0 0x7fbe780b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.568+0000 7fbe7d8cb700 1 -- 172.21.15.79:0/733856909 >> 172.21.15.79:0/733856909 conn(0x7fbe78071b30 msgr2=0x7fbe78071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:32.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.568+0000 7fbe7d8cb700 1 -- 172.21.15.79:0/733856909 shutdown_connections 2023-10-19T08:38:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:32.568+0000 7fbe7d8cb700 1 -- 172.21.15.79:0/733856909 wait complete. 2023-10-19T08:38:32.574 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 9 2023-10-19T08:38:32.986 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-19T08:37:56.667105+0000', 'modified': '2023-10-19T08:38:20.379674+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6833/3076620199', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6832', 'nonce': 3076620199}, {'type': 'v1', 'addr': '172.21.15.89:6833', 'nonce': 3076620199}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-19T08:38:32.987 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-19T08:38:32.987 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-19T08:38:33.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.108+0000 7f65560e2700 1 Processor -- start 2023-10-19T08:38:33.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.108+0000 7f65560e2700 1 -- start start 2023-10-19T08:38:33.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.109+0000 7f65560e2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6550159f40 0x7f655015e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.109+0000 7f65560e2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65500cf710 0x7f65500cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.109+0000 7f65560e2700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655015e870 con 0x7f65500b5610 2023-10-19T08:38:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.109+0000 7f65560e2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65500b5aa0 con 0x7f6550159f40 2023-10-19T08:38:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.109+0000 7f65560e2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65500cd800 con 0x7f65500cf710 2023-10-19T08:38:33.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.109+0000 7f654effd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f65500b5610 0x7f65500cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:56960/0 (socket says 172.21.15.79:56960) 2023-10-19T08:38:33.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.109+0000 7f654effd700 1 -- 172.21.15.79:0/2803080506 learned_addr learned my addr 172.21.15.79:0/2803080506 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:33.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.109+0000 7f654e7fc700 1 -- 172.21.15.79:0/2803080506 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320782958 0 0) 0x7f655015e870 con 0x7f65500b5610 2023-10-19T08:38:33.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.109+0000 7f654e7fc700 1 -- 172.21.15.79:0/2803080506 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65380035b0 con 0x7f65500b5610 2023-10-19T08:38:33.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.109+0000 7f654ffff700 1 --2- 172.21.15.79:0/2803080506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65500cf710 0x7f65500cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.109+0000 7f654f7fe700 1 --2- 172.21.15.79:0/2803080506 >> v2:172.21.15.89:3300/0 conn(0x7f6550159f40 0x7f655015e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.109+0000 7f654e7fc700 1 -- 172.21.15.79:0/2803080506 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 749644299 0 0) 0x7f65380035b0 con 0x7f65500b5610 2023-10-19T08:38:33.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.109+0000 7f654e7fc700 1 -- 172.21.15.79:0/2803080506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65500cf710 msgr2=0x7f65500cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:33.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.109+0000 7f654e7fc700 1 --2- 172.21.15.79:0/2803080506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65500cf710 0x7f65500cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.109+0000 7f654e7fc700 1 -- 172.21.15.79:0/2803080506 >> v2:172.21.15.89:3300/0 conn(0x7f6550159f40 msgr2=0x7f655015e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:33.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.109+0000 7f654e7fc700 1 --2- 172.21.15.79:0/2803080506 >> v2:172.21.15.89:3300/0 conn(0x7f6550159f40 0x7f655015e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.109+0000 7f654e7fc700 1 -- 172.21.15.79:0/2803080506 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65500cdae0 con 0x7f65500b5610 2023-10-19T08:38:33.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.109+0000 7f654e7fc700 1 -- 172.21.15.79:0/2803080506 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f6540001670 con 0x7f65500b5610 2023-10-19T08:38:33.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654e7fc700 1 -- 172.21.15.79:0/2803080506 >> v1:172.21.15.79:6789/0 conn(0x7f65500b5610 legacy=0x7f65500cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:33.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654e7fc700 1 --2- 172.21.15.79:0/2803080506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6538003a00 0x7f6538003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654e7fc700 1 --2- 172.21.15.79:0/2803080506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65500cf710 0x7f6538004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654e7fc700 1 --2- 172.21.15.79:0/2803080506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6538004d90 0x7f6538005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654e7fc700 1 -- 172.21.15.79:0/2803080506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65500b5aa0 con 0x7f6538004d90 2023-10-19T08:38:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654e7fc700 1 -- 172.21.15.79:0/2803080506 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65500cd800 con 0x7f6538003a00 2023-10-19T08:38:33.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654e7fc700 1 -- 172.21.15.79:0/2803080506 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653800baf0 con 0x7f65500cf710 2023-10-19T08:38:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654f7fe700 1 --2- 172.21.15.79:0/2803080506 >> v2:172.21.15.89:3300/0 conn(0x7f6550159f40 0x7f655015e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654ffff700 1 --2- 172.21.15.79:0/2803080506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6538004d90 0x7f6538005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654effd700 1 --2- 172.21.15.79:0/2803080506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65500cf710 0x7f6538004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654f7fe700 1 --2- 172.21.15.79:0/2803080506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6538003a00 0x7f6538003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654ffff700 1 -- 172.21.15.79:0/2803080506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65500cf710 msgr2=0x7f6538004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:33.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654ffff700 1 --2- 172.21.15.79:0/2803080506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65500cf710 0x7f6538004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654ffff700 1 -- 172.21.15.79:0/2803080506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6538003a00 msgr2=0x7f6538003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654ffff700 1 --2- 172.21.15.79:0/2803080506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6538003a00 0x7f6538003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654ffff700 1 -- 172.21.15.79:0/2803080506 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65380035b0 con 0x7f6538004d90 2023-10-19T08:38:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654ffff700 1 --2- 172.21.15.79:0/2803080506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6538004d90 0x7f6538005210 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f65500b26e0 tx=0x7f6538005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c9c0405fb508b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:33.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654e7fc700 1 -- 172.21.15.79:0/2803080506 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548007dc0 con 0x7f6538004d90 2023-10-19T08:38:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654e7fc700 1 -- 172.21.15.79:0/2803080506 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6548003a20 con 0x7f6538004d90 2023-10-19T08:38:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.110+0000 7f654e7fc700 1 -- 172.21.15.79:0/2803080506 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548003dd0 con 0x7f6538004d90 2023-10-19T08:38:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.111+0000 7f65560e2700 1 -- 172.21.15.79:0/2803080506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6538004d90 msgr2=0x7f6538005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.111+0000 7f65560e2700 1 --2- 172.21.15.79:0/2803080506 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6538004d90 0x7f6538005210 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f65500b26e0 tx=0x7f6538005880 comp rx=0 tx=0).stop 2023-10-19T08:38:33.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.111+0000 7f654ffff700 1 -- 172.21.15.79:0/2803080506 reap_dead start 2023-10-19T08:38:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.111+0000 7f65560e2700 1 -- 172.21.15.79:0/2803080506 shutdown_connections 2023-10-19T08:38:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.111+0000 7f65560e2700 1 -- 172.21.15.79:0/2803080506 >> 172.21.15.79:0/2803080506 conn(0x7f655006dcc0 msgr2=0x7f655006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.111+0000 7f65560e2700 1 -- 172.21.15.79:0/2803080506 shutdown_connections 2023-10-19T08:38:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.111+0000 7f65560e2700 1 -- 172.21.15.79:0/2803080506 wait complete. 2023-10-19T08:38:33.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.112+0000 7f65560e2700 1 Processor -- start 2023-10-19T08:38:33.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.112+0000 7f65560e2700 1 -- start start 2023-10-19T08:38:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.113+0000 7f65560e2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6538004d90 0x7f655006a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.113+0000 7f65560e2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65500c5a20 0x7f65500b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.113+0000 7f65560e2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65500b2cf0 0x7f65500c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.113+0000 7f65560e2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655015ae10 con 0x7f6538004d90 2023-10-19T08:38:33.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.113+0000 7f65560e2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655015a320 con 0x7f65500c5a20 2023-10-19T08:38:33.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.113+0000 7f65560e2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65500c9550 con 0x7f65500b2cf0 2023-10-19T08:38:33.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.113+0000 7f654f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6538004d90 0x7f655006a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.113+0000 7f654f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6538004d90 0x7f655006a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46898/0 (socket says 172.21.15.79:46898) 2023-10-19T08:38:33.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.113+0000 7f654f7fe700 1 -- 172.21.15.79:0/1734056331 learned_addr learned my addr 172.21.15.79:0/1734056331 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:33.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.113+0000 7f654effd700 1 --2- 172.21.15.79:0/1734056331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65500c5a20 0x7f65500b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.113+0000 7f654ffff700 1 --2- 172.21.15.79:0/1734056331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65500b2cf0 0x7f65500c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.113+0000 7f654f7fe700 1 -- 172.21.15.79:0/1734056331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65500b2cf0 msgr2=0x7f65500c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:33.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.113+0000 7f654f7fe700 1 --2- 172.21.15.79:0/1734056331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65500b2cf0 0x7f65500c4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.113+0000 7f654f7fe700 1 -- 172.21.15.79:0/1734056331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65500c5a20 msgr2=0x7f65500b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:33.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.113+0000 7f654f7fe700 1 --2- 172.21.15.79:0/1734056331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65500c5a20 0x7f65500b27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.113+0000 7f654f7fe700 1 -- 172.21.15.79:0/1734056331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655015a570 con 0x7f6538004d90 2023-10-19T08:38:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.113+0000 7f654effd700 1 --2- 172.21.15.79:0/1734056331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65500c5a20 0x7f65500b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.114+0000 7f654f7fe700 1 --2- 172.21.15.79:0/1734056331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6538004d90 0x7f655006a490 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6544011900 tx=0x7f6544011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.114+0000 7f6537fff700 1 -- 172.21.15.79:0/1734056331 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6544004230 con 0x7f6538004d90 2023-10-19T08:38:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.114+0000 7f6537fff700 1 -- 172.21.15.79:0/1734056331 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6544004390 con 0x7f6538004d90 2023-10-19T08:38:33.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.114+0000 7f6537fff700 1 -- 172.21.15.79:0/1734056331 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65440036a0 con 0x7f6538004d90 2023-10-19T08:38:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.114+0000 7f65560e2700 1 -- 172.21.15.79:0/1734056331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655015a850 con 0x7f6538004d90 2023-10-19T08:38:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.114+0000 7f65560e2700 1 -- 172.21.15.79:0/1734056331 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65500c44e0 con 0x7f6538004d90 2023-10-19T08:38:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.115+0000 7f6537fff700 1 -- 172.21.15.79:0/1734056331 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6544003800 con 0x7f6538004d90 2023-10-19T08:38:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.115+0000 7f6537fff700 1 --2- 172.21.15.79:0/1734056331 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f653c06a0e0 0x7f653c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.116+0000 7f6537fff700 1 -- 172.21.15.79:0/1734056331 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f65440889a0 con 0x7f6538004d90 2023-10-19T08:38:33.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.116+0000 7f654effd700 1 --2- 172.21.15.79:0/1734056331 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f653c06a0e0 0x7f653c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.116+0000 7f654effd700 1 --2- 172.21.15.79:0/1734056331 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f653c06a0e0 0x7f653c06c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f65500b3ca0 tx=0x7f6540009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:33.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.117+0000 7f656227db80 1 Processor -- start 2023-10-19T08:38:33.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.118+0000 7f656227db80 1 -- start start 2023-10-19T08:38:33.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.118+0000 7f656227db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8be10 0x55df7cd8c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.118+0000 7f656227db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd66cb0 0x55df7cd8fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.118+0000 7f656227db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd90220 0x55df7cd688a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.118+0000 7f656227db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df7ccc15e0 con 0x55df7cd66cb0 2023-10-19T08:38:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.118+0000 7f656227db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df7ccbef00 con 0x55df7cd8be10 2023-10-19T08:38:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.118+0000 7f656227db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df7ccba7f0 con 0x55df7cd90220 2023-10-19T08:38:33.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.118+0000 7f654effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd66cb0 0x55df7cd8fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.119+0000 7f654effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd66cb0 0x55df7cd8fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46908/0 (socket says 172.21.15.79:46908) 2023-10-19T08:38:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.119+0000 7f654effd700 1 -- 172.21.15.79:0/343920288 learned_addr learned my addr 172.21.15.79:0/343920288 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.119+0000 7f654f7fe700 1 --2- 172.21.15.79:0/343920288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8be10 0x55df7cd8c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.119+0000 7f654ffff700 1 --2- 172.21.15.79:0/343920288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd90220 0x55df7cd688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.119+0000 7f654effd700 1 -- 172.21.15.79:0/343920288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd90220 msgr2=0x55df7cd688a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:33.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.119+0000 7f654effd700 1 --2- 172.21.15.79:0/343920288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd90220 0x55df7cd688a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.119+0000 7f654effd700 1 -- 172.21.15.79:0/343920288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8be10 msgr2=0x55df7cd8c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.119+0000 7f654effd700 1 --2- 172.21.15.79:0/343920288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8be10 0x55df7cd8c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.119+0000 7f654effd700 1 -- 172.21.15.79:0/343920288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df7cb3a5e0 con 0x55df7cd66cb0 2023-10-19T08:38:33.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.119+0000 7f654f7fe700 1 --2- 172.21.15.79:0/343920288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8be10 0x55df7cd8c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:33.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.119+0000 7f654effd700 1 --2- 172.21.15.79:0/343920288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd66cb0 0x55df7cd8fce0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6540007330 tx=0x7f6540001760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce52a369edac561 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:33.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.119+0000 7f65357fa700 1 -- 172.21.15.79:0/343920288 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540015900 con 0x55df7cd66cb0 2023-10-19T08:38:33.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.119+0000 7f65357fa700 1 -- 172.21.15.79:0/343920288 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6540015a60 con 0x55df7cd66cb0 2023-10-19T08:38:33.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.119+0000 7f65357fa700 1 -- 172.21.15.79:0/343920288 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540015dd0 con 0x55df7cd66cb0 2023-10-19T08:38:33.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.120+0000 7f656227db80 1 -- 172.21.15.79:0/343920288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd66cb0 msgr2=0x55df7cd8fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:33.142 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.120+0000 7f656227db80 1 --2- 172.21.15.79:0/343920288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd66cb0 0x55df7cd8fce0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6540007330 tx=0x7f6540001760 comp rx=0 tx=0).stop 2023-10-19T08:38:33.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.120+0000 7f656227db80 1 -- 172.21.15.79:0/343920288 shutdown_connections 2023-10-19T08:38:33.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.120+0000 7f656227db80 1 --2- 172.21.15.79:0/343920288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd90220 0x55df7cd688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.120+0000 7f656227db80 1 --2- 172.21.15.79:0/343920288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8be10 0x55df7cd8c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.120+0000 7f656227db80 1 --2- 172.21.15.79:0/343920288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd66cb0 0x55df7cd8fce0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.120+0000 7f656227db80 1 -- 172.21.15.79:0/343920288 >> 172.21.15.79:0/343920288 conn(0x55df7cc95900 msgr2=0x55df7cdae590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.120+0000 7f656227db80 1 -- 172.21.15.79:0/343920288 shutdown_connections 2023-10-19T08:38:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.120+0000 7f656227db80 1 -- 172.21.15.79:0/343920288 wait complete. 2023-10-19T08:38:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.120+0000 7f656227db80 1 -- start start 2023-10-19T08:38:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.121+0000 7f656227db80 1 Processor -- start 2023-10-19T08:38:33.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.121+0000 7f656227db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd66cb0 0x55df7cd95970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.121+0000 7f656227db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd8be10 0x55df7cd93a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.121+0000 7f656227db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8a750 0x55df7cd93fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.121+0000 7f656227db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df7cc58a70 con 0x55df7cd8be10 2023-10-19T08:38:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.121+0000 7f656227db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df7cc58770 con 0x55df7cd8a750 2023-10-19T08:38:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.121+0000 7f656227db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df7cb3c8d0 con 0x55df7cd66cb0 2023-10-19T08:38:33.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.121+0000 7f656227db80 10 client.0 _ll_register_callbacks cb 0x55df7cba2a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T08:38:33.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.121+0000 7f654effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd8be10 0x55df7cd93a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.121+0000 7f654effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd8be10 0x55df7cd93a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46914/0 (socket says 172.21.15.79:46914) 2023-10-19T08:38:33.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.121+0000 7f654effd700 1 -- 172.21.15.79:0/1052302835 learned_addr learned my addr 172.21.15.79:0/1052302835 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:33.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.121+0000 7f654f7fe700 1 --2- 172.21.15.79:0/1052302835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd66cb0 0x55df7cd95970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.121+0000 7f654ffff700 1 --2- 172.21.15.79:0/1052302835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8a750 0x55df7cd93fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f654effd700 1 -- 172.21.15.79:0/1052302835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd66cb0 msgr2=0x55df7cd95970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:33.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f654effd700 1 --2- 172.21.15.79:0/1052302835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd66cb0 0x55df7cd95970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f654effd700 1 -- 172.21.15.79:0/1052302835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8a750 msgr2=0x55df7cd93fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:33.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f654effd700 1 --2- 172.21.15.79:0/1052302835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8a750 0x55df7cd93fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f654effd700 1 -- 172.21.15.79:0/1052302835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65500cdae0 con 0x55df7cd8be10 2023-10-19T08:38:33.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f654effd700 1 --2- 172.21.15.79:0/1052302835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd8be10 0x55df7cd93a80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6540018000 tx=0x7f6540001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb856d2f5bae968 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:33.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f652e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-19T08:38:33.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f652e7fc700 1 -- 172.21.15.79:0/1052302835 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540015900 con 0x55df7cd8be10 2023-10-19T08:38:33.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f652e7fc700 1 -- 172.21.15.79:0/1052302835 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f654001d050 con 0x55df7cd8be10 2023-10-19T08:38:33.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f656227db80 1 -- 172.21.15.79:0/1052302835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55df7cd5bcb0 con 0x55df7cd8be10 2023-10-19T08:38:33.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f652e7fc700 1 -- 172.21.15.79:0/1052302835 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65400013b0 con 0x55df7cd8be10 2023-10-19T08:38:33.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f656227db80 10 client.4923 fetch_fsmap learned FSMap version 9 2023-10-19T08:38:33.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f656227db80 1 -- 172.21.15.79:0/1052302835 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55df7cae6d90 con 0x55df7cd8be10 2023-10-19T08:38:33.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f652e7fc700 1 -- 172.21.15.79:0/1052302835 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55df7cd5bcb0 con 0x55df7cd8be10 2023-10-19T08:38:33.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f652e7fc700 1 -- 172.21.15.79:0/1052302835 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f6540023a60 con 0x55df7cd8be10 2023-10-19T08:38:33.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f656227db80 10 client.4923 fetch_fsmap finished waiting for FSMap version 9 2023-10-19T08:38:33.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f656227db80 10 client.4923 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-19T08:38:33.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f656227db80 20 client.4923 populate_metadata read hostname 'smithi079' 2023-10-19T08:38:33.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f656227db80 1 --2- 172.21.15.79:0/1052302835 >> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] conn(0x55df7cd8e5e0 0x55df7cd8c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f656227db80 4 client.4923 mds_command: new command op to 4275 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-19T08:38:33.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.122+0000 7f656227db80 1 -- 172.21.15.79:0/1052302835 --> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55df7ccb37d0 con 0x55df7cd8e5e0 2023-10-19T08:38:33.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.123+0000 7f654f7fe700 1 --2- 172.21.15.79:0/1052302835 >> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] conn(0x55df7cd8e5e0 0x55df7cd8c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.123+0000 7f654f7fe700 1 --2- 172.21.15.79:0/1052302835 >> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] conn(0x55df7cd8e5e0 0x55df7cd8c760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed74cf58e9e2406f server_cookie=2f738afc57861676 in_seq=0 out_seq=0 2023-10-19T08:38:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.123+0000 7f652e7fc700 10 client.4923 ms_handle_connect on v2:172.21.15.89:6832/3076620199 2023-10-19T08:38:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.124+0000 7f652e7fc700 1 -- 172.21.15.79:0/1052302835 <== mds.0 v2:172.21.15.89:6832/3076620199 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55df7ccb37d0 con 0x55df7cd8e5e0 2023-10-19T08:38:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.124+0000 7f652e7fc700 10 client.4923 handle_command_reply: tid=0 2023-10-19T08:38:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.124+0000 7f656227db80 1 client.4923 shutdown 2023-10-19T08:38:33.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.124+0000 7f656227db80 1 -- 172.21.15.79:0/1052302835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd8be10 msgr2=0x55df7cd93a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.124+0000 7f656227db80 1 --2- 172.21.15.79:0/1052302835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd8be10 0x55df7cd93a80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6540018000 tx=0x7f6540001a00 comp rx=0 tx=0).stop 2023-10-19T08:38:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.124+0000 7f656227db80 1 -- 172.21.15.79:0/1052302835 shutdown_connections 2023-10-19T08:38:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.124+0000 7f656227db80 1 --2- 172.21.15.79:0/1052302835 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8a750 0x55df7cd93fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.124+0000 7f656227db80 1 --2- 172.21.15.79:0/1052302835 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd66cb0 0x55df7cd95970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.124+0000 7f656227db80 1 --2- 172.21.15.79:0/1052302835 >> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] conn(0x55df7cd8e5e0 0x55df7cd8c760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.124+0000 7f656227db80 1 --2- 172.21.15.79:0/1052302835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd8be10 0x55df7cd93a80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.124+0000 7f652e7fc700 0 client.4923 ms_handle_reset on v2:172.21.15.89:6832/3076620199 2023-10-19T08:38:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.124+0000 7f656227db80 1 -- 172.21.15.79:0/1052302835 >> 172.21.15.79:0/1052302835 conn(0x55df7cc95900 msgr2=0x55df7cd63430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.124+0000 7f656227db80 1 -- 172.21.15.79:0/1052302835 shutdown_connections 2023-10-19T08:38:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.124+0000 7f656227db80 1 -- 172.21.15.79:0/1052302835 wait complete. 2023-10-19T08:38:33.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.124+0000 7f656227db80 20 client.4923 trim_cache size 0 max 16384 2023-10-19T08:38:33.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.142+0000 7f656227db80 1 Processor -- start 2023-10-19T08:38:33.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.142+0000 7f656227db80 1 -- start start 2023-10-19T08:38:33.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f656227db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd66cb0 0x55df7ce0ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f656227db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd8a750 0x55df7cdc7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f656227db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8be10 0x55df7cd90610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f656227db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df7cd8a5f0 con 0x55df7cd66cb0 2023-10-19T08:38:33.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f656227db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df7cdc8010 con 0x55df7cd8be10 2023-10-19T08:38:33.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f656227db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df7cd65e20 con 0x55df7cd8a750 2023-10-19T08:38:33.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f654f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd66cb0 0x55df7ce0ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f654f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd66cb0 0x55df7ce0ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46920/0 (socket says 172.21.15.79:46920) 2023-10-19T08:38:33.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f654f7fe700 1 -- 172.21.15.79:0/232888974 learned_addr learned my addr 172.21.15.79:0/232888974 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:33.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f654effd700 1 --2- 172.21.15.79:0/232888974 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd8a750 0x55df7cdc7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f654ffff700 1 --2- 172.21.15.79:0/232888974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8be10 0x55df7cd90610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f654f7fe700 1 -- 172.21.15.79:0/232888974 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd8a750 msgr2=0x55df7cdc7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:33.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f654f7fe700 1 --2- 172.21.15.79:0/232888974 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd8a750 0x55df7cdc7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f654f7fe700 1 -- 172.21.15.79:0/232888974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8be10 msgr2=0x55df7cd90610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:33.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f654f7fe700 1 --2- 172.21.15.79:0/232888974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8be10 0x55df7cd90610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f654f7fe700 1 -- 172.21.15.79:0/232888974 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df7cacfc10 con 0x55df7cd66cb0 2023-10-19T08:38:33.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f654f7fe700 1 --2- 172.21.15.79:0/232888974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd66cb0 0x55df7ce0ed40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6544057a80 tx=0x7f65440869e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20dbf83e0fc59ed server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:33.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f6535ffb700 1 -- 172.21.15.79:0/232888974 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6544086ea0 con 0x55df7cd66cb0 2023-10-19T08:38:33.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f6535ffb700 1 -- 172.21.15.79:0/232888974 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6544055e90 con 0x55df7cd66cb0 2023-10-19T08:38:33.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.143+0000 7f6535ffb700 1 -- 172.21.15.79:0/232888974 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6544056fe0 con 0x55df7cd66cb0 2023-10-19T08:38:33.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.144+0000 7f656227db80 1 -- 172.21.15.79:0/232888974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd66cb0 msgr2=0x55df7ce0ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:33.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.144+0000 7f656227db80 1 --2- 172.21.15.79:0/232888974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd66cb0 0x55df7ce0ed40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6544057a80 tx=0x7f65440869e0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.144+0000 7f656227db80 1 -- 172.21.15.79:0/232888974 shutdown_connections 2023-10-19T08:38:33.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.144+0000 7f656227db80 1 --2- 172.21.15.79:0/232888974 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8be10 0x55df7cd90610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.144+0000 7f656227db80 1 --2- 172.21.15.79:0/232888974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd66cb0 0x55df7ce0ed40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.144+0000 7f656227db80 1 --2- 172.21.15.79:0/232888974 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd8a750 0x55df7cdc7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.144+0000 7f656227db80 1 -- 172.21.15.79:0/232888974 >> 172.21.15.79:0/232888974 conn(0x55df7cc95900 msgr2=0x55df7cd5f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:33.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.144+0000 7f656227db80 1 -- 172.21.15.79:0/232888974 shutdown_connections 2023-10-19T08:38:33.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.144+0000 7f656227db80 1 -- 172.21.15.79:0/232888974 wait complete. 2023-10-19T08:38:33.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.144+0000 7f656227db80 1 -- start start 2023-10-19T08:38:33.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.145+0000 7f656227db80 1 Processor -- start 2023-10-19T08:38:33.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.145+0000 7f656227db80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd66cb0 0x55df7cdef880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.145+0000 7f656227db80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8a750 0x55df7ce0d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.145+0000 7f656227db80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd8be10 0x55df7cd63180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.145+0000 7f656227db80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df7cd94060 con 0x55df7cd8be10 2023-10-19T08:38:33.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.145+0000 7f656227db80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df7ce0e0b0 con 0x55df7cd8a750 2023-10-19T08:38:33.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.145+0000 7f656227db80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df7ce0e300 con 0x55df7cd66cb0 2023-10-19T08:38:33.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.145+0000 7f656227db80 10 client.0 _ll_register_callbacks cb 0x55df7cba2a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T08:38:33.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.145+0000 7f654ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd8be10 0x55df7cd63180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.145+0000 7f654ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd8be10 0x55df7cd63180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46930/0 (socket says 172.21.15.79:46930) 2023-10-19T08:38:33.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.145+0000 7f654ffff700 1 -- 172.21.15.79:0/3128699223 learned_addr learned my addr 172.21.15.79:0/3128699223 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:33.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.145+0000 7f654f7fe700 1 --2- 172.21.15.79:0/3128699223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd66cb0 0x55df7cdef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.145+0000 7f654effd700 1 --2- 172.21.15.79:0/3128699223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8a750 0x55df7ce0d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f654ffff700 1 -- 172.21.15.79:0/3128699223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd66cb0 msgr2=0x55df7cdef880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:33.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f654ffff700 1 --2- 172.21.15.79:0/3128699223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd66cb0 0x55df7cdef880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f654ffff700 1 -- 172.21.15.79:0/3128699223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8a750 msgr2=0x55df7ce0d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:33.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f654ffff700 1 --2- 172.21.15.79:0/3128699223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8a750 0x55df7ce0d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f654ffff700 1 -- 172.21.15.79:0/3128699223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65500c44e0 con 0x55df7cd8be10 2023-10-19T08:38:33.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f654ffff700 1 --2- 172.21.15.79:0/3128699223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd8be10 0x55df7cd63180 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6548013000 tx=0x7f6548004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3966ed064337f2c server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:33.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f652e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-19T08:38:33.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f652e7fc700 1 -- 172.21.15.79:0/3128699223 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548026070 con 0x55df7cd8be10 2023-10-19T08:38:33.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f652e7fc700 1 -- 172.21.15.79:0/3128699223 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6548007e70 con 0x55df7cd8be10 2023-10-19T08:38:33.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f656227db80 1 -- 172.21.15.79:0/3128699223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6540015a60 con 0x55df7cd8be10 2023-10-19T08:38:33.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f652e7fc700 1 -- 172.21.15.79:0/3128699223 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6548007000 con 0x55df7cd8be10 2023-10-19T08:38:33.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f656227db80 10 client.4929 fetch_fsmap learned FSMap version 9 2023-10-19T08:38:33.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f656227db80 1 -- 172.21.15.79:0/3128699223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55df7cb0d200 con 0x55df7cd8be10 2023-10-19T08:38:33.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f652e7fc700 1 -- 172.21.15.79:0/3128699223 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6540015a60 con 0x55df7cd8be10 2023-10-19T08:38:33.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f652e7fc700 1 -- 172.21.15.79:0/3128699223 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f6548004240 con 0x55df7cd8be10 2023-10-19T08:38:33.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f656227db80 10 client.4929 fetch_fsmap finished waiting for FSMap version 9 2023-10-19T08:38:33.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f656227db80 10 client.4929 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-19T08:38:33.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f656227db80 20 client.4929 populate_metadata read hostname 'smithi079' 2023-10-19T08:38:33.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f656227db80 1 --2- 172.21.15.79:0/3128699223 >> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] conn(0x55df7cd93170 0x55df7cd93550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f656227db80 4 client.4929 mds_command: new command op to 4275 tid=0[{"prefix": "status"}] 2023-10-19T08:38:33.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.146+0000 7f656227db80 1 -- 172.21.15.79:0/3128699223 --> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55df7cc74000 con 0x55df7cd93170 2023-10-19T08:38:33.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.147+0000 7f654f7fe700 1 --2- 172.21.15.79:0/3128699223 >> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] conn(0x55df7cd93170 0x55df7cd93550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.147+0000 7f652e7fc700 10 client.4929 ms_handle_connect on v2:172.21.15.89:6832/3076620199 2023-10-19T08:38:33.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.147+0000 7f654f7fe700 1 --2- 172.21.15.79:0/3128699223 >> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] conn(0x55df7cd93170 0x55df7cd93550 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=827fb45f123911dd server_cookie=e964625d555dc76b in_seq=0 out_seq=0 2023-10-19T08:38:33.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.147+0000 7f652e7fc700 1 -- 172.21.15.79:0/3128699223 <== mds.0 v2:172.21.15.89:6832/3076620199 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x55df7cc74000 con 0x55df7cd93170 2023-10-19T08:38:33.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.147+0000 7f652e7fc700 10 client.4929 handle_command_reply: tid=0 2023-10-19T08:38:33.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.147+0000 7f656227db80 1 client.4929 shutdown 2023-10-19T08:38:33.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.147+0000 7f656227db80 1 -- 172.21.15.79:0/3128699223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd8be10 msgr2=0x55df7cd63180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:33.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.147+0000 7f656227db80 1 --2- 172.21.15.79:0/3128699223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd8be10 0x55df7cd63180 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6548013000 tx=0x7f6548004ad0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.147+0000 7f656227db80 1 -- 172.21.15.79:0/3128699223 shutdown_connections 2023-10-19T08:38:33.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.147+0000 7f656227db80 1 --2- 172.21.15.79:0/3128699223 >> [v2:172.21.15.89:6832/3076620199,v1:172.21.15.89:6833/3076620199] conn(0x55df7cd93170 0x55df7cd93550 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.147+0000 7f656227db80 1 --2- 172.21.15.79:0/3128699223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55df7cd8be10 0x55df7cd63180 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.147+0000 7f656227db80 1 --2- 172.21.15.79:0/3128699223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x55df7cd66cb0 0x55df7cdef880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.147+0000 7f656227db80 1 --2- 172.21.15.79:0/3128699223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x55df7cd8a750 0x55df7ce0d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.147+0000 7f652e7fc700 0 client.4929 ms_handle_reset on v2:172.21.15.89:6832/3076620199 2023-10-19T08:38:33.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.147+0000 7f656227db80 1 -- 172.21.15.79:0/3128699223 >> 172.21.15.79:0/3128699223 conn(0x55df7cc95900 msgr2=0x55df7cd8de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:33.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.147+0000 7f656227db80 1 -- 172.21.15.79:0/3128699223 shutdown_connections 2023-10-19T08:38:33.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.147+0000 7f656227db80 1 -- 172.21.15.79:0/3128699223 wait complete. 2023-10-19T08:38:33.176 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.147+0000 7f656227db80 20 client.4929 trim_cache size 0 max 16384 2023-10-19T08:38:33.176 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-19T08:38:33.176 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "98eaa3c1-94c8-49a6-8b8d-caae2bee3a98", 2023-10-19T08:38:33.177 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2023-10-19T08:38:33.177 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4275, 2023-10-19T08:38:33.177 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2023-10-19T08:38:33.177 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2023-10-19T08:38:33.177 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2023-10-19T08:38:33.178 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 35.87151918, 2023-10-19T08:38:33.178 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 9, 2023-10-19T08:38:33.178 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 25, 2023-10-19T08:38:33.178 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 25, 2023-10-19T08:38:33.178 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 41.907801624000001 2023-10-19T08:38:33.179 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-19T08:38:33.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.148+0000 7f65560e2700 1 -- 172.21.15.79:0/1734056331 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f653c06a0e0 msgr2=0x7f653c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:33.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.148+0000 7f65560e2700 1 --2- 172.21.15.79:0/1734056331 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f653c06a0e0 0x7f653c06c5a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f65500b3ca0 tx=0x7f6540009040 comp rx=0 tx=0).stop 2023-10-19T08:38:33.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.148+0000 7f65560e2700 1 -- 172.21.15.79:0/1734056331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6538004d90 msgr2=0x7f655006a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:33.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.148+0000 7f65560e2700 1 --2- 172.21.15.79:0/1734056331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6538004d90 0x7f655006a490 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6544011900 tx=0x7f6544011cc0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.148+0000 7f65560e2700 1 -- 172.21.15.79:0/1734056331 shutdown_connections 2023-10-19T08:38:33.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.148+0000 7f65560e2700 1 --2- 172.21.15.79:0/1734056331 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f653c06a0e0 0x7f653c06c5a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.148+0000 7f65560e2700 1 --2- 172.21.15.79:0/1734056331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65500b2cf0 0x7f65500c4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.181 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.148+0000 7f65560e2700 1 --2- 172.21.15.79:0/1734056331 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6538004d90 0x7f655006a490 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.148+0000 7f65560e2700 1 --2- 172.21.15.79:0/1734056331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65500c5a20 0x7f65500b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.148+0000 7f65560e2700 1 -- 172.21.15.79:0/1734056331 >> 172.21.15.79:0/1734056331 conn(0x7f655006dcc0 msgr2=0x7f65500b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:33.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.148+0000 7f65560e2700 1 -- 172.21.15.79:0/1734056331 shutdown_connections 2023-10-19T08:38:33.182 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.148+0000 7f65560e2700 1 -- 172.21.15.79:0/1734056331 wait complete. 2023-10-19T08:38:33.183 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-19T08:38:33.208 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-19T08:38:33.208 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-19T08:38:33.209 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-19T08:38:33.209 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-19T08:38:33.209 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-19T08:38:33.209 INFO:tasks.ceph_fuse:client.2 config is {} 2023-10-19T08:38:33.210 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-19T08:38:33.210 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-19T08:38:33.210 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-19T08:38:33.210 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-19T08:38:33.211 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-19T08:38:33.211 INFO:tasks.ceph_fuse:client.3 config is {} 2023-10-19T08:38:33.211 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-19T08:38:33.211 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-19T08:38:33.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:33.212 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-19T08:38:33.229 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-19T08:38:33.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:33.230 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-19T08:38:33.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:33.304 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2023-10-19T08:38:33.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:33.419 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-19T08:38:33.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:33.440 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2023-10-19T08:38:33.513 INFO:teuthology.orchestra.run.smithi089.stderr:Cannot find device "ceph-brx" 2023-10-19T08:38:33.515 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T08:38:33.516 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-19T08:38:33.516 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-19T08:38:33.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.635+0000 7f54a7a24700 1 Processor -- start 2023-10-19T08:38:33.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.635+0000 7f54a7a24700 1 -- start start 2023-10-19T08:38:33.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.636+0000 7f54a7a24700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f54a00d14f0 0x7f54a00ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.636+0000 7f54a7a24700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a006c5a0 con 0x7f54a00adee0 2023-10-19T08:38:33.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.636+0000 7f54a7a24700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a006bd40 con 0x7f54a00b0710 2023-10-19T08:38:33.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.636+0000 7f54a7a24700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a0160cb0 con 0x7f54a00d14f0 2023-10-19T08:38:33.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.636+0000 7f54a4fbf700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f54a00d14f0 0x7f54a00ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.636+0000 7f54a5fc1700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f54a00adee0 0x7f54a00b1d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57010/0 (socket says 172.21.15.79:57010) 2023-10-19T08:38:33.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.636+0000 7f54a4fbf700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f54a00d14f0 0x7f54a00ad9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46934/0 (socket says 172.21.15.79:46934) 2023-10-19T08:38:33.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.636+0000 7f54a5fc1700 1 -- 172.21.15.79:0/1574211632 learned_addr learned my addr 172.21.15.79:0/1574211632 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:33.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.636+0000 7f54a4fbf700 1 -- 172.21.15.79:0/1574211632 >> v1:172.21.15.89:6789/0 conn(0x7f54a00b0710 legacy=0x7f54a00b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:33.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.636+0000 7f54a4fbf700 1 -- 172.21.15.79:0/1574211632 >> v1:172.21.15.79:6789/0 conn(0x7f54a00adee0 legacy=0x7f54a00b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:33.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.636+0000 7f54a4fbf700 1 -- 172.21.15.79:0/1574211632 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a006bfe0 con 0x7f54a00d14f0 2023-10-19T08:38:33.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.636+0000 7f5497fff700 1 -- 172.21.15.79:0/1574211632 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73713348 0 0) 0x7f54a006c5a0 con 0x7f54a00adee0 2023-10-19T08:38:33.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.636+0000 7f54a4fbf700 1 --2- 172.21.15.79:0/1574211632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54a00d14f0 0x7f54a00ad9a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5490009840 tx=0x7f5490009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f31c35d7b993ed server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:33.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.637+0000 7f5497fff700 1 -- 172.21.15.79:0/1574211632 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5490004230 con 0x7f54a00d14f0 2023-10-19T08:38:33.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.637+0000 7f5497fff700 1 -- 172.21.15.79:0/1574211632 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5490004390 con 0x7f54a00d14f0 2023-10-19T08:38:33.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.637+0000 7f5497fff700 1 -- 172.21.15.79:0/1574211632 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54900036a0 con 0x7f54a00d14f0 2023-10-19T08:38:33.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.637+0000 7f54a7a24700 1 -- 172.21.15.79:0/1574211632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54a00d14f0 msgr2=0x7f54a00ad9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:33.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.637+0000 7f54a7a24700 1 --2- 172.21.15.79:0/1574211632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54a00d14f0 0x7f54a00ad9a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5490009840 tx=0x7f5490009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:33.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.637+0000 7f54a7a24700 1 -- 172.21.15.79:0/1574211632 shutdown_connections 2023-10-19T08:38:33.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.637+0000 7f54a7a24700 1 --2- 172.21.15.79:0/1574211632 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54a00d14f0 0x7f54a00ad9a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.637+0000 7f54a7a24700 1 -- 172.21.15.79:0/1574211632 >> 172.21.15.79:0/1574211632 conn(0x7f54a009a0b0 msgr2=0x7f54a00d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:33.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.637+0000 7f54a7a24700 1 -- 172.21.15.79:0/1574211632 shutdown_connections 2023-10-19T08:38:33.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.637+0000 7f54a7a24700 1 -- 172.21.15.79:0/1574211632 wait complete. 2023-10-19T08:38:33.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.638+0000 7f54a7a24700 1 Processor -- start 2023-10-19T08:38:33.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.638+0000 7f54a7a24700 1 -- start start 2023-10-19T08:38:33.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.639+0000 7f54a7a24700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54a00adee0 0x7f54a00af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.639+0000 7f54a7a24700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54a00b0710 0x7f54a00c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.639+0000 7f54a7a24700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54a00d14f0 0x7f54a009ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.639+0000 7f54a7a24700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00c69c0 con 0x7f54a00adee0 2023-10-19T08:38:33.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.639+0000 7f54a7a24700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00c5d40 con 0x7f54a00d14f0 2023-10-19T08:38:33.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.639+0000 7f54a7a24700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00c6020 con 0x7f54a00b0710 2023-10-19T08:38:33.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.639+0000 7f54a57c0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54a00adee0 0x7f54a00af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.639+0000 7f54a57c0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54a00adee0 0x7f54a00af070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46940/0 (socket says 172.21.15.79:46940) 2023-10-19T08:38:33.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.639+0000 7f54a57c0700 1 -- 172.21.15.79:0/190848026 learned_addr learned my addr 172.21.15.79:0/190848026 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:33.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.639+0000 7f54a57c0700 1 -- 172.21.15.79:0/190848026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54a00b0710 msgr2=0x7f54a00c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:33.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.639+0000 7f54a57c0700 1 --2- 172.21.15.79:0/190848026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54a00b0710 0x7f54a00c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.639+0000 7f54a57c0700 1 -- 172.21.15.79:0/190848026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54a00d14f0 msgr2=0x7f54a009ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:33.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.639+0000 7f54a57c0700 1 --2- 172.21.15.79:0/190848026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54a00d14f0 0x7f54a009ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.640+0000 7f54a57c0700 1 -- 172.21.15.79:0/190848026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54900094a0 con 0x7f54a00adee0 2023-10-19T08:38:33.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.640+0000 7f54a57c0700 1 --2- 172.21.15.79:0/190848026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54a00adee0 0x7f54a00af070 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c4a0 tx=0x7f549c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:33.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.640+0000 7f5495ffb700 1 -- 172.21.15.79:0/190848026 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0054e0 con 0x7f54a00adee0 2023-10-19T08:38:33.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.640+0000 7f5495ffb700 1 -- 172.21.15.79:0/190848026 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c003680 con 0x7f54a00adee0 2023-10-19T08:38:33.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.640+0000 7f5495ffb700 1 -- 172.21.15.79:0/190848026 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c003a30 con 0x7f54a00adee0 2023-10-19T08:38:33.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.640+0000 7f54a7a24700 1 -- 172.21.15.79:0/190848026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a00c6300 con 0x7f54a00adee0 2023-10-19T08:38:33.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.640+0000 7f54a7a24700 1 -- 172.21.15.79:0/190848026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a00c5960 con 0x7f54a00adee0 2023-10-19T08:38:33.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.641+0000 7f54a7a24700 1 -- 172.21.15.79:0/190848026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a004ee70 con 0x7f54a00adee0 2023-10-19T08:38:33.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.641+0000 7f5495ffb700 1 -- 172.21.15.79:0/190848026 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f549c003b90 con 0x7f54a00adee0 2023-10-19T08:38:33.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.642+0000 7f5495ffb700 1 --2- 172.21.15.79:0/190848026 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f548406a0e0 0x7f548406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:33.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.642+0000 7f5495ffb700 1 -- 172.21.15.79:0/190848026 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f549c087830 con 0x7f54a00adee0 2023-10-19T08:38:33.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.642+0000 7f54a4fbf700 1 --2- 172.21.15.79:0/190848026 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f548406a0e0 0x7f548406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:33.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.642+0000 7f54a4fbf700 1 --2- 172.21.15.79:0/190848026 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f548406a0e0 0x7f548406c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f54a00af9c0 tx=0x7f5490013040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:33.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.646+0000 7f5495ffb700 1 -- 172.21.15.79:0/190848026 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f549c052cc0 con 0x7f54a00adee0 2023-10-19T08:38:33.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.877+0000 7f54a7a24700 1 -- 172.21.15.79:0/190848026 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f54a006bb20 con 0x7f54a00adee0 2023-10-19T08:38:33.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.878+0000 7f5495ffb700 1 -- 172.21.15.79:0/190848026 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f549c0562e0 con 0x7f54a00adee0 2023-10-19T08:38:33.881 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-19T08:38:33.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.880+0000 7f54a7a24700 1 -- 172.21.15.79:0/190848026 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f548406a0e0 msgr2=0x7f548406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:33.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.880+0000 7f54a7a24700 1 --2- 172.21.15.79:0/190848026 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f548406a0e0 0x7f548406c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f54a00af9c0 tx=0x7f5490013040 comp rx=0 tx=0).stop 2023-10-19T08:38:33.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.880+0000 7f54a7a24700 1 -- 172.21.15.79:0/190848026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54a00adee0 msgr2=0x7f54a00af070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:33.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.880+0000 7f54a7a24700 1 --2- 172.21.15.79:0/190848026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54a00adee0 0x7f54a00af070 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c4a0 tx=0x7f549c00c860 comp rx=0 tx=0).stop 2023-10-19T08:38:33.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.880+0000 7f54a7a24700 1 -- 172.21.15.79:0/190848026 shutdown_connections 2023-10-19T08:38:33.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.880+0000 7f54a7a24700 1 --2- 172.21.15.79:0/190848026 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54a00d14f0 0x7f54a009ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.880+0000 7f54a7a24700 1 --2- 172.21.15.79:0/190848026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54a00adee0 0x7f54a00af070 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.880+0000 7f54a7a24700 1 --2- 172.21.15.79:0/190848026 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f548406a0e0 0x7f548406c5a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.880+0000 7f54a7a24700 1 --2- 172.21.15.79:0/190848026 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54a00b0710 0x7f54a00c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:33.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.880+0000 7f54a7a24700 1 -- 172.21.15.79:0/190848026 >> 172.21.15.79:0/190848026 conn(0x7f54a009a0b0 msgr2=0x7f54a00b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:33.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.880+0000 7f54a7a24700 1 -- 172.21.15.79:0/190848026 shutdown_connections 2023-10-19T08:38:33.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:33.880+0000 7f54a7a24700 1 -- 172.21.15.79:0/190848026 wait complete. 2023-10-19T08:38:33.895 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-19T08:38:33.895 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-19T08:38:33.895 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-10-19T08:38:33.896 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-19T08:38:33.896 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-19T08:38:33.896 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-19T08:38:33.896 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-19T08:38:33.897 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-19T08:38:33.897 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-19T08:38:33.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:33.897 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-10-19T08:38:33.914 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-19T08:38:33.915 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-19T08:38:33.915 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-19T08:38:33.915 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:33.915 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-19T08:38:33.915 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:33.916 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:38:33.916 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:33.916 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:38:33.916 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:33.916 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:38:33.917 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:33.917 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-19T08:38:33.917 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:33.917 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-19T08:38:33.917 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42392sec preferred_lft 42392sec 2023-10-19T08:38:33.918 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::b457:4012:3867:53f6/64 scope link noprefixroute 2023-10-19T08:38:33.918 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:33.918 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-19T08:38:33.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:33.919 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-19T08:38:33.919 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-19T08:38:33.919 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add name ceph-brx type bridge 2023-10-19T08:38:33.919 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr flush dev ceph-brx 2023-10-19T08:38:33.920 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set ceph-brx up 2023-10-19T08:38:33.920 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-19T08:38:33.920 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-19T08:38:34.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:34.030 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-19T08:38:34.056 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-10-19T08:38:34.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:34.057 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-10-19T08:38:34.116 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-10-19T08:38:34.117 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-19T08:38:34.117 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-19T08:38:34.117 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-19T08:38:34.117 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-19T08:38:34.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:34.118 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-19T08:38:34.118 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-19T08:38:34.119 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-19T08:38:34.119 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-19T08:38:34.119 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-19T08:38:34.120 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-19T08:38:34.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:34.223 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-19T08:38:34.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:34.240 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list-id 2023-10-19T08:38:34.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:34.296 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-19T08:38:34.296 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-19T08:38:34.297 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-19T08:38:34.297 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-19T08:38:34.297 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-19T08:38:34.391 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-19T08:38:34.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:34.391 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-19T08:38:34.392 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-19T08:38:34.392 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-19T08:38:34.392 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-19T08:38:34.393 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-19T08:38:34.393 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-19T08:38:34.393 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-19T08:38:34.393 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-19T08:38:34.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:34.593 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-19T08:38:34.594 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-19T08:38:34.594 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-10-19T08:38:34.594 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set dev brx.0 master ceph-brx 2023-10-19T08:38:34.595 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-19T08:38:34.700 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-19T08:38:34.701 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-19T08:38:34.701 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-19T08:38:34.726 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-19T08:38:34.726 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-19T08:38:34.726 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-19T08:38:34.782 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2023-10-19T08:38:34.850 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-19T08:38:34.850 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-19T08:38:34.915 INFO:teuthology.orchestra.run.smithi079.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-19T08:38:34.917 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-19T08:38:34.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:34.918 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2023-10-19T08:38:34.974 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-19T08:38:34.974 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-19T08:38:35.016 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2023-10-19T08:38:35.041 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-19T08:38:35.042 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-19T08:38:35.103 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:2023-10-19T08:38:35.099+0000 7f49f29365c0 -1 init, newargv = 0x5654bbef3f80 newargc=15 2023-10-19T08:38:35.103 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[116357]: starting ceph client 2023-10-19T08:38:35.108 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[116357]: starting fuse 2023-10-19T08:38:35.108 INFO:teuthology.orchestra.run.smithi079.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-19T08:38:35.110 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-19T08:38:35.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:35.111 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2023-10-19T08:38:35.167 INFO:teuthology.orchestra.run.smithi079.stdout:46 2023-10-19T08:38:35.168 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-19T08:38:35.168 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2023-10-19T08:38:35.169 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2023-10-19T08:38:35.169 DEBUG:teuthology.orchestra.run.smithi079:> import re 2023-10-19T08:38:35.169 DEBUG:teuthology.orchestra.run.smithi079:> import os 2023-10-19T08:38:35.170 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2023-10-19T08:38:35.170 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-19T08:38:35.170 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2023-10-19T08:38:35.171 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-19T08:38:35.171 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2023-10-19T08:38:35.171 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-19T08:38:35.171 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-19T08:38:35.172 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2023-10-19T08:38:35.172 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2023-10-19T08:38:35.172 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2023-10-19T08:38:35.173 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2023-10-19T08:38:35.173 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-19T08:38:35.173 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2023-10-19T08:38:35.174 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-19T08:38:35.174 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-19T08:38:35.174 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-19T08:38:35.174 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2023-10-19T08:38:35.175 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2023-10-19T08:38:35.175 DEBUG:teuthology.orchestra.run.smithi079:> return f 2023-10-19T08:38:35.175 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-19T08:38:35.176 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-19T08:38:35.176 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.0")) 2023-10-19T08:38:35.176 DEBUG:teuthology.orchestra.run.smithi079:> ' 2023-10-19T08:38:35.291 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.0.116357.asok 2023-10-19T08:38:35.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-19T08:38:35.300 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.116357.asok 2023-10-19T08:38:35.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:35.300 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.116357.asok status 2023-10-19T08:38:35.456 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-19T08:38:35.457 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2023-10-19T08:38:35.457 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "6f3e6b48891b9b50415c0822b6b870797fcda16d", 2023-10-19T08:38:35.457 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 18.0.0-5610-g6f3e6b48 (6f3e6b48891b9b50415c0822b6b870797fcda16d) reef (dev)", 2023-10-19T08:38:35.457 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "0", 2023-10-19T08:38:35.458 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2023-10-19T08:38:35.458 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-19T08:38:35.458 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "116357", 2023-10-19T08:38:35.458 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2023-10-19T08:38:35.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:38:35.459 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2023-10-19T08:38:35.459 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2023-10-19T08:38:35.459 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4944, 2023-10-19T08:38:35.459 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2023-10-19T08:38:35.459 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2023-10-19T08:38:35.460 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2023-10-19T08:38:35.460 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 4944 2023-10-19T08:38:35.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:38:35.460 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2023-10-19T08:38:35.460 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-19T08:38:35.460 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2023-10-19T08:38:35.461 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1855453859 2023-10-19T08:38:35.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:38:35.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:38:35.461 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2023-10-19T08:38:35.461 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-19T08:38:35.462 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2023-10-19T08:38:35.462 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1855453859 2023-10-19T08:38:35.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:38:35.462 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.4944 192.168.0.1:0/1855453859", 2023-10-19T08:38:35.462 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/1855453859", 2023-10-19T08:38:35.463 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2023-10-19T08:38:35.463 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 9, 2023-10-19T08:38:35.463 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 25, 2023-10-19T08:38:35.463 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2023-10-19T08:38:35.463 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2023-10-19T08:38:35.464 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2023-10-19T08:38:35.464 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-19T08:38:35.467 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-19T08:38:35.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.584+0000 7f46e477e700 1 Processor -- start 2023-10-19T08:38:35.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.584+0000 7f46e477e700 1 -- start start 2023-10-19T08:38:35.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.585+0000 7f46e477e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f46dc0af170 0x7f46dc0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:35.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.585+0000 7f46e477e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46dc0b1de0 0x7f46dc0b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:35.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.585+0000 7f46e477e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46dc15de50 con 0x7f46dc0cd800 2023-10-19T08:38:35.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.585+0000 7f46e477e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46dc0af550 con 0x7f46dc0af170 2023-10-19T08:38:35.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.585+0000 7f46e477e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc0b16b0 con 0x7f46dc0b1de0 2023-10-19T08:38:35.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.585+0000 7f46e251a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f46dc0af170 0x7f46dc0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:35.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.585+0000 7f46e1d19700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46dc0b1de0 0x7f46dc0b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:35.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.585+0000 7f46e251a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f46dc0af170 0x7f46dc0cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:33212/0 (socket says 172.21.15.79:33212) 2023-10-19T08:38:35.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.585+0000 7f46e251a700 1 -- 172.21.15.79:0/1463329114 learned_addr learned my addr 172.21.15.79:0/1463329114 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:35.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.585+0000 7f46e2d1b700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f46dc0cd800 0x7f46dc06a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:41884/0 (socket says 172.21.15.79:41884) 2023-10-19T08:38:35.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.585+0000 7f46e1d19700 1 -- 172.21.15.79:0/1463329114 >> v2:172.21.15.89:3300/0 conn(0x7f46dc0af170 msgr2=0x7f46dc0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:35.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.585+0000 7f46e1d19700 1 --2- 172.21.15.79:0/1463329114 >> v2:172.21.15.89:3300/0 conn(0x7f46dc0af170 0x7f46dc0cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:35.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.585+0000 7f46e1d19700 1 -- 172.21.15.79:0/1463329114 >> v1:172.21.15.89:6789/0 conn(0x7f46dc0cd800 legacy=0x7f46dc06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:35.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.585+0000 7f46e1d19700 1 -- 172.21.15.79:0/1463329114 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46dc15e130 con 0x7f46dc0b1de0 2023-10-19T08:38:35.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.585+0000 7f46e251a700 1 --2- 172.21.15.79:0/1463329114 >> v2:172.21.15.89:3300/0 conn(0x7f46dc0af170 0x7f46dc0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:38:35.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.586+0000 7f46e1d19700 1 --2- 172.21.15.79:0/1463329114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46dc0b1de0 0x7f46dc0b2240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009840 tx=0x7f46cc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4440fc36fc05f1c server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:35.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.586+0000 7f46e1518700 1 -- 172.21.15.79:0/1463329114 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc011830 con 0x7f46dc0b1de0 2023-10-19T08:38:35.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.586+0000 7f46e1518700 1 -- 172.21.15.79:0/1463329114 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc011990 con 0x7f46dc0b1de0 2023-10-19T08:38:35.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.586+0000 7f46e1518700 1 -- 172.21.15.79:0/1463329114 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc011d20 con 0x7f46dc0b1de0 2023-10-19T08:38:35.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.586+0000 7f46e477e700 1 -- 172.21.15.79:0/1463329114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46dc0b1de0 msgr2=0x7f46dc0b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:35.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.586+0000 7f46e477e700 1 --2- 172.21.15.79:0/1463329114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46dc0b1de0 0x7f46dc0b2240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f46cc009840 tx=0x7f46cc009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:35.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.586+0000 7f46e477e700 1 -- 172.21.15.79:0/1463329114 shutdown_connections 2023-10-19T08:38:35.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.586+0000 7f46e477e700 1 --2- 172.21.15.79:0/1463329114 >> v2:172.21.15.89:3300/0 conn(0x7f46dc0af170 0x7f46dc0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:35.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.586+0000 7f46e477e700 1 --2- 172.21.15.79:0/1463329114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46dc0b1de0 0x7f46dc0b2240 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:35.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.586+0000 7f46e477e700 1 -- 172.21.15.79:0/1463329114 >> 172.21.15.79:0/1463329114 conn(0x7f46dc06dcc0 msgr2=0x7f46dc06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:35.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.586+0000 7f46e477e700 1 -- 172.21.15.79:0/1463329114 shutdown_connections 2023-10-19T08:38:35.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.586+0000 7f46e477e700 1 -- 172.21.15.79:0/1463329114 wait complete. 2023-10-19T08:38:35.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.587+0000 7f46e477e700 1 Processor -- start 2023-10-19T08:38:35.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.588+0000 7f46e477e700 1 -- start start 2023-10-19T08:38:35.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.588+0000 7f46e477e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46dc0af170 0x7f46dc0abb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:35.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.588+0000 7f46e477e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46dc0b1de0 0x7f46dc15bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:35.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.588+0000 7f46e477e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46dc0cd800 0x7f46dc15c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:35.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.588+0000 7f46e477e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc0c3e60 con 0x7f46dc0cd800 2023-10-19T08:38:35.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.588+0000 7f46e477e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc1e8470 con 0x7f46dc0af170 2023-10-19T08:38:35.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.588+0000 7f46e477e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc1e78f0 con 0x7f46dc0b1de0 2023-10-19T08:38:35.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.588+0000 7f46e2d1b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46dc0cd800 0x7f46dc15c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:35.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.588+0000 7f46e2d1b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46dc0cd800 0x7f46dc15c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:46976/0 (socket says 172.21.15.79:46976) 2023-10-19T08:38:35.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.588+0000 7f46e1d19700 1 --2- 172.21.15.79:0/912772386 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46dc0b1de0 0x7f46dc15bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:35.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.588+0000 7f46e2d1b700 1 -- 172.21.15.79:0/912772386 learned_addr learned my addr 172.21.15.79:0/912772386 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:35.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.588+0000 7f46e251a700 1 --2- 172.21.15.79:0/912772386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46dc0af170 0x7f46dc0abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:35.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.589+0000 7f46e2d1b700 1 -- 172.21.15.79:0/912772386 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46dc0b1de0 msgr2=0x7f46dc15bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:35.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.589+0000 7f46e2d1b700 1 --2- 172.21.15.79:0/912772386 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46dc0b1de0 0x7f46dc15bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:35.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.589+0000 7f46e2d1b700 1 -- 172.21.15.79:0/912772386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46dc0af170 msgr2=0x7f46dc0abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:35.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.589+0000 7f46e2d1b700 1 --2- 172.21.15.79:0/912772386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46dc0af170 0x7f46dc0abb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:35.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.589+0000 7f46e2d1b700 1 -- 172.21.15.79:0/912772386 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d8009550 con 0x7f46dc0cd800 2023-10-19T08:38:35.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.589+0000 7f46e1d19700 1 --2- 172.21.15.79:0/912772386 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46dc0b1de0 0x7f46dc15bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:38:35.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.589+0000 7f46e2d1b700 1 --2- 172.21.15.79:0/912772386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46dc0cd800 0x7f46dc15c4d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f46d400cc00 tx=0x7f46d400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:35.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.589+0000 7f46d2ffd700 1 -- 172.21.15.79:0/912772386 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d400aa40 con 0x7f46dc0cd800 2023-10-19T08:38:35.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.589+0000 7f46d2ffd700 1 -- 172.21.15.79:0/912772386 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d400aba0 con 0x7f46dc0cd800 2023-10-19T08:38:35.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.589+0000 7f46e477e700 1 -- 172.21.15.79:0/912772386 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46cc0094a0 con 0x7f46dc0cd800 2023-10-19T08:38:35.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.589+0000 7f46d2ffd700 1 -- 172.21.15.79:0/912772386 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d4007070 con 0x7f46dc0cd800 2023-10-19T08:38:35.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.589+0000 7f46e477e700 1 -- 172.21.15.79:0/912772386 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46dc1e7eb0 con 0x7f46dc0cd800 2023-10-19T08:38:35.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.590+0000 7f46e477e700 1 -- 172.21.15.79:0/912772386 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46dc0c3fd0 con 0x7f46dc0cd800 2023-10-19T08:38:35.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.590+0000 7f46d2ffd700 1 -- 172.21.15.79:0/912772386 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f46d40071d0 con 0x7f46dc0cd800 2023-10-19T08:38:35.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.591+0000 7f46d2ffd700 1 --2- 172.21.15.79:0/912772386 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f46c006a0e0 0x7f46c006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:35.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.591+0000 7f46d2ffd700 1 -- 172.21.15.79:0/912772386 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f46d4088480 con 0x7f46dc0cd800 2023-10-19T08:38:35.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.591+0000 7f46e251a700 1 --2- 172.21.15.79:0/912772386 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f46c006a0e0 0x7f46c006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:35.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.591+0000 7f46e251a700 1 --2- 172.21.15.79:0/912772386 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f46c006a0e0 0x7f46c006c5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f46d8006d30 tx=0x7f46d80092c0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:35.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.595+0000 7f46d2ffd700 1 -- 172.21.15.79:0/912772386 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f46dc0c3fd0 con 0x7f46dc0cd800 2023-10-19T08:38:35.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.829+0000 7f46e477e700 1 -- 172.21.15.79:0/912772386 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f46dc0c3fa0 con 0x7f46dc0cd800 2023-10-19T08:38:35.833 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.830+0000 7f46d2ffd700 1 -- 172.21.15.79:0/912772386 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f46d4053930 con 0x7f46dc0cd800 2023-10-19T08:38:35.834 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-19T08:38:35.835 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.832+0000 7f46e477e700 1 -- 172.21.15.79:0/912772386 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f46c006a0e0 msgr2=0x7f46c006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:35.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.832+0000 7f46e477e700 1 --2- 172.21.15.79:0/912772386 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f46c006a0e0 0x7f46c006c5a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f46d8006d30 tx=0x7f46d80092c0 comp rx=0 tx=0).stop 2023-10-19T08:38:35.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.832+0000 7f46e477e700 1 -- 172.21.15.79:0/912772386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46dc0cd800 msgr2=0x7f46dc15c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:35.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.832+0000 7f46e477e700 1 --2- 172.21.15.79:0/912772386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46dc0cd800 0x7f46dc15c4d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f46d400cc00 tx=0x7f46d400cf10 comp rx=0 tx=0).stop 2023-10-19T08:38:35.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.832+0000 7f46e477e700 1 -- 172.21.15.79:0/912772386 shutdown_connections 2023-10-19T08:38:35.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.832+0000 7f46e477e700 1 --2- 172.21.15.79:0/912772386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46dc0cd800 0x7f46dc15c4d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:35.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.832+0000 7f46e477e700 1 --2- 172.21.15.79:0/912772386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46dc0af170 0x7f46dc0abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:35.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.832+0000 7f46e477e700 1 --2- 172.21.15.79:0/912772386 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f46c006a0e0 0x7f46c006c5a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:35.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.832+0000 7f46e477e700 1 --2- 172.21.15.79:0/912772386 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46dc0b1de0 0x7f46dc15bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:35.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.832+0000 7f46e477e700 1 -- 172.21.15.79:0/912772386 >> 172.21.15.79:0/912772386 conn(0x7f46dc06dcc0 msgr2=0x7f46dc0cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:35.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.832+0000 7f46e477e700 1 -- 172.21.15.79:0/912772386 shutdown_connections 2023-10-19T08:38:35.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:35.832+0000 7f46e477e700 1 -- 172.21.15.79:0/912772386 wait complete. 2023-10-19T08:38:35.847 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-19T08:38:35.847 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-19T08:38:35.848 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-10-19T08:38:35.848 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-19T08:38:35.848 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-19T08:38:35.848 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-19T08:38:35.849 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-19T08:38:35.849 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-19T08:38:35.849 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-19T08:38:35.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:35.850 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-10-19T08:38:35.867 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-19T08:38:35.867 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-19T08:38:35.868 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-19T08:38:35.868 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:35.868 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-19T08:38:35.868 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:35.868 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:38:35.869 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:35.869 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:38:35.869 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:35.869 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:38:35.869 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:35.870 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-19T08:38:35.870 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:35.870 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-19T08:38:35.870 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42390sec preferred_lft 42390sec 2023-10-19T08:38:35.870 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::b457:4012:3867:53f6/64 scope link noprefixroute 2023-10-19T08:38:35.871 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:35.871 INFO:teuthology.orchestra.run.smithi079.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-19T08:38:35.871 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 6e:3a:af:29:74:06 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:35.871 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-19T08:38:35.871 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:35.871 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5c75:7aff:fe79:bf81/64 scope link 2023-10-19T08:38:35.872 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:35.872 INFO:teuthology.orchestra.run.smithi079.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-19T08:38:35.872 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 6e:3a:af:29:74:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-19T08:38:35.872 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::6c3a:afff:fe29:7406/64 scope link tentative 2023-10-19T08:38:35.872 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:35.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:35.873 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-19T08:38:35.932 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-10-19T08:38:35.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:35.934 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-10-19T08:38:35.991 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-10-19T08:38:35.992 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-19T08:38:35.992 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-19T08:38:35.992 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-19T08:38:35.992 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-19T08:38:35.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:35.993 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-19T08:38:35.993 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-19T08:38:35.993 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-19T08:38:35.994 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-19T08:38:35.994 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-19T08:38:35.994 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-19T08:38:36.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:36.097 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-19T08:38:36.113 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-19T08:38:36.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:36.114 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list-id 2023-10-19T08:38:36.169 INFO:teuthology.orchestra.run.smithi079.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-19T08:38:36.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:36.170 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-19T08:38:36.170 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-19T08:38:36.170 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-19T08:38:36.171 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-19T08:38:36.171 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-19T08:38:36.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:36.262 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-19T08:38:36.300 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-19T08:38:36.300 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-19T08:38:36.301 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-19T08:38:36.301 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:36.301 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-19T08:38:36.301 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:36.301 INFO:teuthology.orchestra.run.smithi079.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-19T08:38:36.302 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 26:90:bd:dd:ac:54 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-19T08:38:36.302 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-19T08:38:36.302 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:36.302 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::2490:bdff:fedd:ac54/64 scope link 2023-10-19T08:38:36.302 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:36.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:36.313 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-19T08:38:36.389 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-19T08:38:36.389 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-19T08:38:36.389 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-19T08:38:36.390 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:36.390 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-19T08:38:36.390 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:36.390 INFO:teuthology.orchestra.run.smithi079.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-19T08:38:36.390 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 26:90:bd:dd:ac:54 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-19T08:38:36.391 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-19T08:38:36.391 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:36.391 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::2490:bdff:fedd:ac54/64 scope link 2023-10-19T08:38:36.391 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:36.401 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-19T08:38:36.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:36.402 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-19T08:38:36.402 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-19T08:38:36.403 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-19T08:38:36.403 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-19T08:38:36.403 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-19T08:38:36.403 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-19T08:38:36.404 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-19T08:38:36.404 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-19T08:38:36.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:36.627 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-19T08:38:36.627 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-19T08:38:36.628 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.1 up 2023-10-19T08:38:36.628 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set dev brx.1 master ceph-brx 2023-10-19T08:38:36.628 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-19T08:38:36.747 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-10-19T08:38:36.747 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-19T08:38:36.747 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-19T08:38:36.770 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-19T08:38:36.770 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-19T08:38:36.770 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-19T08:38:36.826 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2023-10-19T08:38:36.893 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-19T08:38:36.893 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-19T08:38:36.959 INFO:teuthology.orchestra.run.smithi079.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-19T08:38:36.959 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-19T08:38:36.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:36.961 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2023-10-19T08:38:37.018 INFO:teuthology.orchestra.run.smithi079.stdout:46 2023-10-19T08:38:37.018 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-10-19T08:38:37.019 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-10-19T08:38:37.061 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2023-10-19T08:38:37.087 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-19T08:38:37.087 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-19T08:38:37.148 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi079.stderr:2023-10-19T08:38:37.145+0000 7f2c5afb55c0 -1 init, newargv = 0x55b0c0cf5f30 newargc=15 2023-10-19T08:38:37.149 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi079.stderr:ceph-fuse[117010]: starting ceph client 2023-10-19T08:38:37.154 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi079.stderr:ceph-fuse[117010]: starting fuse 2023-10-19T08:38:37.155 INFO:teuthology.orchestra.run.smithi079.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-19T08:38:37.157 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-19T08:38:37.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:37.158 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2023-10-19T08:38:37.213 INFO:teuthology.orchestra.run.smithi079.stdout:46 2023-10-19T08:38:37.214 INFO:teuthology.orchestra.run.smithi079.stdout:48 2023-10-19T08:38:37.214 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-10-19T08:38:37.214 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2023-10-19T08:38:37.215 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2023-10-19T08:38:37.215 DEBUG:teuthology.orchestra.run.smithi079:> import re 2023-10-19T08:38:37.215 DEBUG:teuthology.orchestra.run.smithi079:> import os 2023-10-19T08:38:37.216 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2023-10-19T08:38:37.216 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-19T08:38:37.216 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2023-10-19T08:38:37.216 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-10-19T08:38:37.217 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2023-10-19T08:38:37.217 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-10-19T08:38:37.217 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-19T08:38:37.218 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2023-10-19T08:38:37.218 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2023-10-19T08:38:37.218 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2023-10-19T08:38:37.219 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2023-10-19T08:38:37.219 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-19T08:38:37.219 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2023-10-19T08:38:37.219 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-19T08:38:37.220 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-19T08:38:37.220 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-19T08:38:37.220 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2023-10-19T08:38:37.221 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2023-10-19T08:38:37.221 DEBUG:teuthology.orchestra.run.smithi079:> return f 2023-10-19T08:38:37.221 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-19T08:38:37.222 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-19T08:38:37.222 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.2")) 2023-10-19T08:38:37.222 DEBUG:teuthology.orchestra.run.smithi079:> ' 2023-10-19T08:38:37.339 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.2.117010.asok 2023-10-19T08:38:37.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-19T08:38:37.349 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.117010.asok 2023-10-19T08:38:37.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:37.349 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.117010.asok status 2023-10-19T08:38:37.506 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-19T08:38:37.507 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2023-10-19T08:38:37.507 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "6f3e6b48891b9b50415c0822b6b870797fcda16d", 2023-10-19T08:38:37.507 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 18.0.0-5610-g6f3e6b48 (6f3e6b48891b9b50415c0822b6b870797fcda16d) reef (dev)", 2023-10-19T08:38:37.507 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "2", 2023-10-19T08:38:37.508 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2023-10-19T08:38:37.508 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-10-19T08:38:37.508 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "117010", 2023-10-19T08:38:37.508 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2023-10-19T08:38:37.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:38:37.509 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2023-10-19T08:38:37.509 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2023-10-19T08:38:37.509 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 4953, 2023-10-19T08:38:37.509 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2023-10-19T08:38:37.509 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2023-10-19T08:38:37.509 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2023-10-19T08:38:37.510 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 4953 2023-10-19T08:38:37.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:38:37.510 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2023-10-19T08:38:37.510 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-19T08:38:37.510 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.2:0", 2023-10-19T08:38:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2790604101 2023-10-19T08:38:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:38:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:38:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2023-10-19T08:38:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-19T08:38:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.2:0", 2023-10-19T08:38:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2790604101 2023-10-19T08:38:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:38:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.4953 192.168.0.2:0/2790604101", 2023-10-19T08:38:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.2:0/2790604101", 2023-10-19T08:38:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2023-10-19T08:38:37.513 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 9, 2023-10-19T08:38:37.513 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 25, 2023-10-19T08:38:37.513 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2023-10-19T08:38:37.513 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2023-10-19T08:38:37.514 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2023-10-19T08:38:37.514 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-19T08:38:37.516 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-19T08:38:37.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.632+0000 7fdc4c666700 1 Processor -- start 2023-10-19T08:38:37.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.633+0000 7fdc4c666700 1 -- start start 2023-10-19T08:38:37.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.633+0000 7fdc4c666700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdc440af170 0x7fdc440cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:37.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.634+0000 7fdc4c666700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4415de50 con 0x7fdc440b1de0 2023-10-19T08:38:37.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.634+0000 7fdc4c666700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4415e130 con 0x7fdc440b2270 2023-10-19T08:38:37.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.634+0000 7fdc4c666700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc440af550 con 0x7fdc440af170 2023-10-19T08:38:37.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.634+0000 7fdc4a402700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdc440af170 0x7fdc440cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:37.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.634+0000 7fdc49c01700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdc440b1de0 0x7fdc440cd800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57066/0 (socket says 172.21.15.79:57066) 2023-10-19T08:38:37.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.634+0000 7fdc49c01700 1 -- 172.21.15.79:0/2741358605 learned_addr learned my addr 172.21.15.79:0/2741358605 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.634+0000 7fdc49400700 1 -- 172.21.15.79:0/2741358605 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107653189 0 0) 0x7fdc4415de50 con 0x7fdc440b1de0 2023-10-19T08:38:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.634+0000 7fdc49400700 1 -- 172.21.15.79:0/2741358605 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc300035b0 con 0x7fdc440b1de0 2023-10-19T08:38:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.634+0000 7fdc4a402700 1 -- 172.21.15.79:0/2741358605 >> v1:172.21.15.89:6789/0 conn(0x7fdc440b2270 legacy=0x7fdc4406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.634+0000 7fdc49400700 1 -- 172.21.15.79:0/2741358605 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984377323 0 0) 0x7fdc4415e130 con 0x7fdc440b2270 2023-10-19T08:38:37.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.634+0000 7fdc4a402700 1 -- 172.21.15.79:0/2741358605 >> v1:172.21.15.79:6789/0 conn(0x7fdc440b1de0 legacy=0x7fdc440cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.634+0000 7fdc4a402700 1 -- 172.21.15.79:0/2741358605 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4415e410 con 0x7fdc440af170 2023-10-19T08:38:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.634+0000 7fdc4a402700 1 --2- 172.21.15.79:0/2741358605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc440af170 0x7fdc440cd0c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdc34009870 tx=0x7fdc34009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c9f606d946bf1e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.635+0000 7fdc49400700 1 -- 172.21.15.79:0/2741358605 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc34011830 con 0x7fdc440af170 2023-10-19T08:38:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.635+0000 7fdc49400700 1 -- 172.21.15.79:0/2741358605 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc34011990 con 0x7fdc440af170 2023-10-19T08:38:37.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.635+0000 7fdc49400700 1 -- 172.21.15.79:0/2741358605 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc34011d20 con 0x7fdc440af170 2023-10-19T08:38:37.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.635+0000 7fdc4c666700 1 -- 172.21.15.79:0/2741358605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc440af170 msgr2=0x7fdc440cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:37.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.635+0000 7fdc4c666700 1 --2- 172.21.15.79:0/2741358605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc440af170 0x7fdc440cd0c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdc34009870 tx=0x7fdc34009b80 comp rx=0 tx=0).stop 2023-10-19T08:38:37.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.635+0000 7fdc4c666700 1 -- 172.21.15.79:0/2741358605 shutdown_connections 2023-10-19T08:38:37.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.635+0000 7fdc4c666700 1 --2- 172.21.15.79:0/2741358605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc440af170 0x7fdc440cd0c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:37.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.635+0000 7fdc4c666700 1 -- 172.21.15.79:0/2741358605 >> 172.21.15.79:0/2741358605 conn(0x7fdc4406dcc0 msgr2=0x7fdc4406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:37.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.636+0000 7fdc4c666700 1 -- 172.21.15.79:0/2741358605 shutdown_connections 2023-10-19T08:38:37.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.636+0000 7fdc4c666700 1 -- 172.21.15.79:0/2741358605 wait complete. 2023-10-19T08:38:37.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.637+0000 7fdc4c666700 1 Processor -- start 2023-10-19T08:38:37.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.637+0000 7fdc4c666700 1 -- start start 2023-10-19T08:38:37.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.637+0000 7fdc4c666700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc440af170 0x7fdc44156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:37.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.637+0000 7fdc4c666700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc440b1de0 0x7fdc440af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:37.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.637+0000 7fdc4c666700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc440b2270 0x7fdc440afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:37.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.637+0000 7fdc4c666700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc441e7440 con 0x7fdc440b2270 2023-10-19T08:38:37.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc4c666700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc441e9330 con 0x7fdc440af170 2023-10-19T08:38:37.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc4c666700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc441e6b30 con 0x7fdc440b1de0 2023-10-19T08:38:37.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc4ac03700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc440b2270 0x7fdc440afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:37.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc4ac03700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc440b2270 0x7fdc440afcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47002/0 (socket says 172.21.15.79:47002) 2023-10-19T08:38:37.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc4ac03700 1 -- 172.21.15.79:0/3600027741 learned_addr learned my addr 172.21.15.79:0/3600027741 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:37.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc49c01700 1 --2- 172.21.15.79:0/3600027741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc440b1de0 0x7fdc440af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:37.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc4a402700 1 --2- 172.21.15.79:0/3600027741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc440af170 0x7fdc44156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:37.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc4ac03700 1 -- 172.21.15.79:0/3600027741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc440b1de0 msgr2=0x7fdc440af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:37.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc4ac03700 1 --2- 172.21.15.79:0/3600027741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc440b1de0 0x7fdc440af790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:37.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc4ac03700 1 -- 172.21.15.79:0/3600027741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc440af170 msgr2=0x7fdc44156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:37.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc4ac03700 1 --2- 172.21.15.79:0/3600027741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc440af170 0x7fdc44156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:37.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc4ac03700 1 -- 172.21.15.79:0/3600027741 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc340094a0 con 0x7fdc440b2270 2023-10-19T08:38:37.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc49c01700 1 --2- 172.21.15.79:0/3600027741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc440b1de0 0x7fdc440af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:37.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc4a402700 1 --2- 172.21.15.79:0/3600027741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc440af170 0x7fdc44156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:37.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc4ac03700 1 --2- 172.21.15.79:0/3600027741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc440b2270 0x7fdc440afcd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c00c7a0 tx=0x7fdc3c00cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:37.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc3affd700 1 -- 172.21.15.79:0/3600027741 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c003e30 con 0x7fdc440b2270 2023-10-19T08:38:37.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc3affd700 1 -- 172.21.15.79:0/3600027741 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c005070 con 0x7fdc440b2270 2023-10-19T08:38:37.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc4c666700 1 -- 172.21.15.79:0/3600027741 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc441e6df0 con 0x7fdc440b2270 2023-10-19T08:38:37.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc3affd700 1 -- 172.21.15.79:0/3600027741 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c005420 con 0x7fdc440b2270 2023-10-19T08:38:37.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.638+0000 7fdc4c666700 1 -- 172.21.15.79:0/3600027741 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc44156cc0 con 0x7fdc440b2270 2023-10-19T08:38:37.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.639+0000 7fdc4c666700 1 -- 172.21.15.79:0/3600027741 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc441e75f0 con 0x7fdc440b2270 2023-10-19T08:38:37.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.640+0000 7fdc3affd700 1 -- 172.21.15.79:0/3600027741 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdc3c005580 con 0x7fdc440b2270 2023-10-19T08:38:37.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.640+0000 7fdc3affd700 1 --2- 172.21.15.79:0/3600027741 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdc2806a0e0 0x7fdc2806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:37.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.640+0000 7fdc3affd700 1 -- 172.21.15.79:0/3600027741 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdc3c087eb0 con 0x7fdc440b2270 2023-10-19T08:38:37.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.640+0000 7fdc4a402700 1 --2- 172.21.15.79:0/3600027741 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdc2806a0e0 0x7fdc2806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:37.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.640+0000 7fdc4a402700 1 --2- 172.21.15.79:0/3600027741 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdc2806a0e0 0x7fdc2806c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdc34009bc0 tx=0x7fdc3401c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:37.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.644+0000 7fdc3affd700 1 -- 172.21.15.79:0/3600027741 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fdc441e75f0 con 0x7fdc440b2270 2023-10-19T08:38:37.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.876+0000 7fdc4c666700 1 -- 172.21.15.79:0/3600027741 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdc4404ee70 con 0x7fdc440b2270 2023-10-19T08:38:37.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.877+0000 7fdc3affd700 1 -- 172.21.15.79:0/3600027741 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fdc3c017070 con 0x7fdc440b2270 2023-10-19T08:38:37.881 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-19T08:38:37.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.879+0000 7fdc4c666700 1 -- 172.21.15.79:0/3600027741 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdc2806a0e0 msgr2=0x7fdc2806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:37.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.879+0000 7fdc4c666700 1 --2- 172.21.15.79:0/3600027741 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdc2806a0e0 0x7fdc2806c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdc34009bc0 tx=0x7fdc3401c040 comp rx=0 tx=0).stop 2023-10-19T08:38:37.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.879+0000 7fdc4c666700 1 -- 172.21.15.79:0/3600027741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc440b2270 msgr2=0x7fdc440afcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:37.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.879+0000 7fdc4c666700 1 --2- 172.21.15.79:0/3600027741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc440b2270 0x7fdc440afcd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c00c7a0 tx=0x7fdc3c00cb60 comp rx=0 tx=0).stop 2023-10-19T08:38:37.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.879+0000 7fdc4c666700 1 -- 172.21.15.79:0/3600027741 shutdown_connections 2023-10-19T08:38:37.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.879+0000 7fdc4c666700 1 --2- 172.21.15.79:0/3600027741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc440b2270 0x7fdc440afcd0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:37.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.879+0000 7fdc4c666700 1 --2- 172.21.15.79:0/3600027741 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdc440af170 0x7fdc44156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:37.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.879+0000 7fdc4c666700 1 --2- 172.21.15.79:0/3600027741 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdc2806a0e0 0x7fdc2806c5a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:37.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.879+0000 7fdc4c666700 1 --2- 172.21.15.79:0/3600027741 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdc440b1de0 0x7fdc440af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:37.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.879+0000 7fdc4c666700 1 -- 172.21.15.79:0/3600027741 >> 172.21.15.79:0/3600027741 conn(0x7fdc4406dcc0 msgr2=0x7fdc440caf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:37.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.879+0000 7fdc4c666700 1 -- 172.21.15.79:0/3600027741 shutdown_connections 2023-10-19T08:38:37.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:37.879+0000 7fdc4c666700 1 -- 172.21.15.79:0/3600027741 wait complete. 2023-10-19T08:38:37.894 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-19T08:38:37.894 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-19T08:38:37.895 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-19T08:38:37.895 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-19T08:38:37.895 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-19T08:38:37.896 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-19T08:38:37.896 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-19T08:38:37.896 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-19T08:38:37.896 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-19T08:38:37.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:37.897 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-19T08:38:37.918 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-19T08:38:37.918 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-19T08:38:37.918 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-19T08:38:37.918 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:37.919 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-19T08:38:37.919 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:37.919 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:38:37.919 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:37.920 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:38:37.920 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:37.920 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:38:37.920 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:37.920 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-19T08:38:37.921 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:37.921 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-19T08:38:37.921 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42393sec preferred_lft 42393sec 2023-10-19T08:38:37.921 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::6fbe:3bb2:e4b5:be20/64 scope link noprefixroute 2023-10-19T08:38:37.921 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:37.922 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-19T08:38:37.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:37.922 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-19T08:38:37.923 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-19T08:38:37.923 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add name ceph-brx type bridge 2023-10-19T08:38:37.923 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr flush dev ceph-brx 2023-10-19T08:38:37.924 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set ceph-brx up 2023-10-19T08:38:37.924 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-19T08:38:37.924 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-19T08:38:38.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:38.093 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-19T08:38:38.120 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-19T08:38:38.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:38.121 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-19T08:38:38.197 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-19T08:38:38.198 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-19T08:38:38.198 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-19T08:38:38.198 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-19T08:38:38.198 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-19T08:38:38.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:38.199 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-19T08:38:38.199 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-19T08:38:38.200 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-19T08:38:38.200 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-19T08:38:38.200 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-19T08:38:38.200 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-19T08:38:38.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:38.454 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-19T08:38:38.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:38.472 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list-id 2023-10-19T08:38:38.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:38.528 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-19T08:38:38.529 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-19T08:38:38.529 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-19T08:38:38.529 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-19T08:38:38.529 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-19T08:38:38.621 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-19T08:38:38.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:38.621 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-19T08:38:38.622 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-19T08:38:38.622 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-19T08:38:38.622 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-19T08:38:38.623 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-19T08:38:38.623 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-19T08:38:38.623 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-19T08:38:38.624 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-19T08:38:38.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:38.842 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-19T08:38:38.842 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-19T08:38:38.843 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-19T08:38:38.843 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set dev brx.0 master ceph-brx 2023-10-19T08:38:38.843 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-19T08:38:38.951 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-19T08:38:38.951 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-19T08:38:38.951 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-19T08:38:38.973 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-19T08:38:38.973 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-19T08:38:38.973 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-19T08:38:39.029 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-19T08:38:39.095 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-19T08:38:39.095 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-19T08:38:39.162 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-19T08:38:39.163 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-19T08:38:39.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:39.164 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-19T08:38:39.220 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-19T08:38:39.220 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-19T08:38:39.262 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-19T08:38:39.287 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-19T08:38:39.288 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-19T08:38:39.352 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-19T08:38:39.353 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-19T08:38:39.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:39.354 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-19T08:38:39.364 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi089.stderr:2023-10-19T08:38:39.360+0000 7f8d194855c0 -1 init, newargv = 0x5631288aef90 newargc=15 2023-10-19T08:38:39.365 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi089.stderr:ceph-fuse[110869]: starting ceph client 2023-10-19T08:38:39.369 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi089.stderr:ceph-fuse[110869]: starting fuse 2023-10-19T08:38:39.382 INFO:teuthology.orchestra.run.smithi089.stdout:46 2023-10-19T08:38:39.382 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-19T08:38:39.382 DEBUG:teuthology.orchestra.run.smithi089:> sudo stdin-killer -- python3 -c ' 2023-10-19T08:38:39.383 DEBUG:teuthology.orchestra.run.smithi089:> import glob 2023-10-19T08:38:39.383 DEBUG:teuthology.orchestra.run.smithi089:> import re 2023-10-19T08:38:39.383 DEBUG:teuthology.orchestra.run.smithi089:> import os 2023-10-19T08:38:39.384 DEBUG:teuthology.orchestra.run.smithi089:> import subprocess 2023-10-19T08:38:39.384 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-19T08:38:39.384 DEBUG:teuthology.orchestra.run.smithi089:> def _find_admin_socket(client_name): 2023-10-19T08:38:39.384 DEBUG:teuthology.orchestra.run.smithi089:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-19T08:38:39.385 DEBUG:teuthology.orchestra.run.smithi089:> files = glob.glob(asok_path) 2023-10-19T08:38:39.385 DEBUG:teuthology.orchestra.run.smithi089:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-19T08:38:39.385 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-19T08:38:39.385 DEBUG:teuthology.orchestra.run.smithi089:> # Given a non-glob path, it better be there 2023-10-19T08:38:39.386 DEBUG:teuthology.orchestra.run.smithi089:> if "*" not in asok_path: 2023-10-19T08:38:39.386 DEBUG:teuthology.orchestra.run.smithi089:> assert(len(files) == 1) 2023-10-19T08:38:39.386 DEBUG:teuthology.orchestra.run.smithi089:> return files[0] 2023-10-19T08:38:39.386 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-19T08:38:39.387 DEBUG:teuthology.orchestra.run.smithi089:> for f in files: 2023-10-19T08:38:39.387 DEBUG:teuthology.orchestra.run.smithi089:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-19T08:38:39.387 DEBUG:teuthology.orchestra.run.smithi089:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-19T08:38:39.388 DEBUG:teuthology.orchestra.run.smithi089:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-19T08:38:39.388 DEBUG:teuthology.orchestra.run.smithi089:> contents = proc_f.read() 2023-10-19T08:38:39.388 DEBUG:teuthology.orchestra.run.smithi089:> if mountpoint in contents: 2023-10-19T08:38:39.388 DEBUG:teuthology.orchestra.run.smithi089:> return f 2023-10-19T08:38:39.389 DEBUG:teuthology.orchestra.run.smithi089:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-19T08:38:39.389 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-19T08:38:39.389 DEBUG:teuthology.orchestra.run.smithi089:> print(_find_admin_socket("client.1")) 2023-10-19T08:38:39.389 DEBUG:teuthology.orchestra.run.smithi089:> ' 2023-10-19T08:38:39.505 INFO:teuthology.orchestra.run.smithi089.stdout:/var/run/ceph/ceph-client.1.110869.asok 2023-10-19T08:38:39.509 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:38:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-19T08:38:39.515 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.110869.asok 2023-10-19T08:38:39.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:39.516 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.110869.asok status 2023-10-19T08:38:39.671 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-10-19T08:38:39.671 INFO:teuthology.orchestra.run.smithi089.stdout: "metadata": { 2023-10-19T08:38:39.671 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_sha1": "6f3e6b48891b9b50415c0822b6b870797fcda16d", 2023-10-19T08:38:39.672 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_version": "ceph version 18.0.0-5610-g6f3e6b48 (6f3e6b48891b9b50415c0822b6b870797fcda16d) reef (dev)", 2023-10-19T08:38:39.672 INFO:teuthology.orchestra.run.smithi089.stdout: "entity_id": "1", 2023-10-19T08:38:39.672 INFO:teuthology.orchestra.run.smithi089.stdout: "hostname": "smithi089", 2023-10-19T08:38:39.672 INFO:teuthology.orchestra.run.smithi089.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-19T08:38:39.672 INFO:teuthology.orchestra.run.smithi089.stdout: "pid": "110869", 2023-10-19T08:38:39.673 INFO:teuthology.orchestra.run.smithi089.stdout: "root": "/" 2023-10-19T08:38:39.673 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-19T08:38:39.673 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_count": 0, 2023-10-19T08:38:39.673 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_pinned_count": 0, 2023-10-19T08:38:39.674 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 4741, 2023-10-19T08:38:39.674 INFO:teuthology.orchestra.run.smithi089.stdout: "inst": { 2023-10-19T08:38:39.674 INFO:teuthology.orchestra.run.smithi089.stdout: "name": { 2023-10-19T08:38:39.674 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "client", 2023-10-19T08:38:39.675 INFO:teuthology.orchestra.run.smithi089.stdout: "num": 4741 2023-10-19T08:38:39.675 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-19T08:38:39.675 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2023-10-19T08:38:39.675 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2023-10-19T08:38:39.675 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "192.168.0.1:0", 2023-10-19T08:38:39.675 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1111470001 2023-10-19T08:38:39.676 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-10-19T08:38:39.676 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-19T08:38:39.676 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2023-10-19T08:38:39.676 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2023-10-19T08:38:39.676 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "192.168.0.1:0", 2023-10-19T08:38:39.677 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1111470001 2023-10-19T08:38:39.677 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-19T08:38:39.677 INFO:teuthology.orchestra.run.smithi089.stdout: "inst_str": "client.4741 192.168.0.1:0/1111470001", 2023-10-19T08:38:39.677 INFO:teuthology.orchestra.run.smithi089.stdout: "addr_str": "192.168.0.1:0/1111470001", 2023-10-19T08:38:39.677 INFO:teuthology.orchestra.run.smithi089.stdout: "inode_count": 1, 2023-10-19T08:38:39.678 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_epoch": 9, 2023-10-19T08:38:39.678 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch": 25, 2023-10-19T08:38:39.678 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch_barrier": 0, 2023-10-19T08:38:39.678 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklisted": false, 2023-10-19T08:38:39.678 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs" 2023-10-19T08:38:39.679 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-10-19T08:38:39.680 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-19T08:38:39.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.809+0000 7fdd6b9ef700 1 Processor -- start 2023-10-19T08:38:39.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.810+0000 7fdd6b9ef700 1 -- start start 2023-10-19T08:38:39.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.811+0000 7fdd6b9ef700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdd640ca550 0x7fdd6406adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:39.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.811+0000 7fdd6b9ef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdd64066470 0x7fdd6406e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:39.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.811+0000 7fdd6b9ef700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd640cab30 con 0x7fdd64065fe0 2023-10-19T08:38:39.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.811+0000 7fdd6b9ef700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd640ca930 con 0x7fdd64066470 2023-10-19T08:38:39.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.811+0000 7fdd6b9ef700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd6415ce20 con 0x7fdd640ca550 2023-10-19T08:38:39.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.811+0000 7fdd69f8c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdd64066470 0x7fdd6406e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:39.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.811+0000 7fdd69f8c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdd64066470 0x7fdd6406e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47010/0 (socket says 172.21.15.79:47010) 2023-10-19T08:38:39.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.811+0000 7fdd69f8c700 1 -- 172.21.15.79:0/3430044502 learned_addr learned my addr 172.21.15.79:0/3430044502 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:39.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.811+0000 7fdd6978b700 1 --2- 172.21.15.79:0/3430044502 >> v2:172.21.15.89:3300/0 conn(0x7fdd640ca550 0x7fdd6406adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:39.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.811+0000 7fdd69f8c700 1 -- 172.21.15.79:0/3430044502 >> v2:172.21.15.89:3300/0 conn(0x7fdd640ca550 msgr2=0x7fdd6406adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:39.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.811+0000 7fdd69f8c700 1 --2- 172.21.15.79:0/3430044502 >> v2:172.21.15.89:3300/0 conn(0x7fdd640ca550 0x7fdd6406adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:39.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.811+0000 7fdd69f8c700 1 -- 172.21.15.79:0/3430044502 >> v1:172.21.15.89:6789/0 conn(0x7fdd64065fe0 legacy=0x7fdd6415c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:39.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.811+0000 7fdd69f8c700 1 -- 172.21.15.79:0/3430044502 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd640cae10 con 0x7fdd64066470 2023-10-19T08:38:39.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.811+0000 7fdd69f8c700 1 --2- 172.21.15.79:0/3430044502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd64066470 0x7fdd6406e650 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009e80 tx=0x7fdd5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcafab01af84ced server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:39.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.811+0000 7fdd5bfff700 1 -- 172.21.15.79:0/3430044502 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c00e070 con 0x7fdd64066470 2023-10-19T08:38:39.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.811+0000 7fdd5bfff700 1 -- 172.21.15.79:0/3430044502 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5c00b890 con 0x7fdd64066470 2023-10-19T08:38:39.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.811+0000 7fdd5bfff700 1 -- 172.21.15.79:0/3430044502 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c00bc40 con 0x7fdd64066470 2023-10-19T08:38:39.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.812+0000 7fdd6b9ef700 1 -- 172.21.15.79:0/3430044502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd64066470 msgr2=0x7fdd6406e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:39.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.812+0000 7fdd6b9ef700 1 --2- 172.21.15.79:0/3430044502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd64066470 0x7fdd6406e650 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009e80 tx=0x7fdd5c00b330 comp rx=0 tx=0).stop 2023-10-19T08:38:39.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.812+0000 7fdd6b9ef700 1 -- 172.21.15.79:0/3430044502 shutdown_connections 2023-10-19T08:38:39.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.812+0000 7fdd6b9ef700 1 --2- 172.21.15.79:0/3430044502 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd64066470 0x7fdd6406e650 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:39.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.812+0000 7fdd6b9ef700 1 --2- 172.21.15.79:0/3430044502 >> v2:172.21.15.89:3300/0 conn(0x7fdd640ca550 0x7fdd6406adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:39.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.812+0000 7fdd6b9ef700 1 -- 172.21.15.79:0/3430044502 >> 172.21.15.79:0/3430044502 conn(0x7fdd6406d000 msgr2=0x7fdd6406d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:39.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.812+0000 7fdd6b9ef700 1 -- 172.21.15.79:0/3430044502 shutdown_connections 2023-10-19T08:38:39.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.812+0000 7fdd6b9ef700 1 -- 172.21.15.79:0/3430044502 wait complete. 2023-10-19T08:38:39.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.813+0000 7fdd6b9ef700 1 Processor -- start 2023-10-19T08:38:39.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.813+0000 7fdd6b9ef700 1 -- start start 2023-10-19T08:38:39.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.814+0000 7fdd6b9ef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd64065fe0 0x7fdd6415a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:39.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.814+0000 7fdd6b9ef700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd64066470 0x7fdd640b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:39.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.814+0000 7fdd6b9ef700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd640ca550 0x7fdd640b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:39.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.814+0000 7fdd6b9ef700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640b3060 con 0x7fdd64065fe0 2023-10-19T08:38:39.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.814+0000 7fdd6b9ef700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640b2450 con 0x7fdd64066470 2023-10-19T08:38:39.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.814+0000 7fdd6b9ef700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640b2730 con 0x7fdd640ca550 2023-10-19T08:38:39.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.814+0000 7fdd6978b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd64065fe0 0x7fdd6415a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:39.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.814+0000 7fdd6978b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd64065fe0 0x7fdd6415a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47012/0 (socket says 172.21.15.79:47012) 2023-10-19T08:38:39.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.814+0000 7fdd6978b700 1 -- 172.21.15.79:0/1595435310 learned_addr learned my addr 172.21.15.79:0/1595435310 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:39.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.814+0000 7fdd68f8a700 1 --2- 172.21.15.79:0/1595435310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd64066470 0x7fdd640b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:39.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.814+0000 7fdd69f8c700 1 --2- 172.21.15.79:0/1595435310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd640ca550 0x7fdd640b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:39.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.814+0000 7fdd6978b700 1 -- 172.21.15.79:0/1595435310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd640ca550 msgr2=0x7fdd640b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:39.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.814+0000 7fdd6978b700 1 --2- 172.21.15.79:0/1595435310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd640ca550 0x7fdd640b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:39.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.814+0000 7fdd6978b700 1 -- 172.21.15.79:0/1595435310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd64066470 msgr2=0x7fdd640b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:39.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.814+0000 7fdd6978b700 1 --2- 172.21.15.79:0/1595435310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd64066470 0x7fdd640b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:39.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.814+0000 7fdd6978b700 1 -- 172.21.15.79:0/1595435310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c009b30 con 0x7fdd64065fe0 2023-10-19T08:38:39.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.815+0000 7fdd6978b700 1 --2- 172.21.15.79:0/1595435310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd64065fe0 0x7fdd6415a790 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdd6000e870 tx=0x7fdd6000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:39.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.815+0000 7fdd59ffb700 1 -- 172.21.15.79:0/1595435310 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd60009590 con 0x7fdd64065fe0 2023-10-19T08:38:39.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.815+0000 7fdd59ffb700 1 -- 172.21.15.79:0/1595435310 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd60013680 con 0x7fdd64065fe0 2023-10-19T08:38:39.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.815+0000 7fdd6b9ef700 1 -- 172.21.15.79:0/1595435310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd640b2a10 con 0x7fdd64065fe0 2023-10-19T08:38:39.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.815+0000 7fdd59ffb700 1 -- 172.21.15.79:0/1595435310 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd600139f0 con 0x7fdd64065fe0 2023-10-19T08:38:39.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.815+0000 7fdd6b9ef700 1 -- 172.21.15.79:0/1595435310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd641e4b50 con 0x7fdd64065fe0 2023-10-19T08:38:39.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.816+0000 7fdd6b9ef700 1 -- 172.21.15.79:0/1595435310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd640b3340 con 0x7fdd64065fe0 2023-10-19T08:38:39.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.816+0000 7fdd59ffb700 1 -- 172.21.15.79:0/1595435310 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdd60013b50 con 0x7fdd64065fe0 2023-10-19T08:38:39.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.817+0000 7fdd59ffb700 1 --2- 172.21.15.79:0/1595435310 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdd4806a0e0 0x7fdd4806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:39.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.817+0000 7fdd68f8a700 1 --2- 172.21.15.79:0/1595435310 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdd4806a0e0 0x7fdd4806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:39.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.817+0000 7fdd59ffb700 1 -- 172.21.15.79:0/1595435310 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdd600886a0 con 0x7fdd64065fe0 2023-10-19T08:38:39.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.817+0000 7fdd68f8a700 1 --2- 172.21.15.79:0/1595435310 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdd4806a0e0 0x7fdd4806c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdd6406ed10 tx=0x7fdd54009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:39.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:39.821+0000 7fdd59ffb700 1 -- 172.21.15.79:0/1595435310 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fdd60057530 con 0x7fdd64065fe0 2023-10-19T08:38:40.058 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:40.054+0000 7fdd6b9ef700 1 -- 172.21.15.79:0/1595435310 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdd6406bce0 con 0x7fdd64065fe0 2023-10-19T08:38:40.059 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:40.054+0000 7fdd59ffb700 1 -- 172.21.15.79:0/1595435310 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fdd600570c0 con 0x7fdd64065fe0 2023-10-19T08:38:40.059 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-19T08:38:40.061 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:40.057+0000 7fdd6b9ef700 1 -- 172.21.15.79:0/1595435310 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdd4806a0e0 msgr2=0x7fdd4806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:40.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:40.057+0000 7fdd6b9ef700 1 --2- 172.21.15.79:0/1595435310 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdd4806a0e0 0x7fdd4806c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdd6406ed10 tx=0x7fdd54009040 comp rx=0 tx=0).stop 2023-10-19T08:38:40.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:40.057+0000 7fdd6b9ef700 1 -- 172.21.15.79:0/1595435310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd64065fe0 msgr2=0x7fdd6415a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:40.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:40.057+0000 7fdd6b9ef700 1 --2- 172.21.15.79:0/1595435310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd64065fe0 0x7fdd6415a790 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdd6000e870 tx=0x7fdd6000eb80 comp rx=0 tx=0).stop 2023-10-19T08:38:40.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:40.057+0000 7fdd6b9ef700 1 -- 172.21.15.79:0/1595435310 shutdown_connections 2023-10-19T08:38:40.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:40.057+0000 7fdd6b9ef700 1 --2- 172.21.15.79:0/1595435310 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdd4806a0e0 0x7fdd4806c5a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:40.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:40.057+0000 7fdd6b9ef700 1 --2- 172.21.15.79:0/1595435310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd640ca550 0x7fdd640b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:40.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:40.057+0000 7fdd6b9ef700 1 --2- 172.21.15.79:0/1595435310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd64065fe0 0x7fdd6415a790 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:40.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:40.057+0000 7fdd6b9ef700 1 --2- 172.21.15.79:0/1595435310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd64066470 0x7fdd640b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:40.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:40.057+0000 7fdd6b9ef700 1 -- 172.21.15.79:0/1595435310 >> 172.21.15.79:0/1595435310 conn(0x7fdd6406d000 msgr2=0x7fdd6415b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:40.063 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:40.057+0000 7fdd6b9ef700 1 -- 172.21.15.79:0/1595435310 shutdown_connections 2023-10-19T08:38:40.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:40.057+0000 7fdd6b9ef700 1 -- 172.21.15.79:0/1595435310 wait complete. 2023-10-19T08:38:40.072 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-19T08:38:40.073 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-19T08:38:40.073 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-19T08:38:40.073 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-19T08:38:40.073 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-19T08:38:40.074 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-19T08:38:40.074 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-19T08:38:40.074 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-19T08:38:40.074 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-19T08:38:40.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:40.075 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-19T08:38:40.093 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-19T08:38:40.093 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-19T08:38:40.094 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-19T08:38:40.094 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:40.094 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-19T08:38:40.094 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:40.094 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:38:40.095 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:40.095 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:38:40.095 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:40.095 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:38:40.095 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:40.095 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-19T08:38:40.096 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:40.096 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-19T08:38:40.096 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42391sec preferred_lft 42391sec 2023-10-19T08:38:40.096 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::6fbe:3bb2:e4b5:be20/64 scope link noprefixroute 2023-10-19T08:38:40.096 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:40.097 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-19T08:38:40.097 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether d6:70:c0:be:56:94 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:38:40.097 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-19T08:38:40.097 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:40.097 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::640f:23ff:fee3:c734/64 scope link 2023-10-19T08:38:40.097 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:40.098 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-19T08:38:40.098 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether d6:70:c0:be:56:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-19T08:38:40.098 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::d470:c0ff:febe:5694/64 scope link tentative 2023-10-19T08:38:40.098 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:40.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:40.099 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-19T08:38:40.160 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-19T08:38:40.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:40.161 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-19T08:38:40.219 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-19T08:38:40.219 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-19T08:38:40.220 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-19T08:38:40.220 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-19T08:38:40.220 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-19T08:38:40.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:40.221 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-19T08:38:40.222 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-19T08:38:40.222 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-19T08:38:40.222 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-19T08:38:40.222 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-19T08:38:40.223 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-19T08:38:40.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:40.325 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-19T08:38:40.342 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-19T08:38:40.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:40.343 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list-id 2023-10-19T08:38:40.398 INFO:teuthology.orchestra.run.smithi089.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-19T08:38:40.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:40.399 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-19T08:38:40.399 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-19T08:38:40.399 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-19T08:38:40.399 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-19T08:38:40.400 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-19T08:38:40.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:40.492 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-19T08:38:40.533 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-19T08:38:40.533 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-19T08:38:40.533 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-19T08:38:40.533 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:40.534 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-19T08:38:40.534 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:40.534 INFO:teuthology.orchestra.run.smithi089.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-19T08:38:40.534 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 8a:25:47:77:ae:7d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-19T08:38:40.535 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-19T08:38:40.535 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:40.535 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::8825:47ff:fe77:ae7d/64 scope link tentative 2023-10-19T08:38:40.535 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:40.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:40.545 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-19T08:38:40.625 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-19T08:38:40.625 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-19T08:38:40.625 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-19T08:38:40.625 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:40.625 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-19T08:38:40.626 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:40.626 INFO:teuthology.orchestra.run.smithi089.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-19T08:38:40.626 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 8a:25:47:77:ae:7d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-19T08:38:40.626 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-19T08:38:40.627 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:40.627 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::8825:47ff:fe77:ae7d/64 scope link tentative 2023-10-19T08:38:40.627 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:38:40.640 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-19T08:38:40.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:40.641 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-19T08:38:40.641 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-19T08:38:40.641 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-19T08:38:40.642 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-19T08:38:40.642 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-19T08:38:40.642 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-19T08:38:40.642 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-19T08:38:40.643 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-19T08:38:40.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:40.873 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-19T08:38:40.873 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-19T08:38:40.873 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.1 up 2023-10-19T08:38:40.874 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set dev brx.1 master ceph-brx 2023-10-19T08:38:40.874 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-19T08:38:40.983 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-10-19T08:38:40.983 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-19T08:38:40.984 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-19T08:38:41.003 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-19T08:38:41.003 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-19T08:38:41.003 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-19T08:38:41.059 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-19T08:38:41.125 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-19T08:38:41.126 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-19T08:38:41.191 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-19T08:38:41.192 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-19T08:38:41.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:41.193 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-19T08:38:41.249 INFO:teuthology.orchestra.run.smithi089.stdout:46 2023-10-19T08:38:41.249 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-10-19T08:38:41.250 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-10-19T08:38:41.292 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-19T08:38:41.317 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-19T08:38:41.318 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-19T08:38:41.380 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi089.stderr:2023-10-19T08:38:41.376+0000 7f57a90705c0 -1 init, newargv = 0x55afb970cf60 newargc=15 2023-10-19T08:38:41.380 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi089.stderr:ceph-fuse[111458]: starting ceph client 2023-10-19T08:38:41.384 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-19T08:38:41.385 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi089.stderr:ceph-fuse[111458]: starting fuse 2023-10-19T08:38:41.385 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-19T08:38:41.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:41.386 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-19T08:38:41.442 INFO:teuthology.orchestra.run.smithi089.stdout:46 2023-10-19T08:38:41.442 INFO:teuthology.orchestra.run.smithi089.stdout:48 2023-10-19T08:38:41.442 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-10-19T08:38:41.443 DEBUG:teuthology.orchestra.run.smithi089:> sudo stdin-killer -- python3 -c ' 2023-10-19T08:38:41.443 DEBUG:teuthology.orchestra.run.smithi089:> import glob 2023-10-19T08:38:41.443 DEBUG:teuthology.orchestra.run.smithi089:> import re 2023-10-19T08:38:41.444 DEBUG:teuthology.orchestra.run.smithi089:> import os 2023-10-19T08:38:41.444 DEBUG:teuthology.orchestra.run.smithi089:> import subprocess 2023-10-19T08:38:41.444 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-19T08:38:41.444 DEBUG:teuthology.orchestra.run.smithi089:> def _find_admin_socket(client_name): 2023-10-19T08:38:41.445 DEBUG:teuthology.orchestra.run.smithi089:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-10-19T08:38:41.445 DEBUG:teuthology.orchestra.run.smithi089:> files = glob.glob(asok_path) 2023-10-19T08:38:41.445 DEBUG:teuthology.orchestra.run.smithi089:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-10-19T08:38:41.446 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-19T08:38:41.446 DEBUG:teuthology.orchestra.run.smithi089:> # Given a non-glob path, it better be there 2023-10-19T08:38:41.446 DEBUG:teuthology.orchestra.run.smithi089:> if "*" not in asok_path: 2023-10-19T08:38:41.447 DEBUG:teuthology.orchestra.run.smithi089:> assert(len(files) == 1) 2023-10-19T08:38:41.447 DEBUG:teuthology.orchestra.run.smithi089:> return files[0] 2023-10-19T08:38:41.447 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-19T08:38:41.448 DEBUG:teuthology.orchestra.run.smithi089:> for f in files: 2023-10-19T08:38:41.448 DEBUG:teuthology.orchestra.run.smithi089:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-19T08:38:41.448 DEBUG:teuthology.orchestra.run.smithi089:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-19T08:38:41.448 DEBUG:teuthology.orchestra.run.smithi089:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-19T08:38:41.449 DEBUG:teuthology.orchestra.run.smithi089:> contents = proc_f.read() 2023-10-19T08:38:41.449 DEBUG:teuthology.orchestra.run.smithi089:> if mountpoint in contents: 2023-10-19T08:38:41.449 DEBUG:teuthology.orchestra.run.smithi089:> return f 2023-10-19T08:38:41.449 DEBUG:teuthology.orchestra.run.smithi089:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-19T08:38:41.450 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-19T08:38:41.450 DEBUG:teuthology.orchestra.run.smithi089:> print(_find_admin_socket("client.3")) 2023-10-19T08:38:41.450 DEBUG:teuthology.orchestra.run.smithi089:> ' 2023-10-19T08:38:41.565 INFO:teuthology.orchestra.run.smithi089.stdout:/var/run/ceph/ceph-client.3.111458.asok 2023-10-19T08:38:41.568 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:38:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-19T08:38:41.574 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.111458.asok 2023-10-19T08:38:41.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:41.575 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.111458.asok status 2023-10-19T08:38:41.729 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-10-19T08:38:41.729 INFO:teuthology.orchestra.run.smithi089.stdout: "metadata": { 2023-10-19T08:38:41.729 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_sha1": "6f3e6b48891b9b50415c0822b6b870797fcda16d", 2023-10-19T08:38:41.729 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_version": "ceph version 18.0.0-5610-g6f3e6b48 (6f3e6b48891b9b50415c0822b6b870797fcda16d) reef (dev)", 2023-10-19T08:38:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: "entity_id": "3", 2023-10-19T08:38:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: "hostname": "smithi089", 2023-10-19T08:38:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-10-19T08:38:41.730 INFO:teuthology.orchestra.run.smithi089.stdout: "pid": "111458", 2023-10-19T08:38:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: "root": "/" 2023-10-19T08:38:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-19T08:38:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_count": 0, 2023-10-19T08:38:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_pinned_count": 0, 2023-10-19T08:38:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 4759, 2023-10-19T08:38:41.731 INFO:teuthology.orchestra.run.smithi089.stdout: "inst": { 2023-10-19T08:38:41.732 INFO:teuthology.orchestra.run.smithi089.stdout: "name": { 2023-10-19T08:38:41.732 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "client", 2023-10-19T08:38:41.732 INFO:teuthology.orchestra.run.smithi089.stdout: "num": 4759 2023-10-19T08:38:41.732 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-19T08:38:41.732 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2023-10-19T08:38:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2023-10-19T08:38:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "192.168.0.2:0", 2023-10-19T08:38:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1817759372 2023-10-19T08:38:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-10-19T08:38:41.733 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-19T08:38:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2023-10-19T08:38:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2023-10-19T08:38:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "192.168.0.2:0", 2023-10-19T08:38:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 1817759372 2023-10-19T08:38:41.734 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-19T08:38:41.735 INFO:teuthology.orchestra.run.smithi089.stdout: "inst_str": "client.4759 192.168.0.2:0/1817759372", 2023-10-19T08:38:41.735 INFO:teuthology.orchestra.run.smithi089.stdout: "addr_str": "192.168.0.2:0/1817759372", 2023-10-19T08:38:41.735 INFO:teuthology.orchestra.run.smithi089.stdout: "inode_count": 1, 2023-10-19T08:38:41.735 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_epoch": 9, 2023-10-19T08:38:41.735 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch": 25, 2023-10-19T08:38:41.736 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch_barrier": 0, 2023-10-19T08:38:41.736 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklisted": false, 2023-10-19T08:38:41.736 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs" 2023-10-19T08:38:41.736 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-10-19T08:38:41.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:41.738 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2023-10-19T08:38:41.738 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-19T08:38:41.760 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2023-10-19T08:38:41.760 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-19T08:38:41.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:41.761 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-19T08:38:41.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:41.831 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2023-10-19T08:38:41.832 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.2 2023-10-19T08:38:41.890 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2023-10-19T08:38:41.890 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-10-19T08:38:41.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:41.891 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-19T08:38:41.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:41.959 DEBUG:teuthology.orchestra.run.smithi089:> stat --file-system '--printf=%T 2023-10-19T08:38:41.959 DEBUG:teuthology.orchestra.run.smithi089:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-19T08:38:41.977 INFO:teuthology.orchestra.run.smithi089.stdout:fuseblk 2023-10-19T08:38:41.977 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-19T08:38:41.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:41.978 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-19T08:38:42.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:42.142 DEBUG:teuthology.orchestra.run.smithi089:> stat --file-system '--printf=%T 2023-10-19T08:38:42.146 DEBUG:teuthology.orchestra.run.smithi089:> ' -- /home/ubuntu/cephtest/mnt.3 2023-10-19T08:38:42.164 INFO:teuthology.orchestra.run.smithi089.stdout:fuseblk 2023-10-19T08:38:42.165 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-10-19T08:38:42.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:38:42.165 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-19T08:38:42.234 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-19T08:38:42.335 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:42.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.464+0000 7f7c39c56700 1 Processor -- start 2023-10-19T08:38:42.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.464+0000 7f7c39c56700 1 -- start start 2023-10-19T08:38:42.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.465+0000 7f7c39c56700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c340cd270 0x7f7c3406a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:42.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.465+0000 7f7c39c56700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7c340703b0 0x7f7c3406a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:42.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.465+0000 7f7c39c56700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c340b1fe0 con 0x7f7c3406f910 2023-10-19T08:38:42.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.465+0000 7f7c39c56700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c34160a80 con 0x7f7c340703b0 2023-10-19T08:38:42.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.465+0000 7f7c39c56700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340ce2b0 con 0x7f7c340cd270 2023-10-19T08:38:42.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.465+0000 7f7c33fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7c3406f910 0x7f7c34160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57096/0 (socket says 172.21.15.79:57096) 2023-10-19T08:38:42.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.465+0000 7f7c33fff700 1 -- 172.21.15.79:0/3872471228 learned_addr learned my addr 172.21.15.79:0/3872471228 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:42.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.465+0000 7f7c32ffd700 1 --2- 172.21.15.79:0/3872471228 >> v2:172.21.15.89:3300/0 conn(0x7f7c340703b0 0x7f7c3406a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:42.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.465+0000 7f7c337fe700 1 --2- 172.21.15.79:0/3872471228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c340cd270 0x7f7c3406a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:42.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.466+0000 7f7c337fe700 1 -- 172.21.15.79:0/3872471228 >> v2:172.21.15.89:3300/0 conn(0x7f7c340703b0 msgr2=0x7f7c3406a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:42.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.466+0000 7f7c337fe700 1 --2- 172.21.15.79:0/3872471228 >> v2:172.21.15.89:3300/0 conn(0x7f7c340703b0 0x7f7c3406a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:42.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.466+0000 7f7c337fe700 1 -- 172.21.15.79:0/3872471228 >> v1:172.21.15.79:6789/0 conn(0x7f7c3406f910 legacy=0x7f7c34160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:42.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.466+0000 7f7c337fe700 1 -- 172.21.15.79:0/3872471228 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c340ce550 con 0x7f7c340cd270 2023-10-19T08:38:42.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.466+0000 7f7c32ffd700 1 --2- 172.21.15.79:0/3872471228 >> v2:172.21.15.89:3300/0 conn(0x7f7c340703b0 0x7f7c3406a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:38:42.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.466+0000 7f7c337fe700 1 --2- 172.21.15.79:0/3872471228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c340cd270 0x7f7c3406a220 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009840 tx=0x7f7c24009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a93485d4c9ad27ad server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:42.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.469+0000 7f7c327fc700 1 -- 172.21.15.79:0/3872471228 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24011830 con 0x7f7c340cd270 2023-10-19T08:38:42.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.469+0000 7f7c327fc700 1 -- 172.21.15.79:0/3872471228 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c24011990 con 0x7f7c340cd270 2023-10-19T08:38:42.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.469+0000 7f7c327fc700 1 -- 172.21.15.79:0/3872471228 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24011d20 con 0x7f7c340cd270 2023-10-19T08:38:42.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.469+0000 7f7c39c56700 1 -- 172.21.15.79:0/3872471228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c340cd270 msgr2=0x7f7c3406a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:42.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.469+0000 7f7c39c56700 1 --2- 172.21.15.79:0/3872471228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c340cd270 0x7f7c3406a220 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009840 tx=0x7f7c24009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:42.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.469+0000 7f7c39c56700 1 -- 172.21.15.79:0/3872471228 shutdown_connections 2023-10-19T08:38:42.477 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.469+0000 7f7c39c56700 1 --2- 172.21.15.79:0/3872471228 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c340cd270 0x7f7c3406a220 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:42.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.469+0000 7f7c39c56700 1 --2- 172.21.15.79:0/3872471228 >> v2:172.21.15.89:3300/0 conn(0x7f7c340703b0 0x7f7c3406a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:42.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.469+0000 7f7c39c56700 1 -- 172.21.15.79:0/3872471228 >> 172.21.15.79:0/3872471228 conn(0x7f7c3406dcc0 msgr2=0x7f7c3406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:42.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.469+0000 7f7c39c56700 1 -- 172.21.15.79:0/3872471228 shutdown_connections 2023-10-19T08:38:42.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.469+0000 7f7c39c56700 1 -- 172.21.15.79:0/3872471228 wait complete. 2023-10-19T08:38:42.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.471+0000 7f7c39c56700 1 Processor -- start 2023-10-19T08:38:42.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.471+0000 7f7c39c56700 1 -- start start 2023-10-19T08:38:42.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.471+0000 7f7c39c56700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c3406f910 0x7f7c340c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:42.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.471+0000 7f7c39c56700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c340703b0 0x7f7c340c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:42.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.471+0000 7f7c39c56700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c340cd270 0x7f7c340af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:42.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.471+0000 7f7c39c56700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340c5140 con 0x7f7c340cd270 2023-10-19T08:38:42.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.471+0000 7f7c39c56700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340c5420 con 0x7f7c340703b0 2023-10-19T08:38:42.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.471+0000 7f7c39c56700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340c5700 con 0x7f7c3406f910 2023-10-19T08:38:42.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.472+0000 7f7c33fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c340cd270 0x7f7c340af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:42.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.472+0000 7f7c33fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c340cd270 0x7f7c340af620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47030/0 (socket says 172.21.15.79:47030) 2023-10-19T08:38:42.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.472+0000 7f7c33fff700 1 -- 172.21.15.79:0/3987173006 learned_addr learned my addr 172.21.15.79:0/3987173006 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:42.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.472+0000 7f7c337fe700 1 --2- 172.21.15.79:0/3987173006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c3406f910 0x7f7c340c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:42.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.472+0000 7f7c32ffd700 1 --2- 172.21.15.79:0/3987173006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c340703b0 0x7f7c340c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:42.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.472+0000 7f7c33fff700 1 -- 172.21.15.79:0/3987173006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c3406f910 msgr2=0x7f7c340c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:42.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.472+0000 7f7c33fff700 1 --2- 172.21.15.79:0/3987173006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c3406f910 0x7f7c340c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:42.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.472+0000 7f7c33fff700 1 -- 172.21.15.79:0/3987173006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c340703b0 msgr2=0x7f7c340c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:42.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.472+0000 7f7c33fff700 1 --2- 172.21.15.79:0/3987173006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c340703b0 0x7f7c340c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:42.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.472+0000 7f7c33fff700 1 -- 172.21.15.79:0/3987173006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c280094a0 con 0x7f7c340cd270 2023-10-19T08:38:42.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.472+0000 7f7c33fff700 1 --2- 172.21.15.79:0/3987173006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c340cd270 0x7f7c340af620 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00ca80 tx=0x7f7c2c00ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:42.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.472+0000 7f7c1bfff700 1 -- 172.21.15.79:0/3987173006 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c00aaa0 con 0x7f7c340cd270 2023-10-19T08:38:42.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.472+0000 7f7c1bfff700 1 -- 172.21.15.79:0/3987173006 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c00ac00 con 0x7f7c340cd270 2023-10-19T08:38:42.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.472+0000 7f7c39c56700 1 -- 172.21.15.79:0/3987173006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c240094a0 con 0x7f7c340cd270 2023-10-19T08:38:42.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.472+0000 7f7c1bfff700 1 -- 172.21.15.79:0/3987173006 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c012400 con 0x7f7c340cd270 2023-10-19T08:38:42.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.472+0000 7f7c39c56700 1 -- 172.21.15.79:0/3987173006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c340c5cc0 con 0x7f7c340cd270 2023-10-19T08:38:42.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.473+0000 7f7c39c56700 1 -- 172.21.15.79:0/3987173006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c340c6720 con 0x7f7c340cd270 2023-10-19T08:38:42.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.474+0000 7f7c1bfff700 1 -- 172.21.15.79:0/3987173006 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7c2c01b3b0 con 0x7f7c340cd270 2023-10-19T08:38:42.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.474+0000 7f7c1bfff700 1 --2- 172.21.15.79:0/3987173006 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7c2006a0e0 0x7f7c2006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:42.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.474+0000 7f7c1bfff700 1 -- 172.21.15.79:0/3987173006 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7c2c0883c0 con 0x7f7c340cd270 2023-10-19T08:38:42.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.474+0000 7f7c337fe700 1 --2- 172.21.15.79:0/3987173006 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7c2006a0e0 0x7f7c2006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:42.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.474+0000 7f7c337fe700 1 --2- 172.21.15.79:0/3987173006 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7c2006a0e0 0x7f7c2006c5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7c24000c00 tx=0x7f7c24008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:42.486 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.479+0000 7f7c1bfff700 1 -- 172.21.15.79:0/3987173006 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f7c2c053900 con 0x7f7c340cd270 2023-10-19T08:38:42.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.670+0000 7f7c39c56700 1 -- 172.21.15.79:0/3987173006 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c340c5eb0 con 0x7f7c340cd270 2023-10-19T08:38:42.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.671+0000 7f7c1bfff700 1 -- 172.21.15.79:0/3987173006 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20060 (secure 0 0 0) 0x7f7c2c056f20 con 0x7f7c340cd270 2023-10-19T08:38:42.676 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:42.676 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":25,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:01.725914+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:42.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.673+0000 7f7c39c56700 1 -- 172.21.15.79:0/3987173006 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7c2006a0e0 msgr2=0x7f7c2006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:42.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.673+0000 7f7c39c56700 1 --2- 172.21.15.79:0/3987173006 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7c2006a0e0 0x7f7c2006c5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7c24000c00 tx=0x7f7c24008030 comp rx=0 tx=0).stop 2023-10-19T08:38:42.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.673+0000 7f7c39c56700 1 -- 172.21.15.79:0/3987173006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c340cd270 msgr2=0x7f7c340af620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:42.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.673+0000 7f7c39c56700 1 --2- 172.21.15.79:0/3987173006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c340cd270 0x7f7c340af620 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00ca80 tx=0x7f7c2c00ce40 comp rx=0 tx=0).stop 2023-10-19T08:38:42.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.673+0000 7f7c39c56700 1 -- 172.21.15.79:0/3987173006 shutdown_connections 2023-10-19T08:38:42.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.673+0000 7f7c39c56700 1 --2- 172.21.15.79:0/3987173006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7c340cd270 0x7f7c340af620 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:42.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.673+0000 7f7c39c56700 1 --2- 172.21.15.79:0/3987173006 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7c2006a0e0 0x7f7c2006c5a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:42.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.673+0000 7f7c39c56700 1 --2- 172.21.15.79:0/3987173006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7c3406f910 0x7f7c340c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:42.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.673+0000 7f7c39c56700 1 --2- 172.21.15.79:0/3987173006 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c340703b0 0x7f7c340c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:42.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.673+0000 7f7c39c56700 1 -- 172.21.15.79:0/3987173006 >> 172.21.15.79:0/3987173006 conn(0x7f7c3406dcc0 msgr2=0x7f7c34160130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:42.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.673+0000 7f7c39c56700 1 -- 172.21.15.79:0/3987173006 shutdown_connections 2023-10-19T08:38:42.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.673+0000 7f7c39c56700 1 -- 172.21.15.79:0/3987173006 wait complete. 2023-10-19T08:38:42.690 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T08:37:54.318159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T08:37:55.629862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T08:37:59.333062+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T08:38:42.691 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:38:42.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.809+0000 7f89e1d4b700 1 Processor -- start 2023-10-19T08:38:42.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.809+0000 7f89e1d4b700 1 -- start start 2023-10-19T08:38:42.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.810+0000 7f89e1d4b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f89dc159db0 0x7f89dc0cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:42.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.810+0000 7f89e1d4b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc15d760 con 0x7f89dc0cc640 2023-10-19T08:38:42.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.810+0000 7f89e1d4b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc15da40 con 0x7f89dc06fdc0 2023-10-19T08:38:42.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.810+0000 7f89e1d4b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89dc15dd20 con 0x7f89dc159db0 2023-10-19T08:38:42.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.810+0000 7f89db7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f89dc0cc640 0x7f89dc0cca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57106/0 (socket says 172.21.15.79:57106) 2023-10-19T08:38:42.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.810+0000 7f89db7fe700 1 -- 172.21.15.79:0/412227612 learned_addr learned my addr 172.21.15.79:0/412227612 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:42.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.810+0000 7f89daffd700 1 --2- 172.21.15.79:0/412227612 >> v2:172.21.15.89:3300/0 conn(0x7f89dc159db0 0x7f89dc0cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:42.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.810+0000 7f89da7fc700 1 -- 172.21.15.79:0/412227612 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115902749 0 0) 0x7f89dc15d760 con 0x7f89dc0cc640 2023-10-19T08:38:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.810+0000 7f89da7fc700 1 -- 172.21.15.79:0/412227612 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89c40035b0 con 0x7f89dc0cc640 2023-10-19T08:38:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.810+0000 7f89da7fc700 1 -- 172.21.15.79:0/412227612 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385853301 0 0) 0x7f89dc15da40 con 0x7f89dc06fdc0 2023-10-19T08:38:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.810+0000 7f89da7fc700 1 -- 172.21.15.79:0/412227612 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89dc15d760 con 0x7f89dc06fdc0 2023-10-19T08:38:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.810+0000 7f89daffd700 1 -- 172.21.15.79:0/412227612 >> v1:172.21.15.89:6789/0 conn(0x7f89dc06fdc0 legacy=0x7f89dc0ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.810+0000 7f89daffd700 1 -- 172.21.15.79:0/412227612 >> v1:172.21.15.79:6789/0 conn(0x7f89dc0cc640 legacy=0x7f89dc0cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.810+0000 7f89daffd700 1 -- 172.21.15.79:0/412227612 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc15e000 con 0x7f89dc159db0 2023-10-19T08:38:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.811+0000 7f89daffd700 1 --2- 172.21.15.79:0/412227612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89dc159db0 0x7f89dc0cdae0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009840 tx=0x7f89cc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61678747a2285d53 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.811+0000 7f89da7fc700 1 -- 172.21.15.79:0/412227612 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc011830 con 0x7f89dc159db0 2023-10-19T08:38:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.811+0000 7f89da7fc700 1 -- 172.21.15.79:0/412227612 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc011990 con 0x7f89dc159db0 2023-10-19T08:38:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.811+0000 7f89da7fc700 1 -- 172.21.15.79:0/412227612 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc011d20 con 0x7f89dc159db0 2023-10-19T08:38:42.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.811+0000 7f89e1d4b700 1 -- 172.21.15.79:0/412227612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89dc159db0 msgr2=0x7f89dc0cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.811+0000 7f89e1d4b700 1 --2- 172.21.15.79:0/412227612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89dc159db0 0x7f89dc0cdae0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009840 tx=0x7f89cc009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.811+0000 7f89e1d4b700 1 -- 172.21.15.79:0/412227612 shutdown_connections 2023-10-19T08:38:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.811+0000 7f89e1d4b700 1 --2- 172.21.15.79:0/412227612 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89dc159db0 0x7f89dc0cdae0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.811+0000 7f89e1d4b700 1 -- 172.21.15.79:0/412227612 >> 172.21.15.79:0/412227612 conn(0x7f89dc06dcc0 msgr2=0x7f89dc06e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:42.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.811+0000 7f89e1d4b700 1 -- 172.21.15.79:0/412227612 shutdown_connections 2023-10-19T08:38:42.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.811+0000 7f89e1d4b700 1 -- 172.21.15.79:0/412227612 wait complete. 2023-10-19T08:38:42.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.813+0000 7f89e1d4b700 1 Processor -- start 2023-10-19T08:38:42.824 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.813+0000 7f89e1d4b700 1 -- start start 2023-10-19T08:38:42.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.813+0000 7f89e1d4b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc06fdc0 0x7f89dc1552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:42.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.813+0000 7f89e1d4b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89dc0cc640 0x7f89dc1ef470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:42.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.813+0000 7f89e1d4b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89dc159db0 0x7f89dc0c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:42.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.813+0000 7f89e1d4b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc0c3890 con 0x7f89dc06fdc0 2023-10-19T08:38:42.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.814+0000 7f89e1d4b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc0c57c0 con 0x7f89dc0cc640 2023-10-19T08:38:42.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.814+0000 7f89e1d4b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc1efb30 con 0x7f89dc159db0 2023-10-19T08:38:42.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.814+0000 7f89db7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc06fdc0 0x7f89dc1552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.814+0000 7f89db7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc06fdc0 0x7f89dc1552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47040/0 (socket says 172.21.15.79:47040) 2023-10-19T08:38:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.814+0000 7f89db7fe700 1 -- 172.21.15.79:0/2301540920 learned_addr learned my addr 172.21.15.79:0/2301540920 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.814+0000 7f89daffd700 1 --2- 172.21.15.79:0/2301540920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89dc0cc640 0x7f89dc1ef470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:42.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.814+0000 7f89dbfff700 1 --2- 172.21.15.79:0/2301540920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89dc159db0 0x7f89dc0c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.814+0000 7f89db7fe700 1 -- 172.21.15.79:0/2301540920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89dc159db0 msgr2=0x7f89dc0c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.814+0000 7f89db7fe700 1 --2- 172.21.15.79:0/2301540920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89dc159db0 0x7f89dc0c5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.814+0000 7f89db7fe700 1 -- 172.21.15.79:0/2301540920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89dc0cc640 msgr2=0x7f89dc1ef470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.814+0000 7f89db7fe700 1 --2- 172.21.15.79:0/2301540920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89dc0cc640 0x7f89dc1ef470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.814+0000 7f89db7fe700 1 -- 172.21.15.79:0/2301540920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc0094a0 con 0x7f89dc06fdc0 2023-10-19T08:38:42.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.814+0000 7f89db7fe700 1 --2- 172.21.15.79:0/2301540920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc06fdc0 0x7f89dc1552b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f89d000e940 tx=0x7f89d000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.814+0000 7f89c3fff700 1 -- 172.21.15.79:0/2301540920 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0005d70 con 0x7f89dc06fdc0 2023-10-19T08:38:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.814+0000 7f89c3fff700 1 -- 172.21.15.79:0/2301540920 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d0007070 con 0x7f89dc06fdc0 2023-10-19T08:38:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.814+0000 7f89e1d4b700 1 -- 172.21.15.79:0/2301540920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc1efe10 con 0x7f89dc06fdc0 2023-10-19T08:38:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.814+0000 7f89c3fff700 1 -- 172.21.15.79:0/2301540920 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0007400 con 0x7f89dc06fdc0 2023-10-19T08:38:42.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.814+0000 7f89e1d4b700 1 -- 172.21.15.79:0/2301540920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc1f03d0 con 0x7f89dc06fdc0 2023-10-19T08:38:42.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.815+0000 7f89e1d4b700 1 -- 172.21.15.79:0/2301540920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc0c3650 con 0x7f89dc06fdc0 2023-10-19T08:38:42.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.815+0000 7f89c3fff700 1 -- 172.21.15.79:0/2301540920 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f89d0007560 con 0x7f89dc06fdc0 2023-10-19T08:38:42.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.816+0000 7f89c3fff700 1 --2- 172.21.15.79:0/2301540920 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f89c806a110 0x7f89c806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:42.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.816+0000 7f89c3fff700 1 -- 172.21.15.79:0/2301540920 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f89d008aa80 con 0x7f89dc06fdc0 2023-10-19T08:38:42.830 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.816+0000 7f89daffd700 1 --2- 172.21.15.79:0/2301540920 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f89c806a110 0x7f89c806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:42.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.816+0000 7f89daffd700 1 --2- 172.21.15.79:0/2301540920 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f89c806a110 0x7f89c806c5d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009fd0 tx=0x7f89cc01c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:42.831 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:42.820+0000 7f89c3fff700 1 -- 172.21.15.79:0/2301540920 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f89d0055e90 con 0x7f89dc06fdc0 2023-10-19T08:38:43.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.008+0000 7f89e1d4b700 1 -- 172.21.15.79:0/2301540920 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89dc04ee70 con 0x7f89dc06fdc0 2023-10-19T08:38:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.008+0000 7f89c3fff700 1 -- 172.21.15.79:0/2301540920 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89d00594b0 con 0x7f89dc06fdc0 2023-10-19T08:38:43.014 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:38:43.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.010+0000 7f89e1d4b700 1 -- 172.21.15.79:0/2301540920 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f89c806a110 msgr2=0x7f89c806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.010+0000 7f89e1d4b700 1 --2- 172.21.15.79:0/2301540920 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f89c806a110 0x7f89c806c5d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009fd0 tx=0x7f89cc01c040 comp rx=0 tx=0).stop 2023-10-19T08:38:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.010+0000 7f89e1d4b700 1 -- 172.21.15.79:0/2301540920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc06fdc0 msgr2=0x7f89dc1552b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.010+0000 7f89e1d4b700 1 --2- 172.21.15.79:0/2301540920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc06fdc0 0x7f89dc1552b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f89d000e940 tx=0x7f89d000ec50 comp rx=0 tx=0).stop 2023-10-19T08:38:43.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.011+0000 7f89e1d4b700 1 -- 172.21.15.79:0/2301540920 shutdown_connections 2023-10-19T08:38:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.011+0000 7f89e1d4b700 1 --2- 172.21.15.79:0/2301540920 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f89c806a110 0x7f89c806c5d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.011+0000 7f89e1d4b700 1 --2- 172.21.15.79:0/2301540920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f89dc159db0 0x7f89dc0c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.011+0000 7f89e1d4b700 1 --2- 172.21.15.79:0/2301540920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89dc06fdc0 0x7f89dc1552b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.011+0000 7f89e1d4b700 1 --2- 172.21.15.79:0/2301540920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f89dc0cc640 0x7f89dc1ef470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.011+0000 7f89e1d4b700 1 -- 172.21.15.79:0/2301540920 >> 172.21.15.79:0/2301540920 conn(0x7f89dc06dcc0 msgr2=0x7f89dc0cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:43.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.011+0000 7f89e1d4b700 1 -- 172.21.15.79:0/2301540920 shutdown_connections 2023-10-19T08:38:43.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.011+0000 7f89e1d4b700 1 -- 172.21.15.79:0/2301540920 wait complete. 2023-10-19T08:38:43.027 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:38:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.151+0000 7f7f07df8700 1 Processor -- start 2023-10-19T08:38:43.156 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.151+0000 7f7f07df8700 1 -- start start 2023-10-19T08:38:43.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.152+0000 7f7f07df8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7f000cc640 0x7f7f000cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.152+0000 7f7f07df8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7f00159db0 0x7f7f000b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.152+0000 7f7f07df8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f000ccf60 con 0x7f7f0006fdc0 2023-10-19T08:38:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.152+0000 7f7f07df8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0015d760 con 0x7f7f00159db0 2023-10-19T08:38:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.152+0000 7f7f07df8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0015da40 con 0x7f7f000cc640 2023-10-19T08:38:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.152+0000 7f7f05393700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7f00159db0 0x7f7f000b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.152+0000 7f7f06395700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7f0006fdc0 0x7f7f000b1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57128/0 (socket says 172.21.15.79:57128) 2023-10-19T08:38:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.152+0000 7f7f06395700 1 -- 172.21.15.79:0/3351686838 learned_addr learned my addr 172.21.15.79:0/3351686838 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.152+0000 7f7f05393700 1 -- 172.21.15.79:0/3351686838 >> v2:172.21.15.89:3300/0 conn(0x7f7f000cc640 msgr2=0x7f7f000cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:43.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.152+0000 7f7f05b94700 1 --2- 172.21.15.79:0/3351686838 >> v2:172.21.15.89:3300/0 conn(0x7f7f000cc640 0x7f7f000cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:43.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.153+0000 7f7f05393700 1 --2- 172.21.15.79:0/3351686838 >> v2:172.21.15.89:3300/0 conn(0x7f7f000cc640 0x7f7f000cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.153+0000 7f7f04b92700 1 -- 172.21.15.79:0/3351686838 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199333580 0 0) 0x7f7f000ccf60 con 0x7f7f0006fdc0 2023-10-19T08:38:43.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.153+0000 7f7f05393700 1 -- 172.21.15.79:0/3351686838 >> v1:172.21.15.79:6789/0 conn(0x7f7f0006fdc0 legacy=0x7f7f000b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:43.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.153+0000 7f7f05393700 1 -- 172.21.15.79:0/3351686838 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0015dd20 con 0x7f7f00159db0 2023-10-19T08:38:43.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.153+0000 7f7f05b94700 1 --2- 172.21.15.79:0/3351686838 >> v2:172.21.15.89:3300/0 conn(0x7f7f000cc640 0x7f7f000cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:43.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.153+0000 7f7f05393700 1 --2- 172.21.15.79:0/3351686838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f00159db0 0x7f7f000b16b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7f000cd300 tx=0x7f7efc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba6d61fbdcf64fd server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:43.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.153+0000 7f7f04b92700 1 -- 172.21.15.79:0/3351686838 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc011830 con 0x7f7f00159db0 2023-10-19T08:38:43.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.153+0000 7f7f04b92700 1 -- 172.21.15.79:0/3351686838 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc011990 con 0x7f7f00159db0 2023-10-19T08:38:43.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.153+0000 7f7f04b92700 1 -- 172.21.15.79:0/3351686838 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc011d20 con 0x7f7f00159db0 2023-10-19T08:38:43.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.153+0000 7f7f07df8700 1 -- 172.21.15.79:0/3351686838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f00159db0 msgr2=0x7f7f000b16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:43.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.153+0000 7f7f07df8700 1 --2- 172.21.15.79:0/3351686838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f00159db0 0x7f7f000b16b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7f000cd300 tx=0x7f7efc009b20 comp rx=0 tx=0).stop 2023-10-19T08:38:43.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.153+0000 7f7f07df8700 1 -- 172.21.15.79:0/3351686838 shutdown_connections 2023-10-19T08:38:43.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.153+0000 7f7f07df8700 1 --2- 172.21.15.79:0/3351686838 >> v2:172.21.15.89:3300/0 conn(0x7f7f000cc640 0x7f7f000cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.153+0000 7f7f07df8700 1 --2- 172.21.15.79:0/3351686838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f00159db0 0x7f7f000b16b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.163 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.153+0000 7f7f07df8700 1 -- 172.21.15.79:0/3351686838 >> 172.21.15.79:0/3351686838 conn(0x7f7f0006dcc0 msgr2=0x7f7f0006e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:43.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.154+0000 7f7f07df8700 1 -- 172.21.15.79:0/3351686838 shutdown_connections 2023-10-19T08:38:43.164 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.154+0000 7f7f07df8700 1 -- 172.21.15.79:0/3351686838 wait complete. 2023-10-19T08:38:43.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.155+0000 7f7f07df8700 1 Processor -- start 2023-10-19T08:38:43.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.155+0000 7f7f07df8700 1 -- start start 2023-10-19T08:38:43.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.155+0000 7f7f07df8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f0006fdc0 0x7f7f000c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:43.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.155+0000 7f7f07df8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f000cc640 0x7f7f0014aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.155+0000 7f7f07df8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f00159db0 0x7f7f000c3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.155+0000 7f7f07df8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f000c7c50 con 0x7f7f000cc640 2023-10-19T08:38:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.155+0000 7f7f07df8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f00148cd0 con 0x7f7f0006fdc0 2023-10-19T08:38:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.155+0000 7f7f07df8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f000c8af0 con 0x7f7f00159db0 2023-10-19T08:38:43.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.156+0000 7f7f05393700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f000cc640 0x7f7f0014aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:43.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.156+0000 7f7f05393700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f000cc640 0x7f7f0014aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47060/0 (socket says 172.21.15.79:47060) 2023-10-19T08:38:43.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.156+0000 7f7f05393700 1 -- 172.21.15.79:0/1792300344 learned_addr learned my addr 172.21.15.79:0/1792300344 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:43.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.156+0000 7f7f05b94700 1 --2- 172.21.15.79:0/1792300344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f0006fdc0 0x7f7f000c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:43.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.156+0000 7f7f06395700 1 --2- 172.21.15.79:0/1792300344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f00159db0 0x7f7f000c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:43.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.156+0000 7f7f05393700 1 -- 172.21.15.79:0/1792300344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f00159db0 msgr2=0x7f7f000c3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:43.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.156+0000 7f7f05393700 1 --2- 172.21.15.79:0/1792300344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f00159db0 0x7f7f000c3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.156+0000 7f7f05393700 1 -- 172.21.15.79:0/1792300344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f0006fdc0 msgr2=0x7f7f000c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:43.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.156+0000 7f7f05393700 1 --2- 172.21.15.79:0/1792300344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f0006fdc0 0x7f7f000c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.156+0000 7f7f05393700 1 -- 172.21.15.79:0/1792300344 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc0094a0 con 0x7f7f000cc640 2023-10-19T08:38:43.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.156+0000 7f7f06395700 1 --2- 172.21.15.79:0/1792300344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f00159db0 0x7f7f000c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:43.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.156+0000 7f7f05393700 1 --2- 172.21.15.79:0/1792300344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f000cc640 0x7f7f0014aa70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7efc000c00 tx=0x7f7efc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:43.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.156+0000 7f7ef67fc700 1 -- 172.21.15.79:0/1792300344 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0038a0 con 0x7f7f000cc640 2023-10-19T08:38:43.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.156+0000 7f7ef67fc700 1 -- 172.21.15.79:0/1792300344 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc01f070 con 0x7f7f000cc640 2023-10-19T08:38:43.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.156+0000 7f7f07df8700 1 -- 172.21.15.79:0/1792300344 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f000c8dd0 con 0x7f7f000cc640 2023-10-19T08:38:43.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.156+0000 7f7ef67fc700 1 -- 172.21.15.79:0/1792300344 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc003c40 con 0x7f7f000cc640 2023-10-19T08:38:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.156+0000 7f7f07df8700 1 -- 172.21.15.79:0/1792300344 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f00149280 con 0x7f7f000cc640 2023-10-19T08:38:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.157+0000 7f7f07df8700 1 -- 172.21.15.79:0/1792300344 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f000ccb20 con 0x7f7f000cc640 2023-10-19T08:38:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.158+0000 7f7ef67fc700 1 -- 172.21.15.79:0/1792300344 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7efc026480 con 0x7f7f000cc640 2023-10-19T08:38:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.158+0000 7f7ef67fc700 1 --2- 172.21.15.79:0/1792300344 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7ee406a0e0 0x7f7ee406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:43.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.158+0000 7f7ef67fc700 1 -- 172.21.15.79:0/1792300344 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7efc021070 con 0x7f7f000cc640 2023-10-19T08:38:43.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.158+0000 7f7f05b94700 1 --2- 172.21.15.79:0/1792300344 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7ee406a0e0 0x7f7ee406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:43.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.158+0000 7f7f05b94700 1 --2- 172.21.15.79:0/1792300344 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7ee406a0e0 0x7f7ee406c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0006fd0 tx=0x7f7ef0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:43.173 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.162+0000 7f7ef67fc700 1 -- 172.21.15.79:0/1792300344 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f7efc055770 con 0x7f7f000cc640 2023-10-19T08:38:43.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.351+0000 7f7f07df8700 1 -- 172.21.15.79:0/1792300344 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7f00149470 con 0x7f7f000cc640 2023-10-19T08:38:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.351+0000 7f7ef67fc700 1 -- 172.21.15.79:0/1792300344 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7efc058d90 con 0x7f7f000cc640 2023-10-19T08:38:43.356 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:38:43.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.353+0000 7f7f07df8700 1 -- 172.21.15.79:0/1792300344 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7ee406a0e0 msgr2=0x7f7ee406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:43.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.353+0000 7f7f07df8700 1 --2- 172.21.15.79:0/1792300344 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7ee406a0e0 0x7f7ee406c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0006fd0 tx=0x7f7ef0008040 comp rx=0 tx=0).stop 2023-10-19T08:38:43.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.353+0000 7f7f07df8700 1 -- 172.21.15.79:0/1792300344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f000cc640 msgr2=0x7f7f0014aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:43.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.353+0000 7f7f07df8700 1 --2- 172.21.15.79:0/1792300344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f000cc640 0x7f7f0014aa70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7efc000c00 tx=0x7f7efc004750 comp rx=0 tx=0).stop 2023-10-19T08:38:43.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.353+0000 7f7f07df8700 1 -- 172.21.15.79:0/1792300344 shutdown_connections 2023-10-19T08:38:43.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.353+0000 7f7f07df8700 1 --2- 172.21.15.79:0/1792300344 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7ee406a0e0 0x7f7ee406c5a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.353+0000 7f7f07df8700 1 --2- 172.21.15.79:0/1792300344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f00159db0 0x7f7f000c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.353+0000 7f7f07df8700 1 --2- 172.21.15.79:0/1792300344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f0006fdc0 0x7f7f000c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.353+0000 7f7f07df8700 1 --2- 172.21.15.79:0/1792300344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f000cc640 0x7f7f0014aa70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.353+0000 7f7f07df8700 1 -- 172.21.15.79:0/1792300344 >> 172.21.15.79:0/1792300344 conn(0x7f7f0006dcc0 msgr2=0x7f7f000b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:43.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.353+0000 7f7f07df8700 1 -- 172.21.15.79:0/1792300344 shutdown_connections 2023-10-19T08:38:43.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.353+0000 7f7f07df8700 1 -- 172.21.15.79:0/1792300344 wait complete. 2023-10-19T08:38:43.369 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T08:38:43.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.492+0000 7f478b4e7700 1 Processor -- start 2023-10-19T08:38:43.497 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.492+0000 7f478b4e7700 1 -- start start 2023-10-19T08:38:43.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.492+0000 7f478b4e7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4784159db0 0x7f47840cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:43.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.493+0000 7f478b4e7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f478406fdc0 0x7f47840ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:43.500 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.493+0000 7f478b4e7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f478415d760 con 0x7f47840cc640 2023-10-19T08:38:43.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.493+0000 7f478b4e7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f478415da40 con 0x7f478406fdc0 2023-10-19T08:38:43.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.493+0000 7f478b4e7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f478415dd20 con 0x7f4784159db0 2023-10-19T08:38:43.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.493+0000 7f4789a84700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f478406fdc0 0x7f47840ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:43.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.493+0000 7f4789a84700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f478406fdc0 0x7f47840ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47070/0 (socket says 172.21.15.79:47070) 2023-10-19T08:38:43.501 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.493+0000 7f4789a84700 1 -- 172.21.15.79:0/3000687625 learned_addr learned my addr 172.21.15.79:0/3000687625 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:43.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.493+0000 7f4788a82700 1 --2- 172.21.15.79:0/3000687625 >> v2:172.21.15.89:3300/0 conn(0x7f4784159db0 0x7f47840cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:43.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.493+0000 7f4789a84700 1 -- 172.21.15.79:0/3000687625 >> v2:172.21.15.89:3300/0 conn(0x7f4784159db0 msgr2=0x7f47840cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:43.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.493+0000 7f4789a84700 1 --2- 172.21.15.79:0/3000687625 >> v2:172.21.15.89:3300/0 conn(0x7f4784159db0 0x7f47840cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.493+0000 7f4789a84700 1 -- 172.21.15.79:0/3000687625 >> v1:172.21.15.89:6789/0 conn(0x7f47840cc640 legacy=0x7f47840cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:43.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.493+0000 7f4789a84700 1 -- 172.21.15.79:0/3000687625 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478415e000 con 0x7f478406fdc0 2023-10-19T08:38:43.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.493+0000 7f4789a84700 1 --2- 172.21.15.79:0/3000687625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f478406fdc0 0x7f47840ce020 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f47840cd2b0 tx=0x7f477c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19767ba5fd860bc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:43.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.493+0000 7f477bfff700 1 -- 172.21.15.79:0/3000687625 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c00e070 con 0x7f478406fdc0 2023-10-19T08:38:43.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.493+0000 7f477bfff700 1 -- 172.21.15.79:0/3000687625 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c00b910 con 0x7f478406fdc0 2023-10-19T08:38:43.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.493+0000 7f477bfff700 1 -- 172.21.15.79:0/3000687625 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c00bcc0 con 0x7f478406fdc0 2023-10-19T08:38:43.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.494+0000 7f478b4e7700 1 -- 172.21.15.79:0/3000687625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f478406fdc0 msgr2=0x7f47840ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:43.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.494+0000 7f478b4e7700 1 --2- 172.21.15.79:0/3000687625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f478406fdc0 0x7f47840ce020 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f47840cd2b0 tx=0x7f477c00b330 comp rx=0 tx=0).stop 2023-10-19T08:38:43.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.494+0000 7f478b4e7700 1 -- 172.21.15.79:0/3000687625 shutdown_connections 2023-10-19T08:38:43.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.494+0000 7f478b4e7700 1 --2- 172.21.15.79:0/3000687625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f478406fdc0 0x7f47840ce020 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.494+0000 7f478b4e7700 1 --2- 172.21.15.79:0/3000687625 >> v2:172.21.15.89:3300/0 conn(0x7f4784159db0 0x7f47840cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.494+0000 7f478b4e7700 1 -- 172.21.15.79:0/3000687625 >> 172.21.15.79:0/3000687625 conn(0x7f478406dcc0 msgr2=0x7f478406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:43.504 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.494+0000 7f478b4e7700 1 -- 172.21.15.79:0/3000687625 shutdown_connections 2023-10-19T08:38:43.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.494+0000 7f478b4e7700 1 -- 172.21.15.79:0/3000687625 wait complete. 2023-10-19T08:38:43.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.495+0000 7f478b4e7700 1 Processor -- start 2023-10-19T08:38:43.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.496+0000 7f478b4e7700 1 -- start start 2023-10-19T08:38:43.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.496+0000 7f478b4e7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f478406fdc0 0x7f47840c1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:43.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.496+0000 7f478b4e7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47840cc640 0x7f47840b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:43.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.496+0000 7f478b4e7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4784159db0 0x7f47840c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:43.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.496+0000 7f478b4e7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4784146d80 con 0x7f47840cc640 2023-10-19T08:38:43.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.496+0000 7f478b4e7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47840c24d0 con 0x7f478406fdc0 2023-10-19T08:38:43.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.496+0000 7f478b4e7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47840c2700 con 0x7f4784159db0 2023-10-19T08:38:43.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.497+0000 7f4788a82700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47840cc640 0x7f47840b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:43.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.497+0000 7f4788a82700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47840cc640 0x7f47840b1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47074/0 (socket says 172.21.15.79:47074) 2023-10-19T08:38:43.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.497+0000 7f4788a82700 1 -- 172.21.15.79:0/475208959 learned_addr learned my addr 172.21.15.79:0/475208959 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:43.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.497+0000 7f4789283700 1 --2- 172.21.15.79:0/475208959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f478406fdc0 0x7f47840c1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:43.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.497+0000 7f4789a84700 1 --2- 172.21.15.79:0/475208959 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4784159db0 0x7f47840c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:43.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.497+0000 7f4788a82700 1 -- 172.21.15.79:0/475208959 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4784159db0 msgr2=0x7f47840c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:43.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.497+0000 7f4788a82700 1 --2- 172.21.15.79:0/475208959 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4784159db0 0x7f47840c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.497+0000 7f4788a82700 1 -- 172.21.15.79:0/475208959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f478406fdc0 msgr2=0x7f47840c1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:43.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.497+0000 7f4788a82700 1 --2- 172.21.15.79:0/475208959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f478406fdc0 0x7f47840c1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.497+0000 7f4788a82700 1 -- 172.21.15.79:0/475208959 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c009b30 con 0x7f47840cc640 2023-10-19T08:38:43.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.497+0000 7f4789a84700 1 --2- 172.21.15.79:0/475208959 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4784159db0 0x7f47840c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:43.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.497+0000 7f4789283700 1 --2- 172.21.15.79:0/475208959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f478406fdc0 0x7f47840c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:43.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.497+0000 7f4788a82700 1 --2- 172.21.15.79:0/475208959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47840cc640 0x7f47840b1f60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f477400e9b0 tx=0x7f477400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:43.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.497+0000 7f4779ffb700 1 -- 172.21.15.79:0/475208959 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774009710 con 0x7f47840cc640 2023-10-19T08:38:43.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.497+0000 7f4779ffb700 1 -- 172.21.15.79:0/475208959 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477400c850 con 0x7f47840cc640 2023-10-19T08:38:43.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.497+0000 7f478b4e7700 1 -- 172.21.15.79:0/475208959 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47840c4ca0 con 0x7f47840cc640 2023-10-19T08:38:43.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.497+0000 7f4779ffb700 1 -- 172.21.15.79:0/475208959 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477400cbc0 con 0x7f47840cc640 2023-10-19T08:38:43.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.497+0000 7f478b4e7700 1 -- 172.21.15.79:0/475208959 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47840c5260 con 0x7f47840cc640 2023-10-19T08:38:43.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.498+0000 7f478b4e7700 1 -- 172.21.15.79:0/475208959 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47840c55d0 con 0x7f47840cc640 2023-10-19T08:38:43.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.499+0000 7f4779ffb700 1 -- 172.21.15.79:0/475208959 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f477400cd20 con 0x7f47840cc640 2023-10-19T08:38:43.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.499+0000 7f4779ffb700 1 --2- 172.21.15.79:0/475208959 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f476806a0e0 0x7f476806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:43.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.499+0000 7f4779ffb700 1 -- 172.21.15.79:0/475208959 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4774088970 con 0x7f47840cc640 2023-10-19T08:38:43.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.499+0000 7f4789283700 1 --2- 172.21.15.79:0/475208959 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f476806a0e0 0x7f476806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:43.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.500+0000 7f4789283700 1 --2- 172.21.15.79:0/475208959 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f476806a0e0 0x7f476806c5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f47840b4cd0 tx=0x7f4780009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:43.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.503+0000 7f4779ffb700 1 -- 172.21.15.79:0/475208959 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4774057850 con 0x7f47840cc640 2023-10-19T08:38:43.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.695+0000 7f478b4e7700 1 -- 172.21.15.79:0/475208959 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f478404ee70 con 0x7f47840cc640 2023-10-19T08:38:43.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.695+0000 7f4779ffb700 1 -- 172.21.15.79:0/475208959 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f47740573e0 con 0x7f47840cc640 2023-10-19T08:38:43.700 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.697+0000 7f478b4e7700 1 -- 172.21.15.79:0/475208959 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f476806a0e0 msgr2=0x7f476806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:43.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.697+0000 7f478b4e7700 1 --2- 172.21.15.79:0/475208959 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f476806a0e0 0x7f476806c5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f47840b4cd0 tx=0x7f4780009040 comp rx=0 tx=0).stop 2023-10-19T08:38:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.697+0000 7f478b4e7700 1 -- 172.21.15.79:0/475208959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47840cc640 msgr2=0x7f47840b1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.697+0000 7f478b4e7700 1 --2- 172.21.15.79:0/475208959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47840cc640 0x7f47840b1f60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f477400e9b0 tx=0x7f477400ed70 comp rx=0 tx=0).stop 2023-10-19T08:38:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.697+0000 7f478b4e7700 1 -- 172.21.15.79:0/475208959 shutdown_connections 2023-10-19T08:38:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.697+0000 7f478b4e7700 1 --2- 172.21.15.79:0/475208959 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f476806a0e0 0x7f476806c5a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.697+0000 7f478b4e7700 1 --2- 172.21.15.79:0/475208959 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4784159db0 0x7f47840c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.697+0000 7f478b4e7700 1 --2- 172.21.15.79:0/475208959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f478406fdc0 0x7f47840c1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.697+0000 7f478b4e7700 1 --2- 172.21.15.79:0/475208959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47840cc640 0x7f47840b1f60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.697+0000 7f478b4e7700 1 -- 172.21.15.79:0/475208959 >> 172.21.15.79:0/475208959 conn(0x7f478406dcc0 msgr2=0x7f47840b4080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:43.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.697+0000 7f478b4e7700 1 -- 172.21.15.79:0/475208959 shutdown_connections 2023-10-19T08:38:43.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.697+0000 7f478b4e7700 1 -- 172.21.15.79:0/475208959 wait complete. 2023-10-19T08:38:43.713 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T08:38:43.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.833+0000 7efc4feca700 1 Processor -- start 2023-10-19T08:38:43.837 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.833+0000 7efc4feca700 1 -- start start 2023-10-19T08:38:43.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.833+0000 7efc4feca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc480cfcf0 0x7efc480d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:43.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.834+0000 7efc4feca700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc480b5f20 0x7efc480b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:43.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.834+0000 7efc4feca700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc480d0610 con 0x7efc480b2180 2023-10-19T08:38:43.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.834+0000 7efc4feca700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc480d2b20 con 0x7efc480b5f20 2023-10-19T08:38:43.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.834+0000 7efc4feca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc480d1120 con 0x7efc480cfcf0 2023-10-19T08:38:43.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.834+0000 7efc4e467700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc480b5f20 0x7efc480b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:43.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.834+0000 7efc4d465700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7efc480b2180 0x7efc480d2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57152/0 (socket says 172.21.15.79:57152) 2023-10-19T08:38:43.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.834+0000 7efc4d465700 1 -- 172.21.15.79:0/2890267634 learned_addr learned my addr 172.21.15.79:0/2890267634 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:43.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.834+0000 7efc4dc66700 1 --2- 172.21.15.79:0/2890267634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc480cfcf0 0x7efc480d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:43.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.834+0000 7efc4e467700 1 -- 172.21.15.79:0/2890267634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc480cfcf0 msgr2=0x7efc480d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:43.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.834+0000 7efc4e467700 1 --2- 172.21.15.79:0/2890267634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc480cfcf0 0x7efc480d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.834+0000 7efc4e467700 1 -- 172.21.15.79:0/2890267634 >> v1:172.21.15.79:6789/0 conn(0x7efc480b2180 legacy=0x7efc480d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:43.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.834+0000 7efc4e467700 1 -- 172.21.15.79:0/2890267634 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc480d1400 con 0x7efc480b5f20 2023-10-19T08:38:43.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.834+0000 7efc4cc64700 1 -- 172.21.15.79:0/2890267634 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785073523 0 0) 0x7efc480d0610 con 0x7efc480b2180 2023-10-19T08:38:43.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.834+0000 7efc4dc66700 1 --2- 172.21.15.79:0/2890267634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc480cfcf0 0x7efc480d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:43.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.834+0000 7efc4e467700 1 --2- 172.21.15.79:0/2890267634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480b5f20 0x7efc480b6390 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efc40009d90 tx=0x7efc4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19a7d4464c60d43 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:43.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.834+0000 7efc4cc64700 1 -- 172.21.15.79:0/2890267634 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4000e070 con 0x7efc480b5f20 2023-10-19T08:38:43.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.834+0000 7efc4cc64700 1 -- 172.21.15.79:0/2890267634 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4000bbd0 con 0x7efc480b5f20 2023-10-19T08:38:43.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.834+0000 7efc4cc64700 1 -- 172.21.15.79:0/2890267634 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc40012430 con 0x7efc480b5f20 2023-10-19T08:38:43.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.835+0000 7efc4feca700 1 -- 172.21.15.79:0/2890267634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480b5f20 msgr2=0x7efc480b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:43.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.835+0000 7efc4feca700 1 --2- 172.21.15.79:0/2890267634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480b5f20 0x7efc480b6390 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efc40009d90 tx=0x7efc4000b330 comp rx=0 tx=0).stop 2023-10-19T08:38:43.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.835+0000 7efc4feca700 1 -- 172.21.15.79:0/2890267634 shutdown_connections 2023-10-19T08:38:43.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.835+0000 7efc4feca700 1 --2- 172.21.15.79:0/2890267634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480b5f20 0x7efc480b6390 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.835+0000 7efc4feca700 1 --2- 172.21.15.79:0/2890267634 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc480cfcf0 0x7efc480d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.835+0000 7efc4feca700 1 -- 172.21.15.79:0/2890267634 >> 172.21.15.79:0/2890267634 conn(0x7efc48071b30 msgr2=0x7efc48071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:43.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.835+0000 7efc4feca700 1 -- 172.21.15.79:0/2890267634 shutdown_connections 2023-10-19T08:38:43.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.835+0000 7efc4feca700 1 -- 172.21.15.79:0/2890267634 wait complete. 2023-10-19T08:38:43.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.836+0000 7efc4feca700 1 Processor -- start 2023-10-19T08:38:43.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.836+0000 7efc4feca700 1 -- start start 2023-10-19T08:38:43.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.837+0000 7efc4feca700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480b2180 0x7efc481f65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:43.849 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.837+0000 7efc4feca700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc480b5f20 0x7efc4815a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:43.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.837+0000 7efc4feca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc480cfcf0 0x7efc481e8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:43.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.837+0000 7efc4feca700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc481f5b90 con 0x7efc480b2180 2023-10-19T08:38:43.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.837+0000 7efc4feca700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc481f6110 con 0x7efc480b5f20 2023-10-19T08:38:43.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.837+0000 7efc4feca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc481f6ae0 con 0x7efc480cfcf0 2023-10-19T08:38:43.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.837+0000 7efc4dc66700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480b2180 0x7efc481f65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:43.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.837+0000 7efc4dc66700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480b2180 0x7efc481f65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47086/0 (socket says 172.21.15.79:47086) 2023-10-19T08:38:43.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.837+0000 7efc4dc66700 1 -- 172.21.15.79:0/1613152156 learned_addr learned my addr 172.21.15.79:0/1613152156 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:43.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.837+0000 7efc4dc66700 1 -- 172.21.15.79:0/1613152156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc480cfcf0 msgr2=0x7efc481e8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:43.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.837+0000 7efc4dc66700 1 --2- 172.21.15.79:0/1613152156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc480cfcf0 0x7efc481e8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.837+0000 7efc4dc66700 1 -- 172.21.15.79:0/1613152156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc480b5f20 msgr2=0x7efc4815a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:43.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.837+0000 7efc4dc66700 1 --2- 172.21.15.79:0/1613152156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc480b5f20 0x7efc4815a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:43.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.837+0000 7efc4dc66700 1 -- 172.21.15.79:0/1613152156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc40009a70 con 0x7efc480b2180 2023-10-19T08:38:43.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.838+0000 7efc4dc66700 1 --2- 172.21.15.79:0/1613152156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480b2180 0x7efc481f65a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efc3800c820 tx=0x7efc3800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:43.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.838+0000 7efc3e7fc700 1 -- 172.21.15.79:0/1613152156 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38011800 con 0x7efc480b2180 2023-10-19T08:38:43.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.838+0000 7efc3e7fc700 1 -- 172.21.15.79:0/1613152156 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc38011960 con 0x7efc480b2180 2023-10-19T08:38:43.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.838+0000 7efc4feca700 1 -- 172.21.15.79:0/1613152156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc481e9230 con 0x7efc480b2180 2023-10-19T08:38:43.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.838+0000 7efc3e7fc700 1 -- 172.21.15.79:0/1613152156 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38011d10 con 0x7efc480b2180 2023-10-19T08:38:43.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.838+0000 7efc4feca700 1 -- 172.21.15.79:0/1613152156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc481f5da0 con 0x7efc480b2180 2023-10-19T08:38:43.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.839+0000 7efc4feca700 1 -- 172.21.15.79:0/1613152156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc4804ee70 con 0x7efc480b2180 2023-10-19T08:38:43.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.839+0000 7efc3e7fc700 1 -- 172.21.15.79:0/1613152156 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efc38018360 con 0x7efc480b2180 2023-10-19T08:38:43.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.839+0000 7efc3e7fc700 1 --2- 172.21.15.79:0/1613152156 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efc2c06a0e0 0x7efc2c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:43.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.839+0000 7efc3e7fc700 1 -- 172.21.15.79:0/1613152156 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efc38088850 con 0x7efc480b2180 2023-10-19T08:38:43.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.839+0000 7efc4d465700 1 --2- 172.21.15.79:0/1613152156 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efc2c06a0e0 0x7efc2c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:43.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.840+0000 7efc4d465700 1 --2- 172.21.15.79:0/1613152156 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efc2c06a0e0 0x7efc2c06c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efc440011e0 tx=0x7efc440079b0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:43.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:43.844+0000 7efc3e7fc700 1 -- 172.21.15.79:0/1613152156 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7efc380576b0 con 0x7efc480b2180 2023-10-19T08:38:44.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.035+0000 7efc4feca700 1 -- 172.21.15.79:0/1613152156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc480b2660 con 0x7efc480b2180 2023-10-19T08:38:44.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.035+0000 7efc3e7fc700 1 -- 172.21.15.79:0/1613152156 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7efc38057240 con 0x7efc480b2180 2023-10-19T08:38:44.040 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-19T08:38:44.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.037+0000 7efc4feca700 1 -- 172.21.15.79:0/1613152156 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efc2c06a0e0 msgr2=0x7efc2c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:44.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.037+0000 7efc4feca700 1 --2- 172.21.15.79:0/1613152156 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efc2c06a0e0 0x7efc2c06c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efc440011e0 tx=0x7efc440079b0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.037+0000 7efc4feca700 1 -- 172.21.15.79:0/1613152156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480b2180 msgr2=0x7efc481f65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:44.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.037+0000 7efc4feca700 1 --2- 172.21.15.79:0/1613152156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480b2180 0x7efc481f65a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7efc3800c820 tx=0x7efc3800cbe0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.037+0000 7efc4feca700 1 -- 172.21.15.79:0/1613152156 shutdown_connections 2023-10-19T08:38:44.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.037+0000 7efc4feca700 1 --2- 172.21.15.79:0/1613152156 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efc2c06a0e0 0x7efc2c06c5a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.037+0000 7efc4feca700 1 --2- 172.21.15.79:0/1613152156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc480cfcf0 0x7efc481e8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.037+0000 7efc4feca700 1 --2- 172.21.15.79:0/1613152156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc480b2180 0x7efc481f65a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.037+0000 7efc4feca700 1 --2- 172.21.15.79:0/1613152156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc480b5f20 0x7efc4815a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.037+0000 7efc4feca700 1 -- 172.21.15.79:0/1613152156 >> 172.21.15.79:0/1613152156 conn(0x7efc48071b30 msgr2=0x7efc480b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:44.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.037+0000 7efc4feca700 1 -- 172.21.15.79:0/1613152156 shutdown_connections 2023-10-19T08:38:44.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.038+0000 7efc4feca700 1 -- 172.21.15.79:0/1613152156 wait complete. 2023-10-19T08:38:44.054 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T08:38:44.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.175+0000 7f0071585700 1 Processor -- start 2023-10-19T08:38:44.180 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.175+0000 7f0071585700 1 -- start start 2023-10-19T08:38:44.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.176+0000 7f0071585700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f006c0ad9a0 0x7f006c06a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.185 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.176+0000 7f0071585700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006c06ab90 con 0x7f006c06a760 2023-10-19T08:38:44.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.176+0000 7f0071585700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006c06cf60 con 0x7f006c15adb0 2023-10-19T08:38:44.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.176+0000 7f0071585700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006c071160 con 0x7f006c0ad9a0 2023-10-19T08:38:44.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.176+0000 7f006b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f006c06a760 0x7f006c0c45f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57170/0 (socket says 172.21.15.79:57170) 2023-10-19T08:38:44.186 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.176+0000 7f006b7fe700 1 -- 172.21.15.79:0/2319726030 learned_addr learned my addr 172.21.15.79:0/2319726030 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.176+0000 7f006a7fc700 1 --2- 172.21.15.79:0/2319726030 >> v2:172.21.15.89:3300/0 conn(0x7f006c0ad9a0 0x7f006c06a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.176+0000 7f0069ffb700 1 -- 172.21.15.79:0/2319726030 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074733786 0 0) 0x7f006c06ab90 con 0x7f006c06a760 2023-10-19T08:38:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.176+0000 7f0069ffb700 1 -- 172.21.15.79:0/2319726030 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00540035b0 con 0x7f006c06a760 2023-10-19T08:38:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.176+0000 7f0069ffb700 1 -- 172.21.15.79:0/2319726030 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 335483341 0 0) 0x7f00540035b0 con 0x7f006c06a760 2023-10-19T08:38:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.176+0000 7f0069ffb700 1 -- 172.21.15.79:0/2319726030 >> v2:172.21.15.89:3300/0 conn(0x7f006c0ad9a0 msgr2=0x7f006c06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:44.187 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.176+0000 7f0069ffb700 1 --2- 172.21.15.79:0/2319726030 >> v2:172.21.15.89:3300/0 conn(0x7f006c0ad9a0 0x7f006c06a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.176+0000 7f0069ffb700 1 -- 172.21.15.79:0/2319726030 >> v1:172.21.15.89:6789/0 conn(0x7f006c15adb0 legacy=0x7f006c0709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:44.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.176+0000 7f0069ffb700 1 -- 172.21.15.79:0/2319726030 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c071440 con 0x7f006c06a760 2023-10-19T08:38:44.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.176+0000 7f0069ffb700 1 -- 172.21.15.79:0/2319726030 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f00640019f0 con 0x7f006c06a760 2023-10-19T08:38:44.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f0069ffb700 1 -- 172.21.15.79:0/2319726030 >> v1:172.21.15.79:6789/0 conn(0x7f006c06a760 legacy=0x7f006c0c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:44.188 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f0069ffb700 1 --2- 172.21.15.79:0/2319726030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0054003a70 0x7f0054003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f0069ffb700 1 --2- 172.21.15.79:0/2319726030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0054004850 0x7f0054004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f0069ffb700 1 --2- 172.21.15.79:0/2319726030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0054005210 0x7f005400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f0069ffb700 1 -- 172.21.15.79:0/2319726030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006c071160 con 0x7f0054003a70 2023-10-19T08:38:44.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f0069ffb700 1 -- 172.21.15.79:0/2319726030 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005400c140 con 0x7f0054005210 2023-10-19T08:38:44.189 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f0069ffb700 1 -- 172.21.15.79:0/2319726030 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005400c300 con 0x7f0054004850 2023-10-19T08:38:44.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f006affd700 1 --2- 172.21.15.79:0/2319726030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0054003a70 0x7f0054003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:44.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f006a7fc700 1 --2- 172.21.15.79:0/2319726030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0054004850 0x7f0054004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:44.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f006b7fe700 1 --2- 172.21.15.79:0/2319726030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0054005210 0x7f005400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:44.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f006affd700 1 -- 172.21.15.79:0/2319726030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0054004850 msgr2=0x7f0054004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:44.190 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f006affd700 1 --2- 172.21.15.79:0/2319726030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0054004850 0x7f0054004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f006affd700 1 -- 172.21.15.79:0/2319726030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0054005210 msgr2=0x7f005400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:44.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f006affd700 1 --2- 172.21.15.79:0/2319726030 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0054005210 0x7f005400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f006b7fe700 1 -- 172.21.15.79:0/2319726030 reap_dead start 2023-10-19T08:38:44.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f006affd700 1 -- 172.21.15.79:0/2319726030 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00540035b0 con 0x7f0054003a70 2023-10-19T08:38:44.191 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f006a7fc700 1 --2- 172.21.15.79:0/2319726030 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0054004850 0x7f0054004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f006affd700 1 --2- 172.21.15.79:0/2319726030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0054003a70 0x7f0054003e90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0060001800 tx=0x7f0054005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19aac5254e3f8952 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f0069ffb700 1 -- 172.21.15.79:0/2319726030 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00600012f0 con 0x7f0054003a70 2023-10-19T08:38:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f0069ffb700 1 -- 172.21.15.79:0/2319726030 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0060005310 con 0x7f0054003a70 2023-10-19T08:38:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.177+0000 7f0069ffb700 1 -- 172.21.15.79:0/2319726030 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0060006860 con 0x7f0054003a70 2023-10-19T08:38:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.178+0000 7f0071585700 1 -- 172.21.15.79:0/2319726030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0054003a70 msgr2=0x7f0054003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:44.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.178+0000 7f0071585700 1 --2- 172.21.15.79:0/2319726030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0054003a70 0x7f0054003e90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0060001800 tx=0x7f0054005880 comp rx=0 tx=0).stop 2023-10-19T08:38:44.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.178+0000 7f0071585700 1 -- 172.21.15.79:0/2319726030 shutdown_connections 2023-10-19T08:38:44.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.178+0000 7f0071585700 1 --2- 172.21.15.79:0/2319726030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0054003a70 0x7f0054003e90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.178+0000 7f0071585700 1 -- 172.21.15.79:0/2319726030 >> 172.21.15.79:0/2319726030 conn(0x7f006c0ce960 msgr2=0x7f006c0ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:44.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.178+0000 7f0071585700 1 -- 172.21.15.79:0/2319726030 shutdown_connections 2023-10-19T08:38:44.193 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.178+0000 7f0071585700 1 -- 172.21.15.79:0/2319726030 wait complete. 2023-10-19T08:38:44.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.179+0000 7f0071585700 1 Processor -- start 2023-10-19T08:38:44.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.179+0000 7f0071585700 1 -- start start 2023-10-19T08:38:44.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.180+0000 7f0071585700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0054003a70 0x7f006c152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.180+0000 7f0071585700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006c0cd0d0 0x7f006c0cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.180+0000 7f0071585700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f006c0ac2b0 0x7f006c0cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.180+0000 7f0071585700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006c152970 con 0x7f006c0cd0d0 2023-10-19T08:38:44.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.180+0000 7f0071585700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006c0ac7e0 con 0x7f006c0ac2b0 2023-10-19T08:38:44.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.180+0000 7f0071585700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006c0acac0 con 0x7f0054003a70 2023-10-19T08:38:44.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.180+0000 7f006a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006c0cd0d0 0x7f006c0cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:44.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.180+0000 7f006a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006c0cd0d0 0x7f006c0cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47106/0 (socket says 172.21.15.79:47106) 2023-10-19T08:38:44.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.180+0000 7f006a7fc700 1 -- 172.21.15.79:0/4274988766 learned_addr learned my addr 172.21.15.79:0/4274988766 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:44.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.180+0000 7f006a7fc700 1 -- 172.21.15.79:0/4274988766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0054003a70 msgr2=0x7f006c152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:44.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.180+0000 7f006a7fc700 1 --2- 172.21.15.79:0/4274988766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0054003a70 0x7f006c152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.180+0000 7f006a7fc700 1 -- 172.21.15.79:0/4274988766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f006c0ac2b0 msgr2=0x7f006c0cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:44.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.180+0000 7f006a7fc700 1 --2- 172.21.15.79:0/4274988766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f006c0ac2b0 0x7f006c0cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.180+0000 7f006a7fc700 1 -- 172.21.15.79:0/4274988766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c0acda0 con 0x7f006c0cd0d0 2023-10-19T08:38:44.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.180+0000 7f006a7fc700 1 --2- 172.21.15.79:0/4274988766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006c0cd0d0 0x7f006c0cc530 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f005c011590 tx=0x7f005c011950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:44.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.181+0000 7f00537fe700 1 -- 172.21.15.79:0/4274988766 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c004220 con 0x7f006c0cd0d0 2023-10-19T08:38:44.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.181+0000 7f00537fe700 1 -- 172.21.15.79:0/4274988766 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c004380 con 0x7f006c0cd0d0 2023-10-19T08:38:44.197 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.181+0000 7f0071585700 1 -- 172.21.15.79:0/4274988766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006c0ad080 con 0x7f006c0cd0d0 2023-10-19T08:38:44.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.181+0000 7f00537fe700 1 -- 172.21.15.79:0/4274988766 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c0036a0 con 0x7f006c0cd0d0 2023-10-19T08:38:44.198 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.181+0000 7f0071585700 1 -- 172.21.15.79:0/4274988766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f006c0c4610 con 0x7f006c0cd0d0 2023-10-19T08:38:44.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.181+0000 7f0071585700 1 -- 172.21.15.79:0/4274988766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f006c04ee70 con 0x7f006c0cd0d0 2023-10-19T08:38:44.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.182+0000 7f00537fe700 1 -- 172.21.15.79:0/4274988766 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f005c003800 con 0x7f006c0cd0d0 2023-10-19T08:38:44.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.183+0000 7f00537fe700 1 --2- 172.21.15.79:0/4274988766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f005806a110 0x7f005806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.183+0000 7f00537fe700 1 -- 172.21.15.79:0/4274988766 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f005c088f50 con 0x7f006c0cd0d0 2023-10-19T08:38:44.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.183+0000 7f006affd700 1 --2- 172.21.15.79:0/4274988766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f005806a110 0x7f005806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:44.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.183+0000 7f006affd700 1 --2- 172.21.15.79:0/4274988766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f005806a110 0x7f005806c5d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0060001800 tx=0x7f0060011000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:44.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.186+0000 7f00537fe700 1 -- 172.21.15.79:0/4274988766 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f005c054360 con 0x7f006c0cd0d0 2023-10-19T08:38:44.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.378+0000 7f0071585700 1 -- 172.21.15.79:0/4274988766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f006c15b600 con 0x7f006c0cd0d0 2023-10-19T08:38:44.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.378+0000 7f00537fe700 1 -- 172.21.15.79:0/4274988766 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f005c0220a0 con 0x7f006c0cd0d0 2023-10-19T08:38:44.383 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:44.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.380+0000 7f0071585700 1 -- 172.21.15.79:0/4274988766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f005806a110 msgr2=0x7f005806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:44.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.380+0000 7f0071585700 1 --2- 172.21.15.79:0/4274988766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f005806a110 0x7f005806c5d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0060001800 tx=0x7f0060011000 comp rx=0 tx=0).stop 2023-10-19T08:38:44.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.380+0000 7f0071585700 1 -- 172.21.15.79:0/4274988766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006c0cd0d0 msgr2=0x7f006c0cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:44.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.380+0000 7f0071585700 1 --2- 172.21.15.79:0/4274988766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006c0cd0d0 0x7f006c0cc530 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f005c011590 tx=0x7f005c011950 comp rx=0 tx=0).stop 2023-10-19T08:38:44.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.380+0000 7f0071585700 1 -- 172.21.15.79:0/4274988766 shutdown_connections 2023-10-19T08:38:44.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.380+0000 7f0071585700 1 --2- 172.21.15.79:0/4274988766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f006c0ac2b0 0x7f006c0cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.380+0000 7f0071585700 1 --2- 172.21.15.79:0/4274988766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f005806a110 0x7f005806c5d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.380+0000 7f0071585700 1 --2- 172.21.15.79:0/4274988766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0054003a70 0x7f006c152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.380+0000 7f0071585700 1 --2- 172.21.15.79:0/4274988766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f006c0cd0d0 0x7f006c0cc530 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.380+0000 7f0071585700 1 -- 172.21.15.79:0/4274988766 >> 172.21.15.79:0/4274988766 conn(0x7f006c0ce960 msgr2=0x7f006c06e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:44.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.380+0000 7f0071585700 1 -- 172.21.15.79:0/4274988766 shutdown_connections 2023-10-19T08:38:44.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.380+0000 7f0071585700 1 -- 172.21.15.79:0/4274988766 wait complete. 2023-10-19T08:38:44.397 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:44.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.516+0000 7fc532c1d700 1 Processor -- start 2023-10-19T08:38:44.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.516+0000 7fc532c1d700 1 -- start start 2023-10-19T08:38:44.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.516+0000 7fc532c1d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc52c06a930 0x7fc52c0b3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.516+0000 7fc532c1d700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52c0b2d90 con 0x7fc52c15af30 2023-10-19T08:38:44.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.516+0000 7fc532c1d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52c0ca630 con 0x7fc52c15b310 2023-10-19T08:38:44.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.516+0000 7fc532c1d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c0ca910 con 0x7fc52c06a930 2023-10-19T08:38:44.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.516+0000 7fc5309b9700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc52c15af30 0x7fc52c06a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57186/0 (socket says 172.21.15.79:57186) 2023-10-19T08:38:44.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.516+0000 7fc5309b9700 1 -- 172.21.15.79:0/3793635649 learned_addr learned my addr 172.21.15.79:0/3793635649 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:44.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc5311ba700 1 --2- 172.21.15.79:0/3793635649 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc52c06a930 0x7fc52c0b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:44.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3793635649 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415647897 0 0) 0x7fc52c0b2d90 con 0x7fc52c15af30 2023-10-19T08:38:44.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3793635649 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc51c0035b0 con 0x7fc52c15af30 2023-10-19T08:38:44.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3793635649 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3762703057 0 0) 0x7fc51c0035b0 con 0x7fc52c15af30 2023-10-19T08:38:44.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3793635649 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc52c06a930 msgr2=0x7fc52c0b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:44.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc52b7fe700 1 --2- 172.21.15.79:0/3793635649 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc52c06a930 0x7fc52c0b3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3793635649 >> v1:172.21.15.89:6789/0 conn(0x7fc52c15b310 legacy=0x7fc52c0b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:44.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3793635649 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c0b20d0 con 0x7fc52c15af30 2023-10-19T08:38:44.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3793635649 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7fc520001670 con 0x7fc52c15af30 2023-10-19T08:38:44.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3793635649 >> v1:172.21.15.79:6789/0 conn(0x7fc52c15af30 legacy=0x7fc52c06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:44.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc52b7fe700 1 --2- 172.21.15.79:0/3793635649 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc52c06a930 0x7fc51c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc52b7fe700 1 --2- 172.21.15.79:0/3793635649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc51c003f70 0x7fc51c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc52b7fe700 1 --2- 172.21.15.79:0/3793635649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc51c004d90 0x7fc51c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3793635649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c0ca910 con 0x7fc51c004d90 2023-10-19T08:38:44.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3793635649 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c00bac0 con 0x7fc51c003f70 2023-10-19T08:38:44.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3793635649 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51c00bc80 con 0x7fc52c06a930 2023-10-19T08:38:44.529 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc5311ba700 1 --2- 172.21.15.79:0/3793635649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc51c004d90 0x7fc51c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:44.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc5309b9700 1 --2- 172.21.15.79:0/3793635649 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc52c06a930 0x7fc51c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:44.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc52bfff700 1 --2- 172.21.15.79:0/3793635649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc51c003f70 0x7fc51c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:44.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc5311ba700 1 -- 172.21.15.79:0/3793635649 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc52c06a930 msgr2=0x7fc51c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:44.530 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc5311ba700 1 --2- 172.21.15.79:0/3793635649 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc52c06a930 0x7fc51c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc5311ba700 1 -- 172.21.15.79:0/3793635649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc51c003f70 msgr2=0x7fc51c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:44.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.517+0000 7fc5311ba700 1 --2- 172.21.15.79:0/3793635649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc51c003f70 0x7fc51c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.518+0000 7fc5311ba700 1 -- 172.21.15.79:0/3793635649 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c0035b0 con 0x7fc51c004d90 2023-10-19T08:38:44.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.518+0000 7fc5311ba700 1 --2- 172.21.15.79:0/3793635649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc51c004d90 0x7fc51c005210 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc52c06f150 tx=0x7fc51c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d70cd97fbd0f842 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:44.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.518+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3793635649 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52400ebd0 con 0x7fc51c004d90 2023-10-19T08:38:44.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.518+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3793635649 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52400f040 con 0x7fc51c004d90 2023-10-19T08:38:44.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.518+0000 7fc52b7fe700 1 -- 172.21.15.79:0/3793635649 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524014480 con 0x7fc51c004d90 2023-10-19T08:38:44.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.518+0000 7fc532c1d700 1 -- 172.21.15.79:0/3793635649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc51c004d90 msgr2=0x7fc51c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:44.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.518+0000 7fc532c1d700 1 --2- 172.21.15.79:0/3793635649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc51c004d90 0x7fc51c005210 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc52c06f150 tx=0x7fc51c005880 comp rx=0 tx=0).stop 2023-10-19T08:38:44.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.518+0000 7fc5311ba700 1 -- 172.21.15.79:0/3793635649 reap_dead start 2023-10-19T08:38:44.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.518+0000 7fc532c1d700 1 -- 172.21.15.79:0/3793635649 shutdown_connections 2023-10-19T08:38:44.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.518+0000 7fc532c1d700 1 -- 172.21.15.79:0/3793635649 >> 172.21.15.79:0/3793635649 conn(0x7fc52c06dcc0 msgr2=0x7fc52c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:44.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.518+0000 7fc532c1d700 1 -- 172.21.15.79:0/3793635649 shutdown_connections 2023-10-19T08:38:44.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.518+0000 7fc532c1d700 1 -- 172.21.15.79:0/3793635649 wait complete. 2023-10-19T08:38:44.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.520+0000 7fc532c1d700 1 Processor -- start 2023-10-19T08:38:44.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.520+0000 7fc532c1d700 1 -- start start 2023-10-19T08:38:44.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.521+0000 7fc532c1d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc51c004d90 0x7fc52c14ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.521+0000 7fc532c1d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc52c1576d0 0x7fc52c1f3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.521+0000 7fc532c1d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc52c1f4080 0x7fc52c15c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.521+0000 7fc532c1d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c15e5b0 con 0x7fc51c004d90 2023-10-19T08:38:44.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.521+0000 7fc532c1d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c1f3660 con 0x7fc52c1f4080 2023-10-19T08:38:44.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.521+0000 7fc532c1d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c15dd10 con 0x7fc52c1576d0 2023-10-19T08:38:44.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.521+0000 7fc5309b9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc51c004d90 0x7fc52c14ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:44.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.521+0000 7fc5309b9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc51c004d90 0x7fc52c14ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47126/0 (socket says 172.21.15.79:47126) 2023-10-19T08:38:44.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.521+0000 7fc5309b9700 1 -- 172.21.15.79:0/638137140 learned_addr learned my addr 172.21.15.79:0/638137140 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:44.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.521+0000 7fc5309b9700 1 -- 172.21.15.79:0/638137140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc52c1576d0 msgr2=0x7fc52c1f3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:44.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.521+0000 7fc5309b9700 1 --2- 172.21.15.79:0/638137140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc52c1576d0 0x7fc52c1f3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.521+0000 7fc5309b9700 1 -- 172.21.15.79:0/638137140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc52c1f4080 msgr2=0x7fc52c15c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:44.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.521+0000 7fc5309b9700 1 --2- 172.21.15.79:0/638137140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc52c1f4080 0x7fc52c15c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.521+0000 7fc5309b9700 1 -- 172.21.15.79:0/638137140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c15dff0 con 0x7fc51c004d90 2023-10-19T08:38:44.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.521+0000 7fc5309b9700 1 --2- 172.21.15.79:0/638137140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc51c004d90 0x7fc52c14ec70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc5200017a0 tx=0x7fc5200076a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:44.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.522+0000 7fc5297fa700 1 -- 172.21.15.79:0/638137140 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520007820 con 0x7fc51c004d90 2023-10-19T08:38:44.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.522+0000 7fc5297fa700 1 -- 172.21.15.79:0/638137140 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52000f850 con 0x7fc51c004d90 2023-10-19T08:38:44.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.522+0000 7fc532c1d700 1 -- 172.21.15.79:0/638137140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52c15e2d0 con 0x7fc51c004d90 2023-10-19T08:38:44.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.522+0000 7fc5297fa700 1 -- 172.21.15.79:0/638137140 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52000fbc0 con 0x7fc51c004d90 2023-10-19T08:38:44.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.522+0000 7fc532c1d700 1 -- 172.21.15.79:0/638137140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52c157b50 con 0x7fc51c004d90 2023-10-19T08:38:44.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.523+0000 7fc532c1d700 1 -- 172.21.15.79:0/638137140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc52c1f34c0 con 0x7fc51c004d90 2023-10-19T08:38:44.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.523+0000 7fc5297fa700 1 -- 172.21.15.79:0/638137140 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc52000fd20 con 0x7fc51c004d90 2023-10-19T08:38:44.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.523+0000 7fc5297fa700 1 --2- 172.21.15.79:0/638137140 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc51006a0b0 0x7fc51006c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.523+0000 7fc5297fa700 1 -- 172.21.15.79:0/638137140 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc5200888e0 con 0x7fc51c004d90 2023-10-19T08:38:44.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.523+0000 7fc52bfff700 1 --2- 172.21.15.79:0/638137140 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc51006a0b0 0x7fc51006c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:44.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.524+0000 7fc52bfff700 1 --2- 172.21.15.79:0/638137140 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc51006a0b0 0x7fc51006c570 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc52c1f0f90 tx=0x7fc518009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:44.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.528+0000 7fc5297fa700 1 -- 172.21.15.79:0/638137140 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc52c1f34c0 con 0x7fc51c004d90 2023-10-19T08:38:44.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.717+0000 7fc532c1d700 1 -- 172.21.15.79:0/638137140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc52c1f34c0 con 0x7fc51c004d90 2023-10-19T08:38:44.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.718+0000 7fc5297fa700 1 -- 172.21.15.79:0/638137140 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20155 (secure 0 0 0) 0x7fc52c1f34c0 con 0x7fc51c004d90 2023-10-19T08:38:44.723 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:44.723 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:44.473795+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:44.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.720+0000 7fc532c1d700 1 -- 172.21.15.79:0/638137140 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc51006a0b0 msgr2=0x7fc51006c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:44.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.720+0000 7fc532c1d700 1 --2- 172.21.15.79:0/638137140 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc51006a0b0 0x7fc51006c570 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc52c1f0f90 tx=0x7fc518009040 comp rx=0 tx=0).stop 2023-10-19T08:38:44.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.720+0000 7fc532c1d700 1 -- 172.21.15.79:0/638137140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc51c004d90 msgr2=0x7fc52c14ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:44.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.720+0000 7fc532c1d700 1 --2- 172.21.15.79:0/638137140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc51c004d90 0x7fc52c14ec70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc5200017a0 tx=0x7fc5200076a0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.720+0000 7fc532c1d700 1 -- 172.21.15.79:0/638137140 shutdown_connections 2023-10-19T08:38:44.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.720+0000 7fc532c1d700 1 --2- 172.21.15.79:0/638137140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc52c1f4080 0x7fc52c15c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.720+0000 7fc532c1d700 1 --2- 172.21.15.79:0/638137140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc51c004d90 0x7fc52c14ec70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.720+0000 7fc532c1d700 1 --2- 172.21.15.79:0/638137140 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc51006a0b0 0x7fc51006c570 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.720+0000 7fc532c1d700 1 --2- 172.21.15.79:0/638137140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc52c1576d0 0x7fc52c1f3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.720+0000 7fc532c1d700 1 -- 172.21.15.79:0/638137140 >> 172.21.15.79:0/638137140 conn(0x7fc52c06dcc0 msgr2=0x7fc52c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:44.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.720+0000 7fc532c1d700 1 -- 172.21.15.79:0/638137140 shutdown_connections 2023-10-19T08:38:44.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.720+0000 7fc532c1d700 1 -- 172.21.15.79:0/638137140 wait complete. 2023-10-19T08:38:44.737 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T08:37:54.318159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T08:37:55.629862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T08:37:59.333062+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T08:38:44.738 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:38:44.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.855+0000 7f7accf3c700 1 Processor -- start 2023-10-19T08:38:44.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.855+0000 7f7accf3c700 1 -- start start 2023-10-19T08:38:44.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.856+0000 7f7accf3c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ac815e570 0x7f7ac80d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.856+0000 7f7accf3c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7ac80cb6f0 0x7f7ac80b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.856+0000 7f7accf3c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7ac80b0a30 0x7f7ac80b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.856+0000 7f7accf3c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac80b0ec0 con 0x7f7ac80cb6f0 2023-10-19T08:38:44.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.856+0000 7f7accf3c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac80afd60 con 0x7f7ac80b0a30 2023-10-19T08:38:44.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.856+0000 7f7accf3c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac80af810 con 0x7f7ac815e570 2023-10-19T08:38:44.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.857+0000 7f7ac5d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7ac80cb6f0 0x7f7ac80b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:44.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.857+0000 7f7ac5d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7ac80cb6f0 0x7f7ac80b04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47136/0 (socket says 172.21.15.79:47136) 2023-10-19T08:38:44.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.857+0000 7f7ac5d9b700 1 -- 172.21.15.79:0/419136884 learned_addr learned my addr 172.21.15.79:0/419136884 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:44.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.857+0000 7f7ac6d9d700 1 --2- 172.21.15.79:0/419136884 >> v2:172.21.15.89:3300/0 conn(0x7f7ac80b0a30 0x7f7ac80b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:44.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.857+0000 7f7ac5d9b700 1 -- 172.21.15.79:0/419136884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ac815e570 msgr2=0x7f7ac80d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:44.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.857+0000 7f7ac5d9b700 1 --2- 172.21.15.79:0/419136884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ac815e570 0x7f7ac80d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.857+0000 7f7ac5d9b700 1 -- 172.21.15.79:0/419136884 >> v2:172.21.15.89:3300/0 conn(0x7f7ac80b0a30 msgr2=0x7f7ac80b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:44.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.857+0000 7f7ac5d9b700 1 --2- 172.21.15.79:0/419136884 >> v2:172.21.15.89:3300/0 conn(0x7f7ac80b0a30 0x7f7ac80b15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.857+0000 7f7ac5d9b700 1 -- 172.21.15.79:0/419136884 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac80aef70 con 0x7f7ac80cb6f0 2023-10-19T08:38:44.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.857+0000 7f7ac5d9b700 1 --2- 172.21.15.79:0/419136884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac80cb6f0 0x7f7ac80b04f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7ac808b4c0 tx=0x7f7ab8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f341cfdcfe815bc server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:44.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.857+0000 7f7ac559a700 1 -- 172.21.15.79:0/419136884 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab800b870 con 0x7f7ac80cb6f0 2023-10-19T08:38:44.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.857+0000 7f7ac559a700 1 -- 172.21.15.79:0/419136884 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab800b9d0 con 0x7f7ac80cb6f0 2023-10-19T08:38:44.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.857+0000 7f7ac559a700 1 -- 172.21.15.79:0/419136884 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab800bd60 con 0x7f7ac80cb6f0 2023-10-19T08:38:44.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.858+0000 7f7accf3c700 1 -- 172.21.15.79:0/419136884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac80cb6f0 msgr2=0x7f7ac80b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:44.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.858+0000 7f7accf3c700 1 --2- 172.21.15.79:0/419136884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac80cb6f0 0x7f7ac80b04f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7ac808b4c0 tx=0x7f7ab8009bd0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.858+0000 7f7accf3c700 1 -- 172.21.15.79:0/419136884 shutdown_connections 2023-10-19T08:38:44.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.858+0000 7f7accf3c700 1 --2- 172.21.15.79:0/419136884 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ac815e570 0x7f7ac80d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.858+0000 7f7accf3c700 1 --2- 172.21.15.79:0/419136884 >> v2:172.21.15.89:3300/0 conn(0x7f7ac80b0a30 0x7f7ac80b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.858+0000 7f7accf3c700 1 --2- 172.21.15.79:0/419136884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac80cb6f0 0x7f7ac80b04f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.858+0000 7f7accf3c700 1 -- 172.21.15.79:0/419136884 >> 172.21.15.79:0/419136884 conn(0x7f7ac809a0b0 msgr2=0x7f7ac80d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:44.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.858+0000 7f7accf3c700 1 -- 172.21.15.79:0/419136884 shutdown_connections 2023-10-19T08:38:44.869 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.858+0000 7f7accf3c700 1 -- 172.21.15.79:0/419136884 wait complete. 2023-10-19T08:38:44.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.860+0000 7f7accf3c700 1 Processor -- start 2023-10-19T08:38:44.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.860+0000 7f7accf3c700 1 -- start start 2023-10-19T08:38:44.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.860+0000 7f7accf3c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac80b0a30 0x7f7ac80cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.860+0000 7f7accf3c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ac80cb6f0 0x7f7ac80c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.860+0000 7f7accf3c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ac815e570 0x7f7ac8150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.861+0000 7f7accf3c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac80cabf0 con 0x7f7ac80b0a30 2023-10-19T08:38:44.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.861+0000 7f7accf3c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac80c8030 con 0x7f7ac815e570 2023-10-19T08:38:44.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.861+0000 7f7accf3c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac80c8310 con 0x7f7ac80cb6f0 2023-10-19T08:38:44.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.861+0000 7f7ac659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac80b0a30 0x7f7ac80cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:44.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.861+0000 7f7ac659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac80b0a30 0x7f7ac80cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47140/0 (socket says 172.21.15.79:47140) 2023-10-19T08:38:44.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.861+0000 7f7ac659c700 1 -- 172.21.15.79:0/1551748165 learned_addr learned my addr 172.21.15.79:0/1551748165 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:44.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.861+0000 7f7ac5d9b700 1 --2- 172.21.15.79:0/1551748165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ac80cb6f0 0x7f7ac80c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:44.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.861+0000 7f7ac6d9d700 1 --2- 172.21.15.79:0/1551748165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ac815e570 0x7f7ac8150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:44.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.861+0000 7f7ac659c700 1 -- 172.21.15.79:0/1551748165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ac80cb6f0 msgr2=0x7f7ac80c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:44.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.861+0000 7f7ac659c700 1 --2- 172.21.15.79:0/1551748165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ac80cb6f0 0x7f7ac80c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.861+0000 7f7ac659c700 1 -- 172.21.15.79:0/1551748165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ac815e570 msgr2=0x7f7ac8150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:44.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.861+0000 7f7ac659c700 1 --2- 172.21.15.79:0/1551748165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ac815e570 0x7f7ac8150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:44.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.861+0000 7f7ac659c700 1 -- 172.21.15.79:0/1551748165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab8009550 con 0x7f7ac80b0a30 2023-10-19T08:38:44.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.861+0000 7f7ac659c700 1 --2- 172.21.15.79:0/1551748165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac80b0a30 0x7f7ac80cd300 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00b530 tx=0x7f7abc00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:44.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.861+0000 7f7ab6ffd700 1 -- 172.21.15.79:0/1551748165 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc011830 con 0x7f7ac80b0a30 2023-10-19T08:38:44.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.861+0000 7f7ab6ffd700 1 -- 172.21.15.79:0/1551748165 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc0119b0 con 0x7f7ac80b0a30 2023-10-19T08:38:44.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.861+0000 7f7accf3c700 1 -- 172.21.15.79:0/1551748165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac80c85f0 con 0x7f7ac80b0a30 2023-10-19T08:38:44.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.861+0000 7f7ab6ffd700 1 -- 172.21.15.79:0/1551748165 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc011d60 con 0x7f7ac80b0a30 2023-10-19T08:38:44.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.861+0000 7f7accf3c700 1 -- 172.21.15.79:0/1551748165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac80c6d50 con 0x7f7ac80b0a30 2023-10-19T08:38:44.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.862+0000 7f7accf3c700 1 -- 172.21.15.79:0/1551748165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac80c7e90 con 0x7f7ac80b0a30 2023-10-19T08:38:44.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.863+0000 7f7ab6ffd700 1 -- 172.21.15.79:0/1551748165 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7abc01a400 con 0x7f7ac80b0a30 2023-10-19T08:38:44.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.863+0000 7f7ab6ffd700 1 --2- 172.21.15.79:0/1551748165 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7aa806a0e0 0x7f7aa806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:44.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.863+0000 7f7ab6ffd700 1 -- 172.21.15.79:0/1551748165 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7abc0888a0 con 0x7f7ac80b0a30 2023-10-19T08:38:44.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.863+0000 7f7ac5d9b700 1 --2- 172.21.15.79:0/1551748165 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7aa806a0e0 0x7f7aa806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:44.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.863+0000 7f7ac5d9b700 1 --2- 172.21.15.79:0/1551748165 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7aa806a0e0 0x7f7aa806c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80cbaf0 tx=0x7f7ab8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:44.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:44.867+0000 7f7ab6ffd700 1 -- 172.21.15.79:0/1551748165 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f7ac80c7e90 con 0x7f7ac80b0a30 2023-10-19T08:38:45.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.057+0000 7f7accf3c700 1 -- 172.21.15.79:0/1551748165 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ac80c7e90 con 0x7f7ac80b0a30 2023-10-19T08:38:45.062 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.057+0000 7f7ab6ffd700 1 -- 172.21.15.79:0/1551748165 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ac80c7e90 con 0x7f7ac80b0a30 2023-10-19T08:38:45.062 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:38:45.064 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.059+0000 7f7accf3c700 1 -- 172.21.15.79:0/1551748165 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7aa806a0e0 msgr2=0x7f7aa806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:45.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.059+0000 7f7accf3c700 1 --2- 172.21.15.79:0/1551748165 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7aa806a0e0 0x7f7aa806c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80cbaf0 tx=0x7f7ab8008030 comp rx=0 tx=0).stop 2023-10-19T08:38:45.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.059+0000 7f7accf3c700 1 -- 172.21.15.79:0/1551748165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac80b0a30 msgr2=0x7f7ac80cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:45.065 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.059+0000 7f7accf3c700 1 --2- 172.21.15.79:0/1551748165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac80b0a30 0x7f7ac80cd300 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00b530 tx=0x7f7abc00b8f0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.060+0000 7f7accf3c700 1 -- 172.21.15.79:0/1551748165 shutdown_connections 2023-10-19T08:38:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.060+0000 7f7accf3c700 1 --2- 172.21.15.79:0/1551748165 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ac815e570 0x7f7ac8150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.060+0000 7f7accf3c700 1 --2- 172.21.15.79:0/1551748165 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ac80b0a30 0x7f7ac80cd300 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.066 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.060+0000 7f7accf3c700 1 --2- 172.21.15.79:0/1551748165 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7aa806a0e0 0x7f7aa806c5a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.060+0000 7f7accf3c700 1 --2- 172.21.15.79:0/1551748165 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7ac80cb6f0 0x7f7ac80c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.060+0000 7f7accf3c700 1 -- 172.21.15.79:0/1551748165 >> 172.21.15.79:0/1551748165 conn(0x7f7ac809a0b0 msgr2=0x7f7ac81520a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:45.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.060+0000 7f7accf3c700 1 -- 172.21.15.79:0/1551748165 shutdown_connections 2023-10-19T08:38:45.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.060+0000 7f7accf3c700 1 -- 172.21.15.79:0/1551748165 wait complete. 2023-10-19T08:38:45.076 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:38:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.195+0000 7fa49447e700 1 Processor -- start 2023-10-19T08:38:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.195+0000 7fa49447e700 1 -- start start 2023-10-19T08:38:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.196+0000 7fa49447e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa48c06dff0 0x7fa48c0cae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.196+0000 7fa49447e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48c0663c0 con 0x7fa48c0cecc0 2023-10-19T08:38:45.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.196+0000 7fa49447e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa48c15a2c0 con 0x7fa48c159ee0 2023-10-19T08:38:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.196+0000 7fa49447e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48c0b5030 con 0x7fa48c06dff0 2023-10-19T08:38:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.196+0000 7fa492a1b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa48c0cecc0 0x7fa48c06b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57224/0 (socket says 172.21.15.79:57224) 2023-10-19T08:38:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.196+0000 7fa492a1b700 1 -- 172.21.15.79:0/505597266 learned_addr learned my addr 172.21.15.79:0/505597266 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa491a19700 1 --2- 172.21.15.79:0/505597266 >> v2:172.21.15.89:3300/0 conn(0x7fa48c06dff0 0x7fa48c0cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.205 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa491218700 1 -- 172.21.15.79:0/505597266 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843031612 0 0) 0x7fa48c0663c0 con 0x7fa48c0cecc0 2023-10-19T08:38:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa491218700 1 -- 172.21.15.79:0/505597266 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4780035b0 con 0x7fa48c0cecc0 2023-10-19T08:38:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa491218700 1 -- 172.21.15.79:0/505597266 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2415986701 0 0) 0x7fa4780035b0 con 0x7fa48c0cecc0 2023-10-19T08:38:45.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa491218700 1 -- 172.21.15.79:0/505597266 >> v2:172.21.15.89:3300/0 conn(0x7fa48c06dff0 msgr2=0x7fa48c0cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa491218700 1 --2- 172.21.15.79:0/505597266 >> v2:172.21.15.89:3300/0 conn(0x7fa48c06dff0 0x7fa48c0cae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa491218700 1 -- 172.21.15.79:0/505597266 >> v1:172.21.15.89:6789/0 conn(0x7fa48c159ee0 legacy=0x7fa48c0b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa491218700 1 -- 172.21.15.79:0/505597266 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c0b4d50 con 0x7fa48c0cecc0 2023-10-19T08:38:45.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa491218700 1 -- 172.21.15.79:0/505597266 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7fa4840019f0 con 0x7fa48c0cecc0 2023-10-19T08:38:45.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa491218700 1 -- 172.21.15.79:0/505597266 >> v1:172.21.15.79:6789/0 conn(0x7fa48c0cecc0 legacy=0x7fa48c06b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:45.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa491218700 1 --2- 172.21.15.79:0/505597266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa478003a70 0x7fa478003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa491218700 1 --2- 172.21.15.79:0/505597266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa478004850 0x7fa478004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa491218700 1 --2- 172.21.15.79:0/505597266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa478005210 0x7fa47800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa491218700 1 -- 172.21.15.79:0/505597266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c0b5030 con 0x7fa478005210 2023-10-19T08:38:45.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa491218700 1 -- 172.21.15.79:0/505597266 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47800c140 con 0x7fa478003a70 2023-10-19T08:38:45.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa491218700 1 -- 172.21.15.79:0/505597266 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47800c300 con 0x7fa478004850 2023-10-19T08:38:45.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa492a1b700 1 --2- 172.21.15.79:0/505597266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa478005210 0x7fa47800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa49221a700 1 --2- 172.21.15.79:0/505597266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa478003a70 0x7fa478003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa491a19700 1 --2- 172.21.15.79:0/505597266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa478004850 0x7fa478004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa492a1b700 1 -- 172.21.15.79:0/505597266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa478004850 msgr2=0x7fa478004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:45.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa492a1b700 1 --2- 172.21.15.79:0/505597266 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa478004850 0x7fa478004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa492a1b700 1 -- 172.21.15.79:0/505597266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa478003a70 msgr2=0x7fa478003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:45.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa492a1b700 1 --2- 172.21.15.79:0/505597266 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa478003a70 0x7fa478003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa492a1b700 1 -- 172.21.15.79:0/505597266 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4780035b0 con 0x7fa478005210 2023-10-19T08:38:45.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.197+0000 7fa492a1b700 1 -- 172.21.15.79:0/505597266 reap_dead start 2023-10-19T08:38:45.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.198+0000 7fa492a1b700 1 --2- 172.21.15.79:0/505597266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa478005210 0x7fa47800ba10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa48400a820 tx=0x7fa478005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551f03c6f9e74a6f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:45.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.198+0000 7fa491218700 1 -- 172.21.15.79:0/505597266 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48400a2f0 con 0x7fa478005210 2023-10-19T08:38:45.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.198+0000 7fa491218700 1 -- 172.21.15.79:0/505597266 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa484012600 con 0x7fa478005210 2023-10-19T08:38:45.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.198+0000 7fa491218700 1 -- 172.21.15.79:0/505597266 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4840129b0 con 0x7fa478005210 2023-10-19T08:38:45.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.198+0000 7fa49447e700 1 -- 172.21.15.79:0/505597266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa478005210 msgr2=0x7fa47800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:45.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.198+0000 7fa49447e700 1 --2- 172.21.15.79:0/505597266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa478005210 0x7fa47800ba10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa48400a820 tx=0x7fa478005880 comp rx=0 tx=0).stop 2023-10-19T08:38:45.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.198+0000 7fa49447e700 1 -- 172.21.15.79:0/505597266 shutdown_connections 2023-10-19T08:38:45.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.198+0000 7fa49447e700 1 --2- 172.21.15.79:0/505597266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa478005210 0x7fa47800ba10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.198+0000 7fa49447e700 1 -- 172.21.15.79:0/505597266 >> 172.21.15.79:0/505597266 conn(0x7fa48c06d000 msgr2=0x7fa48c06d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:45.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.198+0000 7fa49447e700 1 -- 172.21.15.79:0/505597266 shutdown_connections 2023-10-19T08:38:45.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.198+0000 7fa49447e700 1 -- 172.21.15.79:0/505597266 wait complete. 2023-10-19T08:38:45.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.199+0000 7fa49447e700 1 Processor -- start 2023-10-19T08:38:45.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.200+0000 7fa49447e700 1 -- start start 2023-10-19T08:38:45.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.200+0000 7fa49447e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa478005210 0x7fa48c15b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.200+0000 7fa49447e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa48c1578b0 0x7fa48c1f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.200+0000 7fa49447e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa48c0afcf0 0x7fa48c1533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.200+0000 7fa49447e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c15c590 con 0x7fa478005210 2023-10-19T08:38:45.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.200+0000 7fa49447e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c157cf0 con 0x7fa48c0afcf0 2023-10-19T08:38:45.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.200+0000 7fa49447e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c15bcf0 con 0x7fa48c1578b0 2023-10-19T08:38:45.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.200+0000 7fa49221a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa478005210 0x7fa48c15b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.200+0000 7fa49221a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa478005210 0x7fa48c15b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47160/0 (socket says 172.21.15.79:47160) 2023-10-19T08:38:45.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.200+0000 7fa49221a700 1 -- 172.21.15.79:0/641735361 learned_addr learned my addr 172.21.15.79:0/641735361 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:45.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.200+0000 7fa492a1b700 1 --2- 172.21.15.79:0/641735361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa48c0afcf0 0x7fa48c1533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.200+0000 7fa491a19700 1 --2- 172.21.15.79:0/641735361 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa48c1578b0 0x7fa48c1f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.201+0000 7fa49221a700 1 -- 172.21.15.79:0/641735361 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa48c1578b0 msgr2=0x7fa48c1f2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:45.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.201+0000 7fa49221a700 1 --2- 172.21.15.79:0/641735361 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa48c1578b0 0x7fa48c1f2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.201+0000 7fa49221a700 1 -- 172.21.15.79:0/641735361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa48c0afcf0 msgr2=0x7fa48c1533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:45.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.201+0000 7fa49221a700 1 --2- 172.21.15.79:0/641735361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa48c0afcf0 0x7fa48c1533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.201+0000 7fa49221a700 1 -- 172.21.15.79:0/641735361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48c15bfd0 con 0x7fa478005210 2023-10-19T08:38:45.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.201+0000 7fa49221a700 1 --2- 172.21.15.79:0/641735361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa478005210 0x7fa48c15b630 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00f820 tx=0x7fa47c00fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:45.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.201+0000 7fa482ffd700 1 -- 172.21.15.79:0/641735361 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0052e0 con 0x7fa478005210 2023-10-19T08:38:45.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.201+0000 7fa482ffd700 1 -- 172.21.15.79:0/641735361 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c005440 con 0x7fa478005210 2023-10-19T08:38:45.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.201+0000 7fa49447e700 1 -- 172.21.15.79:0/641735361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48c15c2b0 con 0x7fa478005210 2023-10-19T08:38:45.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.201+0000 7fa482ffd700 1 -- 172.21.15.79:0/641735361 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0038c0 con 0x7fa478005210 2023-10-19T08:38:45.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.201+0000 7fa49447e700 1 -- 172.21.15.79:0/641735361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48c0b0150 con 0x7fa478005210 2023-10-19T08:38:45.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.202+0000 7fa49447e700 1 -- 172.21.15.79:0/641735361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48c0abc50 con 0x7fa478005210 2023-10-19T08:38:45.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.202+0000 7fa482ffd700 1 -- 172.21.15.79:0/641735361 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa47c003a20 con 0x7fa478005210 2023-10-19T08:38:45.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.203+0000 7fa482ffd700 1 --2- 172.21.15.79:0/641735361 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa47006a0e0 0x7fa47006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.203+0000 7fa482ffd700 1 -- 172.21.15.79:0/641735361 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa47c088400 con 0x7fa478005210 2023-10-19T08:38:45.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.203+0000 7fa491a19700 1 --2- 172.21.15.79:0/641735361 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa47006a0e0 0x7fa47006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.203+0000 7fa491a19700 1 --2- 172.21.15.79:0/641735361 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa47006a0e0 0x7fa47006c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0b0760 tx=0x7fa488009210 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:45.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.207+0000 7fa482ffd700 1 -- 172.21.15.79:0/641735361 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa48c0abc50 con 0x7fa478005210 2023-10-19T08:38:45.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.399+0000 7fa49447e700 1 -- 172.21.15.79:0/641735361 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa48c0abc50 con 0x7fa478005210 2023-10-19T08:38:45.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.399+0000 7fa482ffd700 1 -- 172.21.15.79:0/641735361 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa48c0abc50 con 0x7fa478005210 2023-10-19T08:38:45.404 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:38:45.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.401+0000 7fa49447e700 1 -- 172.21.15.79:0/641735361 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa47006a0e0 msgr2=0x7fa47006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:45.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.401+0000 7fa49447e700 1 --2- 172.21.15.79:0/641735361 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa47006a0e0 0x7fa47006c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0b0760 tx=0x7fa488009210 comp rx=0 tx=0).stop 2023-10-19T08:38:45.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.401+0000 7fa49447e700 1 -- 172.21.15.79:0/641735361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa478005210 msgr2=0x7fa48c15b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:45.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.401+0000 7fa49447e700 1 --2- 172.21.15.79:0/641735361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa478005210 0x7fa48c15b630 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa47c00f820 tx=0x7fa47c00fb30 comp rx=0 tx=0).stop 2023-10-19T08:38:45.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.401+0000 7fa49447e700 1 -- 172.21.15.79:0/641735361 shutdown_connections 2023-10-19T08:38:45.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.401+0000 7fa49447e700 1 --2- 172.21.15.79:0/641735361 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa48c0afcf0 0x7fa48c1533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.402+0000 7fa49447e700 1 --2- 172.21.15.79:0/641735361 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa478005210 0x7fa48c15b630 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.402+0000 7fa49447e700 1 --2- 172.21.15.79:0/641735361 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa47006a0e0 0x7fa47006c5a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.402+0000 7fa49447e700 1 --2- 172.21.15.79:0/641735361 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa48c1578b0 0x7fa48c1f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.402+0000 7fa49447e700 1 -- 172.21.15.79:0/641735361 >> 172.21.15.79:0/641735361 conn(0x7fa48c06d000 msgr2=0x7fa48c0b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:45.408 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.402+0000 7fa49447e700 1 -- 172.21.15.79:0/641735361 shutdown_connections 2023-10-19T08:38:45.409 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.402+0000 7fa49447e700 1 -- 172.21.15.79:0/641735361 wait complete. 2023-10-19T08:38:45.419 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T08:38:45.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.539+0000 7fdf0b749700 1 Processor -- start 2023-10-19T08:38:45.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.539+0000 7fdf0b749700 1 -- start start 2023-10-19T08:38:45.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.540+0000 7fdf0b749700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf040cc640 0x7fdf040cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.540+0000 7fdf0b749700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdf040ceaf0 0x7fdf040b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.540+0000 7fdf0b749700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf040ccf60 con 0x7fdf04159db0 2023-10-19T08:38:45.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.540+0000 7fdf0b749700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0415d760 con 0x7fdf040ceaf0 2023-10-19T08:38:45.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.540+0000 7fdf0b749700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0415da40 con 0x7fdf040cc640 2023-10-19T08:38:45.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.540+0000 7fdf08ce4700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdf04159db0 0x7fdf040b16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57240/0 (socket says 172.21.15.79:57240) 2023-10-19T08:38:45.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.540+0000 7fdf08ce4700 1 -- 172.21.15.79:0/1571883223 learned_addr learned my addr 172.21.15.79:0/1571883223 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:45.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.540+0000 7fdf09ce6700 1 --2- 172.21.15.79:0/1571883223 >> v2:172.21.15.89:3300/0 conn(0x7fdf040ceaf0 0x7fdf040b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdf094e5700 1 --2- 172.21.15.79:0/1571883223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf040cc640 0x7fdf040cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdefbfff700 1 -- 172.21.15.79:0/1571883223 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553631552 0 0) 0x7fdf040ccf60 con 0x7fdf04159db0 2023-10-19T08:38:45.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdefbfff700 1 -- 172.21.15.79:0/1571883223 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdef00035b0 con 0x7fdf04159db0 2023-10-19T08:38:45.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdefbfff700 1 -- 172.21.15.79:0/1571883223 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 811594034 0 0) 0x7fdef00035b0 con 0x7fdf04159db0 2023-10-19T08:38:45.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdefbfff700 1 -- 172.21.15.79:0/1571883223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf040cc640 msgr2=0x7fdf040cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:45.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdefbfff700 1 --2- 172.21.15.79:0/1571883223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf040cc640 0x7fdf040cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdefbfff700 1 -- 172.21.15.79:0/1571883223 >> v2:172.21.15.89:3300/0 conn(0x7fdf040ceaf0 msgr2=0x7fdf040b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:45.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdefbfff700 1 --2- 172.21.15.79:0/1571883223 >> v2:172.21.15.89:3300/0 conn(0x7fdf040ceaf0 0x7fdf040b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdefbfff700 1 -- 172.21.15.79:0/1571883223 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0415dd20 con 0x7fdf04159db0 2023-10-19T08:38:45.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdefbfff700 1 -- 172.21.15.79:0/1571883223 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7fdf00001670 con 0x7fdf04159db0 2023-10-19T08:38:45.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdefbfff700 1 -- 172.21.15.79:0/1571883223 >> v1:172.21.15.79:6789/0 conn(0x7fdf04159db0 legacy=0x7fdf040b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:45.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdefbfff700 1 --2- 172.21.15.79:0/1571883223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf040cc640 0x7fdef0003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdefbfff700 1 --2- 172.21.15.79:0/1571883223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdef0003ff0 0x7fdef0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdefbfff700 1 --2- 172.21.15.79:0/1571883223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdef0004d90 0x7fdef0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdefbfff700 1 -- 172.21.15.79:0/1571883223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0415d760 con 0x7fdef0004d90 2023-10-19T08:38:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdefbfff700 1 -- 172.21.15.79:0/1571883223 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0415da40 con 0x7fdef0003ff0 2023-10-19T08:38:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdefbfff700 1 -- 172.21.15.79:0/1571883223 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef000dc50 con 0x7fdf040cc640 2023-10-19T08:38:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdf09ce6700 1 --2- 172.21.15.79:0/1571883223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdef0004d90 0x7fdef0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdf08ce4700 1 --2- 172.21.15.79:0/1571883223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdef0003ff0 0x7fdef0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdf094e5700 1 --2- 172.21.15.79:0/1571883223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf040cc640 0x7fdef0003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdf09ce6700 1 -- 172.21.15.79:0/1571883223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf040cc640 msgr2=0x7fdef0003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:45.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdf09ce6700 1 --2- 172.21.15.79:0/1571883223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf040cc640 0x7fdef0003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdf09ce6700 1 -- 172.21.15.79:0/1571883223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdef0003ff0 msgr2=0x7fdef0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:45.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdf09ce6700 1 --2- 172.21.15.79:0/1571883223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdef0003ff0 0x7fdef0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdf09ce6700 1 -- 172.21.15.79:0/1571883223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef00035b0 con 0x7fdef0004d90 2023-10-19T08:38:45.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.541+0000 7fdf09ce6700 1 --2- 172.21.15.79:0/1571883223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdef0004d90 0x7fdef0005210 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdefc009fc0 tx=0x7fdef0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80feb08c1df8fc54 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:45.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.542+0000 7fdefbfff700 1 -- 172.21.15.79:0/1571883223 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc00ec30 con 0x7fdef0004d90 2023-10-19T08:38:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.542+0000 7fdefbfff700 1 -- 172.21.15.79:0/1571883223 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc00f040 con 0x7fdef0004d90 2023-10-19T08:38:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.542+0000 7fdefbfff700 1 -- 172.21.15.79:0/1571883223 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc014480 con 0x7fdef0004d90 2023-10-19T08:38:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.542+0000 7fdf0b749700 1 -- 172.21.15.79:0/1571883223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdef0004d90 msgr2=0x7fdef0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.542+0000 7fdf0b749700 1 --2- 172.21.15.79:0/1571883223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdef0004d90 0x7fdef0005210 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdefc009fc0 tx=0x7fdef0005880 comp rx=0 tx=0).stop 2023-10-19T08:38:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.542+0000 7fdf09ce6700 1 -- 172.21.15.79:0/1571883223 reap_dead start 2023-10-19T08:38:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.542+0000 7fdf0b749700 1 -- 172.21.15.79:0/1571883223 shutdown_connections 2023-10-19T08:38:45.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.542+0000 7fdf0b749700 1 -- 172.21.15.79:0/1571883223 >> 172.21.15.79:0/1571883223 conn(0x7fdf0406dcc0 msgr2=0x7fdf0406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:45.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.542+0000 7fdf0b749700 1 -- 172.21.15.79:0/1571883223 shutdown_connections 2023-10-19T08:38:45.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.542+0000 7fdf0b749700 1 -- 172.21.15.79:0/1571883223 wait complete. 2023-10-19T08:38:45.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.543+0000 7fdf0b749700 1 Processor -- start 2023-10-19T08:38:45.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.543+0000 7fdf0b749700 1 -- start start 2023-10-19T08:38:45.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.544+0000 7fdf0b749700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdef0004d90 0x7fdf0414d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.544+0000 7fdf0b749700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf0415abb0 0x7fdf0415c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.544+0000 7fdf0b749700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf0415b030 0x7fdf0415cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.544+0000 7fdf0b749700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0414e5b0 con 0x7fdef0004d90 2023-10-19T08:38:45.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.544+0000 7fdf0b749700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0414e740 con 0x7fdf0415b030 2023-10-19T08:38:45.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.544+0000 7fdf0b749700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0415b5d0 con 0x7fdf0415abb0 2023-10-19T08:38:45.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.544+0000 7fdf094e5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdef0004d90 0x7fdf0414d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.544+0000 7fdf094e5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdef0004d90 0x7fdf0414d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47180/0 (socket says 172.21.15.79:47180) 2023-10-19T08:38:45.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.544+0000 7fdf094e5700 1 -- 172.21.15.79:0/1704039899 learned_addr learned my addr 172.21.15.79:0/1704039899 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:45.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.544+0000 7fdf08ce4700 1 --2- 172.21.15.79:0/1704039899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf0415abb0 0x7fdf0415c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.544+0000 7fdf09ce6700 1 --2- 172.21.15.79:0/1704039899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf0415b030 0x7fdf0415cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.545+0000 7fdf094e5700 1 -- 172.21.15.79:0/1704039899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf0415abb0 msgr2=0x7fdf0415c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:45.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.545+0000 7fdf094e5700 1 --2- 172.21.15.79:0/1704039899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf0415abb0 0x7fdf0415c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.545+0000 7fdf094e5700 1 -- 172.21.15.79:0/1704039899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf0415b030 msgr2=0x7fdf0415cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:45.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.545+0000 7fdf094e5700 1 --2- 172.21.15.79:0/1704039899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf0415b030 0x7fdf0415cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.545+0000 7fdf094e5700 1 -- 172.21.15.79:0/1704039899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0415b8b0 con 0x7fdef0004d90 2023-10-19T08:38:45.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.545+0000 7fdf094e5700 1 --2- 172.21.15.79:0/1704039899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdef0004d90 0x7fdf0414d350 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdef4011aa0 tx=0x7fdef4011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:45.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.545+0000 7fdef9ffb700 1 -- 172.21.15.79:0/1704039899 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4011ee0 con 0x7fdef0004d90 2023-10-19T08:38:45.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.545+0000 7fdef9ffb700 1 -- 172.21.15.79:0/1704039899 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef400f940 con 0x7fdef0004d90 2023-10-19T08:38:45.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.545+0000 7fdf0b749700 1 -- 172.21.15.79:0/1704039899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0415bb90 con 0x7fdef0004d90 2023-10-19T08:38:45.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.545+0000 7fdef9ffb700 1 -- 172.21.15.79:0/1704039899 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef400fcf0 con 0x7fdef0004d90 2023-10-19T08:38:45.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.545+0000 7fdf0b749700 1 -- 172.21.15.79:0/1704039899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf040c51b0 con 0x7fdef0004d90 2023-10-19T08:38:45.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.546+0000 7fdf0b749700 1 -- 172.21.15.79:0/1704039899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0414ea20 con 0x7fdef0004d90 2023-10-19T08:38:45.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.546+0000 7fdef9ffb700 1 -- 172.21.15.79:0/1704039899 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdef401d400 con 0x7fdef0004d90 2023-10-19T08:38:45.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.547+0000 7fdef9ffb700 1 --2- 172.21.15.79:0/1704039899 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdee806a0e0 0x7fdee806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.547+0000 7fdef9ffb700 1 -- 172.21.15.79:0/1704039899 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdef4088eb0 con 0x7fdef0004d90 2023-10-19T08:38:45.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.547+0000 7fdf08ce4700 1 --2- 172.21.15.79:0/1704039899 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdee806a0e0 0x7fdee806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.547+0000 7fdf08ce4700 1 --2- 172.21.15.79:0/1704039899 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdee806a0e0 0x7fdee806c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdf040c8930 tx=0x7fdf00007980 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:45.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.551+0000 7fdef9ffb700 1 -- 172.21.15.79:0/1704039899 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fdef4057db0 con 0x7fdef0004d90 2023-10-19T08:38:45.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.740+0000 7fdf0b749700 1 -- 172.21.15.79:0/1704039899 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdf0415e2b0 con 0x7fdef0004d90 2023-10-19T08:38:45.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.740+0000 7fdef9ffb700 1 -- 172.21.15.79:0/1704039899 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdef4057940 con 0x7fdef0004d90 2023-10-19T08:38:45.745 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:45.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.742+0000 7fdf0b749700 1 -- 172.21.15.79:0/1704039899 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdee806a0e0 msgr2=0x7fdee806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:45.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.742+0000 7fdf0b749700 1 --2- 172.21.15.79:0/1704039899 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdee806a0e0 0x7fdee806c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdf040c8930 tx=0x7fdf00007980 comp rx=0 tx=0).stop 2023-10-19T08:38:45.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.742+0000 7fdf0b749700 1 -- 172.21.15.79:0/1704039899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdef0004d90 msgr2=0x7fdf0414d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:45.747 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.742+0000 7fdf0b749700 1 --2- 172.21.15.79:0/1704039899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdef0004d90 0x7fdf0414d350 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdef4011aa0 tx=0x7fdef4011db0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.742+0000 7fdf0b749700 1 -- 172.21.15.79:0/1704039899 shutdown_connections 2023-10-19T08:38:45.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.742+0000 7fdf0b749700 1 --2- 172.21.15.79:0/1704039899 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf0415b030 0x7fdf0415cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.742+0000 7fdf0b749700 1 --2- 172.21.15.79:0/1704039899 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdef0004d90 0x7fdf0414d350 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.742+0000 7fdf0b749700 1 --2- 172.21.15.79:0/1704039899 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdee806a0e0 0x7fdee806c5a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.748 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.742+0000 7fdf0b749700 1 --2- 172.21.15.79:0/1704039899 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf0415abb0 0x7fdf0415c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.742+0000 7fdf0b749700 1 -- 172.21.15.79:0/1704039899 >> 172.21.15.79:0/1704039899 conn(0x7fdf0406dcc0 msgr2=0x7fdf040b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:45.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.742+0000 7fdf0b749700 1 -- 172.21.15.79:0/1704039899 shutdown_connections 2023-10-19T08:38:45.749 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.742+0000 7fdf0b749700 1 -- 172.21.15.79:0/1704039899 wait complete. 2023-10-19T08:38:45.758 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T08:38:45.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.876+0000 7f05c0c22700 1 Processor -- start 2023-10-19T08:38:45.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.876+0000 7f05c0c22700 1 -- start start 2023-10-19T08:38:45.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.877+0000 7f05c0c22700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f05bc0cd270 0x7f05bc06a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.877+0000 7f05c0c22700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05bc161a90 con 0x7f05bc0cc2a0 2023-10-19T08:38:45.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.877+0000 7f05c0c22700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05bc0b1fe0 con 0x7f05bc0703b0 2023-10-19T08:38:45.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.877+0000 7f05c0c22700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05bc160a80 con 0x7f05bc0cd270 2023-10-19T08:38:45.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.877+0000 7f05ba59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f05bc0cd270 0x7f05bc06a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.877+0000 7f05ba59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f05bc0cd270 0x7f05bc06a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47188/0 (socket says 172.21.15.79:47188) 2023-10-19T08:38:45.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.877+0000 7f05bad9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f05bc0cc2a0 0x7f05bc161380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57264/0 (socket says 172.21.15.79:57264) 2023-10-19T08:38:45.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.877+0000 7f05ba59c700 1 -- 172.21.15.79:0/926317096 learned_addr learned my addr 172.21.15.79:0/926317096 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:45.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.878+0000 7f05ba59c700 1 -- 172.21.15.79:0/926317096 >> v1:172.21.15.89:6789/0 conn(0x7f05bc0703b0 legacy=0x7f05bc160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:45.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.878+0000 7f05ba59c700 1 -- 172.21.15.79:0/926317096 >> v1:172.21.15.79:6789/0 conn(0x7f05bc0cc2a0 legacy=0x7f05bc161380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:45.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.878+0000 7f05ba59c700 1 -- 172.21.15.79:0/926317096 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc0ce2b0 con 0x7f05bc0cd270 2023-10-19T08:38:45.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.878+0000 7f05ba59c700 1 --2- 172.21.15.79:0/926317096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc0cd270 0x7f05bc06a220 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f05b00098f0 tx=0x7f05b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8613e201ee68afa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:45.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.878+0000 7f05b959a700 1 -- 172.21.15.79:0/926317096 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0004230 con 0x7f05bc0cd270 2023-10-19T08:38:45.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.878+0000 7f05b959a700 1 -- 172.21.15.79:0/926317096 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b0004390 con 0x7f05bc0cd270 2023-10-19T08:38:45.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.878+0000 7f05b959a700 1 -- 172.21.15.79:0/926317096 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b00036a0 con 0x7f05bc0cd270 2023-10-19T08:38:45.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.878+0000 7f05c0c22700 1 -- 172.21.15.79:0/926317096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc0cd270 msgr2=0x7f05bc06a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:45.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.878+0000 7f05c0c22700 1 --2- 172.21.15.79:0/926317096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc0cd270 0x7f05bc06a220 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f05b00098f0 tx=0x7f05b0009c00 comp rx=0 tx=0).stop 2023-10-19T08:38:45.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.879+0000 7f05c0c22700 1 -- 172.21.15.79:0/926317096 shutdown_connections 2023-10-19T08:38:45.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.879+0000 7f05c0c22700 1 --2- 172.21.15.79:0/926317096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc0cd270 0x7f05bc06a220 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.879+0000 7f05c0c22700 1 -- 172.21.15.79:0/926317096 >> 172.21.15.79:0/926317096 conn(0x7f05bc06dcc0 msgr2=0x7f05bc06e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:45.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.879+0000 7f05c0c22700 1 -- 172.21.15.79:0/926317096 shutdown_connections 2023-10-19T08:38:45.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.879+0000 7f05c0c22700 1 -- 172.21.15.79:0/926317096 wait complete. 2023-10-19T08:38:45.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.880+0000 7f05c0c22700 1 Processor -- start 2023-10-19T08:38:45.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.880+0000 7f05c0c22700 1 -- start start 2023-10-19T08:38:45.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05c0c22700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05bc0703b0 0x7f05bc154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05c0c22700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc0cc2a0 0x7f05bc0b2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05c0c22700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05bc0cd270 0x7f05bc0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05c0c22700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0b42d0 con 0x7f05bc0cc2a0 2023-10-19T08:38:45.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05c0c22700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0b3230 con 0x7f05bc0cd270 2023-10-19T08:38:45.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05c0c22700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc0b3510 con 0x7f05bc0703b0 2023-10-19T08:38:45.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05b9d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc0cc2a0 0x7f05bc0b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05b9d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc0cc2a0 0x7f05bc0b2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47196/0 (socket says 172.21.15.79:47196) 2023-10-19T08:38:45.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05b9d9b700 1 -- 172.21.15.79:0/4198284023 learned_addr learned my addr 172.21.15.79:0/4198284023 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:45.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05bad9d700 1 --2- 172.21.15.79:0/4198284023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05bc0cd270 0x7f05bc0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05ba59c700 1 --2- 172.21.15.79:0/4198284023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05bc0703b0 0x7f05bc154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05b9d9b700 1 -- 172.21.15.79:0/4198284023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05bc0703b0 msgr2=0x7f05bc154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:45.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05b9d9b700 1 --2- 172.21.15.79:0/4198284023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05bc0703b0 0x7f05bc154fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05b9d9b700 1 -- 172.21.15.79:0/4198284023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05bc0cd270 msgr2=0x7f05bc0b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:45.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05b9d9b700 1 --2- 172.21.15.79:0/4198284023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05bc0cd270 0x7f05bc0b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:45.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05b9d9b700 1 -- 172.21.15.79:0/4198284023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b0009550 con 0x7f05bc0cc2a0 2023-10-19T08:38:45.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05bad9d700 1 --2- 172.21.15.79:0/4198284023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05bc0cd270 0x7f05bc0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:45.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05b9d9b700 1 --2- 172.21.15.79:0/4198284023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc0cc2a0 0x7f05bc0b2850 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00c4d0 tx=0x7f05ac00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:45.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05aaffd700 1 -- 172.21.15.79:0/4198284023 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac011790 con 0x7f05bc0cc2a0 2023-10-19T08:38:45.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05aaffd700 1 -- 172.21.15.79:0/4198284023 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac0118f0 con 0x7f05bc0cc2a0 2023-10-19T08:38:45.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05aaffd700 1 -- 172.21.15.79:0/4198284023 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac011ca0 con 0x7f05bc0cc2a0 2023-10-19T08:38:45.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05c0c22700 1 -- 172.21.15.79:0/4198284023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05bc0b37f0 con 0x7f05bc0cc2a0 2023-10-19T08:38:45.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.881+0000 7f05c0c22700 1 -- 172.21.15.79:0/4198284023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05bc0b3db0 con 0x7f05bc0cc2a0 2023-10-19T08:38:45.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.883+0000 7f05c0c22700 1 -- 172.21.15.79:0/4198284023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05bc04ee70 con 0x7f05bc0cc2a0 2023-10-19T08:38:45.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.883+0000 7f05aaffd700 1 -- 172.21.15.79:0/4198284023 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f05ac01c460 con 0x7f05bc0cc2a0 2023-10-19T08:38:45.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.883+0000 7f05aaffd700 1 --2- 172.21.15.79:0/4198284023 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f059c06a0e0 0x7f059c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:45.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.883+0000 7f05aaffd700 1 -- 172.21.15.79:0/4198284023 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f05ac088640 con 0x7f05bc0cc2a0 2023-10-19T08:38:45.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.883+0000 7f05ba59c700 1 --2- 172.21.15.79:0/4198284023 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f059c06a0e0 0x7f059c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:45.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.884+0000 7f05ba59c700 1 --2- 172.21.15.79:0/4198284023 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f059c06a0e0 0x7f059c06c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0d04b0 tx=0x7f05b0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:45.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:45.887+0000 7f05aaffd700 1 -- 172.21.15.79:0/4198284023 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f05ac053a90 con 0x7f05bc0cc2a0 2023-10-19T08:38:46.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.076+0000 7f05c0c22700 1 -- 172.21.15.79:0/4198284023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f05bc0b1820 con 0x7f05bc0cc2a0 2023-10-19T08:38:46.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.077+0000 7f05aaffd700 1 -- 172.21.15.79:0/4198284023 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f05ac0570b0 con 0x7f05bc0cc2a0 2023-10-19T08:38:46.082 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-19T08:38:46.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.079+0000 7f05c0c22700 1 -- 172.21.15.79:0/4198284023 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f059c06a0e0 msgr2=0x7f059c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:46.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.079+0000 7f05c0c22700 1 --2- 172.21.15.79:0/4198284023 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f059c06a0e0 0x7f059c06c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0d04b0 tx=0x7f05b0008030 comp rx=0 tx=0).stop 2023-10-19T08:38:46.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.079+0000 7f05c0c22700 1 -- 172.21.15.79:0/4198284023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc0cc2a0 msgr2=0x7f05bc0b2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:46.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.079+0000 7f05c0c22700 1 --2- 172.21.15.79:0/4198284023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc0cc2a0 0x7f05bc0b2850 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00c4d0 tx=0x7f05ac00c890 comp rx=0 tx=0).stop 2023-10-19T08:38:46.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.079+0000 7f05c0c22700 1 -- 172.21.15.79:0/4198284023 shutdown_connections 2023-10-19T08:38:46.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.079+0000 7f05c0c22700 1 --2- 172.21.15.79:0/4198284023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05bc0cd270 0x7f05bc0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.079+0000 7f05c0c22700 1 --2- 172.21.15.79:0/4198284023 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f059c06a0e0 0x7f059c06c5a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.079+0000 7f05c0c22700 1 --2- 172.21.15.79:0/4198284023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05bc0703b0 0x7f05bc154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.079+0000 7f05c0c22700 1 --2- 172.21.15.79:0/4198284023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05bc0cc2a0 0x7f05bc0b2850 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.079+0000 7f05c0c22700 1 -- 172.21.15.79:0/4198284023 >> 172.21.15.79:0/4198284023 conn(0x7f05bc06dcc0 msgr2=0x7f05bc15f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:46.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.079+0000 7f05c0c22700 1 -- 172.21.15.79:0/4198284023 shutdown_connections 2023-10-19T08:38:46.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.079+0000 7f05c0c22700 1 -- 172.21.15.79:0/4198284023 wait complete. 2023-10-19T08:38:46.095 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T08:38:46.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.213+0000 7f8f8217c700 1 Processor -- start 2023-10-19T08:38:46.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.213+0000 7f8f8217c700 1 -- start start 2023-10-19T08:38:46.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.214+0000 7f8f8217c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8f7c0b0710 0x7f8f7c0b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.214+0000 7f8f8217c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f7c0d14f0 0x7f8f7c0ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.214+0000 7f8f8217c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8f7c0adee0 0x7f8f7c0b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.214+0000 7f8f8217c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f7c160cb0 con 0x7f8f7c0adee0 2023-10-19T08:38:46.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.214+0000 7f8f8217c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f7c06c5a0 con 0x7f8f7c0b0710 2023-10-19T08:38:46.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.214+0000 7f8f8217c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c06bd40 con 0x7f8f7c0d14f0 2023-10-19T08:38:46.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.214+0000 7f8f7bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8f7c0adee0 0x7f8f7c0b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:46.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.214+0000 7f8f7bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8f7c0adee0 0x7f8f7c0b1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47206/0 (socket says 172.21.15.79:47206) 2023-10-19T08:38:46.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.214+0000 7f8f7bfff700 1 -- 172.21.15.79:0/1035770712 learned_addr learned my addr 172.21.15.79:0/1035770712 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:46.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.214+0000 7f8f7b7fe700 1 --2- 172.21.15.79:0/1035770712 >> v2:172.21.15.89:3300/0 conn(0x7f8f7c0b0710 0x7f8f7c0b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:46.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.214+0000 7f8f7affd700 1 --2- 172.21.15.79:0/1035770712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f7c0d14f0 0x7f8f7c0ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:46.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.214+0000 7f8f7bfff700 1 -- 172.21.15.79:0/1035770712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f7c0d14f0 msgr2=0x7f8f7c0ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:46.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.214+0000 7f8f7bfff700 1 --2- 172.21.15.79:0/1035770712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f7c0d14f0 0x7f8f7c0ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.214+0000 7f8f7bfff700 1 -- 172.21.15.79:0/1035770712 >> v2:172.21.15.89:3300/0 conn(0x7f8f7c0b0710 msgr2=0x7f8f7c0b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:46.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.214+0000 7f8f7bfff700 1 --2- 172.21.15.79:0/1035770712 >> v2:172.21.15.89:3300/0 conn(0x7f8f7c0b0710 0x7f8f7c0b0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.214+0000 7f8f7bfff700 1 -- 172.21.15.79:0/1035770712 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c0b1030 con 0x7f8f7c0adee0 2023-10-19T08:38:46.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.214+0000 7f8f7affd700 1 --2- 172.21.15.79:0/1035770712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f7c0d14f0 0x7f8f7c0ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:46.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.215+0000 7f8f7bfff700 1 --2- 172.21.15.79:0/1035770712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f7c0adee0 0x7f8f7c0b1d50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c08b310 tx=0x7f8f7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c091b790bb115749 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:46.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.215+0000 7f8f7a7fc700 1 -- 172.21.15.79:0/1035770712 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7400e070 con 0x7f8f7c0adee0 2023-10-19T08:38:46.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.215+0000 7f8f7a7fc700 1 -- 172.21.15.79:0/1035770712 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7400b9c0 con 0x7f8f7c0adee0 2023-10-19T08:38:46.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.215+0000 7f8f7a7fc700 1 -- 172.21.15.79:0/1035770712 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7400bd70 con 0x7f8f7c0adee0 2023-10-19T08:38:46.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.215+0000 7f8f8217c700 1 -- 172.21.15.79:0/1035770712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f7c0adee0 msgr2=0x7f8f7c0b1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:46.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.215+0000 7f8f8217c700 1 --2- 172.21.15.79:0/1035770712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f7c0adee0 0x7f8f7c0b1d50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c08b310 tx=0x7f8f7400b330 comp rx=0 tx=0).stop 2023-10-19T08:38:46.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.215+0000 7f8f8217c700 1 -- 172.21.15.79:0/1035770712 shutdown_connections 2023-10-19T08:38:46.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.215+0000 7f8f8217c700 1 --2- 172.21.15.79:0/1035770712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f7c0adee0 0x7f8f7c0b1d50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.215+0000 7f8f8217c700 1 --2- 172.21.15.79:0/1035770712 >> v2:172.21.15.89:3300/0 conn(0x7f8f7c0b0710 0x7f8f7c0b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.215+0000 7f8f8217c700 1 --2- 172.21.15.79:0/1035770712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f7c0d14f0 0x7f8f7c0ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.215+0000 7f8f8217c700 1 -- 172.21.15.79:0/1035770712 >> 172.21.15.79:0/1035770712 conn(0x7f8f7c09a0b0 msgr2=0x7f8f7c0d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:46.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.215+0000 7f8f8217c700 1 -- 172.21.15.79:0/1035770712 shutdown_connections 2023-10-19T08:38:46.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.215+0000 7f8f8217c700 1 -- 172.21.15.79:0/1035770712 wait complete. 2023-10-19T08:38:46.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.216+0000 7f8f8217c700 1 Processor -- start 2023-10-19T08:38:46.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.217+0000 7f8f8217c700 1 -- start start 2023-10-19T08:38:46.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.217+0000 7f8f8217c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f7c0adee0 0x7f8f7c09e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.217+0000 7f8f8217c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f7c0b0710 0x7f8f7c0b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.217+0000 7f8f8217c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f7c0d14f0 0x7f8f7c1f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.217+0000 7f8f8217c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c155c20 con 0x7f8f7c0b0710 2023-10-19T08:38:46.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.217+0000 7f8f8217c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c0b4bd0 con 0x7f8f7c0d14f0 2023-10-19T08:38:46.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.217+0000 7f8f8217c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c0b4eb0 con 0x7f8f7c0adee0 2023-10-19T08:38:46.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.217+0000 7f8f7affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f7c0b0710 0x7f8f7c0b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:46.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.218+0000 7f8f7affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f7c0b0710 0x7f8f7c0b5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47208/0 (socket says 172.21.15.79:47208) 2023-10-19T08:38:46.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.218+0000 7f8f7affd700 1 -- 172.21.15.79:0/2109826371 learned_addr learned my addr 172.21.15.79:0/2109826371 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:46.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.218+0000 7f8f7bfff700 1 --2- 172.21.15.79:0/2109826371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f7c0d14f0 0x7f8f7c1f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:46.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.218+0000 7f8f7b7fe700 1 --2- 172.21.15.79:0/2109826371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f7c0adee0 0x7f8f7c09e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:46.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.218+0000 7f8f7affd700 1 -- 172.21.15.79:0/2109826371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f7c0adee0 msgr2=0x7f8f7c09e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:46.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.218+0000 7f8f7affd700 1 --2- 172.21.15.79:0/2109826371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f7c0adee0 0x7f8f7c09e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.218+0000 7f8f7affd700 1 -- 172.21.15.79:0/2109826371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f7c0d14f0 msgr2=0x7f8f7c1f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:46.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.218+0000 7f8f7affd700 1 --2- 172.21.15.79:0/2109826371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f7c0d14f0 0x7f8f7c1f5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.218+0000 7f8f7affd700 1 -- 172.21.15.79:0/2109826371 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f74009b30 con 0x7f8f7c0b0710 2023-10-19T08:38:46.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.218+0000 7f8f7affd700 1 --2- 172.21.15.79:0/2109826371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f7c0b0710 0x7f8f7c0b5d30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00c7f0 tx=0x7f8f6c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:46.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.218+0000 7f8f63fff700 1 -- 172.21.15.79:0/2109826371 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c011800 con 0x7f8f7c0b0710 2023-10-19T08:38:46.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.218+0000 7f8f63fff700 1 -- 172.21.15.79:0/2109826371 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c011960 con 0x7f8f7c0b0710 2023-10-19T08:38:46.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.218+0000 7f8f63fff700 1 -- 172.21.15.79:0/2109826371 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c011cf0 con 0x7f8f7c0b0710 2023-10-19T08:38:46.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.218+0000 7f8f8217c700 1 -- 172.21.15.79:0/2109826371 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f7c0b5190 con 0x7f8f7c0b0710 2023-10-19T08:38:46.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.218+0000 7f8f8217c700 1 -- 172.21.15.79:0/2109826371 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7c0b5520 con 0x7f8f7c0b0710 2023-10-19T08:38:46.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.219+0000 7f8f8217c700 1 -- 172.21.15.79:0/2109826371 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f7c0b5930 con 0x7f8f7c0b0710 2023-10-19T08:38:46.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.220+0000 7f8f63fff700 1 -- 172.21.15.79:0/2109826371 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8f6c018360 con 0x7f8f7c0b0710 2023-10-19T08:38:46.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.220+0000 7f8f63fff700 1 --2- 172.21.15.79:0/2109826371 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f8f6806a0e0 0x7f8f6806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.220+0000 7f8f63fff700 1 -- 172.21.15.79:0/2109826371 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8f6c088790 con 0x7f8f7c0b0710 2023-10-19T08:38:46.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.220+0000 7f8f7b7fe700 1 --2- 172.21.15.79:0/2109826371 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f8f6806a0e0 0x7f8f6806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:46.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.220+0000 7f8f7b7fe700 1 --2- 172.21.15.79:0/2109826371 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f8f6806a0e0 0x7f8f6806c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009930 tx=0x7f8f70008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:46.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.224+0000 7f8f63fff700 1 -- 172.21.15.79:0/2109826371 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f8f6c053ac0 con 0x7f8f7c0b0710 2023-10-19T08:38:46.416 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.412+0000 7f8f8217c700 1 -- 172.21.15.79:0/2109826371 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8f7c0b4920 con 0x7f8f7c0b0710 2023-10-19T08:38:46.417 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.412+0000 7f8f63fff700 1 -- 172.21.15.79:0/2109826371 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8f6c0570e0 con 0x7f8f7c0b0710 2023-10-19T08:38:46.417 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:46.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.414+0000 7f8f8217c700 1 -- 172.21.15.79:0/2109826371 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f8f6806a0e0 msgr2=0x7f8f6806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:46.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.414+0000 7f8f8217c700 1 --2- 172.21.15.79:0/2109826371 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f8f6806a0e0 0x7f8f6806c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8f70009930 tx=0x7f8f70008040 comp rx=0 tx=0).stop 2023-10-19T08:38:46.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.414+0000 7f8f8217c700 1 -- 172.21.15.79:0/2109826371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f7c0b0710 msgr2=0x7f8f7c0b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:46.419 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.414+0000 7f8f8217c700 1 --2- 172.21.15.79:0/2109826371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f7c0b0710 0x7f8f7c0b5d30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00c7f0 tx=0x7f8f6c00cb00 comp rx=0 tx=0).stop 2023-10-19T08:38:46.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.414+0000 7f8f8217c700 1 -- 172.21.15.79:0/2109826371 shutdown_connections 2023-10-19T08:38:46.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.414+0000 7f8f8217c700 1 --2- 172.21.15.79:0/2109826371 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f7c0d14f0 0x7f8f7c1f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.414+0000 7f8f8217c700 1 --2- 172.21.15.79:0/2109826371 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f8f6806a0e0 0x7f8f6806c5a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.414+0000 7f8f8217c700 1 --2- 172.21.15.79:0/2109826371 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f7c0adee0 0x7f8f7c09e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.414+0000 7f8f8217c700 1 --2- 172.21.15.79:0/2109826371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f7c0b0710 0x7f8f7c0b5d30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.414+0000 7f8f8217c700 1 -- 172.21.15.79:0/2109826371 >> 172.21.15.79:0/2109826371 conn(0x7f8f7c09a0b0 msgr2=0x7f8f7c070390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:46.421 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.414+0000 7f8f8217c700 1 -- 172.21.15.79:0/2109826371 shutdown_connections 2023-10-19T08:38:46.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.414+0000 7f8f8217c700 1 -- 172.21.15.79:0/2109826371 wait complete. 2023-10-19T08:38:46.431 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:46.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.548+0000 7fc846265700 1 Processor -- start 2023-10-19T08:38:46.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.549+0000 7fc846265700 1 -- start start 2023-10-19T08:38:46.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.550+0000 7fc846265700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8401593b0 0x7fc84006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.550+0000 7fc846265700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc84015cf50 0x7fc84015d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.550+0000 7fc846265700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc84006d020 0x7fc84006d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.550+0000 7fc846265700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84015d910 con 0x7fc84015cf50 2023-10-19T08:38:46.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.550+0000 7fc846265700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84006d9b0 con 0x7fc84006d020 2023-10-19T08:38:46.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.550+0000 7fc846265700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400cde20 con 0x7fc8401593b0 2023-10-19T08:38:46.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.550+0000 7fc83f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc84015cf50 0x7fc84015d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:46.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.550+0000 7fc83f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc84015cf50 0x7fc84015d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47218/0 (socket says 172.21.15.79:47218) 2023-10-19T08:38:46.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.550+0000 7fc83f7fe700 1 -- 172.21.15.79:0/1483395101 learned_addr learned my addr 172.21.15.79:0/1483395101 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:46.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.550+0000 7fc844802700 1 --2- 172.21.15.79:0/1483395101 >> v2:172.21.15.89:3300/0 conn(0x7fc84006d020 0x7fc84006d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:46.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.550+0000 7fc83f7fe700 1 -- 172.21.15.79:0/1483395101 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8401593b0 msgr2=0x7fc84006b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:46.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.550+0000 7fc83f7fe700 1 --2- 172.21.15.79:0/1483395101 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8401593b0 0x7fc84006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.550+0000 7fc83f7fe700 1 -- 172.21.15.79:0/1483395101 >> v2:172.21.15.89:3300/0 conn(0x7fc84006d020 msgr2=0x7fc84006d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:46.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.550+0000 7fc83f7fe700 1 --2- 172.21.15.79:0/1483395101 >> v2:172.21.15.89:3300/0 conn(0x7fc84006d020 0x7fc84006d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.550+0000 7fc83f7fe700 1 -- 172.21.15.79:0/1483395101 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84006bb00 con 0x7fc84015cf50 2023-10-19T08:38:46.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.550+0000 7fc83f7fe700 1 --2- 172.21.15.79:0/1483395101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc84015cf50 0x7fc84015d3d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc8400711b0 tx=0x7fc828009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196538b6234823f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:46.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.550+0000 7fc83effd700 1 -- 172.21.15.79:0/1483395101 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82800f8a0 con 0x7fc84015cf50 2023-10-19T08:38:46.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.550+0000 7fc83effd700 1 -- 172.21.15.79:0/1483395101 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82800fa00 con 0x7fc84015cf50 2023-10-19T08:38:46.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.550+0000 7fc83effd700 1 -- 172.21.15.79:0/1483395101 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82800fd90 con 0x7fc84015cf50 2023-10-19T08:38:46.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.551+0000 7fc846265700 1 -- 172.21.15.79:0/1483395101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc84015cf50 msgr2=0x7fc84015d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:46.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.551+0000 7fc846265700 1 --2- 172.21.15.79:0/1483395101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc84015cf50 0x7fc84015d3d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc8400711b0 tx=0x7fc828009bd0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.551+0000 7fc846265700 1 -- 172.21.15.79:0/1483395101 shutdown_connections 2023-10-19T08:38:46.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.551+0000 7fc846265700 1 --2- 172.21.15.79:0/1483395101 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8401593b0 0x7fc84006b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.551+0000 7fc846265700 1 --2- 172.21.15.79:0/1483395101 >> v2:172.21.15.89:3300/0 conn(0x7fc84006d020 0x7fc84006d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.551+0000 7fc846265700 1 --2- 172.21.15.79:0/1483395101 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc84015cf50 0x7fc84015d3d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.551+0000 7fc846265700 1 -- 172.21.15.79:0/1483395101 >> 172.21.15.79:0/1483395101 conn(0x7fc8400cf1a0 msgr2=0x7fc8400cf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:46.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.551+0000 7fc846265700 1 -- 172.21.15.79:0/1483395101 shutdown_connections 2023-10-19T08:38:46.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.551+0000 7fc846265700 1 -- 172.21.15.79:0/1483395101 wait complete. 2023-10-19T08:38:46.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.552+0000 7fc846265700 1 Processor -- start 2023-10-19T08:38:46.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.552+0000 7fc846265700 1 -- start start 2023-10-19T08:38:46.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.553+0000 7fc846265700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc84006d020 0x7fc8401584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.553+0000 7fc846265700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8401593b0 0x7fc8401f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.553+0000 7fc846265700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc84015cf50 0x7fc8401f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.553+0000 7fc846265700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400c8770 con 0x7fc84006d020 2023-10-19T08:38:46.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.553+0000 7fc846265700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400c78c0 con 0x7fc84015cf50 2023-10-19T08:38:46.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.553+0000 7fc846265700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8401f38f0 con 0x7fc8401593b0 2023-10-19T08:38:46.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.553+0000 7fc83ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc84006d020 0x7fc8401584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:46.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.553+0000 7fc83ffff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc84006d020 0x7fc8401584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47222/0 (socket says 172.21.15.79:47222) 2023-10-19T08:38:46.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.553+0000 7fc83ffff700 1 -- 172.21.15.79:0/1503253424 learned_addr learned my addr 172.21.15.79:0/1503253424 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:46.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.554+0000 7fc83f7fe700 1 --2- 172.21.15.79:0/1503253424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8401593b0 0x7fc8401f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:46.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.554+0000 7fc844802700 1 --2- 172.21.15.79:0/1503253424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc84015cf50 0x7fc8401f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:46.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.554+0000 7fc83ffff700 1 -- 172.21.15.79:0/1503253424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8401593b0 msgr2=0x7fc8401f3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:46.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.554+0000 7fc83ffff700 1 --2- 172.21.15.79:0/1503253424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8401593b0 0x7fc8401f3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.554+0000 7fc83ffff700 1 -- 172.21.15.79:0/1503253424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc84015cf50 msgr2=0x7fc8401f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:46.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.554+0000 7fc83ffff700 1 --2- 172.21.15.79:0/1503253424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc84015cf50 0x7fc8401f33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.554+0000 7fc83ffff700 1 -- 172.21.15.79:0/1503253424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc828009550 con 0x7fc84006d020 2023-10-19T08:38:46.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.554+0000 7fc83f7fe700 1 --2- 172.21.15.79:0/1503253424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8401593b0 0x7fc8401f3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:46.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.554+0000 7fc83ffff700 1 --2- 172.21.15.79:0/1503253424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc84006d020 0x7fc8401584b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc83000b560 tx=0x7fc83000b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:46.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.554+0000 7fc83cff9700 1 -- 172.21.15.79:0/1503253424 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830011830 con 0x7fc84006d020 2023-10-19T08:38:46.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.554+0000 7fc83cff9700 1 -- 172.21.15.79:0/1503253424 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc830011990 con 0x7fc84006d020 2023-10-19T08:38:46.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.554+0000 7fc846265700 1 -- 172.21.15.79:0/1503253424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8400c7af0 con 0x7fc84006d020 2023-10-19T08:38:46.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.554+0000 7fc83cff9700 1 -- 172.21.15.79:0/1503253424 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830011d40 con 0x7fc84006d020 2023-10-19T08:38:46.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.554+0000 7fc846265700 1 -- 172.21.15.79:0/1503253424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8400c80b0 con 0x7fc84006d020 2023-10-19T08:38:46.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.555+0000 7fc846265700 1 -- 172.21.15.79:0/1503253424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc840159790 con 0x7fc84006d020 2023-10-19T08:38:46.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.555+0000 7fc83cff9700 1 -- 172.21.15.79:0/1503253424 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc83001a400 con 0x7fc84006d020 2023-10-19T08:38:46.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.556+0000 7fc83cff9700 1 --2- 172.21.15.79:0/1503253424 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc82006a0e0 0x7fc82006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.556+0000 7fc83cff9700 1 -- 172.21.15.79:0/1503253424 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc830088880 con 0x7fc84006d020 2023-10-19T08:38:46.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.556+0000 7fc83f7fe700 1 --2- 172.21.15.79:0/1503253424 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc82006a0e0 0x7fc82006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:46.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.556+0000 7fc83f7fe700 1 --2- 172.21.15.79:0/1503253424 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc82006a0e0 0x7fc82006c5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc8400cdb20 tx=0x7fc828008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:46.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.560+0000 7fc83cff9700 1 -- 172.21.15.79:0/1503253424 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc840159790 con 0x7fc84006d020 2023-10-19T08:38:46.753 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.749+0000 7fc846265700 1 -- 172.21.15.79:0/1503253424 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc840159790 con 0x7fc84006d020 2023-10-19T08:38:46.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.750+0000 7fc83cff9700 1 -- 172.21.15.79:0/1503253424 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20155 (secure 0 0 0) 0x7fc830053cd0 con 0x7fc84006d020 2023-10-19T08:38:46.755 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:46.756 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:44.473795+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:46.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.752+0000 7fc846265700 1 -- 172.21.15.79:0/1503253424 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc82006a0e0 msgr2=0x7fc82006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:46.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.752+0000 7fc846265700 1 --2- 172.21.15.79:0/1503253424 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc82006a0e0 0x7fc82006c5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc8400cdb20 tx=0x7fc828008030 comp rx=0 tx=0).stop 2023-10-19T08:38:46.757 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.752+0000 7fc846265700 1 -- 172.21.15.79:0/1503253424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc84006d020 msgr2=0x7fc8401584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:46.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.752+0000 7fc846265700 1 --2- 172.21.15.79:0/1503253424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc84006d020 0x7fc8401584b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc83000b560 tx=0x7fc83000b920 comp rx=0 tx=0).stop 2023-10-19T08:38:46.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.752+0000 7fc846265700 1 -- 172.21.15.79:0/1503253424 shutdown_connections 2023-10-19T08:38:46.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.752+0000 7fc846265700 1 --2- 172.21.15.79:0/1503253424 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc84015cf50 0x7fc8401f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.752+0000 7fc846265700 1 --2- 172.21.15.79:0/1503253424 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc84006d020 0x7fc8401584b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.752+0000 7fc846265700 1 --2- 172.21.15.79:0/1503253424 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc82006a0e0 0x7fc82006c5a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.752+0000 7fc846265700 1 --2- 172.21.15.79:0/1503253424 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8401593b0 0x7fc8401f3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.752+0000 7fc846265700 1 -- 172.21.15.79:0/1503253424 >> 172.21.15.79:0/1503253424 conn(0x7fc8400cf1a0 msgr2=0x7fc8400cbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:46.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.753+0000 7fc846265700 1 -- 172.21.15.79:0/1503253424 shutdown_connections 2023-10-19T08:38:46.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.753+0000 7fc846265700 1 -- 172.21.15.79:0/1503253424 wait complete. 2023-10-19T08:38:46.769 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T08:37:54.318159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T08:37:55.629862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T08:37:59.333062+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T08:38:46.770 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:38:46.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.887+0000 7f8266222700 1 Processor -- start 2023-10-19T08:38:46.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.887+0000 7f8266222700 1 -- start start 2023-10-19T08:38:46.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.888+0000 7f8266222700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f826006a930 0x7f82600cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.888+0000 7f8266222700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f82600703b0 0x7f82600cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.888+0000 7f8266222700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82600b1fe0 con 0x7f82600cd270 2023-10-19T08:38:46.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.888+0000 7f8266222700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8260160a80 con 0x7f82600703b0 2023-10-19T08:38:46.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.888+0000 7f8266222700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82600ce2b0 con 0x7f826006a930 2023-10-19T08:38:46.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.888+0000 7f825ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f82600703b0 0x7f82600cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:46.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.888+0000 7f825ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f82600703b0 0x7f82600cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47234/0 (socket says 172.21.15.79:47234) 2023-10-19T08:38:46.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.888+0000 7f825ffff700 1 -- 172.21.15.79:0/1664126802 learned_addr learned my addr 172.21.15.79:0/1664126802 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:46.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.888+0000 7f825effd700 1 --2- 172.21.15.79:0/1664126802 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f826006a930 0x7f82600cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:46.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.888+0000 7f825ffff700 1 -- 172.21.15.79:0/1664126802 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f826006a930 msgr2=0x7f82600cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:46.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.888+0000 7f825ffff700 1 --2- 172.21.15.79:0/1664126802 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f826006a930 0x7f82600cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.888+0000 7f825ffff700 1 -- 172.21.15.79:0/1664126802 >> v1:172.21.15.89:6789/0 conn(0x7f82600cd270 legacy=0x7f826006a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:46.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.889+0000 7f825ffff700 1 -- 172.21.15.79:0/1664126802 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82600ce550 con 0x7f82600703b0 2023-10-19T08:38:46.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.889+0000 7f825effd700 1 --2- 172.21.15.79:0/1664126802 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f826006a930 0x7f82600cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:46.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.889+0000 7f825ffff700 1 --2- 172.21.15.79:0/1664126802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82600703b0 0x7f82600cb7d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8258009e50 tx=0x7f825800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebbb9747a2a7151b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:46.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.889+0000 7f825e7fc700 1 -- 172.21.15.79:0/1664126802 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825800e070 con 0x7f82600703b0 2023-10-19T08:38:46.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.889+0000 7f825e7fc700 1 -- 172.21.15.79:0/1664126802 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8258003a20 con 0x7f82600703b0 2023-10-19T08:38:46.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.889+0000 7f825e7fc700 1 -- 172.21.15.79:0/1664126802 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8258003dd0 con 0x7f82600703b0 2023-10-19T08:38:46.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.889+0000 7f8266222700 1 -- 172.21.15.79:0/1664126802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82600703b0 msgr2=0x7f82600cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:46.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.889+0000 7f8266222700 1 --2- 172.21.15.79:0/1664126802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82600703b0 0x7f82600cb7d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8258009e50 tx=0x7f825800b330 comp rx=0 tx=0).stop 2023-10-19T08:38:46.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.889+0000 7f8266222700 1 -- 172.21.15.79:0/1664126802 shutdown_connections 2023-10-19T08:38:46.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.889+0000 7f8266222700 1 --2- 172.21.15.79:0/1664126802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82600703b0 0x7f82600cb7d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.889+0000 7f8266222700 1 --2- 172.21.15.79:0/1664126802 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f826006a930 0x7f82600cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.889+0000 7f8266222700 1 -- 172.21.15.79:0/1664126802 >> 172.21.15.79:0/1664126802 conn(0x7f826006dcc0 msgr2=0x7f826006e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:46.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.889+0000 7f8266222700 1 -- 172.21.15.79:0/1664126802 shutdown_connections 2023-10-19T08:38:46.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.889+0000 7f8266222700 1 -- 172.21.15.79:0/1664126802 wait complete. 2023-10-19T08:38:46.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.891+0000 7f8266222700 1 Processor -- start 2023-10-19T08:38:46.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.891+0000 7f8266222700 1 -- start start 2023-10-19T08:38:46.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.891+0000 7f8266222700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f826006a930 0x7f82601f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.891+0000 7f8266222700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82600703b0 0x7f826015d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.891+0000 7f8266222700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82600cd270 0x7f82600abd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.891+0000 7f8266222700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82600abc00 con 0x7f82600703b0 2023-10-19T08:38:46.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.891+0000 7f8266222700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82600c7d50 con 0x7f82600cd270 2023-10-19T08:38:46.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.891+0000 7f8266222700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82601f63c0 con 0x7f826006a930 2023-10-19T08:38:46.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.892+0000 7f825effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82600703b0 0x7f826015d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:46.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.892+0000 7f825effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82600703b0 0x7f826015d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47238/0 (socket says 172.21.15.79:47238) 2023-10-19T08:38:46.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.892+0000 7f825effd700 1 -- 172.21.15.79:0/2430488278 learned_addr learned my addr 172.21.15.79:0/2430488278 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:46.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.892+0000 7f825ffff700 1 --2- 172.21.15.79:0/2430488278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82600cd270 0x7f82600abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:46.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.892+0000 7f825f7fe700 1 --2- 172.21.15.79:0/2430488278 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f826006a930 0x7f82601f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:46.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.892+0000 7f825effd700 1 -- 172.21.15.79:0/2430488278 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f826006a930 msgr2=0x7f82601f5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:46.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.892+0000 7f825effd700 1 --2- 172.21.15.79:0/2430488278 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f826006a930 0x7f82601f5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.892+0000 7f825effd700 1 -- 172.21.15.79:0/2430488278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82600cd270 msgr2=0x7f82600abd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:46.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.892+0000 7f825effd700 1 --2- 172.21.15.79:0/2430488278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82600cd270 0x7f82600abd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:46.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.892+0000 7f825effd700 1 -- 172.21.15.79:0/2430488278 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8258009b30 con 0x7f82600703b0 2023-10-19T08:38:46.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.892+0000 7f825effd700 1 --2- 172.21.15.79:0/2430488278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82600703b0 0x7f826015d330 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f825000c7f0 tx=0x7f825000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:46.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.892+0000 7f8247fff700 1 -- 172.21.15.79:0/2430488278 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250011800 con 0x7f82600703b0 2023-10-19T08:38:46.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.892+0000 7f8247fff700 1 -- 172.21.15.79:0/2430488278 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8250011960 con 0x7f82600703b0 2023-10-19T08:38:46.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.892+0000 7f8247fff700 1 -- 172.21.15.79:0/2430488278 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8250011cf0 con 0x7f82600703b0 2023-10-19T08:38:46.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.892+0000 7f8266222700 1 -- 172.21.15.79:0/2430488278 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82601f65f0 con 0x7f82600703b0 2023-10-19T08:38:46.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.892+0000 7f8266222700 1 -- 172.21.15.79:0/2430488278 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82601f6bb0 con 0x7f82600703b0 2023-10-19T08:38:46.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.893+0000 7f8266222700 1 -- 172.21.15.79:0/2430488278 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f826004ee70 con 0x7f82600703b0 2023-10-19T08:38:46.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.894+0000 7f8247fff700 1 -- 172.21.15.79:0/2430488278 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8250018360 con 0x7f82600703b0 2023-10-19T08:38:46.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.894+0000 7f8247fff700 1 --2- 172.21.15.79:0/2430488278 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f824c06a0e0 0x7f824c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:46.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.894+0000 7f8247fff700 1 -- 172.21.15.79:0/2430488278 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8250088730 con 0x7f82600703b0 2023-10-19T08:38:46.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.894+0000 7f825f7fe700 1 --2- 172.21.15.79:0/2430488278 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f824c06a0e0 0x7f824c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:46.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.894+0000 7f825f7fe700 1 --2- 172.21.15.79:0/2430488278 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f824c06a0e0 0x7f824c06c5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8254007fd0 tx=0x7f8254007ec0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:46.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:46.898+0000 7f8247fff700 1 -- 172.21.15.79:0/2430488278 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f8250053af0 con 0x7f82600703b0 2023-10-19T08:38:47.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.086+0000 7f8266222700 1 -- 172.21.15.79:0/2430488278 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82600b1820 con 0x7f82600703b0 2023-10-19T08:38:47.091 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.087+0000 7f8247fff700 1 -- 172.21.15.79:0/2430488278 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8250057110 con 0x7f82600703b0 2023-10-19T08:38:47.092 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:38:47.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.089+0000 7f8266222700 1 -- 172.21.15.79:0/2430488278 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f824c06a0e0 msgr2=0x7f824c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:47.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.089+0000 7f8266222700 1 --2- 172.21.15.79:0/2430488278 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f824c06a0e0 0x7f824c06c5a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8254007fd0 tx=0x7f8254007ec0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.089+0000 7f8266222700 1 -- 172.21.15.79:0/2430488278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82600703b0 msgr2=0x7f826015d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:47.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.089+0000 7f8266222700 1 --2- 172.21.15.79:0/2430488278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82600703b0 0x7f826015d330 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f825000c7f0 tx=0x7f825000cb00 comp rx=0 tx=0).stop 2023-10-19T08:38:47.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.089+0000 7f8266222700 1 -- 172.21.15.79:0/2430488278 shutdown_connections 2023-10-19T08:38:47.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.089+0000 7f8266222700 1 --2- 172.21.15.79:0/2430488278 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82600cd270 0x7f82600abd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.089+0000 7f8266222700 1 --2- 172.21.15.79:0/2430488278 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f824c06a0e0 0x7f824c06c5a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.089+0000 7f8266222700 1 --2- 172.21.15.79:0/2430488278 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f826006a930 0x7f82601f5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.089+0000 7f8266222700 1 --2- 172.21.15.79:0/2430488278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82600703b0 0x7f826015d330 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.089+0000 7f8266222700 1 -- 172.21.15.79:0/2430488278 >> 172.21.15.79:0/2430488278 conn(0x7f826006dcc0 msgr2=0x7f82600cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:47.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.089+0000 7f8266222700 1 -- 172.21.15.79:0/2430488278 shutdown_connections 2023-10-19T08:38:47.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.089+0000 7f8266222700 1 -- 172.21.15.79:0/2430488278 wait complete. 2023-10-19T08:38:47.105 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:38:47.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.224+0000 7f35dfb2d700 1 Processor -- start 2023-10-19T08:38:47.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.224+0000 7f35dfb2d700 1 -- start start 2023-10-19T08:38:47.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.225+0000 7f35dfb2d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d815aec0 0x7f35d8070120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:47.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.225+0000 7f35dfb2d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f35d80ca280 0x7f35d806a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:47.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.225+0000 7f35dfb2d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f35d806a760 0x7f35d80cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:47.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.225+0000 7f35dfb2d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d806abf0 con 0x7f35d80ca280 2023-10-19T08:38:47.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.225+0000 7f35dfb2d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d815b2a0 con 0x7f35d806a760 2023-10-19T08:38:47.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.225+0000 7f35dfb2d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d80b31d0 con 0x7f35d815aec0 2023-10-19T08:38:47.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.225+0000 7f35dd0c8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f35d80ca280 0x7f35d806a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:47.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.225+0000 7f35dd0c8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f35d80ca280 0x7f35d806a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47246/0 (socket says 172.21.15.79:47246) 2023-10-19T08:38:47.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.225+0000 7f35dd0c8700 1 -- 172.21.15.79:0/3444480380 learned_addr learned my addr 172.21.15.79:0/3444480380 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:47.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.225+0000 7f35de0ca700 1 --2- 172.21.15.79:0/3444480380 >> v2:172.21.15.89:3300/0 conn(0x7f35d806a760 0x7f35d80cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:47.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.225+0000 7f35dd8c9700 1 --2- 172.21.15.79:0/3444480380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d815aec0 0x7f35d8070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:47.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.225+0000 7f35dd0c8700 1 -- 172.21.15.79:0/3444480380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d815aec0 msgr2=0x7f35d8070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:47.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.225+0000 7f35dd0c8700 1 --2- 172.21.15.79:0/3444480380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d815aec0 0x7f35d8070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.225+0000 7f35dd0c8700 1 -- 172.21.15.79:0/3444480380 >> v2:172.21.15.89:3300/0 conn(0x7f35d806a760 msgr2=0x7f35d80cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:47.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.225+0000 7f35dd0c8700 1 --2- 172.21.15.79:0/3444480380 >> v2:172.21.15.89:3300/0 conn(0x7f35d806a760 0x7f35d80cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.225+0000 7f35dd0c8700 1 -- 172.21.15.79:0/3444480380 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d80b2650 con 0x7f35d80ca280 2023-10-19T08:38:47.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.226+0000 7f35dd0c8700 1 --2- 172.21.15.79:0/3444480380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35d80ca280 0x7f35d806a220 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f35d80c3730 tx=0x7f35d4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2320a194da1e59c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:47.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.226+0000 7f35dc8c7700 1 -- 172.21.15.79:0/3444480380 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d4011830 con 0x7f35d80ca280 2023-10-19T08:38:47.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.226+0000 7f35dc8c7700 1 -- 172.21.15.79:0/3444480380 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d4011990 con 0x7f35d80ca280 2023-10-19T08:38:47.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.226+0000 7f35dc8c7700 1 -- 172.21.15.79:0/3444480380 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d4011d20 con 0x7f35d80ca280 2023-10-19T08:38:47.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.226+0000 7f35dfb2d700 1 -- 172.21.15.79:0/3444480380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35d80ca280 msgr2=0x7f35d806a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:47.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.226+0000 7f35dfb2d700 1 --2- 172.21.15.79:0/3444480380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35d80ca280 0x7f35d806a220 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f35d80c3730 tx=0x7f35d4009bd0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.226+0000 7f35dfb2d700 1 -- 172.21.15.79:0/3444480380 shutdown_connections 2023-10-19T08:38:47.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.226+0000 7f35dfb2d700 1 --2- 172.21.15.79:0/3444480380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d815aec0 0x7f35d8070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.226+0000 7f35dfb2d700 1 --2- 172.21.15.79:0/3444480380 >> v2:172.21.15.89:3300/0 conn(0x7f35d806a760 0x7f35d80cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.226+0000 7f35dfb2d700 1 --2- 172.21.15.79:0/3444480380 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35d80ca280 0x7f35d806a220 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.226+0000 7f35dfb2d700 1 -- 172.21.15.79:0/3444480380 >> 172.21.15.79:0/3444480380 conn(0x7f35d806dcc0 msgr2=0x7f35d806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:47.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.226+0000 7f35dfb2d700 1 -- 172.21.15.79:0/3444480380 shutdown_connections 2023-10-19T08:38:47.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.226+0000 7f35dfb2d700 1 -- 172.21.15.79:0/3444480380 wait complete. 2023-10-19T08:38:47.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.228+0000 7f35dfb2d700 1 Processor -- start 2023-10-19T08:38:47.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.228+0000 7f35dfb2d700 1 -- start start 2023-10-19T08:38:47.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.228+0000 7f35dfb2d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35d806a760 0x7f35d814bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:47.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.228+0000 7f35dfb2d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d80ca280 0x7f35d8154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:47.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.228+0000 7f35dfb2d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d815aec0 0x7f35d8155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:47.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.228+0000 7f35dfb2d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d815b740 con 0x7f35d806a760 2023-10-19T08:38:47.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.228+0000 7f35dfb2d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d814c520 con 0x7f35d815aec0 2023-10-19T08:38:47.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.228+0000 7f35dfb2d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d80c9f10 con 0x7f35d80ca280 2023-10-19T08:38:47.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.228+0000 7f35dd8c9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35d806a760 0x7f35d814bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:47.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.228+0000 7f35dd8c9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35d806a760 0x7f35d814bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47250/0 (socket says 172.21.15.79:47250) 2023-10-19T08:38:47.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.228+0000 7f35dd8c9700 1 -- 172.21.15.79:0/27298694 learned_addr learned my addr 172.21.15.79:0/27298694 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:47.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.229+0000 7f35de0ca700 1 --2- 172.21.15.79:0/27298694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d815aec0 0x7f35d8155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:47.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.229+0000 7f35dd0c8700 1 --2- 172.21.15.79:0/27298694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d80ca280 0x7f35d8154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:47.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.229+0000 7f35dd8c9700 1 -- 172.21.15.79:0/27298694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d80ca280 msgr2=0x7f35d8154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:47.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.229+0000 7f35dd8c9700 1 --2- 172.21.15.79:0/27298694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d80ca280 0x7f35d8154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.229+0000 7f35dd8c9700 1 -- 172.21.15.79:0/27298694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d815aec0 msgr2=0x7f35d8155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:47.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.229+0000 7f35dd8c9700 1 --2- 172.21.15.79:0/27298694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d815aec0 0x7f35d8155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.229+0000 7f35dd8c9700 1 -- 172.21.15.79:0/27298694 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d4009550 con 0x7f35d806a760 2023-10-19T08:38:47.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.229+0000 7f35de0ca700 1 --2- 172.21.15.79:0/27298694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d815aec0 0x7f35d8155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:47.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.229+0000 7f35dd8c9700 1 --2- 172.21.15.79:0/27298694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35d806a760 0x7f35d814bfe0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f35c800e8a0 tx=0x7f35c800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:47.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.229+0000 7f35ce7fc700 1 -- 172.21.15.79:0/27298694 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c8009590 con 0x7f35d806a760 2023-10-19T08:38:47.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.229+0000 7f35ce7fc700 1 -- 172.21.15.79:0/27298694 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c800eea0 con 0x7f35d806a760 2023-10-19T08:38:47.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.229+0000 7f35dfb2d700 1 -- 172.21.15.79:0/27298694 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d815b990 con 0x7f35d806a760 2023-10-19T08:38:47.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.229+0000 7f35ce7fc700 1 -- 172.21.15.79:0/27298694 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c800ca50 con 0x7f35d806a760 2023-10-19T08:38:47.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.229+0000 7f35dfb2d700 1 -- 172.21.15.79:0/27298694 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d815bf50 con 0x7f35d806a760 2023-10-19T08:38:47.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.230+0000 7f35dfb2d700 1 -- 172.21.15.79:0/27298694 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d80b1c60 con 0x7f35d806a760 2023-10-19T08:38:47.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.230+0000 7f35ce7fc700 1 -- 172.21.15.79:0/27298694 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f35c800cbb0 con 0x7f35d806a760 2023-10-19T08:38:47.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.231+0000 7f35ce7fc700 1 --2- 172.21.15.79:0/27298694 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f35bc06a0e0 0x7f35bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:47.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.231+0000 7f35ce7fc700 1 -- 172.21.15.79:0/27298694 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f35c80888b0 con 0x7f35d806a760 2023-10-19T08:38:47.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.231+0000 7f35dd0c8700 1 --2- 172.21.15.79:0/27298694 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f35bc06a0e0 0x7f35bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:47.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.231+0000 7f35dd0c8700 1 --2- 172.21.15.79:0/27298694 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f35bc06a0e0 0x7f35bc06c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009c10 tx=0x7f35d4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:47.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.235+0000 7f35ce7fc700 1 -- 172.21.15.79:0/27298694 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f35c8057660 con 0x7f35d806a760 2023-10-19T08:38:47.428 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.424+0000 7f35dfb2d700 1 -- 172.21.15.79:0/27298694 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f35d804ee70 con 0x7f35d806a760 2023-10-19T08:38:47.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.424+0000 7f35ce7fc700 1 -- 172.21.15.79:0/27298694 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f35c80210a0 con 0x7f35d806a760 2023-10-19T08:38:47.429 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:38:47.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.426+0000 7f35dfb2d700 1 -- 172.21.15.79:0/27298694 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f35bc06a0e0 msgr2=0x7f35bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:47.431 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.426+0000 7f35dfb2d700 1 --2- 172.21.15.79:0/27298694 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f35bc06a0e0 0x7f35bc06c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f35d4009c10 tx=0x7f35d4008030 comp rx=0 tx=0).stop 2023-10-19T08:38:47.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.426+0000 7f35dfb2d700 1 -- 172.21.15.79:0/27298694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35d806a760 msgr2=0x7f35d814bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:47.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.426+0000 7f35dfb2d700 1 --2- 172.21.15.79:0/27298694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35d806a760 0x7f35d814bfe0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f35c800e8a0 tx=0x7f35c800ec60 comp rx=0 tx=0).stop 2023-10-19T08:38:47.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.427+0000 7f35dfb2d700 1 -- 172.21.15.79:0/27298694 shutdown_connections 2023-10-19T08:38:47.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.427+0000 7f35dfb2d700 1 --2- 172.21.15.79:0/27298694 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35d815aec0 0x7f35d8155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.427+0000 7f35dfb2d700 1 --2- 172.21.15.79:0/27298694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35d806a760 0x7f35d814bfe0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.427+0000 7f35dfb2d700 1 --2- 172.21.15.79:0/27298694 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f35bc06a0e0 0x7f35bc06c5a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.427+0000 7f35dfb2d700 1 --2- 172.21.15.79:0/27298694 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35d80ca280 0x7f35d8154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.427+0000 7f35dfb2d700 1 -- 172.21.15.79:0/27298694 >> 172.21.15.79:0/27298694 conn(0x7f35d806dcc0 msgr2=0x7f35d80ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:47.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.427+0000 7f35dfb2d700 1 -- 172.21.15.79:0/27298694 shutdown_connections 2023-10-19T08:38:47.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.427+0000 7f35dfb2d700 1 -- 172.21.15.79:0/27298694 wait complete. 2023-10-19T08:38:47.443 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T08:38:47.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.563+0000 7f22b61f8700 1 Processor -- start 2023-10-19T08:38:47.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.563+0000 7f22b61f8700 1 -- start start 2023-10-19T08:38:47.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.565+0000 7f22b61f8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22b00cc640 0x7f22b00cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:47.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.565+0000 7f22b61f8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f22b0159db0 0x7f22b00b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:47.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.565+0000 7f22b61f8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b00ccf60 con 0x7f22b006fdc0 2023-10-19T08:38:47.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.565+0000 7f22b61f8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b015d760 con 0x7f22b00cc640 2023-10-19T08:38:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.565+0000 7f22b61f8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b015da40 con 0x7f22b0159db0 2023-10-19T08:38:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.565+0000 7f22af7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22b00cc640 0x7f22b00cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.565+0000 7f22af7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f22b00cc640 0x7f22b00cca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47258/0 (socket says 172.21.15.79:47258) 2023-10-19T08:38:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.565+0000 7f22af7fe700 1 -- 172.21.15.79:0/974799183 learned_addr learned my addr 172.21.15.79:0/974799183 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:47.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.565+0000 7f22aeffd700 1 --2- 172.21.15.79:0/974799183 >> v2:172.21.15.89:3300/0 conn(0x7f22b0159db0 0x7f22b00b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:47.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.565+0000 7f22af7fe700 1 -- 172.21.15.79:0/974799183 >> v2:172.21.15.89:3300/0 conn(0x7f22b0159db0 msgr2=0x7f22b00b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:47.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.565+0000 7f22af7fe700 1 --2- 172.21.15.79:0/974799183 >> v2:172.21.15.89:3300/0 conn(0x7f22b0159db0 0x7f22b00b16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.565+0000 7f22af7fe700 1 -- 172.21.15.79:0/974799183 >> v1:172.21.15.89:6789/0 conn(0x7f22b006fdc0 legacy=0x7f22b00b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:47.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.565+0000 7f22af7fe700 1 -- 172.21.15.79:0/974799183 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b015dd20 con 0x7f22b00cc640 2023-10-19T08:38:47.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.565+0000 7f22af7fe700 1 --2- 172.21.15.79:0/974799183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b00cc640 0x7f22b00cca20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f22b006e980 tx=0x7f22a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266b9ab1ab443684 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:47.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.565+0000 7f22ae7fc700 1 -- 172.21.15.79:0/974799183 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4004230 con 0x7f22b00cc640 2023-10-19T08:38:47.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.565+0000 7f22ae7fc700 1 -- 172.21.15.79:0/974799183 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a4004390 con 0x7f22b00cc640 2023-10-19T08:38:47.575 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.565+0000 7f22ae7fc700 1 -- 172.21.15.79:0/974799183 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a40036a0 con 0x7f22b00cc640 2023-10-19T08:38:47.575 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.566+0000 7f22b61f8700 1 -- 172.21.15.79:0/974799183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b00cc640 msgr2=0x7f22b00cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:47.575 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.566+0000 7f22b61f8700 1 --2- 172.21.15.79:0/974799183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b00cc640 0x7f22b00cca20 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f22b006e980 tx=0x7f22a4009bd0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.575 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.566+0000 7f22b61f8700 1 -- 172.21.15.79:0/974799183 shutdown_connections 2023-10-19T08:38:47.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.566+0000 7f22b61f8700 1 --2- 172.21.15.79:0/974799183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b00cc640 0x7f22b00cca20 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.566+0000 7f22b61f8700 1 --2- 172.21.15.79:0/974799183 >> v2:172.21.15.89:3300/0 conn(0x7f22b0159db0 0x7f22b00b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.566+0000 7f22b61f8700 1 -- 172.21.15.79:0/974799183 >> 172.21.15.79:0/974799183 conn(0x7f22b006dcc0 msgr2=0x7f22b006e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:47.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.566+0000 7f22b61f8700 1 -- 172.21.15.79:0/974799183 shutdown_connections 2023-10-19T08:38:47.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.566+0000 7f22b61f8700 1 -- 172.21.15.79:0/974799183 wait complete. 2023-10-19T08:38:47.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.567+0000 7f22b61f8700 1 Processor -- start 2023-10-19T08:38:47.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.567+0000 7f22b61f8700 1 -- start start 2023-10-19T08:38:47.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.568+0000 7f22b61f8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b006fdc0 0x7f22b015c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:47.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.568+0000 7f22b61f8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22b00cc640 0x7f22b00cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:47.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.568+0000 7f22b61f8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22b0159db0 0x7f22b0145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:47.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.568+0000 7f22b61f8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b01458e0 con 0x7f22b006fdc0 2023-10-19T08:38:47.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.568+0000 7f22b61f8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b0145300 con 0x7f22b0159db0 2023-10-19T08:38:47.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.568+0000 7f22b61f8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b00d0680 con 0x7f22b00cc640 2023-10-19T08:38:47.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.568+0000 7f22af7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b006fdc0 0x7f22b015c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:47.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.568+0000 7f22af7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b006fdc0 0x7f22b015c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47262/0 (socket says 172.21.15.79:47262) 2023-10-19T08:38:47.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.568+0000 7f22af7fe700 1 -- 172.21.15.79:0/2127221798 learned_addr learned my addr 172.21.15.79:0/2127221798 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:47.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.568+0000 7f22affff700 1 --2- 172.21.15.79:0/2127221798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22b0159db0 0x7f22b0145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:47.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.568+0000 7f22aeffd700 1 --2- 172.21.15.79:0/2127221798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22b00cc640 0x7f22b00cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:47.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.568+0000 7f22af7fe700 1 -- 172.21.15.79:0/2127221798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22b00cc640 msgr2=0x7f22b00cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:47.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.568+0000 7f22af7fe700 1 --2- 172.21.15.79:0/2127221798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22b00cc640 0x7f22b00cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.568+0000 7f22af7fe700 1 -- 172.21.15.79:0/2127221798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22b0159db0 msgr2=0x7f22b0145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:47.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.568+0000 7f22af7fe700 1 --2- 172.21.15.79:0/2127221798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22b0159db0 0x7f22b0145d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.568+0000 7f22af7fe700 1 -- 172.21.15.79:0/2127221798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a4009550 con 0x7f22b006fdc0 2023-10-19T08:38:47.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.568+0000 7f22affff700 1 --2- 172.21.15.79:0/2127221798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22b0159db0 0x7f22b0145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:47.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.569+0000 7f22af7fe700 1 --2- 172.21.15.79:0/2127221798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b006fdc0 0x7f22b015c190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009130 tx=0x7f22a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:47.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.569+0000 7f2297fff700 1 -- 172.21.15.79:0/2127221798 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4003dc0 con 0x7f22b006fdc0 2023-10-19T08:38:47.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.569+0000 7f2297fff700 1 -- 172.21.15.79:0/2127221798 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a401f070 con 0x7f22b006fdc0 2023-10-19T08:38:47.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.569+0000 7f22b61f8700 1 -- 172.21.15.79:0/2127221798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b0145570 con 0x7f22b006fdc0 2023-10-19T08:38:47.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.569+0000 7f2297fff700 1 -- 172.21.15.79:0/2127221798 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4011870 con 0x7f22b006fdc0 2023-10-19T08:38:47.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.569+0000 7f22b61f8700 1 -- 172.21.15.79:0/2127221798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b015c6d0 con 0x7f22b006fdc0 2023-10-19T08:38:47.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.570+0000 7f22b61f8700 1 -- 172.21.15.79:0/2127221798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b0145700 con 0x7f22b006fdc0 2023-10-19T08:38:47.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.570+0000 7f2297fff700 1 -- 172.21.15.79:0/2127221798 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f22a4021030 con 0x7f22b006fdc0 2023-10-19T08:38:47.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.570+0000 7f2297fff700 1 --2- 172.21.15.79:0/2127221798 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f229c06a0e0 0x7f229c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:47.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.571+0000 7f2297fff700 1 -- 172.21.15.79:0/2127221798 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f22a4089f30 con 0x7f22b006fdc0 2023-10-19T08:38:47.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.571+0000 7f22aeffd700 1 --2- 172.21.15.79:0/2127221798 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f229c06a0e0 0x7f229c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:47.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.571+0000 7f22aeffd700 1 --2- 172.21.15.79:0/2127221798 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f229c06a0e0 0x7f229c06c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f22b01f3f30 tx=0x7f22a0008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:47.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.575+0000 7f2297fff700 1 -- 172.21.15.79:0/2127221798 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f22a4055380 con 0x7f22b006fdc0 2023-10-19T08:38:47.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.763+0000 7f22b61f8700 1 -- 172.21.15.79:0/2127221798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f22b015dfd0 con 0x7f22b006fdc0 2023-10-19T08:38:47.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.763+0000 7f2297fff700 1 -- 172.21.15.79:0/2127221798 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f22a40589a0 con 0x7f22b006fdc0 2023-10-19T08:38:47.768 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:47.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.765+0000 7f22b61f8700 1 -- 172.21.15.79:0/2127221798 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f229c06a0e0 msgr2=0x7f229c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:47.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.765+0000 7f22b61f8700 1 --2- 172.21.15.79:0/2127221798 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f229c06a0e0 0x7f229c06c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f22b01f3f30 tx=0x7f22a0008040 comp rx=0 tx=0).stop 2023-10-19T08:38:47.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.765+0000 7f22b61f8700 1 -- 172.21.15.79:0/2127221798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b006fdc0 msgr2=0x7f22b015c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:47.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.765+0000 7f22b61f8700 1 --2- 172.21.15.79:0/2127221798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b006fdc0 0x7f22b015c190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009130 tx=0x7f22a4004750 comp rx=0 tx=0).stop 2023-10-19T08:38:47.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.765+0000 7f22b61f8700 1 -- 172.21.15.79:0/2127221798 shutdown_connections 2023-10-19T08:38:47.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.765+0000 7f22b61f8700 1 --2- 172.21.15.79:0/2127221798 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22b0159db0 0x7f22b0145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.765+0000 7f22b61f8700 1 --2- 172.21.15.79:0/2127221798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f22b006fdc0 0x7f22b015c190 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.765+0000 7f22b61f8700 1 --2- 172.21.15.79:0/2127221798 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f229c06a0e0 0x7f229c06c5a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.765+0000 7f22b61f8700 1 --2- 172.21.15.79:0/2127221798 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f22b00cc640 0x7f22b00cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.765+0000 7f22b61f8700 1 -- 172.21.15.79:0/2127221798 >> 172.21.15.79:0/2127221798 conn(0x7f22b006dcc0 msgr2=0x7f22b01524b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:47.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.765+0000 7f22b61f8700 1 -- 172.21.15.79:0/2127221798 shutdown_connections 2023-10-19T08:38:47.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.765+0000 7f22b61f8700 1 -- 172.21.15.79:0/2127221798 wait complete. 2023-10-19T08:38:47.781 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T08:38:47.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.899+0000 7f1d242b0700 1 Processor -- start 2023-10-19T08:38:47.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.899+0000 7f1d242b0700 1 -- start start 2023-10-19T08:38:47.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.900+0000 7f1d242b0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1d1c0cd270 0x7f1d1c06a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:47.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.900+0000 7f1d242b0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d1c0703b0 0x7f1d1c06a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:47.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.900+0000 7f1d242b0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1c0b1fe0 con 0x7f1d1c06f910 2023-10-19T08:38:47.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.900+0000 7f1d242b0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1c160a80 con 0x7f1d1c0cd270 2023-10-19T08:38:47.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.900+0000 7f1d242b0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0ce2b0 con 0x7f1d1c0703b0 2023-10-19T08:38:47.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.901+0000 7f1d2184b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d1c0703b0 0x7f1d1c06a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:47.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.901+0000 7f1d2204c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1d1c0cd270 0x7f1d1c06a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:47.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.901+0000 7f1d2204c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1d1c0cd270 0x7f1d1c06a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:33516/0 (socket says 172.21.15.79:33516) 2023-10-19T08:38:47.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.901+0000 7f1d2184b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d1c0703b0 0x7f1d1c06a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:49896/0 (socket says 172.21.15.79:49896) 2023-10-19T08:38:47.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.901+0000 7f1d2284d700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1d1c06f910 0x7f1d1c160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:42188/0 (socket says 172.21.15.79:42188) 2023-10-19T08:38:47.912 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.901+0000 7f1d2204c700 1 -- 172.21.15.79:0/4039137043 learned_addr learned my addr 172.21.15.79:0/4039137043 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:47.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.901+0000 7f1d2204c700 1 -- 172.21.15.79:0/4039137043 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d1c0703b0 msgr2=0x7f1d1c06a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:47.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.901+0000 7f1d2204c700 1 --2- 172.21.15.79:0/4039137043 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d1c0703b0 0x7f1d1c06a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.901+0000 7f1d2204c700 1 -- 172.21.15.79:0/4039137043 >> v1:172.21.15.89:6789/0 conn(0x7f1d1c06f910 legacy=0x7f1d1c160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:47.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.901+0000 7f1d2204c700 1 -- 172.21.15.79:0/4039137043 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c0ce550 con 0x7f1d1c0cd270 2023-10-19T08:38:47.913 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.901+0000 7f1d2184b700 1 --2- 172.21.15.79:0/4039137043 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d1c0703b0 0x7f1d1c06a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:38:47.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.901+0000 7f1d2204c700 1 --2- 172.21.15.79:0/4039137043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d1c0cd270 0x7f1d1c06a220 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d180098f0 tx=0x7f1d18009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c10cc758d7b73f97 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:47.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.902+0000 7f1d2104a700 1 -- 172.21.15.79:0/4039137043 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d18011830 con 0x7f1d1c0cd270 2023-10-19T08:38:47.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.902+0000 7f1d2104a700 1 -- 172.21.15.79:0/4039137043 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d18011990 con 0x7f1d1c0cd270 2023-10-19T08:38:47.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.902+0000 7f1d2104a700 1 -- 172.21.15.79:0/4039137043 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d18011d20 con 0x7f1d1c0cd270 2023-10-19T08:38:47.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.902+0000 7f1d242b0700 1 -- 172.21.15.79:0/4039137043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d1c0cd270 msgr2=0x7f1d1c06a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:47.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.902+0000 7f1d242b0700 1 --2- 172.21.15.79:0/4039137043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d1c0cd270 0x7f1d1c06a220 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d180098f0 tx=0x7f1d18009c00 comp rx=0 tx=0).stop 2023-10-19T08:38:47.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.902+0000 7f1d242b0700 1 -- 172.21.15.79:0/4039137043 shutdown_connections 2023-10-19T08:38:47.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.902+0000 7f1d242b0700 1 --2- 172.21.15.79:0/4039137043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d1c0cd270 0x7f1d1c06a220 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.902+0000 7f1d242b0700 1 --2- 172.21.15.79:0/4039137043 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d1c0703b0 0x7f1d1c06a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.902+0000 7f1d242b0700 1 -- 172.21.15.79:0/4039137043 >> 172.21.15.79:0/4039137043 conn(0x7f1d1c06dcc0 msgr2=0x7f1d1c06e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:47.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.902+0000 7f1d242b0700 1 -- 172.21.15.79:0/4039137043 shutdown_connections 2023-10-19T08:38:47.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.902+0000 7f1d242b0700 1 -- 172.21.15.79:0/4039137043 wait complete. 2023-10-19T08:38:47.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.903+0000 7f1d242b0700 1 Processor -- start 2023-10-19T08:38:47.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.903+0000 7f1d242b0700 1 -- start start 2023-10-19T08:38:47.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.904+0000 7f1d242b0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d1c06f910 0x7f1d1c1f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:47.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.904+0000 7f1d242b0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d1c0703b0 0x7f1d1c15a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:47.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.904+0000 7f1d242b0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d1c0cd270 0x7f1d1c15aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:47.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.904+0000 7f1d242b0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0ab8e0 con 0x7f1d1c0703b0 2023-10-19T08:38:47.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.904+0000 7f1d242b0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c159270 con 0x7f1d1c06f910 2023-10-19T08:38:47.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.904+0000 7f1d242b0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c159550 con 0x7f1d1c0cd270 2023-10-19T08:38:47.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.904+0000 7f1d2184b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d1c0703b0 0x7f1d1c15a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:47.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.904+0000 7f1d2184b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d1c0703b0 0x7f1d1c15a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47278/0 (socket says 172.21.15.79:47278) 2023-10-19T08:38:47.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.904+0000 7f1d2184b700 1 -- 172.21.15.79:0/2646294388 learned_addr learned my addr 172.21.15.79:0/2646294388 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.904+0000 7f1d2204c700 1 --2- 172.21.15.79:0/2646294388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d1c06f910 0x7f1d1c1f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.904+0000 7f1d2284d700 1 --2- 172.21.15.79:0/2646294388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d1c0cd270 0x7f1d1c15aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.905+0000 7f1d2184b700 1 -- 172.21.15.79:0/2646294388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d1c0cd270 msgr2=0x7f1d1c15aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.905+0000 7f1d2184b700 1 --2- 172.21.15.79:0/2646294388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d1c0cd270 0x7f1d1c15aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.905+0000 7f1d2184b700 1 -- 172.21.15.79:0/2646294388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d1c06f910 msgr2=0x7f1d1c1f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:47.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.905+0000 7f1d2184b700 1 --2- 172.21.15.79:0/2646294388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d1c06f910 0x7f1d1c1f20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:47.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.905+0000 7f1d2184b700 1 -- 172.21.15.79:0/2646294388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0c0094a0 con 0x7f1d1c0703b0 2023-10-19T08:38:47.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.905+0000 7f1d2184b700 1 --2- 172.21.15.79:0/2646294388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d1c0703b0 0x7f1d1c15a4d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c00ebe0 tx=0x7f1d0c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:47.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.905+0000 7f1d12ffd700 1 -- 172.21.15.79:0/2646294388 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c00c850 con 0x7f1d1c0703b0 2023-10-19T08:38:47.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.905+0000 7f1d12ffd700 1 -- 172.21.15.79:0/2646294388 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0c00c9b0 con 0x7f1d1c0703b0 2023-10-19T08:38:47.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.905+0000 7f1d242b0700 1 -- 172.21.15.79:0/2646294388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d18009550 con 0x7f1d1c0703b0 2023-10-19T08:38:47.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.905+0000 7f1d12ffd700 1 -- 172.21.15.79:0/2646294388 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0c00cd40 con 0x7f1d1c0703b0 2023-10-19T08:38:47.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.905+0000 7f1d242b0700 1 -- 172.21.15.79:0/2646294388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1c0abaf0 con 0x7f1d1c0703b0 2023-10-19T08:38:47.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.906+0000 7f1d242b0700 1 -- 172.21.15.79:0/2646294388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1c04ee70 con 0x7f1d1c0703b0 2023-10-19T08:38:47.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.906+0000 7f1d12ffd700 1 -- 172.21.15.79:0/2646294388 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1d0c013470 con 0x7f1d1c0703b0 2023-10-19T08:38:47.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.907+0000 7f1d12ffd700 1 --2- 172.21.15.79:0/2646294388 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1d0006a0e0 0x7f1d0006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:47.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.907+0000 7f1d2204c700 1 --2- 172.21.15.79:0/2646294388 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1d0006a0e0 0x7f1d0006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:47.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.907+0000 7f1d12ffd700 1 -- 172.21.15.79:0/2646294388 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1d0c088920 con 0x7f1d1c0703b0 2023-10-19T08:38:47.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.907+0000 7f1d2204c700 1 --2- 172.21.15.79:0/2646294388 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1d0006a0e0 0x7f1d0006c5a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1d18009c40 tx=0x7f1d18008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:47.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:47.911+0000 7f1d12ffd700 1 -- 172.21.15.79:0/2646294388 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f1d0c053ce0 con 0x7f1d1c0703b0 2023-10-19T08:38:48.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.101+0000 7f1d242b0700 1 -- 172.21.15.79:0/2646294388 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1d1c0cc460 con 0x7f1d1c0703b0 2023-10-19T08:38:48.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.101+0000 7f1d12ffd700 1 -- 172.21.15.79:0/2646294388 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1d0c00cea0 con 0x7f1d1c0703b0 2023-10-19T08:38:48.106 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-19T08:38:48.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.103+0000 7f1d242b0700 1 -- 172.21.15.79:0/2646294388 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1d0006a0e0 msgr2=0x7f1d0006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:48.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.103+0000 7f1d242b0700 1 --2- 172.21.15.79:0/2646294388 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1d0006a0e0 0x7f1d0006c5a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1d18009c40 tx=0x7f1d18008030 comp rx=0 tx=0).stop 2023-10-19T08:38:48.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.103+0000 7f1d242b0700 1 -- 172.21.15.79:0/2646294388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d1c0703b0 msgr2=0x7f1d1c15a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:48.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.103+0000 7f1d242b0700 1 --2- 172.21.15.79:0/2646294388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d1c0703b0 0x7f1d1c15a4d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c00ebe0 tx=0x7f1d0c00eef0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.103+0000 7f1d242b0700 1 -- 172.21.15.79:0/2646294388 shutdown_connections 2023-10-19T08:38:48.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.103+0000 7f1d242b0700 1 --2- 172.21.15.79:0/2646294388 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1d0006a0e0 0x7f1d0006c5a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.103+0000 7f1d242b0700 1 --2- 172.21.15.79:0/2646294388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d1c0cd270 0x7f1d1c15aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.103+0000 7f1d242b0700 1 --2- 172.21.15.79:0/2646294388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d1c06f910 0x7f1d1c1f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.103+0000 7f1d242b0700 1 --2- 172.21.15.79:0/2646294388 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d1c0703b0 0x7f1d1c15a4d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.103+0000 7f1d242b0700 1 -- 172.21.15.79:0/2646294388 >> 172.21.15.79:0/2646294388 conn(0x7f1d1c06dcc0 msgr2=0x7f1d1c1600e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:48.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.103+0000 7f1d242b0700 1 -- 172.21.15.79:0/2646294388 shutdown_connections 2023-10-19T08:38:48.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.103+0000 7f1d242b0700 1 -- 172.21.15.79:0/2646294388 wait complete. 2023-10-19T08:38:48.119 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T08:38:48.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.238+0000 7f7f2bbdd700 1 Processor -- start 2023-10-19T08:38:48.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.238+0000 7f7f2bbdd700 1 -- start start 2023-10-19T08:38:48.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.239+0000 7f7f2bbdd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f240b0c00 0x7f7f240d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.239+0000 7f7f2bbdd700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f240b25f0 con 0x7f7f2415e570 2023-10-19T08:38:48.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.239+0000 7f7f2bbdd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f240afd60 con 0x7f7f240cb6f0 2023-10-19T08:38:48.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.239+0000 7f7f2bbdd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f240af810 con 0x7f7f240b0c00 2023-10-19T08:38:48.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.239+0000 7f7f29979700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7f2415e570 0x7f7f240b04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57356/0 (socket says 172.21.15.79:57356) 2023-10-19T08:38:48.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.239+0000 7f7f29979700 1 -- 172.21.15.79:0/1653424586 learned_addr learned my addr 172.21.15.79:0/1653424586 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:48.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.239+0000 7f7f28977700 1 -- 172.21.15.79:0/1653424586 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2145388341 0 0) 0x7f7f240b25f0 con 0x7f7f2415e570 2023-10-19T08:38:48.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.239+0000 7f7f28977700 1 -- 172.21.15.79:0/1653424586 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f100035b0 con 0x7f7f2415e570 2023-10-19T08:38:48.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.239+0000 7f7f29178700 1 --2- 172.21.15.79:0/1653424586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f240b0c00 0x7f7f240d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:48.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f28977700 1 -- 172.21.15.79:0/1653424586 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3383598911 0 0) 0x7f7f100035b0 con 0x7f7f2415e570 2023-10-19T08:38:48.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f28977700 1 -- 172.21.15.79:0/1653424586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f240b0c00 msgr2=0x7f7f240d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:48.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f28977700 1 --2- 172.21.15.79:0/1653424586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f240b0c00 0x7f7f240d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f28977700 1 -- 172.21.15.79:0/1653424586 >> v1:172.21.15.89:6789/0 conn(0x7f7f240cb6f0 legacy=0x7f7f240ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:48.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f28977700 1 -- 172.21.15.79:0/1653424586 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f240aef70 con 0x7f7f2415e570 2023-10-19T08:38:48.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f28977700 1 -- 172.21.15.79:0/1653424586 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f7f14001670 con 0x7f7f2415e570 2023-10-19T08:38:48.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f28977700 1 -- 172.21.15.79:0/1653424586 >> v1:172.21.15.79:6789/0 conn(0x7f7f2415e570 legacy=0x7f7f240b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:48.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f28977700 1 --2- 172.21.15.79:0/1653424586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f240b0c00 0x7f7f10003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f28977700 1 --2- 172.21.15.79:0/1653424586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f10004020 0x7f7f10004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f28977700 1 --2- 172.21.15.79:0/1653424586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f10004d90 0x7f7f10005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f28977700 1 -- 172.21.15.79:0/1653424586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f240af810 con 0x7f7f10004020 2023-10-19T08:38:48.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f28977700 1 -- 172.21.15.79:0/1653424586 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1000bb70 con 0x7f7f10004d90 2023-10-19T08:38:48.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f28977700 1 -- 172.21.15.79:0/1653424586 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1000bd30 con 0x7f7f240b0c00 2023-10-19T08:38:48.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f29178700 1 --2- 172.21.15.79:0/1653424586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f10004020 0x7f7f10004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:48.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f29979700 1 --2- 172.21.15.79:0/1653424586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f240b0c00 0x7f7f10003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:48.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f2a17a700 1 --2- 172.21.15.79:0/1653424586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f10004d90 0x7f7f10005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:48.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f29178700 1 -- 172.21.15.79:0/1653424586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f240b0c00 msgr2=0x7f7f10003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:48.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f29178700 1 --2- 172.21.15.79:0/1653424586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f240b0c00 0x7f7f10003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f29178700 1 -- 172.21.15.79:0/1653424586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f10004d90 msgr2=0x7f7f10005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:48.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f29178700 1 --2- 172.21.15.79:0/1653424586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f10004d90 0x7f7f10005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f29178700 1 -- 172.21.15.79:0/1653424586 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f100035b0 con 0x7f7f10004020 2023-10-19T08:38:48.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f29979700 1 --2- 172.21.15.79:0/1653424586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f240b0c00 0x7f7f10003aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:48.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f2a17a700 1 --2- 172.21.15.79:0/1653424586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f10004d90 0x7f7f10005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:48.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f29178700 1 --2- 172.21.15.79:0/1653424586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f10004020 0x7f7f10004850 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7f20009b60 tx=0x7f7f10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4168c1710346075b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:48.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f28977700 1 -- 172.21.15.79:0/1653424586 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2000e6c0 con 0x7f7f10004020 2023-10-19T08:38:48.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f28977700 1 -- 172.21.15.79:0/1653424586 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2000e820 con 0x7f7f10004020 2023-10-19T08:38:48.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.240+0000 7f7f28977700 1 -- 172.21.15.79:0/1653424586 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2000eb90 con 0x7f7f10004020 2023-10-19T08:38:48.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.241+0000 7f7f2bbdd700 1 -- 172.21.15.79:0/1653424586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f10004020 msgr2=0x7f7f10004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:48.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.241+0000 7f7f2bbdd700 1 --2- 172.21.15.79:0/1653424586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f10004020 0x7f7f10004850 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7f20009b60 tx=0x7f7f10005880 comp rx=0 tx=0).stop 2023-10-19T08:38:48.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.241+0000 7f7f2a17a700 1 -- 172.21.15.79:0/1653424586 reap_dead start 2023-10-19T08:38:48.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.241+0000 7f7f2bbdd700 1 -- 172.21.15.79:0/1653424586 shutdown_connections 2023-10-19T08:38:48.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.241+0000 7f7f2bbdd700 1 -- 172.21.15.79:0/1653424586 >> 172.21.15.79:0/1653424586 conn(0x7f7f2409a0b0 msgr2=0x7f7f240d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:48.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.241+0000 7f7f2bbdd700 1 -- 172.21.15.79:0/1653424586 shutdown_connections 2023-10-19T08:38:48.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.241+0000 7f7f2bbdd700 1 -- 172.21.15.79:0/1653424586 wait complete. 2023-10-19T08:38:48.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.242+0000 7f7f2bbdd700 1 Processor -- start 2023-10-19T08:38:48.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.242+0000 7f7f2bbdd700 1 -- start start 2023-10-19T08:38:48.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.243+0000 7f7f2bbdd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f10004020 0x7f7f24150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.243+0000 7f7f2bbdd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f240b14e0 0x7f7f240b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.243+0000 7f7f2bbdd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f24159af0 0x7f7f24159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.243+0000 7f7f2bbdd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f240b1ea0 con 0x7f7f24159af0 2023-10-19T08:38:48.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.243+0000 7f7f2bbdd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f24155050 con 0x7f7f10004020 2023-10-19T08:38:48.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.243+0000 7f7f2bbdd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f24155330 con 0x7f7f240b14e0 2023-10-19T08:38:48.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.243+0000 7f7f2a17a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f24159af0 0x7f7f24159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:48.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.243+0000 7f7f2a17a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f24159af0 0x7f7f24159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47300/0 (socket says 172.21.15.79:47300) 2023-10-19T08:38:48.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.243+0000 7f7f2a17a700 1 -- 172.21.15.79:0/3212823431 learned_addr learned my addr 172.21.15.79:0/3212823431 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:48.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.243+0000 7f7f2a17a700 1 -- 172.21.15.79:0/3212823431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f240b14e0 msgr2=0x7f7f240b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:48.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.243+0000 7f7f2a17a700 1 --2- 172.21.15.79:0/3212823431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f240b14e0 0x7f7f240b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.243+0000 7f7f29979700 1 --2- 172.21.15.79:0/3212823431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f10004020 0x7f7f24150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:48.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.243+0000 7f7f2a17a700 1 -- 172.21.15.79:0/3212823431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f10004020 msgr2=0x7f7f24150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:48.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.243+0000 7f7f2a17a700 1 --2- 172.21.15.79:0/3212823431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f10004020 0x7f7f24150bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.243+0000 7f7f2a17a700 1 -- 172.21.15.79:0/3212823431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f24155610 con 0x7f7f24159af0 2023-10-19T08:38:48.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.243+0000 7f7f2a17a700 1 --2- 172.21.15.79:0/3212823431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f24159af0 0x7f7f24159f70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7f240ce550 tx=0x7f7f1c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:48.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.244+0000 7f7f1a7fc700 1 -- 172.21.15.79:0/3212823431 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c003c10 con 0x7f7f24159af0 2023-10-19T08:38:48.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.244+0000 7f7f1a7fc700 1 -- 172.21.15.79:0/3212823431 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1c003d90 con 0x7f7f24159af0 2023-10-19T08:38:48.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.244+0000 7f7f2bbdd700 1 -- 172.21.15.79:0/3212823431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f241558f0 con 0x7f7f24159af0 2023-10-19T08:38:48.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.244+0000 7f7f1a7fc700 1 -- 172.21.15.79:0/3212823431 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c005310 con 0x7f7f24159af0 2023-10-19T08:38:48.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.244+0000 7f7f2bbdd700 1 -- 172.21.15.79:0/3212823431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f24151100 con 0x7f7f24159af0 2023-10-19T08:38:48.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.245+0000 7f7f2bbdd700 1 -- 172.21.15.79:0/3212823431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2404ee70 con 0x7f7f24159af0 2023-10-19T08:38:48.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.245+0000 7f7f1a7fc700 1 -- 172.21.15.79:0/3212823431 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7f1c005470 con 0x7f7f24159af0 2023-10-19T08:38:48.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.245+0000 7f7f1a7fc700 1 --2- 172.21.15.79:0/3212823431 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7f0806a0e0 0x7f7f0806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.245+0000 7f7f1a7fc700 1 -- 172.21.15.79:0/3212823431 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7f1c0887f0 con 0x7f7f24159af0 2023-10-19T08:38:48.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.246+0000 7f7f29979700 1 --2- 172.21.15.79:0/3212823431 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7f0806a0e0 0x7f7f0806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:48.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.246+0000 7f7f29979700 1 --2- 172.21.15.79:0/3212823431 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7f0806a0e0 0x7f7f0806c5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7f14001c90 tx=0x7f7f14001b20 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:48.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.250+0000 7f7f1a7fc700 1 -- 172.21.15.79:0/3212823431 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f7f1c053c40 con 0x7f7f24159af0 2023-10-19T08:38:48.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.438+0000 7f7f2bbdd700 1 -- 172.21.15.79:0/3212823431 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7f240c7290 con 0x7f7f24159af0 2023-10-19T08:38:48.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.438+0000 7f7f1a7fc700 1 -- 172.21.15.79:0/3212823431 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7f1c01a310 con 0x7f7f24159af0 2023-10-19T08:38:48.443 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:48.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.440+0000 7f7f2bbdd700 1 -- 172.21.15.79:0/3212823431 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7f0806a0e0 msgr2=0x7f7f0806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:48.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.440+0000 7f7f2bbdd700 1 --2- 172.21.15.79:0/3212823431 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7f0806a0e0 0x7f7f0806c5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7f14001c90 tx=0x7f7f14001b20 comp rx=0 tx=0).stop 2023-10-19T08:38:48.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.440+0000 7f7f2bbdd700 1 -- 172.21.15.79:0/3212823431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f24159af0 msgr2=0x7f7f24159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:48.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.440+0000 7f7f2bbdd700 1 --2- 172.21.15.79:0/3212823431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f24159af0 0x7f7f24159f70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7f240ce550 tx=0x7f7f1c00ee70 comp rx=0 tx=0).stop 2023-10-19T08:38:48.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.440+0000 7f7f2bbdd700 1 -- 172.21.15.79:0/3212823431 shutdown_connections 2023-10-19T08:38:48.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.440+0000 7f7f2bbdd700 1 --2- 172.21.15.79:0/3212823431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f24159af0 0x7f7f24159f70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.440+0000 7f7f2bbdd700 1 --2- 172.21.15.79:0/3212823431 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f10004020 0x7f7f24150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.440+0000 7f7f2bbdd700 1 --2- 172.21.15.79:0/3212823431 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7f0806a0e0 0x7f7f0806c5a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.440+0000 7f7f2bbdd700 1 --2- 172.21.15.79:0/3212823431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f240b14e0 0x7f7f240b1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.441+0000 7f7f2bbdd700 1 -- 172.21.15.79:0/3212823431 >> 172.21.15.79:0/3212823431 conn(0x7f7f2409a0b0 msgr2=0x7f7f240d14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:48.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.441+0000 7f7f2bbdd700 1 -- 172.21.15.79:0/3212823431 shutdown_connections 2023-10-19T08:38:48.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.441+0000 7f7f2bbdd700 1 -- 172.21.15.79:0/3212823431 wait complete. 2023-10-19T08:38:48.458 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:48.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.574+0000 7f657fbe4700 1 Processor -- start 2023-10-19T08:38:48.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.575+0000 7f657fbe4700 1 -- start start 2023-10-19T08:38:48.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.575+0000 7f657fbe4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f65780af170 0x7f65780cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.575+0000 7f657fbe4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65780b1de0 0x7f65780b2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.575+0000 7f657fbe4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f657815de50 con 0x7f65780cd800 2023-10-19T08:38:48.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.575+0000 7f657fbe4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65780af550 con 0x7f65780b1de0 2023-10-19T08:38:48.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.575+0000 7f657fbe4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65780b16b0 con 0x7f65780af170 2023-10-19T08:38:48.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.576+0000 7f657d17f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65780b1de0 0x7f65780b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:48.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.576+0000 7f657d17f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65780b1de0 0x7f65780b2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47304/0 (socket says 172.21.15.79:47304) 2023-10-19T08:38:48.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.576+0000 7f657d17f700 1 -- 172.21.15.79:0/924506370 learned_addr learned my addr 172.21.15.79:0/924506370 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:48.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.576+0000 7f657d980700 1 --2- 172.21.15.79:0/924506370 >> v2:172.21.15.89:3300/0 conn(0x7f65780af170 0x7f65780cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:48.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.576+0000 7f657d17f700 1 -- 172.21.15.79:0/924506370 >> v2:172.21.15.89:3300/0 conn(0x7f65780af170 msgr2=0x7f65780cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:48.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.576+0000 7f657d17f700 1 --2- 172.21.15.79:0/924506370 >> v2:172.21.15.89:3300/0 conn(0x7f65780af170 0x7f65780cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.576+0000 7f657d17f700 1 -- 172.21.15.79:0/924506370 >> v1:172.21.15.89:6789/0 conn(0x7f65780cd800 legacy=0x7f657806a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:48.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.576+0000 7f657d17f700 1 -- 172.21.15.79:0/924506370 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657815e130 con 0x7f65780b1de0 2023-10-19T08:38:48.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.576+0000 7f657d17f700 1 --2- 172.21.15.79:0/924506370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65780b1de0 0x7f65780b2270 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f65740098f0 tx=0x7f6574009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a07dae65b4950ba7 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:48.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.576+0000 7f657c97e700 1 -- 172.21.15.79:0/924506370 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657400b860 con 0x7f65780b1de0 2023-10-19T08:38:48.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.576+0000 7f657c97e700 1 -- 172.21.15.79:0/924506370 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657400b9c0 con 0x7f65780b1de0 2023-10-19T08:38:48.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.576+0000 7f657c97e700 1 -- 172.21.15.79:0/924506370 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657400bd50 con 0x7f65780b1de0 2023-10-19T08:38:48.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.577+0000 7f657fbe4700 1 -- 172.21.15.79:0/924506370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65780b1de0 msgr2=0x7f65780b2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:48.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.577+0000 7f657fbe4700 1 --2- 172.21.15.79:0/924506370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65780b1de0 0x7f65780b2270 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f65740098f0 tx=0x7f6574009c00 comp rx=0 tx=0).stop 2023-10-19T08:38:48.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.577+0000 7f657fbe4700 1 -- 172.21.15.79:0/924506370 shutdown_connections 2023-10-19T08:38:48.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.577+0000 7f657fbe4700 1 --2- 172.21.15.79:0/924506370 >> v2:172.21.15.89:3300/0 conn(0x7f65780af170 0x7f65780cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.577+0000 7f657fbe4700 1 --2- 172.21.15.79:0/924506370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65780b1de0 0x7f65780b2270 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.577+0000 7f657fbe4700 1 -- 172.21.15.79:0/924506370 >> 172.21.15.79:0/924506370 conn(0x7f657806dcc0 msgr2=0x7f657806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:48.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.577+0000 7f657fbe4700 1 -- 172.21.15.79:0/924506370 shutdown_connections 2023-10-19T08:38:48.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.577+0000 7f657fbe4700 1 -- 172.21.15.79:0/924506370 wait complete. 2023-10-19T08:38:48.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.578+0000 7f657fbe4700 1 Processor -- start 2023-10-19T08:38:48.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.578+0000 7f657fbe4700 1 -- start start 2023-10-19T08:38:48.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f657fbe4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65780af170 0x7f65780b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f657fbe4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65780b1de0 0x7f65780ad040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f657fbe4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65780cd800 0x7f65780b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f657fbe4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65780b27e0 con 0x7f65780cd800 2023-10-19T08:38:48.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f657fbe4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65780b55a0 con 0x7f65780b1de0 2023-10-19T08:38:48.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f657fbe4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65780b29f0 con 0x7f65780af170 2023-10-19T08:38:48.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f657e181700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65780cd800 0x7f65780b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:48.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f657e181700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65780cd800 0x7f65780b34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47314/0 (socket says 172.21.15.79:47314) 2023-10-19T08:38:48.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f657e181700 1 -- 172.21.15.79:0/549995123 learned_addr learned my addr 172.21.15.79:0/549995123 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:48.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f657e181700 1 -- 172.21.15.79:0/549995123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65780af170 msgr2=0x7f65780b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:48.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f657e181700 1 --2- 172.21.15.79:0/549995123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65780af170 0x7f65780b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f657e181700 1 -- 172.21.15.79:0/549995123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65780b1de0 msgr2=0x7f65780ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:48.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f657e181700 1 --2- 172.21.15.79:0/549995123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65780b1de0 0x7f65780ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f657e181700 1 -- 172.21.15.79:0/549995123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6574009550 con 0x7f65780cd800 2023-10-19T08:38:48.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f657e181700 1 --2- 172.21.15.79:0/549995123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65780cd800 0x7f65780b34d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f657000cb50 tx=0x7f657000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:48.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f656e7fc700 1 -- 172.21.15.79:0/549995123 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6570003c00 con 0x7f65780cd800 2023-10-19T08:38:48.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f656e7fc700 1 -- 172.21.15.79:0/549995123 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6570003d60 con 0x7f65780cd800 2023-10-19T08:38:48.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f657fbe4700 1 -- 172.21.15.79:0/549995123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65780b2cd0 con 0x7f65780cd800 2023-10-19T08:38:48.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f656e7fc700 1 -- 172.21.15.79:0/549995123 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657000ab70 con 0x7f65780cd800 2023-10-19T08:38:48.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.579+0000 7f657fbe4700 1 -- 172.21.15.79:0/549995123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6578157840 con 0x7f65780cd800 2023-10-19T08:38:48.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.580+0000 7f657fbe4700 1 -- 172.21.15.79:0/549995123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657806a910 con 0x7f65780cd800 2023-10-19T08:38:48.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.581+0000 7f656e7fc700 1 -- 172.21.15.79:0/549995123 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f657000acd0 con 0x7f65780cd800 2023-10-19T08:38:48.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.581+0000 7f656e7fc700 1 --2- 172.21.15.79:0/549995123 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f655c06a0e0 0x7f655c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.582+0000 7f656e7fc700 1 -- 172.21.15.79:0/549995123 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f65700890e0 con 0x7f65780cd800 2023-10-19T08:38:48.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.582+0000 7f657d980700 1 --2- 172.21.15.79:0/549995123 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f655c06a0e0 0x7f655c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:48.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.582+0000 7f657d980700 1 --2- 172.21.15.79:0/549995123 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f655c06a0e0 0x7f655c06c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f65780caf60 tx=0x7f6568008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:48.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.585+0000 7f656e7fc700 1 -- 172.21.15.79:0/549995123 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6570054610 con 0x7f65780cd800 2023-10-19T08:38:48.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.775+0000 7f657fbe4700 1 -- 172.21.15.79:0/549995123 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65780b31f0 con 0x7f65780cd800 2023-10-19T08:38:48.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.776+0000 7f656e7fc700 1 -- 172.21.15.79:0/549995123 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20155 (secure 0 0 0) 0x7f65780b31f0 con 0x7f65780cd800 2023-10-19T08:38:48.781 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:48.781 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:44.473795+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:48.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.778+0000 7f657fbe4700 1 -- 172.21.15.79:0/549995123 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f655c06a0e0 msgr2=0x7f655c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:48.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.778+0000 7f657fbe4700 1 --2- 172.21.15.79:0/549995123 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f655c06a0e0 0x7f655c06c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f65780caf60 tx=0x7f6568008040 comp rx=0 tx=0).stop 2023-10-19T08:38:48.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.778+0000 7f657fbe4700 1 -- 172.21.15.79:0/549995123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65780cd800 msgr2=0x7f65780b34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:48.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.778+0000 7f657fbe4700 1 --2- 172.21.15.79:0/549995123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65780cd800 0x7f65780b34d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f657000cb50 tx=0x7f657000cf10 comp rx=0 tx=0).stop 2023-10-19T08:38:48.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.778+0000 7f657fbe4700 1 -- 172.21.15.79:0/549995123 shutdown_connections 2023-10-19T08:38:48.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.778+0000 7f657fbe4700 1 --2- 172.21.15.79:0/549995123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65780cd800 0x7f65780b34d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.778+0000 7f657fbe4700 1 --2- 172.21.15.79:0/549995123 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f655c06a0e0 0x7f655c06c5a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.778+0000 7f657fbe4700 1 --2- 172.21.15.79:0/549995123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65780af170 0x7f65780b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.778+0000 7f657fbe4700 1 --2- 172.21.15.79:0/549995123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65780b1de0 0x7f65780ad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.778+0000 7f657fbe4700 1 -- 172.21.15.79:0/549995123 >> 172.21.15.79:0/549995123 conn(0x7f657806dcc0 msgr2=0x7f65780b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:48.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.778+0000 7f657fbe4700 1 -- 172.21.15.79:0/549995123 shutdown_connections 2023-10-19T08:38:48.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.778+0000 7f657fbe4700 1 -- 172.21.15.79:0/549995123 wait complete. 2023-10-19T08:38:48.794 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T08:37:54.318159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T08:37:55.629862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T08:37:59.333062+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T08:38:48.795 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:38:48.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.913+0000 7fcd09978700 1 Processor -- start 2023-10-19T08:38:48.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.913+0000 7fcd09978700 1 -- start start 2023-10-19T08:38:48.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.914+0000 7fcd09978700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcd040b2180 0x7fcd040d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.914+0000 7fcd09978700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcd040b5f20 0x7fcd040b6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.914+0000 7fcd09978700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd040d1120 con 0x7fcd040cfcf0 2023-10-19T08:38:48.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.914+0000 7fcd09978700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd040d1400 con 0x7fcd040b2180 2023-10-19T08:38:48.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.914+0000 7fcd09978700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd040d16e0 con 0x7fcd040b5f20 2023-10-19T08:38:48.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.914+0000 7fcd027fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcd040b2180 0x7fcd040d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:48.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.914+0000 7fcd027fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcd040b2180 0x7fcd040d2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47320/0 (socket says 172.21.15.79:47320) 2023-10-19T08:38:48.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.914+0000 7fcd027fc700 1 -- 172.21.15.79:0/3472587245 learned_addr learned my addr 172.21.15.79:0/3472587245 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:48.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.914+0000 7fcd037fe700 1 --2- 172.21.15.79:0/3472587245 >> v2:172.21.15.89:3300/0 conn(0x7fcd040b5f20 0x7fcd040b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:48.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.914+0000 7fcd027fc700 1 -- 172.21.15.79:0/3472587245 >> v2:172.21.15.89:3300/0 conn(0x7fcd040b5f20 msgr2=0x7fcd040b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:48.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.914+0000 7fcd027fc700 1 --2- 172.21.15.79:0/3472587245 >> v2:172.21.15.89:3300/0 conn(0x7fcd040b5f20 0x7fcd040b6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.914+0000 7fcd027fc700 1 -- 172.21.15.79:0/3472587245 >> v1:172.21.15.89:6789/0 conn(0x7fcd040cfcf0 legacy=0x7fcd040d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:48.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.914+0000 7fcd027fc700 1 -- 172.21.15.79:0/3472587245 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd040d19c0 con 0x7fcd040b2180 2023-10-19T08:38:48.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.914+0000 7fcd037fe700 1 --2- 172.21.15.79:0/3472587245 >> v2:172.21.15.89:3300/0 conn(0x7fcd040b5f20 0x7fcd040b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:48.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.914+0000 7fcd027fc700 1 --2- 172.21.15.79:0/3472587245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd040b2180 0x7fcd040d2410 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcd040d0da0 tx=0x7fccf4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97083fd3610e141a server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:48.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.914+0000 7fcd01ffb700 1 -- 172.21.15.79:0/3472587245 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4004230 con 0x7fcd040b2180 2023-10-19T08:38:48.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.915+0000 7fcd01ffb700 1 -- 172.21.15.79:0/3472587245 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf4004390 con 0x7fcd040b2180 2023-10-19T08:38:48.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.915+0000 7fcd01ffb700 1 -- 172.21.15.79:0/3472587245 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf40036a0 con 0x7fcd040b2180 2023-10-19T08:38:48.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.915+0000 7fcd09978700 1 -- 172.21.15.79:0/3472587245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd040b2180 msgr2=0x7fcd040d2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:48.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.915+0000 7fcd09978700 1 --2- 172.21.15.79:0/3472587245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd040b2180 0x7fcd040d2410 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcd040d0da0 tx=0x7fccf4009bd0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.915+0000 7fcd09978700 1 -- 172.21.15.79:0/3472587245 shutdown_connections 2023-10-19T08:38:48.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.915+0000 7fcd09978700 1 --2- 172.21.15.79:0/3472587245 >> v2:172.21.15.89:3300/0 conn(0x7fcd040b5f20 0x7fcd040b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.915+0000 7fcd09978700 1 --2- 172.21.15.79:0/3472587245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd040b2180 0x7fcd040d2410 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.915+0000 7fcd09978700 1 -- 172.21.15.79:0/3472587245 >> 172.21.15.79:0/3472587245 conn(0x7fcd04071b30 msgr2=0x7fcd04071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:48.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.915+0000 7fcd09978700 1 -- 172.21.15.79:0/3472587245 shutdown_connections 2023-10-19T08:38:48.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.915+0000 7fcd09978700 1 -- 172.21.15.79:0/3472587245 wait complete. 2023-10-19T08:38:48.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.917+0000 7fcd09978700 1 Processor -- start 2023-10-19T08:38:48.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.917+0000 7fcd09978700 1 -- start start 2023-10-19T08:38:48.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd09978700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd040b2180 0x7fcd041513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd09978700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd040b5f20 0x7fcd041f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd09978700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd040cfcf0 0x7fcd0415e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd09978700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd041518e0 con 0x7fcd040b5f20 2023-10-19T08:38:48.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd09978700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0415ea30 con 0x7fcd040b2180 2023-10-19T08:38:48.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd09978700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd040c7b40 con 0x7fcd040cfcf0 2023-10-19T08:38:48.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd027fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd040b5f20 0x7fcd041f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:48.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd027fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd040b5f20 0x7fcd041f2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47326/0 (socket says 172.21.15.79:47326) 2023-10-19T08:38:48.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd027fc700 1 -- 172.21.15.79:0/185041159 learned_addr learned my addr 172.21.15.79:0/185041159 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:48.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd02ffd700 1 --2- 172.21.15.79:0/185041159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd040b2180 0x7fcd041513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:48.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd037fe700 1 --2- 172.21.15.79:0/185041159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd040cfcf0 0x7fcd0415e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:48.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd027fc700 1 -- 172.21.15.79:0/185041159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd040cfcf0 msgr2=0x7fcd0415e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:48.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd027fc700 1 --2- 172.21.15.79:0/185041159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd040cfcf0 0x7fcd0415e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd027fc700 1 -- 172.21.15.79:0/185041159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd040b2180 msgr2=0x7fcd041513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:48.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd027fc700 1 --2- 172.21.15.79:0/185041159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd040b2180 0x7fcd041513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:48.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd027fc700 1 -- 172.21.15.79:0/185041159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf4009550 con 0x7fcd040b5f20 2023-10-19T08:38:48.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd037fe700 1 --2- 172.21.15.79:0/185041159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd040cfcf0 0x7fcd0415e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:48.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd02ffd700 1 --2- 172.21.15.79:0/185041159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd040b2180 0x7fcd041513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:48.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd027fc700 1 --2- 172.21.15.79:0/185041159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd040b5f20 0x7fcd041f2a40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fccf4009130 tx=0x7fccf4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:48.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fccebfff700 1 -- 172.21.15.79:0/185041159 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4011630 con 0x7fcd040b5f20 2023-10-19T08:38:48.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fccebfff700 1 -- 172.21.15.79:0/185041159 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf4011790 con 0x7fcd040b5f20 2023-10-19T08:38:48.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.918+0000 7fcd09978700 1 -- 172.21.15.79:0/185041159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd040c7e20 con 0x7fcd040b5f20 2023-10-19T08:38:48.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.919+0000 7fccebfff700 1 -- 172.21.15.79:0/185041159 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf4011b00 con 0x7fcd040b5f20 2023-10-19T08:38:48.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.919+0000 7fcd09978700 1 -- 172.21.15.79:0/185041159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd040c83e0 con 0x7fcd040b5f20 2023-10-19T08:38:48.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.919+0000 7fcd09978700 1 -- 172.21.15.79:0/185041159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0404ee70 con 0x7fcd040b5f20 2023-10-19T08:38:48.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.920+0000 7fccebfff700 1 -- 172.21.15.79:0/185041159 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fccf4021070 con 0x7fcd040b5f20 2023-10-19T08:38:48.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.920+0000 7fccebfff700 1 --2- 172.21.15.79:0/185041159 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fccf006a0e0 0x7fccf006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:48.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.920+0000 7fccebfff700 1 -- 172.21.15.79:0/185041159 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fccf4089f90 con 0x7fcd040b5f20 2023-10-19T08:38:48.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.920+0000 7fcd02ffd700 1 --2- 172.21.15.79:0/185041159 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fccf006a0e0 0x7fccf006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:48.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.921+0000 7fcd02ffd700 1 --2- 172.21.15.79:0/185041159 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fccf006a0e0 0x7fccf006c5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009930 tx=0x7fccf8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:48.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:48.924+0000 7fccebfff700 1 -- 172.21.15.79:0/185041159 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fccf40bc940 con 0x7fcd040b5f20 2023-10-19T08:38:49.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.113+0000 7fcd09978700 1 -- 172.21.15.79:0/185041159 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd040c6800 con 0x7fcd040b5f20 2023-10-19T08:38:49.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.113+0000 7fccebfff700 1 -- 172.21.15.79:0/185041159 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fccf4055350 con 0x7fcd040b5f20 2023-10-19T08:38:49.118 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:38:49.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.115+0000 7fcd09978700 1 -- 172.21.15.79:0/185041159 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fccf006a0e0 msgr2=0x7fccf006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:49.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.115+0000 7fcd09978700 1 --2- 172.21.15.79:0/185041159 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fccf006a0e0 0x7fccf006c5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009930 tx=0x7fccf8008040 comp rx=0 tx=0).stop 2023-10-19T08:38:49.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.115+0000 7fcd09978700 1 -- 172.21.15.79:0/185041159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd040b5f20 msgr2=0x7fcd041f2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:49.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.115+0000 7fcd09978700 1 --2- 172.21.15.79:0/185041159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd040b5f20 0x7fcd041f2a40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fccf4009130 tx=0x7fccf4004750 comp rx=0 tx=0).stop 2023-10-19T08:38:49.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.115+0000 7fcd09978700 1 -- 172.21.15.79:0/185041159 shutdown_connections 2023-10-19T08:38:49.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.115+0000 7fcd09978700 1 --2- 172.21.15.79:0/185041159 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fccf006a0e0 0x7fccf006c5a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.115+0000 7fcd09978700 1 --2- 172.21.15.79:0/185041159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcd040cfcf0 0x7fcd0415e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.115+0000 7fcd09978700 1 --2- 172.21.15.79:0/185041159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcd040b2180 0x7fcd041513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.115+0000 7fcd09978700 1 --2- 172.21.15.79:0/185041159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcd040b5f20 0x7fcd041f2a40 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.115+0000 7fcd09978700 1 -- 172.21.15.79:0/185041159 >> 172.21.15.79:0/185041159 conn(0x7fcd04071b30 msgr2=0x7fcd040b6460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:49.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.115+0000 7fcd09978700 1 -- 172.21.15.79:0/185041159 shutdown_connections 2023-10-19T08:38:49.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.115+0000 7fcd09978700 1 -- 172.21.15.79:0/185041159 wait complete. 2023-10-19T08:38:49.132 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:38:49.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.250+0000 7fece95d9700 1 Processor -- start 2023-10-19T08:38:49.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.250+0000 7fece95d9700 1 -- start start 2023-10-19T08:38:49.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.251+0000 7fece95d9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fece406a930 0x7fece40cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.251+0000 7fece95d9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece40703b0 0x7fece40cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.251+0000 7fece95d9700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece40b1fe0 con 0x7fece40cd270 2023-10-19T08:38:49.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.251+0000 7fece95d9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece4160a80 con 0x7fece406a930 2023-10-19T08:38:49.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.251+0000 7fece95d9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece40ce2b0 con 0x7fece40703b0 2023-10-19T08:38:49.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.251+0000 7fece2ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fece40cd270 0x7fece406a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57404/0 (socket says 172.21.15.79:57404) 2023-10-19T08:38:49.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.251+0000 7fece2ffd700 1 -- 172.21.15.79:0/2456092163 learned_addr learned my addr 172.21.15.79:0/2456092163 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:49.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.251+0000 7fece27fc700 1 --2- 172.21.15.79:0/2456092163 >> v2:172.21.15.89:3300/0 conn(0x7fece406a930 0x7fece40cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.251+0000 7fece37fe700 1 --2- 172.21.15.79:0/2456092163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece40703b0 0x7fece40cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.251+0000 7fece1ffb700 1 -- 172.21.15.79:0/2456092163 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468745724 0 0) 0x7fece40b1fe0 con 0x7fece40cd270 2023-10-19T08:38:49.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece1ffb700 1 -- 172.21.15.79:0/2456092163 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feccc0035b0 con 0x7fece40cd270 2023-10-19T08:38:49.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece1ffb700 1 -- 172.21.15.79:0/2456092163 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2634182184 0 0) 0x7feccc0035b0 con 0x7fece40cd270 2023-10-19T08:38:49.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece1ffb700 1 -- 172.21.15.79:0/2456092163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece40703b0 msgr2=0x7fece40cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:49.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece1ffb700 1 --2- 172.21.15.79:0/2456092163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece40703b0 0x7fece40cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece1ffb700 1 -- 172.21.15.79:0/2456092163 >> v2:172.21.15.89:3300/0 conn(0x7fece406a930 msgr2=0x7fece40cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:49.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece1ffb700 1 --2- 172.21.15.79:0/2456092163 >> v2:172.21.15.89:3300/0 conn(0x7fece406a930 0x7fece40cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece1ffb700 1 -- 172.21.15.79:0/2456092163 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece40ce550 con 0x7fece40cd270 2023-10-19T08:38:49.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece1ffb700 1 -- 172.21.15.79:0/2456092163 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7fecd8001670 con 0x7fece40cd270 2023-10-19T08:38:49.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece1ffb700 1 -- 172.21.15.79:0/2456092163 >> v1:172.21.15.79:6789/0 conn(0x7fece40cd270 legacy=0x7fece406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:49.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece1ffb700 1 --2- 172.21.15.79:0/2456092163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feccc003a70 0x7feccc003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece1ffb700 1 --2- 172.21.15.79:0/2456092163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feccc004850 0x7feccc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece1ffb700 1 --2- 172.21.15.79:0/2456092163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feccc005210 0x7feccc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece1ffb700 1 -- 172.21.15.79:0/2456092163 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece4160a80 con 0x7feccc004850 2023-10-19T08:38:49.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece1ffb700 1 -- 172.21.15.79:0/2456092163 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece40ce2b0 con 0x7feccc003a70 2023-10-19T08:38:49.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece1ffb700 1 -- 172.21.15.79:0/2456092163 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feccc00bf50 con 0x7feccc005210 2023-10-19T08:38:49.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece37fe700 1 --2- 172.21.15.79:0/2456092163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece40703b0 0x7fece40cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:38:49.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece27fc700 1 --2- 172.21.15.79:0/2456092163 >> v2:172.21.15.89:3300/0 conn(0x7fece406a930 0x7fece40cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:38:49.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece27fc700 1 --2- 172.21.15.79:0/2456092163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feccc004850 0x7feccc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece2ffd700 1 --2- 172.21.15.79:0/2456092163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feccc003a70 0x7feccc003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece37fe700 1 --2- 172.21.15.79:0/2456092163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feccc005210 0x7feccc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece27fc700 1 -- 172.21.15.79:0/2456092163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feccc005210 msgr2=0x7feccc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:49.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece27fc700 1 --2- 172.21.15.79:0/2456092163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feccc005210 0x7feccc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece27fc700 1 -- 172.21.15.79:0/2456092163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feccc003a70 msgr2=0x7feccc003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:49.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece27fc700 1 --2- 172.21.15.79:0/2456092163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feccc003a70 0x7feccc003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece27fc700 1 -- 172.21.15.79:0/2456092163 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc0035b0 con 0x7feccc004850 2023-10-19T08:38:49.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.252+0000 7fece27fc700 1 --2- 172.21.15.79:0/2456092163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feccc004850 0x7feccc004cd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009d30 tx=0x7feccc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58afcdbb994c511 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:49.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.253+0000 7fece1ffb700 1 -- 172.21.15.79:0/2456092163 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4009e80 con 0x7feccc004850 2023-10-19T08:38:49.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.253+0000 7fece1ffb700 1 -- 172.21.15.79:0/2456092163 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd400e9a0 con 0x7feccc004850 2023-10-19T08:38:49.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.253+0000 7fece1ffb700 1 -- 172.21.15.79:0/2456092163 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd400ed10 con 0x7feccc004850 2023-10-19T08:38:49.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.253+0000 7fece95d9700 1 -- 172.21.15.79:0/2456092163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feccc004850 msgr2=0x7feccc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:49.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.253+0000 7fece95d9700 1 --2- 172.21.15.79:0/2456092163 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feccc004850 0x7feccc004cd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009d30 tx=0x7feccc005880 comp rx=0 tx=0).stop 2023-10-19T08:38:49.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.253+0000 7fece37fe700 1 -- 172.21.15.79:0/2456092163 reap_dead start 2023-10-19T08:38:49.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.253+0000 7fece95d9700 1 -- 172.21.15.79:0/2456092163 shutdown_connections 2023-10-19T08:38:49.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.253+0000 7fece95d9700 1 -- 172.21.15.79:0/2456092163 >> 172.21.15.79:0/2456092163 conn(0x7fece406dcc0 msgr2=0x7fece406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:49.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.253+0000 7fece95d9700 1 -- 172.21.15.79:0/2456092163 shutdown_connections 2023-10-19T08:38:49.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.253+0000 7fece95d9700 1 -- 172.21.15.79:0/2456092163 wait complete. 2023-10-19T08:38:49.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.254+0000 7fece95d9700 1 Processor -- start 2023-10-19T08:38:49.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.255+0000 7fece95d9700 1 -- start start 2023-10-19T08:38:49.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.255+0000 7fece95d9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece415e460 0x7fece41f28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.255+0000 7fece95d9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece41f6880 0x7fece40b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.255+0000 7fece95d9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fece40b3350 0x7fece415f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.255+0000 7fece95d9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece40b2980 con 0x7fece41f6880 2023-10-19T08:38:49.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.255+0000 7fece95d9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece41f6d00 con 0x7fece40b3350 2023-10-19T08:38:49.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.255+0000 7fece95d9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece41f2f00 con 0x7fece415e460 2023-10-19T08:38:49.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.255+0000 7fece27fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece41f6880 0x7fece40b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.255+0000 7fece27fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece41f6880 0x7fece40b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47344/0 (socket says 172.21.15.79:47344) 2023-10-19T08:38:49.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.255+0000 7fece27fc700 1 -- 172.21.15.79:0/2452189636 learned_addr learned my addr 172.21.15.79:0/2452189636 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:49.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.256+0000 7fece2ffd700 1 --2- 172.21.15.79:0/2452189636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece415e460 0x7fece41f28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.256+0000 7fece37fe700 1 --2- 172.21.15.79:0/2452189636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fece40b3350 0x7fece415f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.256+0000 7fece27fc700 1 -- 172.21.15.79:0/2452189636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece415e460 msgr2=0x7fece41f28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:49.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.256+0000 7fece27fc700 1 --2- 172.21.15.79:0/2452189636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece415e460 0x7fece41f28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.256+0000 7fece27fc700 1 -- 172.21.15.79:0/2452189636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fece40b3350 msgr2=0x7fece415f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:49.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.256+0000 7fece27fc700 1 --2- 172.21.15.79:0/2452189636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fece40b3350 0x7fece415f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.256+0000 7fece27fc700 1 -- 172.21.15.79:0/2452189636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece41f31e0 con 0x7fece41f6880 2023-10-19T08:38:49.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.256+0000 7fece2ffd700 1 --2- 172.21.15.79:0/2452189636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece415e460 0x7fece41f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:49.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.256+0000 7fece27fc700 1 --2- 172.21.15.79:0/2452189636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece41f6880 0x7fece40b2e10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fecd400e790 tx=0x7fecd40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:49.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.256+0000 7feccb7fe700 1 -- 172.21.15.79:0/2452189636 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4020070 con 0x7fece41f6880 2023-10-19T08:38:49.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.256+0000 7fece95d9700 1 -- 172.21.15.79:0/2452189636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece41f34c0 con 0x7fece41f6880 2023-10-19T08:38:49.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.256+0000 7feccb7fe700 1 -- 172.21.15.79:0/2452189636 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd4009e80 con 0x7fece41f6880 2023-10-19T08:38:49.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.256+0000 7feccb7fe700 1 -- 172.21.15.79:0/2452189636 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4006e60 con 0x7fece41f6880 2023-10-19T08:38:49.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.256+0000 7fece95d9700 1 -- 172.21.15.79:0/2452189636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece415f660 con 0x7fece41f6880 2023-10-19T08:38:49.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.257+0000 7fece95d9700 1 -- 172.21.15.79:0/2452189636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece40b3730 con 0x7fece41f6880 2023-10-19T08:38:49.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.257+0000 7feccb7fe700 1 -- 172.21.15.79:0/2452189636 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fecd4024070 con 0x7fece41f6880 2023-10-19T08:38:49.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.258+0000 7feccb7fe700 1 --2- 172.21.15.79:0/2452189636 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fecd006a0e0 0x7fecd006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.258+0000 7feccb7fe700 1 -- 172.21.15.79:0/2452189636 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fecd4089c40 con 0x7fece41f6880 2023-10-19T08:38:49.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.258+0000 7fece2ffd700 1 --2- 172.21.15.79:0/2452189636 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fecd006a0e0 0x7fecd006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.258+0000 7fece2ffd700 1 --2- 172.21.15.79:0/2452189636 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fecd006a0e0 0x7fecd006c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fecd8001050 tx=0x7fecd8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:49.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.262+0000 7feccb7fe700 1 -- 172.21.15.79:0/2452189636 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fecd4058c40 con 0x7fece41f6880 2023-10-19T08:38:49.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.455+0000 7fece95d9700 1 -- 172.21.15.79:0/2452189636 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fece404ee70 con 0x7fece41f6880 2023-10-19T08:38:49.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.455+0000 7feccb7fe700 1 -- 172.21.15.79:0/2452189636 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fecd40587d0 con 0x7fece41f6880 2023-10-19T08:38:49.460 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:38:49.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.457+0000 7fece95d9700 1 -- 172.21.15.79:0/2452189636 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fecd006a0e0 msgr2=0x7fecd006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:49.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.457+0000 7fece95d9700 1 --2- 172.21.15.79:0/2452189636 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fecd006a0e0 0x7fecd006c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fecd8001050 tx=0x7fecd8009040 comp rx=0 tx=0).stop 2023-10-19T08:38:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.457+0000 7fece95d9700 1 -- 172.21.15.79:0/2452189636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece41f6880 msgr2=0x7fece40b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.457+0000 7fece95d9700 1 --2- 172.21.15.79:0/2452189636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece41f6880 0x7fece40b2e10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fecd400e790 tx=0x7fecd40047c0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.457+0000 7fece95d9700 1 -- 172.21.15.79:0/2452189636 shutdown_connections 2023-10-19T08:38:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.457+0000 7fece95d9700 1 --2- 172.21.15.79:0/2452189636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fece40b3350 0x7fece415f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.457+0000 7fece95d9700 1 --2- 172.21.15.79:0/2452189636 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fecd006a0e0 0x7fecd006c5a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.457+0000 7fece95d9700 1 --2- 172.21.15.79:0/2452189636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fece415e460 0x7fece41f28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.457+0000 7fece95d9700 1 --2- 172.21.15.79:0/2452189636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece41f6880 0x7fece40b2e10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.457+0000 7fece95d9700 1 -- 172.21.15.79:0/2452189636 >> 172.21.15.79:0/2452189636 conn(0x7fece406dcc0 msgr2=0x7fece40c3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:49.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.457+0000 7fece95d9700 1 -- 172.21.15.79:0/2452189636 shutdown_connections 2023-10-19T08:38:49.464 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.458+0000 7fece95d9700 1 -- 172.21.15.79:0/2452189636 wait complete. 2023-10-19T08:38:49.474 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T08:38:49.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.596+0000 7f646f0d7700 1 Processor -- start 2023-10-19T08:38:49.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.597+0000 7f646f0d7700 1 -- start start 2023-10-19T08:38:49.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.597+0000 7f646f0d7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f64680d14f0 0x7f64680ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.597+0000 7f646f0d7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f64680adee0 0x7f64680b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.597+0000 7f646f0d7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646806c5a0 con 0x7f64680b0710 2023-10-19T08:38:49.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.597+0000 7f646f0d7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6468160cb0 con 0x7f64680adee0 2023-10-19T08:38:49.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.597+0000 7f646f0d7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f646806bd40 con 0x7f64680d14f0 2023-10-19T08:38:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.598+0000 7f646d674700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f64680adee0 0x7f64680b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.598+0000 7f646d674700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f64680adee0 0x7f64680b1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47354/0 (socket says 172.21.15.79:47354) 2023-10-19T08:38:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.598+0000 7f646d674700 1 -- 172.21.15.79:0/1126091884 learned_addr learned my addr 172.21.15.79:0/1126091884 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.598+0000 7f6467fff700 1 --2- 172.21.15.79:0/1126091884 >> v2:172.21.15.89:3300/0 conn(0x7f64680d14f0 0x7f64680ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.598+0000 7f646d674700 1 -- 172.21.15.79:0/1126091884 >> v2:172.21.15.89:3300/0 conn(0x7f64680d14f0 msgr2=0x7f64680ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.598+0000 7f646d674700 1 --2- 172.21.15.79:0/1126091884 >> v2:172.21.15.89:3300/0 conn(0x7f64680d14f0 0x7f64680ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.598+0000 7f646d674700 1 -- 172.21.15.79:0/1126091884 >> v1:172.21.15.89:6789/0 conn(0x7f64680b0710 legacy=0x7f64680b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.598+0000 7f646d674700 1 -- 172.21.15.79:0/1126091884 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646806bfe0 con 0x7f64680adee0 2023-10-19T08:38:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.598+0000 7f646d674700 1 --2- 172.21.15.79:0/1126091884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64680adee0 0x7f64680b1d50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f64680726d0 tx=0x7f646000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f655d44520961ef server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.598+0000 7f64677fe700 1 -- 172.21.15.79:0/1126091884 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646000e070 con 0x7f64680adee0 2023-10-19T08:38:49.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.598+0000 7f64677fe700 1 -- 172.21.15.79:0/1126091884 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646000b9c0 con 0x7f64680adee0 2023-10-19T08:38:49.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.598+0000 7f64677fe700 1 -- 172.21.15.79:0/1126091884 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646000bd70 con 0x7f64680adee0 2023-10-19T08:38:49.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.599+0000 7f646f0d7700 1 -- 172.21.15.79:0/1126091884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64680adee0 msgr2=0x7f64680b1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:49.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.599+0000 7f646f0d7700 1 --2- 172.21.15.79:0/1126091884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64680adee0 0x7f64680b1d50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f64680726d0 tx=0x7f646000b330 comp rx=0 tx=0).stop 2023-10-19T08:38:49.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.599+0000 7f646f0d7700 1 -- 172.21.15.79:0/1126091884 shutdown_connections 2023-10-19T08:38:49.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.599+0000 7f646f0d7700 1 --2- 172.21.15.79:0/1126091884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64680adee0 0x7f64680b1d50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.599+0000 7f646f0d7700 1 --2- 172.21.15.79:0/1126091884 >> v2:172.21.15.89:3300/0 conn(0x7f64680d14f0 0x7f64680ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.599+0000 7f646f0d7700 1 -- 172.21.15.79:0/1126091884 >> 172.21.15.79:0/1126091884 conn(0x7f646809a0b0 msgr2=0x7f64680d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:49.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.599+0000 7f646f0d7700 1 -- 172.21.15.79:0/1126091884 shutdown_connections 2023-10-19T08:38:49.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.599+0000 7f646f0d7700 1 -- 172.21.15.79:0/1126091884 wait complete. 2023-10-19T08:38:49.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.600+0000 7f646f0d7700 1 Processor -- start 2023-10-19T08:38:49.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.600+0000 7f646f0d7700 1 -- start start 2023-10-19T08:38:49.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.601+0000 7f646f0d7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64680adee0 0x7f6468160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.601+0000 7f646f0d7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64680b0710 0x7f646815e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.601+0000 7f646f0d7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64680d14f0 0x7f646815ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.601+0000 7f646f0d7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646815c090 con 0x7f64680adee0 2023-10-19T08:38:49.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.601+0000 7f646f0d7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64681609d0 con 0x7f64680d14f0 2023-10-19T08:38:49.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.601+0000 7f646f0d7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646815a3a0 con 0x7f64680b0710 2023-10-19T08:38:49.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.601+0000 7f646ce73700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64680adee0 0x7f6468160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.601+0000 7f646ce73700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64680adee0 0x7f6468160490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47356/0 (socket says 172.21.15.79:47356) 2023-10-19T08:38:49.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.601+0000 7f646ce73700 1 -- 172.21.15.79:0/3214680275 learned_addr learned my addr 172.21.15.79:0/3214680275 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:49.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.601+0000 7f646d674700 1 --2- 172.21.15.79:0/3214680275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64680d14f0 0x7f646815ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.601+0000 7f6467fff700 1 --2- 172.21.15.79:0/3214680275 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64680b0710 0x7f646815e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.601+0000 7f646ce73700 1 -- 172.21.15.79:0/3214680275 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64680b0710 msgr2=0x7f646815e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:49.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.601+0000 7f646ce73700 1 --2- 172.21.15.79:0/3214680275 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64680b0710 0x7f646815e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.601+0000 7f646ce73700 1 -- 172.21.15.79:0/3214680275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64680d14f0 msgr2=0x7f646815ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:49.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.601+0000 7f646ce73700 1 --2- 172.21.15.79:0/3214680275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64680d14f0 0x7f646815ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.601+0000 7f646ce73700 1 -- 172.21.15.79:0/3214680275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6460009b30 con 0x7f64680adee0 2023-10-19T08:38:49.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.601+0000 7f646d674700 1 --2- 172.21.15.79:0/3214680275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64680d14f0 0x7f646815ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:49.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.601+0000 7f646ce73700 1 --2- 172.21.15.79:0/3214680275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64680adee0 0x7f6468160490 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f645c00c4e0 tx=0x7f645c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:49.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.602+0000 7f64657fa700 1 -- 172.21.15.79:0/3214680275 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c0052d0 con 0x7f64680adee0 2023-10-19T08:38:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.602+0000 7f64657fa700 1 -- 172.21.15.79:0/3214680275 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c005430 con 0x7f64680adee0 2023-10-19T08:38:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.602+0000 7f646f0d7700 1 -- 172.21.15.79:0/3214680275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646815a680 con 0x7f64680adee0 2023-10-19T08:38:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.602+0000 7f64657fa700 1 -- 172.21.15.79:0/3214680275 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c0038c0 con 0x7f64680adee0 2023-10-19T08:38:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.602+0000 7f646f0d7700 1 -- 172.21.15.79:0/3214680275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646815bcb0 con 0x7f64680adee0 2023-10-19T08:38:49.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.603+0000 7f646f0d7700 1 -- 172.21.15.79:0/3214680275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646804ee70 con 0x7f64680adee0 2023-10-19T08:38:49.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.603+0000 7f64657fa700 1 -- 172.21.15.79:0/3214680275 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f645c003a20 con 0x7f64680adee0 2023-10-19T08:38:49.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.603+0000 7f64657fa700 1 --2- 172.21.15.79:0/3214680275 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f644c06a0b0 0x7f644c06c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.603+0000 7f64657fa700 1 -- 172.21.15.79:0/3214680275 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f645c087d70 con 0x7f64680adee0 2023-10-19T08:38:49.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.603+0000 7f6467fff700 1 --2- 172.21.15.79:0/3214680275 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f644c06a0b0 0x7f644c06c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.604+0000 7f6467fff700 1 --2- 172.21.15.79:0/3214680275 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f644c06a0b0 0x7f644c06c570 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f64680d0940 tx=0x7f6454008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:49.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.608+0000 7f64657fa700 1 -- 172.21.15.79:0/3214680275 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f645c053130 con 0x7f64680adee0 2023-10-19T08:38:49.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.798+0000 7f646f0d7700 1 -- 172.21.15.79:0/3214680275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64680d01a0 con 0x7f64680adee0 2023-10-19T08:38:49.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.798+0000 7f64657fa700 1 -- 172.21.15.79:0/3214680275 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f645c056750 con 0x7f64680adee0 2023-10-19T08:38:49.803 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:49.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.800+0000 7f646f0d7700 1 -- 172.21.15.79:0/3214680275 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f644c06a0b0 msgr2=0x7f644c06c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:49.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.800+0000 7f646f0d7700 1 --2- 172.21.15.79:0/3214680275 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f644c06a0b0 0x7f644c06c570 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f64680d0940 tx=0x7f6454008040 comp rx=0 tx=0).stop 2023-10-19T08:38:49.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.800+0000 7f646f0d7700 1 -- 172.21.15.79:0/3214680275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64680adee0 msgr2=0x7f6468160490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:49.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.800+0000 7f646f0d7700 1 --2- 172.21.15.79:0/3214680275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64680adee0 0x7f6468160490 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f645c00c4e0 tx=0x7f645c00c8a0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.800+0000 7f646f0d7700 1 -- 172.21.15.79:0/3214680275 shutdown_connections 2023-10-19T08:38:49.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.800+0000 7f646f0d7700 1 --2- 172.21.15.79:0/3214680275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64680d14f0 0x7f646815ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.800+0000 7f646f0d7700 1 --2- 172.21.15.79:0/3214680275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64680adee0 0x7f6468160490 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.800+0000 7f646f0d7700 1 --2- 172.21.15.79:0/3214680275 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f644c06a0b0 0x7f644c06c570 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.800+0000 7f646f0d7700 1 --2- 172.21.15.79:0/3214680275 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f64680b0710 0x7f646815e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.800+0000 7f646f0d7700 1 -- 172.21.15.79:0/3214680275 >> 172.21.15.79:0/3214680275 conn(0x7f646809a0b0 msgr2=0x7f64680ae2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:49.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.800+0000 7f646f0d7700 1 -- 172.21.15.79:0/3214680275 shutdown_connections 2023-10-19T08:38:49.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.800+0000 7f646f0d7700 1 -- 172.21.15.79:0/3214680275 wait complete. 2023-10-19T08:38:49.817 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T08:38:49.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.936+0000 7f6f6e815700 1 Processor -- start 2023-10-19T08:38:49.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.936+0000 7f6f6e815700 1 -- start start 2023-10-19T08:38:49.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.936+0000 7f6f6e815700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f680cd270 0x7f6f6806a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.936+0000 7f6f6e815700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6f680703b0 0x7f6f6806a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.936+0000 7f6f6e815700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6f6806f910 0x7f6f68160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.936+0000 7f6f6e815700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f68160a80 con 0x7f6f6806f910 2023-10-19T08:38:49.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.936+0000 7f6f6e815700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f680b1fe0 con 0x7f6f680703b0 2023-10-19T08:38:49.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.936+0000 7f6f6e815700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680ce2b0 con 0x7f6f680cd270 2023-10-19T08:38:49.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.937+0000 7f6f6cdb2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6f6806f910 0x7f6f68160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.937+0000 7f6f6cdb2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6f6806f910 0x7f6f68160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47368/0 (socket says 172.21.15.79:47368) 2023-10-19T08:38:49.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.937+0000 7f6f6cdb2700 1 -- 172.21.15.79:0/2167931985 learned_addr learned my addr 172.21.15.79:0/2167931985 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:49.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.937+0000 7f6f677fe700 1 --2- 172.21.15.79:0/2167931985 >> v2:172.21.15.89:3300/0 conn(0x7f6f680703b0 0x7f6f6806a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.937+0000 7f6f67fff700 1 --2- 172.21.15.79:0/2167931985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f680cd270 0x7f6f6806a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.937+0000 7f6f6cdb2700 1 -- 172.21.15.79:0/2167931985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f680cd270 msgr2=0x7f6f6806a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:49.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.937+0000 7f6f6cdb2700 1 --2- 172.21.15.79:0/2167931985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f680cd270 0x7f6f6806a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.937+0000 7f6f6cdb2700 1 -- 172.21.15.79:0/2167931985 >> v2:172.21.15.89:3300/0 conn(0x7f6f680703b0 msgr2=0x7f6f6806a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:49.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.937+0000 7f6f6cdb2700 1 --2- 172.21.15.79:0/2167931985 >> v2:172.21.15.89:3300/0 conn(0x7f6f680703b0 0x7f6f6806a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.937+0000 7f6f6cdb2700 1 -- 172.21.15.79:0/2167931985 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f680ce550 con 0x7f6f6806f910 2023-10-19T08:38:49.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.937+0000 7f6f677fe700 1 --2- 172.21.15.79:0/2167931985 >> v2:172.21.15.89:3300/0 conn(0x7f6f680703b0 0x7f6f6806a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:49.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.937+0000 7f6f67fff700 1 --2- 172.21.15.79:0/2167931985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f680cd270 0x7f6f6806a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:49.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.937+0000 7f6f6cdb2700 1 --2- 172.21.15.79:0/2167931985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f6806f910 0x7f6f68160c70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6f68071810 tx=0x7f6f6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724246c2f15ffad0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:49.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.937+0000 7f6f66ffd700 1 -- 172.21.15.79:0/2167931985 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6000e070 con 0x7f6f6806f910 2023-10-19T08:38:49.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.937+0000 7f6f66ffd700 1 -- 172.21.15.79:0/2167931985 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6000b9c0 con 0x7f6f6806f910 2023-10-19T08:38:49.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.937+0000 7f6f66ffd700 1 -- 172.21.15.79:0/2167931985 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6000bd70 con 0x7f6f6806f910 2023-10-19T08:38:49.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.938+0000 7f6f6e815700 1 -- 172.21.15.79:0/2167931985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f6806f910 msgr2=0x7f6f68160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:49.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.938+0000 7f6f6e815700 1 --2- 172.21.15.79:0/2167931985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f6806f910 0x7f6f68160c70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6f68071810 tx=0x7f6f6000b330 comp rx=0 tx=0).stop 2023-10-19T08:38:49.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.938+0000 7f6f6e815700 1 -- 172.21.15.79:0/2167931985 shutdown_connections 2023-10-19T08:38:49.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.938+0000 7f6f6e815700 1 --2- 172.21.15.79:0/2167931985 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f680cd270 0x7f6f6806a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.938+0000 7f6f6e815700 1 --2- 172.21.15.79:0/2167931985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f6806f910 0x7f6f68160c70 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.938+0000 7f6f6e815700 1 --2- 172.21.15.79:0/2167931985 >> v2:172.21.15.89:3300/0 conn(0x7f6f680703b0 0x7f6f6806a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.938+0000 7f6f6e815700 1 -- 172.21.15.79:0/2167931985 >> 172.21.15.79:0/2167931985 conn(0x7f6f6806dcc0 msgr2=0x7f6f6806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:49.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.938+0000 7f6f6e815700 1 -- 172.21.15.79:0/2167931985 shutdown_connections 2023-10-19T08:38:49.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.938+0000 7f6f6e815700 1 -- 172.21.15.79:0/2167931985 wait complete. 2023-10-19T08:38:49.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.939+0000 7f6f6e815700 1 Processor -- start 2023-10-19T08:38:49.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.939+0000 7f6f6e815700 1 -- start start 2023-10-19T08:38:49.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.940+0000 7f6f6e815700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6806f910 0x7f6f68158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.940+0000 7f6f6e815700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f680703b0 0x7f6f680ae400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.940+0000 7f6f6e815700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f680cd270 0x7f6f680ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.940+0000 7f6f6e815700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680c5120 con 0x7f6f680cd270 2023-10-19T08:38:49.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.940+0000 7f6f6e815700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680c53d0 con 0x7f6f6806f910 2023-10-19T08:38:49.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.940+0000 7f6f6e815700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680c56b0 con 0x7f6f680703b0 2023-10-19T08:38:49.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.940+0000 7f6f6cdb2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f680cd270 0x7f6f680ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.940+0000 7f6f6cdb2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f680cd270 0x7f6f680ac1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47374/0 (socket says 172.21.15.79:47374) 2023-10-19T08:38:49.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.940+0000 7f6f6cdb2700 1 -- 172.21.15.79:0/3771039214 learned_addr learned my addr 172.21.15.79:0/3771039214 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:49.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.940+0000 7f6f677fe700 1 --2- 172.21.15.79:0/3771039214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f680703b0 0x7f6f680ae400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.941+0000 7f6f6cdb2700 1 -- 172.21.15.79:0/3771039214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f680703b0 msgr2=0x7f6f680ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:49.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.941+0000 7f6f6cdb2700 1 --2- 172.21.15.79:0/3771039214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f680703b0 0x7f6f680ae400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.941+0000 7f6f6cdb2700 1 -- 172.21.15.79:0/3771039214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6806f910 msgr2=0x7f6f68158770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:49.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.941+0000 7f6f67fff700 1 --2- 172.21.15.79:0/3771039214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6806f910 0x7f6f68158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.941+0000 7f6f6cdb2700 1 --2- 172.21.15.79:0/3771039214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6806f910 0x7f6f68158770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:49.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.941+0000 7f6f6cdb2700 1 -- 172.21.15.79:0/3771039214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f60009b30 con 0x7f6f680cd270 2023-10-19T08:38:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.941+0000 7f6f67fff700 1 --2- 172.21.15.79:0/3771039214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6806f910 0x7f6f68158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.941+0000 7f6f6cdb2700 1 --2- 172.21.15.79:0/3771039214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f680cd270 0x7f6f680ac1d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000b370 tx=0x7f6f60004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.941+0000 7f6f64ff9700 1 -- 172.21.15.79:0/3771039214 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f60004310 con 0x7f6f680cd270 2023-10-19T08:38:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.941+0000 7f6f64ff9700 1 -- 172.21.15.79:0/3771039214 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f60004470 con 0x7f6f680cd270 2023-10-19T08:38:49.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.941+0000 7f6f6e815700 1 -- 172.21.15.79:0/3771039214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f680c5990 con 0x7f6f680cd270 2023-10-19T08:38:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.941+0000 7f6f64ff9700 1 -- 172.21.15.79:0/3771039214 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f60004820 con 0x7f6f680cd270 2023-10-19T08:38:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.941+0000 7f6f6e815700 1 -- 172.21.15.79:0/3771039214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6815ec40 con 0x7f6f680cd270 2023-10-19T08:38:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.942+0000 7f6f6e815700 1 -- 172.21.15.79:0/3771039214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f680c5eb0 con 0x7f6f680cd270 2023-10-19T08:38:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.942+0000 7f6f64ff9700 1 -- 172.21.15.79:0/3771039214 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6f6001b430 con 0x7f6f680cd270 2023-10-19T08:38:49.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.943+0000 7f6f64ff9700 1 --2- 172.21.15.79:0/3771039214 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6f5406a0e0 0x7f6f5406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.943+0000 7f6f64ff9700 1 -- 172.21.15.79:0/3771039214 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6f60089a50 con 0x7f6f680cd270 2023-10-19T08:38:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.943+0000 7f6f67fff700 1 --2- 172.21.15.79:0/3771039214 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6f5406a0e0 0x7f6f5406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.943+0000 7f6f67fff700 1 --2- 172.21.15.79:0/3771039214 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6f5406a0e0 0x7f6f5406c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6f580089b0 tx=0x7f6f58008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:49.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:49.947+0000 7f6f64ff9700 1 -- 172.21.15.79:0/3771039214 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6f60054ea0 con 0x7f6f680cd270 2023-10-19T08:38:50.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.136+0000 7f6f6e815700 1 -- 172.21.15.79:0/3771039214 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f6804ee70 con 0x7f6f680cd270 2023-10-19T08:38:50.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.137+0000 7f6f64ff9700 1 -- 172.21.15.79:0/3771039214 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6f6001f020 con 0x7f6f680cd270 2023-10-19T08:38:50.142 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-19T08:38:50.143 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.138+0000 7f6f6e815700 1 -- 172.21.15.79:0/3771039214 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6f5406a0e0 msgr2=0x7f6f5406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:50.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.138+0000 7f6f6e815700 1 --2- 172.21.15.79:0/3771039214 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6f5406a0e0 0x7f6f5406c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6f580089b0 tx=0x7f6f58008040 comp rx=0 tx=0).stop 2023-10-19T08:38:50.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.138+0000 7f6f6e815700 1 -- 172.21.15.79:0/3771039214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f680cd270 msgr2=0x7f6f680ac1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:50.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.138+0000 7f6f6e815700 1 --2- 172.21.15.79:0/3771039214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f680cd270 0x7f6f680ac1d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6f6000b370 tx=0x7f6f60004ad0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.139+0000 7f6f6e815700 1 -- 172.21.15.79:0/3771039214 shutdown_connections 2023-10-19T08:38:50.144 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.139+0000 7f6f6e815700 1 --2- 172.21.15.79:0/3771039214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f680cd270 0x7f6f680ac1d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.139+0000 7f6f6e815700 1 --2- 172.21.15.79:0/3771039214 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6806f910 0x7f6f68158770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.139+0000 7f6f6e815700 1 --2- 172.21.15.79:0/3771039214 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6f5406a0e0 0x7f6f5406c5a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.139+0000 7f6f6e815700 1 --2- 172.21.15.79:0/3771039214 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f680703b0 0x7f6f680ae400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.139+0000 7f6f6e815700 1 -- 172.21.15.79:0/3771039214 >> 172.21.15.79:0/3771039214 conn(0x7f6f6806dcc0 msgr2=0x7f6f6806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:50.145 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.139+0000 7f6f6e815700 1 -- 172.21.15.79:0/3771039214 shutdown_connections 2023-10-19T08:38:50.146 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.139+0000 7f6f6e815700 1 -- 172.21.15.79:0/3771039214 wait complete. 2023-10-19T08:38:50.155 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T08:38:50.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.274+0000 7ff17fed5700 1 Processor -- start 2023-10-19T08:38:50.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.274+0000 7ff17fed5700 1 -- start start 2023-10-19T08:38:50.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.275+0000 7ff17fed5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff1780cc640 0x7ff1780cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:50.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.275+0000 7ff17fed5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff178159db0 0x7ff1780b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:50.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.275+0000 7ff17fed5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff17806fdc0 0x7ff1780b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:50.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.275+0000 7ff17fed5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1780ccf60 con 0x7ff17806fdc0 2023-10-19T08:38:50.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.275+0000 7ff17fed5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff17815d760 con 0x7ff1780cc640 2023-10-19T08:38:50.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.275+0000 7ff17fed5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17815da40 con 0x7ff178159db0 2023-10-19T08:38:50.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.275+0000 7ff17e472700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff17806fdc0 0x7ff1780b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:50.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.275+0000 7ff17e472700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff17806fdc0 0x7ff1780b1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47382/0 (socket says 172.21.15.79:47382) 2023-10-19T08:38:50.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.275+0000 7ff17e472700 1 -- 172.21.15.79:0/1838714984 learned_addr learned my addr 172.21.15.79:0/1838714984 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:50.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.275+0000 7ff17dc71700 1 --2- 172.21.15.79:0/1838714984 >> v2:172.21.15.89:3300/0 conn(0x7ff1780cc640 0x7ff1780cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:50.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.275+0000 7ff17d470700 1 --2- 172.21.15.79:0/1838714984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff178159db0 0x7ff1780b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:50.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.276+0000 7ff17e472700 1 -- 172.21.15.79:0/1838714984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff178159db0 msgr2=0x7ff1780b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:50.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.276+0000 7ff17e472700 1 --2- 172.21.15.79:0/1838714984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff178159db0 0x7ff1780b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.276+0000 7ff17e472700 1 -- 172.21.15.79:0/1838714984 >> v2:172.21.15.89:3300/0 conn(0x7ff1780cc640 msgr2=0x7ff1780cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:50.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.276+0000 7ff17e472700 1 --2- 172.21.15.79:0/1838714984 >> v2:172.21.15.89:3300/0 conn(0x7ff1780cc640 0x7ff1780cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.276+0000 7ff17e472700 1 -- 172.21.15.79:0/1838714984 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17815dd20 con 0x7ff17806fdc0 2023-10-19T08:38:50.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.276+0000 7ff17e472700 1 --2- 172.21.15.79:0/1838714984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff17806fdc0 0x7ff1780b1bf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff1780cd300 tx=0x7ff17000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae9d7c9d107dd5f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:50.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.276+0000 7ff17cc6f700 1 -- 172.21.15.79:0/1838714984 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17000e070 con 0x7ff17806fdc0 2023-10-19T08:38:50.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.276+0000 7ff17cc6f700 1 -- 172.21.15.79:0/1838714984 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17000b9c0 con 0x7ff17806fdc0 2023-10-19T08:38:50.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.276+0000 7ff17cc6f700 1 -- 172.21.15.79:0/1838714984 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17000bd70 con 0x7ff17806fdc0 2023-10-19T08:38:50.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.276+0000 7ff17fed5700 1 -- 172.21.15.79:0/1838714984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff17806fdc0 msgr2=0x7ff1780b1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:50.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.276+0000 7ff17fed5700 1 --2- 172.21.15.79:0/1838714984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff17806fdc0 0x7ff1780b1bf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff1780cd300 tx=0x7ff17000b330 comp rx=0 tx=0).stop 2023-10-19T08:38:50.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.276+0000 7ff17fed5700 1 -- 172.21.15.79:0/1838714984 shutdown_connections 2023-10-19T08:38:50.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.276+0000 7ff17fed5700 1 --2- 172.21.15.79:0/1838714984 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff17806fdc0 0x7ff1780b1bf0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.276+0000 7ff17fed5700 1 --2- 172.21.15.79:0/1838714984 >> v2:172.21.15.89:3300/0 conn(0x7ff1780cc640 0x7ff1780cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.276+0000 7ff17fed5700 1 --2- 172.21.15.79:0/1838714984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff178159db0 0x7ff1780b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.276+0000 7ff17fed5700 1 -- 172.21.15.79:0/1838714984 >> 172.21.15.79:0/1838714984 conn(0x7ff17806dcc0 msgr2=0x7ff17806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:50.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.277+0000 7ff17fed5700 1 -- 172.21.15.79:0/1838714984 shutdown_connections 2023-10-19T08:38:50.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.277+0000 7ff17fed5700 1 -- 172.21.15.79:0/1838714984 wait complete. 2023-10-19T08:38:50.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.278+0000 7ff17fed5700 1 Processor -- start 2023-10-19T08:38:50.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.278+0000 7ff17fed5700 1 -- start start 2023-10-19T08:38:50.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.278+0000 7ff17fed5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff17806fdc0 0x7ff178154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:50.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.278+0000 7ff17fed5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1780cc640 0x7ff1780b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:50.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.278+0000 7ff17fed5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff178159db0 0x7ff1780b6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:50.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.278+0000 7ff17fed5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1780c5750 con 0x7ff17806fdc0 2023-10-19T08:38:50.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.278+0000 7ff17fed5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1780c5a30 con 0x7ff1780cc640 2023-10-19T08:38:50.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.278+0000 7ff17fed5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1780c5d10 con 0x7ff178159db0 2023-10-19T08:38:50.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.278+0000 7ff17dc71700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff17806fdc0 0x7ff178154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:50.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.279+0000 7ff17dc71700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff17806fdc0 0x7ff178154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47384/0 (socket says 172.21.15.79:47384) 2023-10-19T08:38:50.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.279+0000 7ff17dc71700 1 -- 172.21.15.79:0/2907912213 learned_addr learned my addr 172.21.15.79:0/2907912213 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:50.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.279+0000 7ff17e472700 1 --2- 172.21.15.79:0/2907912213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff178159db0 0x7ff1780b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:50.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.279+0000 7ff17d470700 1 --2- 172.21.15.79:0/2907912213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1780cc640 0x7ff1780b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:50.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.279+0000 7ff17dc71700 1 -- 172.21.15.79:0/2907912213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff178159db0 msgr2=0x7ff1780b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:50.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.279+0000 7ff17dc71700 1 --2- 172.21.15.79:0/2907912213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff178159db0 0x7ff1780b6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.279+0000 7ff17dc71700 1 -- 172.21.15.79:0/2907912213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1780cc640 msgr2=0x7ff1780b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:50.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.279+0000 7ff17dc71700 1 --2- 172.21.15.79:0/2907912213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1780cc640 0x7ff1780b6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.279+0000 7ff17dc71700 1 -- 172.21.15.79:0/2907912213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff170009b30 con 0x7ff17806fdc0 2023-10-19T08:38:50.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.279+0000 7ff17dc71700 1 --2- 172.21.15.79:0/2907912213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff17806fdc0 0x7ff178154ff0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff16800d800 tx=0x7ff16800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:50.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.279+0000 7ff16e7fc700 1 -- 172.21.15.79:0/2907912213 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1680125f0 con 0x7ff17806fdc0 2023-10-19T08:38:50.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.279+0000 7ff16e7fc700 1 -- 172.21.15.79:0/2907912213 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff168012750 con 0x7ff17806fdc0 2023-10-19T08:38:50.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.279+0000 7ff17fed5700 1 -- 172.21.15.79:0/2907912213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1780c5ff0 con 0x7ff17806fdc0 2023-10-19T08:38:50.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.279+0000 7ff16e7fc700 1 -- 172.21.15.79:0/2907912213 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff168012ae0 con 0x7ff17806fdc0 2023-10-19T08:38:50.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.279+0000 7ff17fed5700 1 -- 172.21.15.79:0/2907912213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff178155530 con 0x7ff17806fdc0 2023-10-19T08:38:50.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.280+0000 7ff17fed5700 1 -- 172.21.15.79:0/2907912213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1781f0990 con 0x7ff17806fdc0 2023-10-19T08:38:50.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.280+0000 7ff16e7fc700 1 -- 172.21.15.79:0/2907912213 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff168012c40 con 0x7ff17806fdc0 2023-10-19T08:38:50.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.281+0000 7ff16e7fc700 1 --2- 172.21.15.79:0/2907912213 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff15c06a0e0 0x7ff15c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:50.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.281+0000 7ff17d470700 1 --2- 172.21.15.79:0/2907912213 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff15c06a0e0 0x7ff15c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:50.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.281+0000 7ff16e7fc700 1 -- 172.21.15.79:0/2907912213 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff168088810 con 0x7ff17806fdc0 2023-10-19T08:38:50.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.281+0000 7ff17d470700 1 --2- 172.21.15.79:0/2907912213 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff15c06a0e0 0x7ff15c06c5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff1780c2f70 tx=0x7ff174008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:50.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.285+0000 7ff16e7fc700 1 -- 172.21.15.79:0/2907912213 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ff168053c70 con 0x7ff17806fdc0 2023-10-19T08:38:50.479 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.475+0000 7ff17fed5700 1 -- 172.21.15.79:0/2907912213 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff17804ee70 con 0x7ff17806fdc0 2023-10-19T08:38:50.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.475+0000 7ff16e7fc700 1 -- 172.21.15.79:0/2907912213 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff168057290 con 0x7ff17806fdc0 2023-10-19T08:38:50.480 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:50.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.477+0000 7ff17fed5700 1 -- 172.21.15.79:0/2907912213 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff15c06a0e0 msgr2=0x7ff15c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:50.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.478+0000 7ff17fed5700 1 --2- 172.21.15.79:0/2907912213 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff15c06a0e0 0x7ff15c06c5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff1780c2f70 tx=0x7ff174008040 comp rx=0 tx=0).stop 2023-10-19T08:38:50.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.478+0000 7ff17fed5700 1 -- 172.21.15.79:0/2907912213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff17806fdc0 msgr2=0x7ff178154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:50.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.478+0000 7ff17fed5700 1 --2- 172.21.15.79:0/2907912213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff17806fdc0 0x7ff178154ff0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff16800d800 tx=0x7ff16800db10 comp rx=0 tx=0).stop 2023-10-19T08:38:50.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.478+0000 7ff17fed5700 1 -- 172.21.15.79:0/2907912213 shutdown_connections 2023-10-19T08:38:50.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.478+0000 7ff17fed5700 1 --2- 172.21.15.79:0/2907912213 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff15c06a0e0 0x7ff15c06c5a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.478+0000 7ff17fed5700 1 --2- 172.21.15.79:0/2907912213 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff178159db0 0x7ff1780b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.478+0000 7ff17fed5700 1 --2- 172.21.15.79:0/2907912213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff17806fdc0 0x7ff178154ff0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.478+0000 7ff17fed5700 1 --2- 172.21.15.79:0/2907912213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff1780cc640 0x7ff1780b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.478+0000 7ff17fed5700 1 -- 172.21.15.79:0/2907912213 >> 172.21.15.79:0/2907912213 conn(0x7ff17806dcc0 msgr2=0x7ff1780c8690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:50.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.478+0000 7ff17fed5700 1 -- 172.21.15.79:0/2907912213 shutdown_connections 2023-10-19T08:38:50.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.478+0000 7ff17fed5700 1 -- 172.21.15.79:0/2907912213 wait complete. 2023-10-19T08:38:50.533 INFO:tasks.cephfs_test_runner:Starting test: test_network_death (tasks.cephfs.test_client_recovery.TestClientNetworkRecovery) Simulate software freeze or temporary network failure. 2023-10-19T08:38:50.534 INFO:tasks.cephfs_test_runner:test_network_death (tasks.cephfs.test_client_recovery.TestClientNetworkRecovery) 2023-10-19T08:38:50.535 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death' 2023-10-19T08:38:50.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.652+0000 7f098ab09700 1 Processor -- start 2023-10-19T08:38:50.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.652+0000 7f098ab09700 1 -- start start 2023-10-19T08:38:50.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.653+0000 7f098ab09700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0984159f40 0x7f098415e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:50.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.653+0000 7f098ab09700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f09840b5610 0x7f09840cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:50.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.653+0000 7f098ab09700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09840cc870 con 0x7f09840ce5c0 2023-10-19T08:38:50.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.653+0000 7f098ab09700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098415e870 con 0x7f0984159f40 2023-10-19T08:38:50.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.653+0000 7f098ab09700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09840b5aa0 con 0x7f09840b5610 2023-10-19T08:38:50.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.653+0000 7f09888a5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0984159f40 0x7f098415e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:50.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.653+0000 7f09888a5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0984159f40 0x7f098415e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47390/0 (socket says 172.21.15.79:47390) 2023-10-19T08:38:50.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.653+0000 7f09888a5700 1 -- 172.21.15.79:0/3773871685 learned_addr learned my addr 172.21.15.79:0/3773871685 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:50.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.654+0000 7f09888a5700 1 -- 172.21.15.79:0/3773871685 >> v2:172.21.15.89:3300/0 conn(0x7f09840b5610 msgr2=0x7f09840cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:50.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.654+0000 7f09888a5700 1 --2- 172.21.15.79:0/3773871685 >> v2:172.21.15.89:3300/0 conn(0x7f09840b5610 0x7f09840cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.654+0000 7f09888a5700 1 -- 172.21.15.79:0/3773871685 >> v1:172.21.15.89:6789/0 conn(0x7f09840ce5c0 legacy=0x7f09840b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:50.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.654+0000 7f09888a5700 1 -- 172.21.15.79:0/3773871685 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09840cd800 con 0x7f0984159f40 2023-10-19T08:38:50.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.654+0000 7f09888a5700 1 --2- 172.21.15.79:0/3773871685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0984159f40 0x7f098415e330 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0984071c50 tx=0x7f0978009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47393520dcef61d server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:50.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.654+0000 7f09837fe700 1 -- 172.21.15.79:0/3773871685 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978004230 con 0x7f0984159f40 2023-10-19T08:38:50.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.654+0000 7f09837fe700 1 -- 172.21.15.79:0/3773871685 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0978004390 con 0x7f0984159f40 2023-10-19T08:38:50.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.654+0000 7f09837fe700 1 -- 172.21.15.79:0/3773871685 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09780036a0 con 0x7f0984159f40 2023-10-19T08:38:50.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.654+0000 7f098ab09700 1 -- 172.21.15.79:0/3773871685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0984159f40 msgr2=0x7f098415e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:50.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.654+0000 7f098ab09700 1 --2- 172.21.15.79:0/3773871685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0984159f40 0x7f098415e330 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0984071c50 tx=0x7f0978009bd0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.655+0000 7f098ab09700 1 -- 172.21.15.79:0/3773871685 shutdown_connections 2023-10-19T08:38:50.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.655+0000 7f098ab09700 1 --2- 172.21.15.79:0/3773871685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0984159f40 0x7f098415e330 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.655+0000 7f098ab09700 1 --2- 172.21.15.79:0/3773871685 >> v2:172.21.15.89:3300/0 conn(0x7f09840b5610 0x7f09840cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.655+0000 7f098ab09700 1 -- 172.21.15.79:0/3773871685 >> 172.21.15.79:0/3773871685 conn(0x7f098406dcc0 msgr2=0x7f098406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:50.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.655+0000 7f098ab09700 1 -- 172.21.15.79:0/3773871685 shutdown_connections 2023-10-19T08:38:50.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.655+0000 7f098ab09700 1 -- 172.21.15.79:0/3773871685 wait complete. 2023-10-19T08:38:50.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.656+0000 7f098ab09700 1 Processor -- start 2023-10-19T08:38:50.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.656+0000 7f098ab09700 1 -- start start 2023-10-19T08:38:50.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f098ab09700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09840ce5c0 0x7f0984146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:50.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f098ab09700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0984159f40 0x7f09840c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f098ab09700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09840c9970 0x7f098414d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f098ab09700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09840c94e0 con 0x7f0984159f40 2023-10-19T08:38:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f098ab09700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09840c88d0 con 0x7f09840ce5c0 2023-10-19T08:38:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f098ab09700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09840c8bb0 con 0x7f09840c9970 2023-10-19T08:38:50.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f0983fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0984159f40 0x7f09840c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:50.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f0983fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0984159f40 0x7f09840c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47396/0 (socket says 172.21.15.79:47396) 2023-10-19T08:38:50.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f0983fff700 1 -- 172.21.15.79:0/3657852275 learned_addr learned my addr 172.21.15.79:0/3657852275 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:50.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f09888a5700 1 --2- 172.21.15.79:0/3657852275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09840ce5c0 0x7f0984146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:50.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f09890a6700 1 --2- 172.21.15.79:0/3657852275 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09840c9970 0x7f098414d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:50.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f0983fff700 1 -- 172.21.15.79:0/3657852275 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09840c9970 msgr2=0x7f098414d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:50.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f0983fff700 1 --2- 172.21.15.79:0/3657852275 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09840c9970 0x7f098414d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f0983fff700 1 -- 172.21.15.79:0/3657852275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09840ce5c0 msgr2=0x7f0984146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:50.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f0983fff700 1 --2- 172.21.15.79:0/3657852275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09840ce5c0 0x7f0984146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:50.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f0983fff700 1 -- 172.21.15.79:0/3657852275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0978009550 con 0x7f0984159f40 2023-10-19T08:38:50.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f0983fff700 1 --2- 172.21.15.79:0/3657852275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0984159f40 0x7f09840c7e80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f097000b530 tx=0x7f097000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:50.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f09817fa700 1 -- 172.21.15.79:0/3657852275 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970011830 con 0x7f0984159f40 2023-10-19T08:38:50.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f09817fa700 1 -- 172.21.15.79:0/3657852275 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09700119b0 con 0x7f0984159f40 2023-10-19T08:38:50.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f098ab09700 1 -- 172.21.15.79:0/3657852275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09840c8e90 con 0x7f0984159f40 2023-10-19T08:38:50.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f09817fa700 1 -- 172.21.15.79:0/3657852275 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970011d60 con 0x7f0984159f40 2023-10-19T08:38:50.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.657+0000 7f098ab09700 1 -- 172.21.15.79:0/3657852275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0984146b50 con 0x7f0984159f40 2023-10-19T08:38:50.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.658+0000 7f098ab09700 1 -- 172.21.15.79:0/3657852275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098406b150 con 0x7f0984159f40 2023-10-19T08:38:50.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.659+0000 7f09817fa700 1 -- 172.21.15.79:0/3657852275 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f097001a400 con 0x7f0984159f40 2023-10-19T08:38:50.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.659+0000 7f09817fa700 1 --2- 172.21.15.79:0/3657852275 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f096806a0e0 0x7f096806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:50.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.659+0000 7f09817fa700 1 -- 172.21.15.79:0/3657852275 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f09700888c0 con 0x7f0984159f40 2023-10-19T08:38:50.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.659+0000 7f09888a5700 1 --2- 172.21.15.79:0/3657852275 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f096806a0e0 0x7f096806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:50.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.660+0000 7f09888a5700 1 --2- 172.21.15.79:0/3657852275 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f096806a0e0 0x7f096806c5a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0978009130 tx=0x7f0978008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:50.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.663+0000 7f09817fa700 1 -- 172.21.15.79:0/3657852275 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f0970053d10 con 0x7f0984159f40 2023-10-19T08:38:50.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:50.928+0000 7f098ab09700 1 -- 172.21.15.79:0/3657852275 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death"]} v 0) v1 -- 0x7f098404ee70 con 0x7f0984159f40 2023-10-19T08:38:51.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.508+0000 7f09817fa700 1 -- 172.21.15.79:0/3657852275 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientNetworkRecovery.test_network_death"]}]=0 v64) v1 ==== 160+0+0 (secure 0 0 0) 0x7f0970057330 con 0x7f0984159f40 2023-10-19T08:38:51.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.510+0000 7f098ab09700 1 -- 172.21.15.79:0/3657852275 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f096806a0e0 msgr2=0x7f096806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:51.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.510+0000 7f098ab09700 1 --2- 172.21.15.79:0/3657852275 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f096806a0e0 0x7f096806c5a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0978009130 tx=0x7f0978008030 comp rx=0 tx=0).stop 2023-10-19T08:38:51.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.510+0000 7f098ab09700 1 -- 172.21.15.79:0/3657852275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0984159f40 msgr2=0x7f09840c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:51.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.510+0000 7f098ab09700 1 --2- 172.21.15.79:0/3657852275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0984159f40 0x7f09840c7e80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f097000b530 tx=0x7f097000b8f0 comp rx=0 tx=0).stop 2023-10-19T08:38:51.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.511+0000 7f098ab09700 1 -- 172.21.15.79:0/3657852275 shutdown_connections 2023-10-19T08:38:51.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.511+0000 7f098ab09700 1 --2- 172.21.15.79:0/3657852275 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f096806a0e0 0x7f096806c5a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:51.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.511+0000 7f098ab09700 1 --2- 172.21.15.79:0/3657852275 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f09840c9970 0x7f098414d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:51.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.511+0000 7f098ab09700 1 --2- 172.21.15.79:0/3657852275 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f09840ce5c0 0x7f0984146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:51.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.511+0000 7f098ab09700 1 --2- 172.21.15.79:0/3657852275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0984159f40 0x7f09840c7e80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:51.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.511+0000 7f098ab09700 1 -- 172.21.15.79:0/3657852275 >> 172.21.15.79:0/3657852275 conn(0x7f098406dcc0 msgr2=0x7f098406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:51.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.511+0000 7f098ab09700 1 -- 172.21.15.79:0/3657852275 shutdown_connections 2023-10-19T08:38:51.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.511+0000 7f098ab09700 1 -- 172.21.15.79:0/3657852275 wait complete. 2023-10-19T08:38:51.528 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:51.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.645+0000 7f533617b700 1 Processor -- start 2023-10-19T08:38:51.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.645+0000 7f533617b700 1 -- start start 2023-10-19T08:38:51.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.646+0000 7f533617b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f533015d8c0 0x7f533006a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:51.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.646+0000 7f533617b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53300cd550 con 0x7f53300af170 2023-10-19T08:38:51.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.646+0000 7f533617b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f533015de50 con 0x7f53300cd0c0 2023-10-19T08:38:51.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.646+0000 7f533617b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53300af550 con 0x7f533015d8c0 2023-10-19T08:38:51.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.646+0000 7f532f7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f53300af170 0x7f53300b1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57474/0 (socket says 172.21.15.79:57474) 2023-10-19T08:38:51.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.646+0000 7f532f7fe700 1 -- 172.21.15.79:0/316254519 learned_addr learned my addr 172.21.15.79:0/316254519 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:51.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.646+0000 7f532ffff700 1 --2- 172.21.15.79:0/316254519 >> v2:172.21.15.89:3300/0 conn(0x7f533015d8c0 0x7f533006a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:51.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.647+0000 7f532e7fc700 1 -- 172.21.15.79:0/316254519 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079286302 0 0) 0x7f5324001110 con 0x7f53300af170 2023-10-19T08:38:51.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.647+0000 7f532e7fc700 1 -- 172.21.15.79:0/316254519 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53180035b0 con 0x7f53300af170 2023-10-19T08:38:51.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.647+0000 7f532e7fc700 1 -- 172.21.15.79:0/316254519 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2518662765 0 0) 0x7f53180035b0 con 0x7f53300af170 2023-10-19T08:38:51.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.647+0000 7f532ffff700 1 -- 172.21.15.79:0/316254519 >> v1:172.21.15.89:6789/0 conn(0x7f53300cd0c0 legacy=0x7f53300cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:51.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.647+0000 7f532ffff700 1 -- 172.21.15.79:0/316254519 >> v1:172.21.15.79:6789/0 conn(0x7f53300af170 legacy=0x7f53300b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:51.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.647+0000 7f532ffff700 1 -- 172.21.15.79:0/316254519 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533015e130 con 0x7f533015d8c0 2023-10-19T08:38:51.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.647+0000 7f532ffff700 1 --2- 172.21.15.79:0/316254519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f533015d8c0 0x7f533006a220 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5328009dc0 tx=0x7f532800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12d50926f543ef3e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:51.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.647+0000 7f532e7fc700 1 -- 172.21.15.79:0/316254519 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532800e070 con 0x7f533015d8c0 2023-10-19T08:38:51.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.647+0000 7f532e7fc700 1 -- 172.21.15.79:0/316254519 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5328003a20 con 0x7f533015d8c0 2023-10-19T08:38:51.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.647+0000 7f532e7fc700 1 -- 172.21.15.79:0/316254519 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324001800 con 0x7f533015d8c0 2023-10-19T08:38:51.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.648+0000 7f533617b700 1 -- 172.21.15.79:0/316254519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f533015d8c0 msgr2=0x7f533006a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:51.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.648+0000 7f533617b700 1 --2- 172.21.15.79:0/316254519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f533015d8c0 0x7f533006a220 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5328009dc0 tx=0x7f532800b330 comp rx=0 tx=0).stop 2023-10-19T08:38:51.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.648+0000 7f533617b700 1 -- 172.21.15.79:0/316254519 shutdown_connections 2023-10-19T08:38:51.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.648+0000 7f533617b700 1 --2- 172.21.15.79:0/316254519 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f533015d8c0 0x7f533006a220 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:51.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.648+0000 7f533617b700 1 -- 172.21.15.79:0/316254519 >> 172.21.15.79:0/316254519 conn(0x7f533006dcc0 msgr2=0x7f533006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:51.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.648+0000 7f533617b700 1 -- 172.21.15.79:0/316254519 shutdown_connections 2023-10-19T08:38:51.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.648+0000 7f533617b700 1 -- 172.21.15.79:0/316254519 wait complete. 2023-10-19T08:38:51.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.649+0000 7f533617b700 1 Processor -- start 2023-10-19T08:38:51.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.649+0000 7f533617b700 1 -- start start 2023-10-19T08:38:51.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.650+0000 7f533617b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53300af170 0x7f533015af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:51.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.650+0000 7f533617b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53300cd0c0 0x7f5330158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:51.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.650+0000 7f533617b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f533015d8c0 0x7f53300c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:51.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.650+0000 7f533617b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53300b58d0 con 0x7f53300cd0c0 2023-10-19T08:38:51.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.650+0000 7f533617b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53300c8230 con 0x7f533015d8c0 2023-10-19T08:38:51.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.650+0000 7f533617b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53300c8510 con 0x7f53300af170 2023-10-19T08:38:51.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.650+0000 7f532effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53300cd0c0 0x7f5330158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:51.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.650+0000 7f532effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53300cd0c0 0x7f5330158f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47410/0 (socket says 172.21.15.79:47410) 2023-10-19T08:38:51.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.650+0000 7f532effd700 1 -- 172.21.15.79:0/983148706 learned_addr learned my addr 172.21.15.79:0/983148706 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:51.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.650+0000 7f532ffff700 1 --2- 172.21.15.79:0/983148706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f533015d8c0 0x7f53300c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:51.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.650+0000 7f532f7fe700 1 --2- 172.21.15.79:0/983148706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53300af170 0x7f533015af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:51.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.650+0000 7f532effd700 1 -- 172.21.15.79:0/983148706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53300af170 msgr2=0x7f533015af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:51.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.650+0000 7f532effd700 1 --2- 172.21.15.79:0/983148706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53300af170 0x7f533015af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:51.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.650+0000 7f532effd700 1 -- 172.21.15.79:0/983148706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f533015d8c0 msgr2=0x7f53300c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:51.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.650+0000 7f532effd700 1 --2- 172.21.15.79:0/983148706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f533015d8c0 0x7f53300c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:51.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.650+0000 7f532effd700 1 -- 172.21.15.79:0/983148706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5328009a70 con 0x7f53300cd0c0 2023-10-19T08:38:51.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.650+0000 7f532ffff700 1 --2- 172.21.15.79:0/983148706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f533015d8c0 0x7f53300c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:51.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.650+0000 7f532effd700 1 --2- 172.21.15.79:0/983148706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53300cd0c0 0x7f5330158f40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f532000c450 tx=0x7f532000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:51.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.651+0000 7f5317fff700 1 -- 172.21.15.79:0/983148706 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53200052d0 con 0x7f53300cd0c0 2023-10-19T08:38:51.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.651+0000 7f5317fff700 1 -- 172.21.15.79:0/983148706 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5320005430 con 0x7f53300cd0c0 2023-10-19T08:38:51.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.651+0000 7f5317fff700 1 -- 172.21.15.79:0/983148706 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53200038c0 con 0x7f53300cd0c0 2023-10-19T08:38:51.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.651+0000 7f533617b700 1 -- 172.21.15.79:0/983148706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53300c87f0 con 0x7f53300cd0c0 2023-10-19T08:38:51.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.651+0000 7f533617b700 1 -- 172.21.15.79:0/983148706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53300c8db0 con 0x7f53300cd0c0 2023-10-19T08:38:51.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.652+0000 7f533617b700 1 -- 172.21.15.79:0/983148706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f533004ee70 con 0x7f53300cd0c0 2023-10-19T08:38:51.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.652+0000 7f5317fff700 1 -- 172.21.15.79:0/983148706 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5320003a20 con 0x7f53300cd0c0 2023-10-19T08:38:51.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.652+0000 7f5317fff700 1 --2- 172.21.15.79:0/983148706 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f531c06a0e0 0x7f531c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:51.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.652+0000 7f5317fff700 1 -- 172.21.15.79:0/983148706 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5320087b80 con 0x7f53300cd0c0 2023-10-19T08:38:51.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.652+0000 7f532f7fe700 1 --2- 172.21.15.79:0/983148706 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f531c06a0e0 0x7f531c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:51.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.653+0000 7f532f7fe700 1 --2- 172.21.15.79:0/983148706 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f531c06a0e0 0x7f531c06c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f533015b990 tx=0x7f5324001070 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:51.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.657+0000 7f5317fff700 1 -- 172.21.15.79:0/983148706 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f5320052f50 con 0x7f53300cd0c0 2023-10-19T08:38:51.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.846+0000 7f533617b700 1 -- 172.21.15.79:0/983148706 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f533006b110 con 0x7f53300cd0c0 2023-10-19T08:38:51.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.847+0000 7f5317fff700 1 -- 172.21.15.79:0/983148706 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20155 (secure 0 0 0) 0x7f5320056570 con 0x7f53300cd0c0 2023-10-19T08:38:51.852 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:51.852 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:44.473795+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:51.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.849+0000 7f533617b700 1 -- 172.21.15.79:0/983148706 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f531c06a0e0 msgr2=0x7f531c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:51.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.849+0000 7f533617b700 1 --2- 172.21.15.79:0/983148706 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f531c06a0e0 0x7f531c06c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f533015b990 tx=0x7f5324001070 comp rx=0 tx=0).stop 2023-10-19T08:38:51.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.849+0000 7f533617b700 1 -- 172.21.15.79:0/983148706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53300cd0c0 msgr2=0x7f5330158f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:51.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.849+0000 7f533617b700 1 --2- 172.21.15.79:0/983148706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53300cd0c0 0x7f5330158f40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f532000c450 tx=0x7f532000c810 comp rx=0 tx=0).stop 2023-10-19T08:38:51.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.849+0000 7f533617b700 1 -- 172.21.15.79:0/983148706 shutdown_connections 2023-10-19T08:38:51.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.849+0000 7f533617b700 1 --2- 172.21.15.79:0/983148706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f533015d8c0 0x7f53300c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:51.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.849+0000 7f533617b700 1 --2- 172.21.15.79:0/983148706 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f531c06a0e0 0x7f531c06c5a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:51.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.849+0000 7f533617b700 1 --2- 172.21.15.79:0/983148706 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53300af170 0x7f533015af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:51.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.849+0000 7f533617b700 1 --2- 172.21.15.79:0/983148706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53300cd0c0 0x7f5330158f40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:51.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.849+0000 7f533617b700 1 -- 172.21.15.79:0/983148706 >> 172.21.15.79:0/983148706 conn(0x7f533006dcc0 msgr2=0x7f53300cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:51.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.849+0000 7f533617b700 1 -- 172.21.15.79:0/983148706 shutdown_connections 2023-10-19T08:38:51.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.849+0000 7f533617b700 1 -- 172.21.15.79:0/983148706 wait complete. 2023-10-19T08:38:51.866 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T08:37:54.318159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T08:37:55.629862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T08:37:59.333062+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T08:38:51.867 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:38:51.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.986+0000 7ff98380f700 1 Processor -- start 2023-10-19T08:38:51.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.986+0000 7ff98380f700 1 -- start start 2023-10-19T08:38:51.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.987+0000 7ff98380f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff97c06a930 0x7ff97c0cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:51.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.987+0000 7ff98380f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff97c0703b0 0x7ff97c0cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:51.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.987+0000 7ff98380f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff97c0b1fe0 con 0x7ff97c0cd270 2023-10-19T08:38:51.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.987+0000 7ff98380f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97c160a80 con 0x7ff97c0703b0 2023-10-19T08:38:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.987+0000 7ff98380f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97c0ce2b0 con 0x7ff97c06a930 2023-10-19T08:38:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.987+0000 7ff981dac700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff97c0703b0 0x7ff97c0cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.987+0000 7ff9815ab700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7ff97c0cd270 0x7ff97c06a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57488/0 (socket says 172.21.15.79:57488) 2023-10-19T08:38:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.987+0000 7ff9815ab700 1 -- 172.21.15.79:0/3364544276 learned_addr learned my addr 172.21.15.79:0/3364544276 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:51.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.987+0000 7ff980daa700 1 --2- 172.21.15.79:0/3364544276 >> v2:172.21.15.89:3300/0 conn(0x7ff97c06a930 0x7ff97c0cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.987+0000 7ff981dac700 1 -- 172.21.15.79:0/3364544276 >> v2:172.21.15.89:3300/0 conn(0x7ff97c06a930 msgr2=0x7ff97c0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.987+0000 7ff981dac700 1 --2- 172.21.15.79:0/3364544276 >> v2:172.21.15.89:3300/0 conn(0x7ff97c06a930 0x7ff97c0cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.987+0000 7ff981dac700 1 -- 172.21.15.79:0/3364544276 >> v1:172.21.15.79:6789/0 conn(0x7ff97c0cd270 legacy=0x7ff97c06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.987+0000 7ff981dac700 1 -- 172.21.15.79:0/3364544276 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c0ce550 con 0x7ff97c0703b0 2023-10-19T08:38:51.995 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.988+0000 7ff981dac700 1 --2- 172.21.15.79:0/3364544276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff97c0703b0 0x7ff97c0cb7d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff97c06b2d0 tx=0x7ff97400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0255617e60525d server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:51.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.988+0000 7ff973fff700 1 -- 172.21.15.79:0/3364544276 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97400e070 con 0x7ff97c0703b0 2023-10-19T08:38:51.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.988+0000 7ff973fff700 1 -- 172.21.15.79:0/3364544276 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97400bbd0 con 0x7ff97c0703b0 2023-10-19T08:38:51.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.988+0000 7ff973fff700 1 -- 172.21.15.79:0/3364544276 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974012430 con 0x7ff97c0703b0 2023-10-19T08:38:51.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.988+0000 7ff98380f700 1 -- 172.21.15.79:0/3364544276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff97c0703b0 msgr2=0x7ff97c0cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:51.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.988+0000 7ff98380f700 1 --2- 172.21.15.79:0/3364544276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff97c0703b0 0x7ff97c0cb7d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff97c06b2d0 tx=0x7ff97400b330 comp rx=0 tx=0).stop 2023-10-19T08:38:51.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.988+0000 7ff98380f700 1 -- 172.21.15.79:0/3364544276 shutdown_connections 2023-10-19T08:38:51.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.988+0000 7ff98380f700 1 --2- 172.21.15.79:0/3364544276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff97c0703b0 0x7ff97c0cb7d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:51.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.988+0000 7ff98380f700 1 --2- 172.21.15.79:0/3364544276 >> v2:172.21.15.89:3300/0 conn(0x7ff97c06a930 0x7ff97c0cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:51.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.988+0000 7ff98380f700 1 -- 172.21.15.79:0/3364544276 >> 172.21.15.79:0/3364544276 conn(0x7ff97c06dcc0 msgr2=0x7ff97c06e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:51.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.988+0000 7ff98380f700 1 -- 172.21.15.79:0/3364544276 shutdown_connections 2023-10-19T08:38:51.998 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.988+0000 7ff98380f700 1 -- 172.21.15.79:0/3364544276 wait complete. 2023-10-19T08:38:52.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.989+0000 7ff98380f700 1 Processor -- start 2023-10-19T08:38:52.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.990+0000 7ff98380f700 1 -- start start 2023-10-19T08:38:52.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.990+0000 7ff98380f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff97c06a930 0x7ff97c0ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:52.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.990+0000 7ff98380f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff97c0703b0 0x7ff97c0cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:52.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.990+0000 7ff98380f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff97c0cd270 0x7ff97c0cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:52.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.990+0000 7ff98380f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c0ae730 con 0x7ff97c0703b0 2023-10-19T08:38:52.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.990+0000 7ff98380f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c1f3540 con 0x7ff97c06a930 2023-10-19T08:38:52.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.990+0000 7ff98380f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c1f3870 con 0x7ff97c0cd270 2023-10-19T08:38:52.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.990+0000 7ff980daa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff97c0703b0 0x7ff97c0cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:52.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.990+0000 7ff980daa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff97c0703b0 0x7ff97c0cb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47424/0 (socket says 172.21.15.79:47424) 2023-10-19T08:38:52.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.990+0000 7ff980daa700 1 -- 172.21.15.79:0/2566724344 learned_addr learned my addr 172.21.15.79:0/2566724344 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:52.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.990+0000 7ff9815ab700 1 --2- 172.21.15.79:0/2566724344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff97c06a930 0x7ff97c0ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:52.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.991+0000 7ff981dac700 1 --2- 172.21.15.79:0/2566724344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff97c0cd270 0x7ff97c0cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:52.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.991+0000 7ff980daa700 1 -- 172.21.15.79:0/2566724344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff97c0cd270 msgr2=0x7ff97c0cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:52.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.991+0000 7ff980daa700 1 --2- 172.21.15.79:0/2566724344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff97c0cd270 0x7ff97c0cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.991+0000 7ff980daa700 1 -- 172.21.15.79:0/2566724344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff97c06a930 msgr2=0x7ff97c0ae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:52.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.991+0000 7ff980daa700 1 --2- 172.21.15.79:0/2566724344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff97c06a930 0x7ff97c0ae1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.991+0000 7ff980daa700 1 -- 172.21.15.79:0/2566724344 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff974009a70 con 0x7ff97c0703b0 2023-10-19T08:38:52.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.991+0000 7ff981dac700 1 --2- 172.21.15.79:0/2566724344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff97c0cd270 0x7ff97c0cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:52.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.991+0000 7ff980daa700 1 --2- 172.21.15.79:0/2566724344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff97c0703b0 0x7ff97c0cb190 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff97800d7d0 tx=0x7ff97800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:52.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.991+0000 7ff971ffb700 1 -- 172.21.15.79:0/2566724344 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9780125f0 con 0x7ff97c0703b0 2023-10-19T08:38:52.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.991+0000 7ff971ffb700 1 -- 172.21.15.79:0/2566724344 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff978012750 con 0x7ff97c0703b0 2023-10-19T08:38:52.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.991+0000 7ff98380f700 1 -- 172.21.15.79:0/2566724344 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97c1f3b50 con 0x7ff97c0703b0 2023-10-19T08:38:52.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.991+0000 7ff971ffb700 1 -- 172.21.15.79:0/2566724344 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff978012ac0 con 0x7ff97c0703b0 2023-10-19T08:38:52.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.991+0000 7ff98380f700 1 -- 172.21.15.79:0/2566724344 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff97c1f4110 con 0x7ff97c0703b0 2023-10-19T08:38:52.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.992+0000 7ff98380f700 1 -- 172.21.15.79:0/2566724344 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97c1f42d0 con 0x7ff97c0703b0 2023-10-19T08:38:52.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.992+0000 7ff971ffb700 1 -- 172.21.15.79:0/2566724344 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff978012c20 con 0x7ff97c0703b0 2023-10-19T08:38:52.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.993+0000 7ff971ffb700 1 --2- 172.21.15.79:0/2566724344 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff96006a0e0 0x7ff96006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:52.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.993+0000 7ff971ffb700 1 -- 172.21.15.79:0/2566724344 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff978088c00 con 0x7ff97c0703b0 2023-10-19T08:38:52.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.993+0000 7ff9815ab700 1 --2- 172.21.15.79:0/2566724344 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff96006a0e0 0x7ff96006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:52.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.993+0000 7ff9815ab700 1 --2- 172.21.15.79:0/2566724344 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff96006a0e0 0x7ff96006c5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff96c005910 tx=0x7ff96c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:52.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:51.997+0000 7ff971ffb700 1 -- 172.21.15.79:0/2566724344 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ff97808f080 con 0x7ff97c0703b0 2023-10-19T08:38:52.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.187+0000 7ff98380f700 1 -- 172.21.15.79:0/2566724344 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff97c04ee70 con 0x7ff97c0703b0 2023-10-19T08:38:52.192 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.187+0000 7ff971ffb700 1 -- 172.21.15.79:0/2566724344 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff978057a50 con 0x7ff97c0703b0 2023-10-19T08:38:52.192 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:38:52.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.189+0000 7ff98380f700 1 -- 172.21.15.79:0/2566724344 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff96006a0e0 msgr2=0x7ff96006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:52.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.189+0000 7ff98380f700 1 --2- 172.21.15.79:0/2566724344 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff96006a0e0 0x7ff96006c5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff96c005910 tx=0x7ff96c009040 comp rx=0 tx=0).stop 2023-10-19T08:38:52.194 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.189+0000 7ff98380f700 1 -- 172.21.15.79:0/2566724344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff97c0703b0 msgr2=0x7ff97c0cb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:52.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.189+0000 7ff98380f700 1 --2- 172.21.15.79:0/2566724344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff97c0703b0 0x7ff97c0cb190 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff97800d7d0 tx=0x7ff97800db90 comp rx=0 tx=0).stop 2023-10-19T08:38:52.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.189+0000 7ff98380f700 1 -- 172.21.15.79:0/2566724344 shutdown_connections 2023-10-19T08:38:52.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.189+0000 7ff98380f700 1 --2- 172.21.15.79:0/2566724344 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff96006a0e0 0x7ff96006c5a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.189+0000 7ff98380f700 1 --2- 172.21.15.79:0/2566724344 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff97c0cd270 0x7ff97c0cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.195 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.189+0000 7ff98380f700 1 --2- 172.21.15.79:0/2566724344 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff97c06a930 0x7ff97c0ae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.189+0000 7ff98380f700 1 --2- 172.21.15.79:0/2566724344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff97c0703b0 0x7ff97c0cb190 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.189+0000 7ff98380f700 1 -- 172.21.15.79:0/2566724344 >> 172.21.15.79:0/2566724344 conn(0x7ff97c06dcc0 msgr2=0x7ff97c06a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:52.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.189+0000 7ff98380f700 1 -- 172.21.15.79:0/2566724344 shutdown_connections 2023-10-19T08:38:52.196 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.189+0000 7ff98380f700 1 -- 172.21.15.79:0/2566724344 wait complete. 2023-10-19T08:38:52.205 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:38:52.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.327+0000 7f5c7db2a700 1 Processor -- start 2023-10-19T08:38:52.332 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.327+0000 7f5c7db2a700 1 -- start start 2023-10-19T08:38:52.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.328+0000 7f5c7db2a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c7815d170 0x7f5c780cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:52.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.328+0000 7f5c7db2a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5c7815e270 0x7f5c780b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:52.335 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.328+0000 7f5c7db2a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c7815e6f0 con 0x7f5c780ce2e0 2023-10-19T08:38:52.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.328+0000 7f5c7db2a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c780cb080 con 0x7f5c7815e270 2023-10-19T08:38:52.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.328+0000 7f5c7db2a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c780cb820 con 0x7f5c7815d170 2023-10-19T08:38:52.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.329+0000 7f5c777fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c7815d170 0x7f5c780cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:52.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.329+0000 7f5c76ffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5c7815e270 0x7f5c780b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:52.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.329+0000 7f5c77fff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5c780ce2e0 0x7f5c7806cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:42348/0 (socket says 172.21.15.79:42348) 2023-10-19T08:38:52.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.329+0000 7f5c77fff700 1 -- 172.21.15.79:0/2218841658 learned_addr learned my addr 172.21.15.79:0/2218841658 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:52.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.329+0000 7f5c777fe700 1 -- 172.21.15.79:0/2218841658 >> v2:172.21.15.89:3300/0 conn(0x7f5c7815e270 msgr2=0x7f5c780b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:52.337 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.329+0000 7f5c777fe700 1 --2- 172.21.15.79:0/2218841658 >> v2:172.21.15.89:3300/0 conn(0x7f5c7815e270 0x7f5c780b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.329+0000 7f5c777fe700 1 -- 172.21.15.79:0/2218841658 >> v1:172.21.15.89:6789/0 conn(0x7f5c780ce2e0 legacy=0x7f5c7806cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:52.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.329+0000 7f5c777fe700 1 -- 172.21.15.79:0/2218841658 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c780cb260 con 0x7f5c7815d170 2023-10-19T08:38:52.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.329+0000 7f5c767fc700 1 -- 172.21.15.79:0/2218841658 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3040730426 0 0) 0x7f5c7815e6f0 con 0x7f5c780ce2e0 2023-10-19T08:38:52.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.329+0000 7f5c76ffd700 1 --2- 172.21.15.79:0/2218841658 >> v2:172.21.15.89:3300/0 conn(0x7f5c7815e270 0x7f5c780b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:38:52.338 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.329+0000 7f5c777fe700 1 --2- 172.21.15.79:0/2218841658 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c7815d170 0x7f5c780cab40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009840 tx=0x7f5c60009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=513a36e544eca8c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:52.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.329+0000 7f5c767fc700 1 -- 172.21.15.79:0/2218841658 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c60011830 con 0x7f5c7815d170 2023-10-19T08:38:52.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.329+0000 7f5c767fc700 1 -- 172.21.15.79:0/2218841658 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c60011990 con 0x7f5c7815d170 2023-10-19T08:38:52.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.329+0000 7f5c767fc700 1 -- 172.21.15.79:0/2218841658 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c60011d20 con 0x7f5c7815d170 2023-10-19T08:38:52.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.330+0000 7f5c7db2a700 1 -- 172.21.15.79:0/2218841658 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c7815d170 msgr2=0x7f5c780cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:52.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.330+0000 7f5c7db2a700 1 --2- 172.21.15.79:0/2218841658 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c7815d170 0x7f5c780cab40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009840 tx=0x7f5c60009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:52.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.330+0000 7f5c7db2a700 1 -- 172.21.15.79:0/2218841658 shutdown_connections 2023-10-19T08:38:52.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.330+0000 7f5c7db2a700 1 --2- 172.21.15.79:0/2218841658 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c7815d170 0x7f5c780cab40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.330+0000 7f5c7db2a700 1 --2- 172.21.15.79:0/2218841658 >> v2:172.21.15.89:3300/0 conn(0x7f5c7815e270 0x7f5c780b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.330+0000 7f5c7db2a700 1 -- 172.21.15.79:0/2218841658 >> 172.21.15.79:0/2218841658 conn(0x7f5c780cefd0 msgr2=0x7f5c780cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:52.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.330+0000 7f5c7db2a700 1 -- 172.21.15.79:0/2218841658 shutdown_connections 2023-10-19T08:38:52.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.330+0000 7f5c7db2a700 1 -- 172.21.15.79:0/2218841658 wait complete. 2023-10-19T08:38:52.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.331+0000 7f5c7db2a700 1 Processor -- start 2023-10-19T08:38:52.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.331+0000 7f5c7db2a700 1 -- start start 2023-10-19T08:38:52.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.332+0000 7f5c7db2a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c780ce2e0 0x7f5c780c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:52.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.332+0000 7f5c7db2a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c7815d170 0x7f5c7814f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:52.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.332+0000 7f5c7db2a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c7815e270 0x7f5c78149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:52.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.332+0000 7f5c7db2a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c78148e20 con 0x7f5c7815e270 2023-10-19T08:38:52.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.332+0000 7f5c7db2a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c78165050 con 0x7f5c7815d170 2023-10-19T08:38:52.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.332+0000 7f5c7db2a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c78165330 con 0x7f5c780ce2e0 2023-10-19T08:38:52.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.332+0000 7f5c77fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c7815e270 0x7f5c78149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:52.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.332+0000 7f5c77fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c7815e270 0x7f5c78149870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47440/0 (socket says 172.21.15.79:47440) 2023-10-19T08:38:52.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.332+0000 7f5c77fff700 1 -- 172.21.15.79:0/691839149 learned_addr learned my addr 172.21.15.79:0/691839149 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:52.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.332+0000 7f5c76ffd700 1 --2- 172.21.15.79:0/691839149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c7815d170 0x7f5c7814f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:52.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.332+0000 7f5c777fe700 1 --2- 172.21.15.79:0/691839149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c780ce2e0 0x7f5c780c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:52.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.333+0000 7f5c77fff700 1 -- 172.21.15.79:0/691839149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c780ce2e0 msgr2=0x7f5c780c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:52.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.333+0000 7f5c77fff700 1 --2- 172.21.15.79:0/691839149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c780ce2e0 0x7f5c780c4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.333+0000 7f5c77fff700 1 -- 172.21.15.79:0/691839149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c7815d170 msgr2=0x7f5c7814f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:52.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.333+0000 7f5c77fff700 1 --2- 172.21.15.79:0/691839149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c7815d170 0x7f5c7814f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.333+0000 7f5c77fff700 1 -- 172.21.15.79:0/691839149 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c680094a0 con 0x7f5c7815e270 2023-10-19T08:38:52.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.333+0000 7f5c76ffd700 1 --2- 172.21.15.79:0/691839149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c7815d170 0x7f5c7814f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:52.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.333+0000 7f5c777fe700 1 --2- 172.21.15.79:0/691839149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c780ce2e0 0x7f5c780c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:52.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.333+0000 7f5c77fff700 1 --2- 172.21.15.79:0/691839149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c7815e270 0x7f5c78149870 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000cca0 tx=0x7f5c7000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:52.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.333+0000 7f5c6ffff700 1 -- 172.21.15.79:0/691839149 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7000cea0 con 0x7f5c7815e270 2023-10-19T08:38:52.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.333+0000 7f5c6ffff700 1 -- 172.21.15.79:0/691839149 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7000ade0 con 0x7f5c7815e270 2023-10-19T08:38:52.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.333+0000 7f5c7db2a700 1 -- 172.21.15.79:0/691839149 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c600094a0 con 0x7f5c7815e270 2023-10-19T08:38:52.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.333+0000 7f5c6ffff700 1 -- 172.21.15.79:0/691839149 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c70007310 con 0x7f5c7815e270 2023-10-19T08:38:52.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.333+0000 7f5c7db2a700 1 -- 172.21.15.79:0/691839149 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c78149070 con 0x7f5c7815e270 2023-10-19T08:38:52.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.334+0000 7f5c7db2a700 1 -- 172.21.15.79:0/691839149 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c7804ee70 con 0x7f5c7815e270 2023-10-19T08:38:52.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.334+0000 7f5c6ffff700 1 -- 172.21.15.79:0/691839149 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5c70007470 con 0x7f5c7815e270 2023-10-19T08:38:52.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.335+0000 7f5c6ffff700 1 --2- 172.21.15.79:0/691839149 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5c5806a0e0 0x7f5c5806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:52.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.335+0000 7f5c777fe700 1 --2- 172.21.15.79:0/691839149 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5c5806a0e0 0x7f5c5806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:52.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.335+0000 7f5c6ffff700 1 -- 172.21.15.79:0/691839149 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5c70088760 con 0x7f5c7815e270 2023-10-19T08:38:52.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.335+0000 7f5c777fe700 1 --2- 172.21.15.79:0/691839149 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5c5806a0e0 0x7f5c5806c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5c60000c00 tx=0x7f5c60008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:52.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.339+0000 7f5c6ffff700 1 -- 172.21.15.79:0/691839149 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f5c70053bb0 con 0x7f5c7815e270 2023-10-19T08:38:52.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.529+0000 7f5c7db2a700 1 -- 172.21.15.79:0/691839149 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5c780b1890 con 0x7f5c7815e270 2023-10-19T08:38:52.534 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.530+0000 7f5c6ffff700 1 -- 172.21.15.79:0/691839149 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5c700571d0 con 0x7f5c7815e270 2023-10-19T08:38:52.535 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:38:52.536 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.532+0000 7f5c7db2a700 1 -- 172.21.15.79:0/691839149 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5c5806a0e0 msgr2=0x7f5c5806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.532+0000 7f5c7db2a700 1 --2- 172.21.15.79:0/691839149 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5c5806a0e0 0x7f5c5806c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5c60000c00 tx=0x7f5c60008030 comp rx=0 tx=0).stop 2023-10-19T08:38:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.532+0000 7f5c7db2a700 1 -- 172.21.15.79:0/691839149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c7815e270 msgr2=0x7f5c78149870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.532+0000 7f5c7db2a700 1 --2- 172.21.15.79:0/691839149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c7815e270 0x7f5c78149870 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000cca0 tx=0x7f5c7000a340 comp rx=0 tx=0).stop 2023-10-19T08:38:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.532+0000 7f5c7db2a700 1 -- 172.21.15.79:0/691839149 shutdown_connections 2023-10-19T08:38:52.537 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.532+0000 7f5c7db2a700 1 --2- 172.21.15.79:0/691839149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c7815e270 0x7f5c78149870 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.532+0000 7f5c7db2a700 1 --2- 172.21.15.79:0/691839149 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f5c5806a0e0 0x7f5c5806c5a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.532+0000 7f5c7db2a700 1 --2- 172.21.15.79:0/691839149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c780ce2e0 0x7f5c780c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.532+0000 7f5c7db2a700 1 --2- 172.21.15.79:0/691839149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c7815d170 0x7f5c7814f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.532+0000 7f5c7db2a700 1 -- 172.21.15.79:0/691839149 >> 172.21.15.79:0/691839149 conn(0x7f5c780cefd0 msgr2=0x7f5c780c8940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:52.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.532+0000 7f5c7db2a700 1 -- 172.21.15.79:0/691839149 shutdown_connections 2023-10-19T08:38:52.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.532+0000 7f5c7db2a700 1 -- 172.21.15.79:0/691839149 wait complete. 2023-10-19T08:38:52.548 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T08:38:52.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.667+0000 7f497cfb1700 1 Processor -- start 2023-10-19T08:38:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.667+0000 7f497cfb1700 1 -- start start 2023-10-19T08:38:52.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.668+0000 7f497cfb1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49780cd270 0x7f497806a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:52.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.668+0000 7f497cfb1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49780cc2a0 0x7f497806a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:52.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.668+0000 7f497cfb1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49780b1fe0 con 0x7f49780703b0 2023-10-19T08:38:52.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.668+0000 7f497cfb1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4978160a80 con 0x7f49780cd270 2023-10-19T08:38:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.668+0000 7f497cfb1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49780ce2b0 con 0x7f49780cc2a0 2023-10-19T08:38:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.668+0000 7f497659c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49780cd270 0x7f497806a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.668+0000 7f497659c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49780cd270 0x7f497806a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47444/0 (socket says 172.21.15.79:47444) 2023-10-19T08:38:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.668+0000 7f497659c700 1 -- 172.21.15.79:0/438693336 learned_addr learned my addr 172.21.15.79:0/438693336 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:52.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.668+0000 7f4976d9d700 1 --2- 172.21.15.79:0/438693336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49780cc2a0 0x7f497806a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:52.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.668+0000 7f497659c700 1 -- 172.21.15.79:0/438693336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49780cc2a0 msgr2=0x7f497806a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:52.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.668+0000 7f497659c700 1 --2- 172.21.15.79:0/438693336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49780cc2a0 0x7f497806a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.668+0000 7f497659c700 1 -- 172.21.15.79:0/438693336 >> v1:172.21.15.89:6789/0 conn(0x7f49780703b0 legacy=0x7f4978160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:52.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.668+0000 7f497659c700 1 -- 172.21.15.79:0/438693336 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49780ce550 con 0x7f49780cd270 2023-10-19T08:38:52.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.668+0000 7f4976d9d700 1 --2- 172.21.15.79:0/438693336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49780cc2a0 0x7f497806a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:52.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.668+0000 7f497659c700 1 --2- 172.21.15.79:0/438693336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49780cd270 0x7f497806a220 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f496c0098f0 tx=0x7f496c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d280442e7d8409 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:52.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.668+0000 7f497559a700 1 -- 172.21.15.79:0/438693336 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c004230 con 0x7f49780cd270 2023-10-19T08:38:52.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.668+0000 7f497559a700 1 -- 172.21.15.79:0/438693336 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496c004390 con 0x7f49780cd270 2023-10-19T08:38:52.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.668+0000 7f497559a700 1 -- 172.21.15.79:0/438693336 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c0036a0 con 0x7f49780cd270 2023-10-19T08:38:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.669+0000 7f497cfb1700 1 -- 172.21.15.79:0/438693336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49780cd270 msgr2=0x7f497806a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.669+0000 7f497cfb1700 1 --2- 172.21.15.79:0/438693336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49780cd270 0x7f497806a220 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f496c0098f0 tx=0x7f496c009c00 comp rx=0 tx=0).stop 2023-10-19T08:38:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.669+0000 7f497cfb1700 1 -- 172.21.15.79:0/438693336 shutdown_connections 2023-10-19T08:38:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.669+0000 7f497cfb1700 1 --2- 172.21.15.79:0/438693336 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49780cc2a0 0x7f497806a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.669+0000 7f497cfb1700 1 --2- 172.21.15.79:0/438693336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49780cd270 0x7f497806a220 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.669+0000 7f497cfb1700 1 -- 172.21.15.79:0/438693336 >> 172.21.15.79:0/438693336 conn(0x7f497806dcc0 msgr2=0x7f497806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:52.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.669+0000 7f497cfb1700 1 -- 172.21.15.79:0/438693336 shutdown_connections 2023-10-19T08:38:52.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.669+0000 7f497cfb1700 1 -- 172.21.15.79:0/438693336 wait complete. 2023-10-19T08:38:52.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.670+0000 7f497cfb1700 1 Processor -- start 2023-10-19T08:38:52.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.670+0000 7f497cfb1700 1 -- start start 2023-10-19T08:38:52.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.671+0000 7f497cfb1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49780703b0 0x7f49780ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:52.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.671+0000 7f497cfb1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49780cc2a0 0x7f49781f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:52.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.671+0000 7f497cfb1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49780cd270 0x7f4978156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:52.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.671+0000 7f497cfb1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49780acea0 con 0x7f49780703b0 2023-10-19T08:38:52.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.671+0000 7f497cfb1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49781f3570 con 0x7f49780cc2a0 2023-10-19T08:38:52.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.671+0000 7f497cfb1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49780ac840 con 0x7f49780cd270 2023-10-19T08:38:52.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.671+0000 7f497659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49780703b0 0x7f49780ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:52.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.671+0000 7f497659c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49780703b0 0x7f49780ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47450/0 (socket says 172.21.15.79:47450) 2023-10-19T08:38:52.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.671+0000 7f497659c700 1 -- 172.21.15.79:0/2108578390 learned_addr learned my addr 172.21.15.79:0/2108578390 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:52.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.671+0000 7f4976d9d700 1 --2- 172.21.15.79:0/2108578390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49780cd270 0x7f4978156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:52.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.671+0000 7f4975d9b700 1 --2- 172.21.15.79:0/2108578390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49780cc2a0 0x7f49781f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:52.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.672+0000 7f497659c700 1 -- 172.21.15.79:0/2108578390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49780cd270 msgr2=0x7f4978156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:52.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.672+0000 7f497659c700 1 --2- 172.21.15.79:0/2108578390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49780cd270 0x7f4978156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.672+0000 7f497659c700 1 -- 172.21.15.79:0/2108578390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49780cc2a0 msgr2=0x7f49781f3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:52.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.672+0000 7f497659c700 1 --2- 172.21.15.79:0/2108578390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49780cc2a0 0x7f49781f3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.672+0000 7f497659c700 1 -- 172.21.15.79:0/2108578390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c009550 con 0x7f49780703b0 2023-10-19T08:38:52.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.672+0000 7f4975d9b700 1 --2- 172.21.15.79:0/2108578390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49780cc2a0 0x7f49781f3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:52.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.672+0000 7f497659c700 1 --2- 172.21.15.79:0/2108578390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49780703b0 0x7f49780ab8e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f496c009130 tx=0x7f496c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:52.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.672+0000 7f4966ffd700 1 -- 172.21.15.79:0/2108578390 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c003d80 con 0x7f49780703b0 2023-10-19T08:38:52.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.672+0000 7f4966ffd700 1 -- 172.21.15.79:0/2108578390 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496c01f070 con 0x7f49780703b0 2023-10-19T08:38:52.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.672+0000 7f4966ffd700 1 -- 172.21.15.79:0/2108578390 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c00b8a0 con 0x7f49780703b0 2023-10-19T08:38:52.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.672+0000 7f497cfb1700 1 -- 172.21.15.79:0/2108578390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49780abfa0 con 0x7f49780703b0 2023-10-19T08:38:52.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.672+0000 7f497cfb1700 1 -- 172.21.15.79:0/2108578390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49780ac560 con 0x7f49780703b0 2023-10-19T08:38:52.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.673+0000 7f497cfb1700 1 -- 172.21.15.79:0/2108578390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497804ee70 con 0x7f49780703b0 2023-10-19T08:38:52.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.673+0000 7f4966ffd700 1 -- 172.21.15.79:0/2108578390 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f496c021030 con 0x7f49780703b0 2023-10-19T08:38:52.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.674+0000 7f4966ffd700 1 --2- 172.21.15.79:0/2108578390 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f495806a0e0 0x7f495806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:52.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.674+0000 7f4975d9b700 1 --2- 172.21.15.79:0/2108578390 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f495806a0e0 0x7f495806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:52.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.674+0000 7f4966ffd700 1 -- 172.21.15.79:0/2108578390 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f496c089e90 con 0x7f49780703b0 2023-10-19T08:38:52.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.674+0000 7f4975d9b700 1 --2- 172.21.15.79:0/2108578390 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f495806a0e0 0x7f495806c5a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49780ca850 tx=0x7f4968008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:52.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.678+0000 7f4966ffd700 1 -- 172.21.15.79:0/2108578390 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f496c055400 con 0x7f49780703b0 2023-10-19T08:38:52.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.868+0000 7f497cfb1700 1 -- 172.21.15.79:0/2108578390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f497804ee70 con 0x7f49780703b0 2023-10-19T08:38:52.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.868+0000 7f4966ffd700 1 -- 172.21.15.79:0/2108578390 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f496c058a20 con 0x7f49780703b0 2023-10-19T08:38:52.873 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:52.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.870+0000 7f497cfb1700 1 -- 172.21.15.79:0/2108578390 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f495806a0e0 msgr2=0x7f495806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:52.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.870+0000 7f497cfb1700 1 --2- 172.21.15.79:0/2108578390 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f495806a0e0 0x7f495806c5a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f49780ca850 tx=0x7f4968008040 comp rx=0 tx=0).stop 2023-10-19T08:38:52.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.870+0000 7f497cfb1700 1 -- 172.21.15.79:0/2108578390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49780703b0 msgr2=0x7f49780ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:52.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.870+0000 7f497cfb1700 1 --2- 172.21.15.79:0/2108578390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49780703b0 0x7f49780ab8e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f496c009130 tx=0x7f496c004750 comp rx=0 tx=0).stop 2023-10-19T08:38:52.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.870+0000 7f497cfb1700 1 -- 172.21.15.79:0/2108578390 shutdown_connections 2023-10-19T08:38:52.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.870+0000 7f497cfb1700 1 --2- 172.21.15.79:0/2108578390 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f495806a0e0 0x7f495806c5a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.870+0000 7f497cfb1700 1 --2- 172.21.15.79:0/2108578390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49780cd270 0x7f4978156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.870+0000 7f497cfb1700 1 --2- 172.21.15.79:0/2108578390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49780703b0 0x7f49780ab8e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.871+0000 7f497cfb1700 1 --2- 172.21.15.79:0/2108578390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49780cc2a0 0x7f49781f3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:52.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.871+0000 7f497cfb1700 1 -- 172.21.15.79:0/2108578390 >> 172.21.15.79:0/2108578390 conn(0x7f497806dcc0 msgr2=0x7f497806a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:52.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.871+0000 7f497cfb1700 1 -- 172.21.15.79:0/2108578390 shutdown_connections 2023-10-19T08:38:52.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:52.871+0000 7f497cfb1700 1 -- 172.21.15.79:0/2108578390 wait complete. 2023-10-19T08:38:52.887 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T08:38:53.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.005+0000 7f0b5c3cf700 1 Processor -- start 2023-10-19T08:38:53.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.005+0000 7f0b5c3cf700 1 -- start start 2023-10-19T08:38:53.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.006+0000 7f0b5c3cf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b5415aec0 0x7f0b54070120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:53.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.006+0000 7f0b5c3cf700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0b5406a930 0x7f0b540b3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:53.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.006+0000 7f0b5c3cf700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b540b31d0 con 0x7f0b540ca280 2023-10-19T08:38:53.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.006+0000 7f0b5c3cf700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5415b2a0 con 0x7f0b5406a930 2023-10-19T08:38:53.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.006+0000 7f0b5c3cf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b540b2650 con 0x7f0b5415aec0 2023-10-19T08:38:53.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.006+0000 7f0b5a96c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0b5406a930 0x7f0b540b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:53.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.006+0000 7f0b5a96c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0b5406a930 0x7f0b540b3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47460/0 (socket says 172.21.15.79:47460) 2023-10-19T08:38:53.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.006+0000 7f0b5a96c700 1 -- 172.21.15.79:0/3499846019 learned_addr learned my addr 172.21.15.79:0/3499846019 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:53.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.006+0000 7f0b5a16b700 1 --2- 172.21.15.79:0/3499846019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b5415aec0 0x7f0b54070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:53.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.006+0000 7f0b5a96c700 1 -- 172.21.15.79:0/3499846019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b5415aec0 msgr2=0x7f0b54070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:53.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.006+0000 7f0b5a96c700 1 --2- 172.21.15.79:0/3499846019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b5415aec0 0x7f0b54070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.006+0000 7f0b5a96c700 1 -- 172.21.15.79:0/3499846019 >> v1:172.21.15.89:6789/0 conn(0x7f0b540ca280 legacy=0x7f0b5406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:53.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.006+0000 7f0b5a96c700 1 -- 172.21.15.79:0/3499846019 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b540cac60 con 0x7f0b5406a930 2023-10-19T08:38:53.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.006+0000 7f0b5a96c700 1 --2- 172.21.15.79:0/3499846019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b5406a930 0x7f0b540b3660 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009e50 tx=0x7f0b4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf2ca3691a959b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:53.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.006+0000 7f0b59169700 1 -- 172.21.15.79:0/3499846019 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c00e070 con 0x7f0b5406a930 2023-10-19T08:38:53.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.007+0000 7f0b59169700 1 -- 172.21.15.79:0/3499846019 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c00b9c0 con 0x7f0b5406a930 2023-10-19T08:38:53.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.007+0000 7f0b59169700 1 -- 172.21.15.79:0/3499846019 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c00bd70 con 0x7f0b5406a930 2023-10-19T08:38:53.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.007+0000 7f0b5c3cf700 1 -- 172.21.15.79:0/3499846019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b5406a930 msgr2=0x7f0b540b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:53.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.007+0000 7f0b5c3cf700 1 --2- 172.21.15.79:0/3499846019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b5406a930 0x7f0b540b3660 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009e50 tx=0x7f0b4c00b330 comp rx=0 tx=0).stop 2023-10-19T08:38:53.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.007+0000 7f0b5c3cf700 1 -- 172.21.15.79:0/3499846019 shutdown_connections 2023-10-19T08:38:53.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.007+0000 7f0b5c3cf700 1 --2- 172.21.15.79:0/3499846019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b5406a930 0x7f0b540b3660 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.007+0000 7f0b5c3cf700 1 --2- 172.21.15.79:0/3499846019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b5415aec0 0x7f0b54070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.007+0000 7f0b5c3cf700 1 -- 172.21.15.79:0/3499846019 >> 172.21.15.79:0/3499846019 conn(0x7f0b5406dcc0 msgr2=0x7f0b5406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:53.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.007+0000 7f0b5c3cf700 1 -- 172.21.15.79:0/3499846019 shutdown_connections 2023-10-19T08:38:53.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.007+0000 7f0b5c3cf700 1 -- 172.21.15.79:0/3499846019 wait complete. 2023-10-19T08:38:53.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.008+0000 7f0b5c3cf700 1 Processor -- start 2023-10-19T08:38:53.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.008+0000 7f0b5c3cf700 1 -- start start 2023-10-19T08:38:53.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.009+0000 7f0b5c3cf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b5406a930 0x7f0b541f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:53.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.009+0000 7f0b5c3cf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b540ca280 0x7f0b5415cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:53.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.009+0000 7f0b5c3cf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b5415aec0 0x7f0b54159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:53.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.009+0000 7f0b5c3cf700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5415d620 con 0x7f0b5406a930 2023-10-19T08:38:53.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.009+0000 7f0b5c3cf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5415d900 con 0x7f0b5415aec0 2023-10-19T08:38:53.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.009+0000 7f0b5c3cf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5415dbe0 con 0x7f0b540ca280 2023-10-19T08:38:53.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.009+0000 7f0b5a16b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b5406a930 0x7f0b541f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:53.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.009+0000 7f0b5a16b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b5406a930 0x7f0b541f2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47462/0 (socket says 172.21.15.79:47462) 2023-10-19T08:38:53.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.009+0000 7f0b5a16b700 1 -- 172.21.15.79:0/1973751685 learned_addr learned my addr 172.21.15.79:0/1973751685 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:53.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.009+0000 7f0b5996a700 1 --2- 172.21.15.79:0/1973751685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b540ca280 0x7f0b5415cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:53.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.009+0000 7f0b5a96c700 1 --2- 172.21.15.79:0/1973751685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b5415aec0 0x7f0b54159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:53.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.009+0000 7f0b5a16b700 1 -- 172.21.15.79:0/1973751685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b540ca280 msgr2=0x7f0b5415cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:53.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.009+0000 7f0b5a16b700 1 --2- 172.21.15.79:0/1973751685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b540ca280 0x7f0b5415cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.009+0000 7f0b5a16b700 1 -- 172.21.15.79:0/1973751685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b5415aec0 msgr2=0x7f0b54159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:53.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.009+0000 7f0b5a16b700 1 --2- 172.21.15.79:0/1973751685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b5415aec0 0x7f0b54159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.009+0000 7f0b5a16b700 1 -- 172.21.15.79:0/1973751685 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c009b30 con 0x7f0b5406a930 2023-10-19T08:38:53.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.010+0000 7f0b5a16b700 1 --2- 172.21.15.79:0/1973751685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b5406a930 0x7f0b541f2f30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000e810 tx=0x7f0b5000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:53.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.010+0000 7f0b4affd700 1 -- 172.21.15.79:0/1973751685 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5000c070 con 0x7f0b5406a930 2023-10-19T08:38:53.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.010+0000 7f0b4affd700 1 -- 172.21.15.79:0/1973751685 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b50013610 con 0x7f0b5406a930 2023-10-19T08:38:53.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.010+0000 7f0b5c3cf700 1 -- 172.21.15.79:0/1973751685 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5415dec0 con 0x7f0b5406a930 2023-10-19T08:38:53.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.010+0000 7f0b4affd700 1 -- 172.21.15.79:0/1973751685 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b500139c0 con 0x7f0b5406a930 2023-10-19T08:38:53.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.010+0000 7f0b5c3cf700 1 -- 172.21.15.79:0/1973751685 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b541f5b80 con 0x7f0b5406a930 2023-10-19T08:38:53.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.011+0000 7f0b5c3cf700 1 -- 172.21.15.79:0/1973751685 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5404ee70 con 0x7f0b5406a930 2023-10-19T08:38:53.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.011+0000 7f0b4affd700 1 -- 172.21.15.79:0/1973751685 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0b50013b20 con 0x7f0b5406a930 2023-10-19T08:38:53.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.012+0000 7f0b4affd700 1 --2- 172.21.15.79:0/1973751685 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0b3806a0e0 0x7f0b3806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:53.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.012+0000 7f0b5996a700 1 --2- 172.21.15.79:0/1973751685 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0b3806a0e0 0x7f0b3806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:53.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.012+0000 7f0b4affd700 1 -- 172.21.15.79:0/1973751685 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0b500885b0 con 0x7f0b5406a930 2023-10-19T08:38:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.012+0000 7f0b5996a700 1 --2- 172.21.15.79:0/1973751685 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0b3806a0e0 0x7f0b3806c5a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0b5406fa20 tx=0x7f0b44009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:53.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.016+0000 7f0b4affd700 1 -- 172.21.15.79:0/1973751685 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f0b50057410 con 0x7f0b5406a930 2023-10-19T08:38:53.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.206+0000 7f0b5c3cf700 1 -- 172.21.15.79:0/1973751685 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b540ca700 con 0x7f0b5406a930 2023-10-19T08:38:53.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.206+0000 7f0b4affd700 1 -- 172.21.15.79:0/1973751685 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b50056fa0 con 0x7f0b5406a930 2023-10-19T08:38:53.211 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-19T08:38:53.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.208+0000 7f0b5c3cf700 1 -- 172.21.15.79:0/1973751685 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0b3806a0e0 msgr2=0x7f0b3806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:53.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.208+0000 7f0b5c3cf700 1 --2- 172.21.15.79:0/1973751685 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0b3806a0e0 0x7f0b3806c5a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0b5406fa20 tx=0x7f0b44009040 comp rx=0 tx=0).stop 2023-10-19T08:38:53.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.208+0000 7f0b5c3cf700 1 -- 172.21.15.79:0/1973751685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b5406a930 msgr2=0x7f0b541f2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:53.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.208+0000 7f0b5c3cf700 1 --2- 172.21.15.79:0/1973751685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b5406a930 0x7f0b541f2f30 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000e810 tx=0x7f0b5000eb20 comp rx=0 tx=0).stop 2023-10-19T08:38:53.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.208+0000 7f0b5c3cf700 1 -- 172.21.15.79:0/1973751685 shutdown_connections 2023-10-19T08:38:53.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.208+0000 7f0b5c3cf700 1 --2- 172.21.15.79:0/1973751685 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b5415aec0 0x7f0b54159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.208+0000 7f0b5c3cf700 1 --2- 172.21.15.79:0/1973751685 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b5406a930 0x7f0b541f2f30 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.208+0000 7f0b5c3cf700 1 --2- 172.21.15.79:0/1973751685 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0b3806a0e0 0x7f0b3806c5a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.208+0000 7f0b5c3cf700 1 --2- 172.21.15.79:0/1973751685 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b540ca280 0x7f0b5415cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.208+0000 7f0b5c3cf700 1 -- 172.21.15.79:0/1973751685 >> 172.21.15.79:0/1973751685 conn(0x7f0b5406dcc0 msgr2=0x7f0b540b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:53.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.208+0000 7f0b5c3cf700 1 -- 172.21.15.79:0/1973751685 shutdown_connections 2023-10-19T08:38:53.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.208+0000 7f0b5c3cf700 1 -- 172.21.15.79:0/1973751685 wait complete. 2023-10-19T08:38:53.224 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T08:38:53.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.346+0000 7f9b0015e700 1 Processor -- start 2023-10-19T08:38:53.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.346+0000 7f9b0015e700 1 -- start start 2023-10-19T08:38:53.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.347+0000 7f9b0015e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9af80b0c00 0x7f9af80d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:53.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.347+0000 7f9b0015e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af80b25f0 con 0x7f9af80cb6f0 2023-10-19T08:38:53.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.347+0000 7f9b0015e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af80afd60 con 0x7f9af815e570 2023-10-19T08:38:53.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.347+0000 7f9b0015e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af80af810 con 0x7f9af80b0c00 2023-10-19T08:38:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.347+0000 7f9afe6fb700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9af80cb6f0 0x7f9af80ad9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57546/0 (socket says 172.21.15.79:57546) 2023-10-19T08:38:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.347+0000 7f9afe6fb700 1 -- 172.21.15.79:0/4206749118 learned_addr learned my addr 172.21.15.79:0/4206749118 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.347+0000 7f9afd6f9700 1 --2- 172.21.15.79:0/4206749118 >> v2:172.21.15.89:3300/0 conn(0x7f9af80b0c00 0x7f9af80d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.347+0000 7f9afcef8700 1 -- 172.21.15.79:0/4206749118 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107708007 0 0) 0x7f9af80b25f0 con 0x7f9af80cb6f0 2023-10-19T08:38:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.347+0000 7f9afcef8700 1 -- 172.21.15.79:0/4206749118 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ae40035b0 con 0x7f9af80cb6f0 2023-10-19T08:38:53.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.347+0000 7f9afd6f9700 1 -- 172.21.15.79:0/4206749118 >> v1:172.21.15.89:6789/0 conn(0x7f9af815e570 legacy=0x7f9af80b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:53.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.347+0000 7f9afcef8700 1 -- 172.21.15.79:0/4206749118 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2821843732 0 0) 0x7f9ae40035b0 con 0x7f9af80cb6f0 2023-10-19T08:38:53.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.347+0000 7f9afd6f9700 1 -- 172.21.15.79:0/4206749118 >> v1:172.21.15.79:6789/0 conn(0x7f9af80cb6f0 legacy=0x7f9af80ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:53.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.347+0000 7f9afd6f9700 1 -- 172.21.15.79:0/4206749118 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af80aef70 con 0x7f9af80b0c00 2023-10-19T08:38:53.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.348+0000 7f9afd6f9700 1 --2- 172.21.15.79:0/4206749118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af80b0c00 0x7f9af80d1990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009840 tx=0x7f9ae8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3f4df1c92f77da4 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:53.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.348+0000 7f9afcef8700 1 -- 172.21.15.79:0/4206749118 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af00019f0 con 0x7f9af80b0c00 2023-10-19T08:38:53.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.348+0000 7f9afcef8700 1 -- 172.21.15.79:0/4206749118 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae8004030 con 0x7f9af80b0c00 2023-10-19T08:38:53.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.348+0000 7f9afcef8700 1 -- 172.21.15.79:0/4206749118 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80043c0 con 0x7f9af80b0c00 2023-10-19T08:38:53.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.348+0000 7f9b0015e700 1 -- 172.21.15.79:0/4206749118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af80b0c00 msgr2=0x7f9af80d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:53.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.348+0000 7f9b0015e700 1 --2- 172.21.15.79:0/4206749118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af80b0c00 0x7f9af80d1990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009840 tx=0x7f9ae8009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:53.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.348+0000 7f9b0015e700 1 -- 172.21.15.79:0/4206749118 shutdown_connections 2023-10-19T08:38:53.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.348+0000 7f9b0015e700 1 --2- 172.21.15.79:0/4206749118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af80b0c00 0x7f9af80d1990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.348+0000 7f9b0015e700 1 -- 172.21.15.79:0/4206749118 >> 172.21.15.79:0/4206749118 conn(0x7f9af809a0b0 msgr2=0x7f9af80d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:53.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.348+0000 7f9b0015e700 1 -- 172.21.15.79:0/4206749118 shutdown_connections 2023-10-19T08:38:53.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.348+0000 7f9b0015e700 1 -- 172.21.15.79:0/4206749118 wait complete. 2023-10-19T08:38:53.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.349+0000 7f9b0015e700 1 Processor -- start 2023-10-19T08:38:53.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.349+0000 7f9b0015e700 1 -- start start 2023-10-19T08:38:53.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.350+0000 7f9b0015e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9af80b0c00 0x7f9af80c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:53.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.350+0000 7f9b0015e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9af80cb6f0 0x7f9af814b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:53.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.350+0000 7f9b0015e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af815e570 0x7f9af80c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:53.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.350+0000 7f9b0015e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af81f1550 con 0x7f9af80b0c00 2023-10-19T08:38:53.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.350+0000 7f9b0015e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af81f0960 con 0x7f9af815e570 2023-10-19T08:38:53.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.350+0000 7f9b0015e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af81f0c20 con 0x7f9af80cb6f0 2023-10-19T08:38:53.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.350+0000 7f9afdefa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9af80b0c00 0x7f9af80c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:53.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.350+0000 7f9afdefa700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9af80b0c00 0x7f9af80c9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47476/0 (socket says 172.21.15.79:47476) 2023-10-19T08:38:53.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.350+0000 7f9afdefa700 1 -- 172.21.15.79:0/3029722766 learned_addr learned my addr 172.21.15.79:0/3029722766 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:53.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.350+0000 7f9afe6fb700 1 --2- 172.21.15.79:0/3029722766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af815e570 0x7f9af80c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:53.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.350+0000 7f9afd6f9700 1 --2- 172.21.15.79:0/3029722766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9af80cb6f0 0x7f9af814b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:53.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.351+0000 7f9afdefa700 1 -- 172.21.15.79:0/3029722766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9af80cb6f0 msgr2=0x7f9af814b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:53.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.351+0000 7f9afdefa700 1 --2- 172.21.15.79:0/3029722766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9af80cb6f0 0x7f9af814b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.351+0000 7f9afdefa700 1 -- 172.21.15.79:0/3029722766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af815e570 msgr2=0x7f9af80c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:53.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.351+0000 7f9afdefa700 1 --2- 172.21.15.79:0/3029722766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af815e570 0x7f9af80c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.351+0000 7f9afdefa700 1 -- 172.21.15.79:0/3029722766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae80094a0 con 0x7f9af80b0c00 2023-10-19T08:38:53.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.351+0000 7f9afdefa700 1 --2- 172.21.15.79:0/3029722766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9af80b0c00 0x7f9af80c9600 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9af400c450 tx=0x7f9af400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:53.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.351+0000 7f9aee7fc700 1 -- 172.21.15.79:0/3029722766 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af40052d0 con 0x7f9af80b0c00 2023-10-19T08:38:53.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.351+0000 7f9aee7fc700 1 -- 172.21.15.79:0/3029722766 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af4005430 con 0x7f9af80b0c00 2023-10-19T08:38:53.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.351+0000 7f9aee7fc700 1 -- 172.21.15.79:0/3029722766 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af40038c0 con 0x7f9af80b0c00 2023-10-19T08:38:53.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.351+0000 7f9b0015e700 1 -- 172.21.15.79:0/3029722766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af81f0f00 con 0x7f9af80b0c00 2023-10-19T08:38:53.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.351+0000 7f9b0015e700 1 -- 172.21.15.79:0/3029722766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af814b6f0 con 0x7f9af80b0c00 2023-10-19T08:38:53.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.352+0000 7f9b0015e700 1 -- 172.21.15.79:0/3029722766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af804ee70 con 0x7f9af80b0c00 2023-10-19T08:38:53.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.352+0000 7f9aee7fc700 1 -- 172.21.15.79:0/3029722766 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9af4003a20 con 0x7f9af80b0c00 2023-10-19T08:38:53.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.353+0000 7f9aee7fc700 1 --2- 172.21.15.79:0/3029722766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9adc06a0e0 0x7f9adc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:53.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.353+0000 7f9aee7fc700 1 -- 172.21.15.79:0/3029722766 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9af4087c30 con 0x7f9af80b0c00 2023-10-19T08:38:53.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.353+0000 7f9afd6f9700 1 --2- 172.21.15.79:0/3029722766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9adc06a0e0 0x7f9adc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:53.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.353+0000 7f9afd6f9700 1 --2- 172.21.15.79:0/3029722766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9adc06a0e0 0x7f9adc06c5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80090b0 tx=0x7f9ae8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:53.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.357+0000 7f9aee7fc700 1 -- 172.21.15.79:0/3029722766 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f9af4052ff0 con 0x7f9af80b0c00 2023-10-19T08:38:53.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.548+0000 7f9b0015e700 1 -- 172.21.15.79:0/3029722766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9af815db80 con 0x7f9af80b0c00 2023-10-19T08:38:53.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.549+0000 7f9aee7fc700 1 -- 172.21.15.79:0/3029722766 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9af4056610 con 0x7f9af80b0c00 2023-10-19T08:38:53.554 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:53.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.551+0000 7f9b0015e700 1 -- 172.21.15.79:0/3029722766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9adc06a0e0 msgr2=0x7f9adc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:53.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.551+0000 7f9b0015e700 1 --2- 172.21.15.79:0/3029722766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9adc06a0e0 0x7f9adc06c5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9ae80090b0 tx=0x7f9ae8008030 comp rx=0 tx=0).stop 2023-10-19T08:38:53.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.551+0000 7f9b0015e700 1 -- 172.21.15.79:0/3029722766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9af80b0c00 msgr2=0x7f9af80c9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:53.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.551+0000 7f9b0015e700 1 --2- 172.21.15.79:0/3029722766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9af80b0c00 0x7f9af80c9600 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9af400c450 tx=0x7f9af400c810 comp rx=0 tx=0).stop 2023-10-19T08:38:53.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.551+0000 7f9b0015e700 1 -- 172.21.15.79:0/3029722766 shutdown_connections 2023-10-19T08:38:53.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.551+0000 7f9b0015e700 1 --2- 172.21.15.79:0/3029722766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9af815e570 0x7f9af80c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.551+0000 7f9b0015e700 1 --2- 172.21.15.79:0/3029722766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9af80b0c00 0x7f9af80c9600 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.551+0000 7f9b0015e700 1 --2- 172.21.15.79:0/3029722766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9adc06a0e0 0x7f9adc06c5a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.551+0000 7f9b0015e700 1 --2- 172.21.15.79:0/3029722766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9af80cb6f0 0x7f9af814b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.551+0000 7f9b0015e700 1 -- 172.21.15.79:0/3029722766 >> 172.21.15.79:0/3029722766 conn(0x7f9af809a0b0 msgr2=0x7f9af815c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:53.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.551+0000 7f9b0015e700 1 -- 172.21.15.79:0/3029722766 shutdown_connections 2023-10-19T08:38:53.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.551+0000 7f9b0015e700 1 -- 172.21.15.79:0/3029722766 wait complete. 2023-10-19T08:38:53.567 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-19T08:38:53.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.686+0000 7fb1a4c41700 1 Processor -- start 2023-10-19T08:38:53.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.686+0000 7fb1a4c41700 1 -- start start 2023-10-19T08:38:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.686+0000 7fb1a4c41700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb1a00cd270 0x7fb1a006a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.686+0000 7fb1a4c41700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb1a00cc2a0 0x7fb1a006a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:53.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.686+0000 7fb1a4c41700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a00b1fe0 con 0x7fb1a00703b0 2023-10-19T08:38:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.686+0000 7fb1a4c41700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a0160a80 con 0x7fb1a00cd270 2023-10-19T08:38:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.687+0000 7fb1a4c41700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a00ce2b0 con 0x7fb1a00cc2a0 2023-10-19T08:38:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.687+0000 7fb19e59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb1a00cd270 0x7fb1a006a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:53.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.687+0000 7fb19dd9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb1a00703b0 0x7fb1a0160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57556/0 (socket says 172.21.15.79:57556) 2023-10-19T08:38:53.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.687+0000 7fb19dd9b700 1 -- 172.21.15.79:0/997287365 learned_addr learned my addr 172.21.15.79:0/997287365 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:53.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.687+0000 7fb19ed9d700 1 --2- 172.21.15.79:0/997287365 >> v2:172.21.15.89:3300/0 conn(0x7fb1a00cc2a0 0x7fb1a006a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:53.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.687+0000 7fb19e59c700 1 -- 172.21.15.79:0/997287365 >> v2:172.21.15.89:3300/0 conn(0x7fb1a00cc2a0 msgr2=0x7fb1a006a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:53.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.687+0000 7fb19e59c700 1 --2- 172.21.15.79:0/997287365 >> v2:172.21.15.89:3300/0 conn(0x7fb1a00cc2a0 0x7fb1a006a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.687+0000 7fb19e59c700 1 -- 172.21.15.79:0/997287365 >> v1:172.21.15.79:6789/0 conn(0x7fb1a00703b0 legacy=0x7fb1a0160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:53.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.687+0000 7fb19d59a700 1 -- 172.21.15.79:0/997287365 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638770411 0 0) 0x7fb1a00b1fe0 con 0x7fb1a00703b0 2023-10-19T08:38:53.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.687+0000 7fb19e59c700 1 -- 172.21.15.79:0/997287365 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a00ce550 con 0x7fb1a00cd270 2023-10-19T08:38:53.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.687+0000 7fb19e59c700 1 --2- 172.21.15.79:0/997287365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1a00cd270 0x7fb1a006a220 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb1a006b2a0 tx=0x7fb190009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a62ba516605f47 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:53.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.687+0000 7fb19d59a700 1 -- 172.21.15.79:0/997287365 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190011830 con 0x7fb1a00cd270 2023-10-19T08:38:53.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.687+0000 7fb19d59a700 1 -- 172.21.15.79:0/997287365 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb190011990 con 0x7fb1a00cd270 2023-10-19T08:38:53.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.687+0000 7fb19d59a700 1 -- 172.21.15.79:0/997287365 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190011d20 con 0x7fb1a00cd270 2023-10-19T08:38:53.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.688+0000 7fb1a4c41700 1 -- 172.21.15.79:0/997287365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1a00cd270 msgr2=0x7fb1a006a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:53.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.688+0000 7fb1a4c41700 1 --2- 172.21.15.79:0/997287365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1a00cd270 0x7fb1a006a220 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb1a006b2a0 tx=0x7fb190009b20 comp rx=0 tx=0).stop 2023-10-19T08:38:53.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.688+0000 7fb1a4c41700 1 -- 172.21.15.79:0/997287365 shutdown_connections 2023-10-19T08:38:53.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.688+0000 7fb1a4c41700 1 --2- 172.21.15.79:0/997287365 >> v2:172.21.15.89:3300/0 conn(0x7fb1a00cc2a0 0x7fb1a006a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.688+0000 7fb1a4c41700 1 --2- 172.21.15.79:0/997287365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1a00cd270 0x7fb1a006a220 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.688+0000 7fb1a4c41700 1 -- 172.21.15.79:0/997287365 >> 172.21.15.79:0/997287365 conn(0x7fb1a006dcc0 msgr2=0x7fb1a006e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:53.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.688+0000 7fb1a4c41700 1 -- 172.21.15.79:0/997287365 shutdown_connections 2023-10-19T08:38:53.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.688+0000 7fb1a4c41700 1 -- 172.21.15.79:0/997287365 wait complete. 2023-10-19T08:38:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.689+0000 7fb1a4c41700 1 Processor -- start 2023-10-19T08:38:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.689+0000 7fb1a4c41700 1 -- start start 2023-10-19T08:38:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.690+0000 7fb1a4c41700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1a00703b0 0x7fb1a015d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:53.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.690+0000 7fb1a4c41700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1a00cc2a0 0x7fb1a0160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.690+0000 7fb1a4c41700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1a00cd270 0x7fb1a0161100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.690+0000 7fb1a4c41700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a00b3a50 con 0x7fb1a00cc2a0 2023-10-19T08:38:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.690+0000 7fb1a4c41700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a015db80 con 0x7fb1a00cd270 2023-10-19T08:38:53.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.690+0000 7fb1a4c41700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a00b29f0 con 0x7fb1a00703b0 2023-10-19T08:38:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.690+0000 7fb19dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1a00cc2a0 0x7fb1a0160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.690+0000 7fb19dd9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1a00cc2a0 0x7fb1a0160bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47490/0 (socket says 172.21.15.79:47490) 2023-10-19T08:38:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.690+0000 7fb19dd9b700 1 -- 172.21.15.79:0/372344023 learned_addr learned my addr 172.21.15.79:0/372344023 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.690+0000 7fb19dd9b700 1 -- 172.21.15.79:0/372344023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1a00703b0 msgr2=0x7fb1a015d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:53.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.690+0000 7fb19dd9b700 1 --2- 172.21.15.79:0/372344023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1a00703b0 0x7fb1a015d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.690+0000 7fb19dd9b700 1 -- 172.21.15.79:0/372344023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1a00cd270 msgr2=0x7fb1a0161100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:53.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.690+0000 7fb19dd9b700 1 --2- 172.21.15.79:0/372344023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1a00cd270 0x7fb1a0161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.690+0000 7fb19dd9b700 1 -- 172.21.15.79:0/372344023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1900094a0 con 0x7fb1a00cc2a0 2023-10-19T08:38:53.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.691+0000 7fb19dd9b700 1 --2- 172.21.15.79:0/372344023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1a00cc2a0 0x7fb1a0160bc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb19400c550 tx=0x7fb19400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:53.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.691+0000 7fb18effd700 1 -- 172.21.15.79:0/372344023 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194004c80 con 0x7fb1a00cc2a0 2023-10-19T08:38:53.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.691+0000 7fb18effd700 1 -- 172.21.15.79:0/372344023 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb194004e00 con 0x7fb1a00cc2a0 2023-10-19T08:38:53.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.691+0000 7fb1a4c41700 1 -- 172.21.15.79:0/372344023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a00b2c90 con 0x7fb1a00cc2a0 2023-10-19T08:38:53.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.691+0000 7fb18effd700 1 -- 172.21.15.79:0/372344023 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194007310 con 0x7fb1a00cc2a0 2023-10-19T08:38:53.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.691+0000 7fb1a4c41700 1 -- 172.21.15.79:0/372344023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a00b3250 con 0x7fb1a00cc2a0 2023-10-19T08:38:53.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.692+0000 7fb1a4c41700 1 -- 172.21.15.79:0/372344023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a0066b10 con 0x7fb1a00cc2a0 2023-10-19T08:38:53.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.692+0000 7fb18effd700 1 -- 172.21.15.79:0/372344023 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb194007470 con 0x7fb1a00cc2a0 2023-10-19T08:38:53.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.693+0000 7fb18effd700 1 --2- 172.21.15.79:0/372344023 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fb18006a0e0 0x7fb18006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:53.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.693+0000 7fb18effd700 1 -- 172.21.15.79:0/372344023 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb194088b40 con 0x7fb1a00cc2a0 2023-10-19T08:38:53.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.693+0000 7fb19e59c700 1 --2- 172.21.15.79:0/372344023 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fb18006a0e0 0x7fb18006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:53.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.693+0000 7fb19e59c700 1 --2- 172.21.15.79:0/372344023 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fb18006a0e0 0x7fb18006c5a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb1900090b0 tx=0x7fb190010000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:53.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.697+0000 7fb18effd700 1 -- 172.21.15.79:0/372344023 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fb194054070 con 0x7fb1a00cc2a0 2023-10-19T08:38:53.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.887+0000 7fb1a4c41700 1 -- 172.21.15.79:0/372344023 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb1a006fbf0 con 0x7fb1a00cc2a0 2023-10-19T08:38:53.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.891+0000 7fb18effd700 1 -- 172.21.15.79:0/372344023 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb194057690 con 0x7fb1a00cc2a0 2023-10-19T08:38:53.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.893+0000 7fb1a4c41700 1 -- 172.21.15.79:0/372344023 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fb18006a0e0 msgr2=0x7fb18006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:53.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.893+0000 7fb1a4c41700 1 --2- 172.21.15.79:0/372344023 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fb18006a0e0 0x7fb18006c5a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb1900090b0 tx=0x7fb190010000 comp rx=0 tx=0).stop 2023-10-19T08:38:53.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.893+0000 7fb1a4c41700 1 -- 172.21.15.79:0/372344023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1a00cc2a0 msgr2=0x7fb1a0160bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:53.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.893+0000 7fb1a4c41700 1 --2- 172.21.15.79:0/372344023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1a00cc2a0 0x7fb1a0160bc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb19400c550 tx=0x7fb19400c910 comp rx=0 tx=0).stop 2023-10-19T08:38:53.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.893+0000 7fb1a4c41700 1 -- 172.21.15.79:0/372344023 shutdown_connections 2023-10-19T08:38:53.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.893+0000 7fb1a4c41700 1 --2- 172.21.15.79:0/372344023 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1a00cd270 0x7fb1a0161100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.893+0000 7fb1a4c41700 1 --2- 172.21.15.79:0/372344023 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fb18006a0e0 0x7fb18006c5a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.893+0000 7fb1a4c41700 1 --2- 172.21.15.79:0/372344023 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1a00703b0 0x7fb1a015d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.893+0000 7fb1a4c41700 1 --2- 172.21.15.79:0/372344023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1a00cc2a0 0x7fb1a0160bc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:53.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.894+0000 7fb1a4c41700 1 -- 172.21.15.79:0/372344023 >> 172.21.15.79:0/372344023 conn(0x7fb1a006dcc0 msgr2=0x7fb1a006e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:53.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.894+0000 7fb1a4c41700 1 -- 172.21.15.79:0/372344023 shutdown_connections 2023-10-19T08:38:53.901 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:53.894+0000 7fb1a4c41700 1 -- 172.21.15.79:0/372344023 wait complete. 2023-10-19T08:38:53.910 INFO:tasks.cephfs_test_runner:Simulate software freeze or temporary network failure. ... skipped 'Require first client to be on separate server from MDSs' 2023-10-19T08:38:53.910 INFO:tasks.cephfs_test_runner:Starting test: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) If any client gets unresponsive/it's session get idle due to lagginess 2023-10-19T08:38:53.911 INFO:tasks.cephfs_test_runner:test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) 2023-10-19T08:38:53.911 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD.test_client_eviction_if_config_is_set' 2023-10-19T08:38:54.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.027+0000 7f6cd038e700 1 Processor -- start 2023-10-19T08:38:54.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.027+0000 7f6cd038e700 1 -- start start 2023-10-19T08:38:54.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.028+0000 7f6cd038e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cc80b0710 0x7f6cc80b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:54.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.028+0000 7f6cd038e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6cc80b1d50 0x7f6cc80b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:54.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.028+0000 7f6cd038e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc806c5a0 con 0x7f6cc80d14f0 2023-10-19T08:38:54.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.028+0000 7f6cd038e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc8160cb0 con 0x7f6cc80b1d50 2023-10-19T08:38:54.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.028+0000 7f6cd038e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc806bd40 con 0x7f6cc80b0710 2023-10-19T08:38:54.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.028+0000 7f6cce92b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6cc80b1d50 0x7f6cc80b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:54.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.028+0000 7f6cce92b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6cc80b1d50 0x7f6cc80b21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47502/0 (socket says 172.21.15.79:47502) 2023-10-19T08:38:54.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.028+0000 7f6cce92b700 1 -- 172.21.15.79:0/3761825247 learned_addr learned my addr 172.21.15.79:0/3761825247 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:54.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.028+0000 7f6cce12a700 1 --2- 172.21.15.79:0/3761825247 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cc80b0710 0x7f6cc80b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:54.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.028+0000 7f6cce92b700 1 -- 172.21.15.79:0/3761825247 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cc80b0710 msgr2=0x7f6cc80b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:54.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.028+0000 7f6cce92b700 1 --2- 172.21.15.79:0/3761825247 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cc80b0710 0x7f6cc80b0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:54.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.028+0000 7f6cce92b700 1 -- 172.21.15.79:0/3761825247 >> v1:172.21.15.89:6789/0 conn(0x7f6cc80d14f0 legacy=0x7f6cc80ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:54.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.028+0000 7f6cce92b700 1 -- 172.21.15.79:0/3761825247 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc80b1030 con 0x7f6cc80b1d50 2023-10-19T08:38:54.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.028+0000 7f6cce92b700 1 --2- 172.21.15.79:0/3761825247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cc80b1d50 0x7f6cc80b21e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0009e50 tx=0x7f6cc000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245510d20832fb45 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:54.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.028+0000 7f6ccd128700 1 -- 172.21.15.79:0/3761825247 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc000e070 con 0x7f6cc80b1d50 2023-10-19T08:38:54.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.029+0000 7f6ccd128700 1 -- 172.21.15.79:0/3761825247 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc0003a20 con 0x7f6cc80b1d50 2023-10-19T08:38:54.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.029+0000 7f6ccd128700 1 -- 172.21.15.79:0/3761825247 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0003dd0 con 0x7f6cc80b1d50 2023-10-19T08:38:54.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.029+0000 7f6cd038e700 1 -- 172.21.15.79:0/3761825247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cc80b1d50 msgr2=0x7f6cc80b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:54.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.029+0000 7f6cd038e700 1 --2- 172.21.15.79:0/3761825247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cc80b1d50 0x7f6cc80b21e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0009e50 tx=0x7f6cc000b330 comp rx=0 tx=0).stop 2023-10-19T08:38:54.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.029+0000 7f6cd038e700 1 -- 172.21.15.79:0/3761825247 shutdown_connections 2023-10-19T08:38:54.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.029+0000 7f6cd038e700 1 --2- 172.21.15.79:0/3761825247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cc80b1d50 0x7f6cc80b21e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:54.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.029+0000 7f6cd038e700 1 --2- 172.21.15.79:0/3761825247 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cc80b0710 0x7f6cc80b0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:54.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.029+0000 7f6cd038e700 1 -- 172.21.15.79:0/3761825247 >> 172.21.15.79:0/3761825247 conn(0x7f6cc809a0b0 msgr2=0x7f6cc80d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:54.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.029+0000 7f6cd038e700 1 -- 172.21.15.79:0/3761825247 shutdown_connections 2023-10-19T08:38:54.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.029+0000 7f6cd038e700 1 -- 172.21.15.79:0/3761825247 wait complete. 2023-10-19T08:38:54.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.030+0000 7f6cd038e700 1 Processor -- start 2023-10-19T08:38:54.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.030+0000 7f6cd038e700 1 -- start start 2023-10-19T08:38:54.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.031+0000 7f6cd038e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cc80b0710 0x7f6cc815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:54.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.031+0000 7f6cd038e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cc80b1d50 0x7f6cc815d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:54.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.031+0000 7f6cd038e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cc80d14f0 0x7f6cc809ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:54.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.031+0000 7f6cd038e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc815d8e0 con 0x7f6cc80b1d50 2023-10-19T08:38:54.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.031+0000 7f6cd038e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc815aa30 con 0x7f6cc80d14f0 2023-10-19T08:38:54.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.031+0000 7f6cd038e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc815daf0 con 0x7f6cc80b0710 2023-10-19T08:38:54.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.031+0000 7f6ccd929700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cc80b1d50 0x7f6cc815d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:54.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.031+0000 7f6ccd929700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cc80b1d50 0x7f6cc815d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47506/0 (socket says 172.21.15.79:47506) 2023-10-19T08:38:54.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.031+0000 7f6ccd929700 1 -- 172.21.15.79:0/3722838118 learned_addr learned my addr 172.21.15.79:0/3722838118 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:54.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.031+0000 7f6cce12a700 1 --2- 172.21.15.79:0/3722838118 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cc80b0710 0x7f6cc815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:54.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.031+0000 7f6cce92b700 1 --2- 172.21.15.79:0/3722838118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cc80d14f0 0x7f6cc809ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:54.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.031+0000 7f6ccd929700 1 -- 172.21.15.79:0/3722838118 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cc80b0710 msgr2=0x7f6cc815a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:54.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.031+0000 7f6ccd929700 1 --2- 172.21.15.79:0/3722838118 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cc80b0710 0x7f6cc815a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:54.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.031+0000 7f6ccd929700 1 -- 172.21.15.79:0/3722838118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cc80d14f0 msgr2=0x7f6cc809ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:54.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.031+0000 7f6ccd929700 1 --2- 172.21.15.79:0/3722838118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cc80d14f0 0x7f6cc809ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:54.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.031+0000 7f6ccd929700 1 -- 172.21.15.79:0/3722838118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc0009b30 con 0x7f6cc80b1d50 2023-10-19T08:38:54.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.031+0000 7f6cce92b700 1 --2- 172.21.15.79:0/3722838118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cc80d14f0 0x7f6cc809ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:54.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.032+0000 7f6ccd929700 1 --2- 172.21.15.79:0/3722838118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cc80b1d50 0x7f6cc815d0f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800b4a0 tx=0x7f6cb800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:54.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.032+0000 7f6cbeffd700 1 -- 172.21.15.79:0/3722838118 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8011830 con 0x7f6cc80b1d50 2023-10-19T08:38:54.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.032+0000 7f6cbeffd700 1 -- 172.21.15.79:0/3722838118 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb8011990 con 0x7f6cc80b1d50 2023-10-19T08:38:54.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.032+0000 7f6cd038e700 1 -- 172.21.15.79:0/3722838118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc815ddd0 con 0x7f6cc80b1d50 2023-10-19T08:38:54.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.032+0000 7f6cbeffd700 1 -- 172.21.15.79:0/3722838118 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8011d40 con 0x7f6cc80b1d50 2023-10-19T08:38:54.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.032+0000 7f6cd038e700 1 -- 172.21.15.79:0/3722838118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc80b2ce0 con 0x7f6cc80b1d50 2023-10-19T08:38:54.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.033+0000 7f6cd038e700 1 -- 172.21.15.79:0/3722838118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc815e010 con 0x7f6cc80b1d50 2023-10-19T08:38:54.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.033+0000 7f6cbeffd700 1 -- 172.21.15.79:0/3722838118 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6cb801a400 con 0x7f6cc80b1d50 2023-10-19T08:38:54.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.033+0000 7f6cbeffd700 1 --2- 172.21.15.79:0/3722838118 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6cac06a0e0 0x7f6cac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:54.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.034+0000 7f6cbeffd700 1 -- 172.21.15.79:0/3722838118 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6cb8088500 con 0x7f6cc80b1d50 2023-10-19T08:38:54.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.034+0000 7f6cce12a700 1 --2- 172.21.15.79:0/3722838118 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6cac06a0e0 0x7f6cac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:54.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.034+0000 7f6cce12a700 1 --2- 172.21.15.79:0/3722838118 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6cac06a0e0 0x7f6cac06c5a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400a990 tx=0x7f6cc4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:54.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.038+0000 7f6cbeffd700 1 -- 172.21.15.79:0/3722838118 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6cc815e010 con 0x7f6cc80b1d50 2023-10-19T08:38:54.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.307+0000 7f6cd038e700 1 -- 172.21.15.79:0/3722838118 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD.test_client_eviction_if_config_is_set"]} v 0) v1 -- 0x7f6cc80b2f00 con 0x7f6cc80b1d50 2023-10-19T08:38:54.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.515+0000 7f6cbeffd700 1 -- 172.21.15.79:0/3722838118 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD.test_client_eviction_if_config_is_set"]}]=0 v67) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6cb8053950 con 0x7f6cc80b1d50 2023-10-19T08:38:54.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.518+0000 7f6cd038e700 1 -- 172.21.15.79:0/3722838118 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6cac06a0e0 msgr2=0x7f6cac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:54.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.518+0000 7f6cd038e700 1 --2- 172.21.15.79:0/3722838118 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6cac06a0e0 0x7f6cac06c5a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400a990 tx=0x7f6cc4008040 comp rx=0 tx=0).stop 2023-10-19T08:38:54.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.518+0000 7f6cd038e700 1 -- 172.21.15.79:0/3722838118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cc80b1d50 msgr2=0x7f6cc815d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:54.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.518+0000 7f6cd038e700 1 --2- 172.21.15.79:0/3722838118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cc80b1d50 0x7f6cc815d0f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800b4a0 tx=0x7f6cb800b860 comp rx=0 tx=0).stop 2023-10-19T08:38:54.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.518+0000 7f6cd038e700 1 -- 172.21.15.79:0/3722838118 shutdown_connections 2023-10-19T08:38:54.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.518+0000 7f6cd038e700 1 --2- 172.21.15.79:0/3722838118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6cc80d14f0 0x7f6cc809ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:54.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.518+0000 7f6cd038e700 1 --2- 172.21.15.79:0/3722838118 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6cac06a0e0 0x7f6cac06c5a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:54.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.518+0000 7f6cd038e700 1 --2- 172.21.15.79:0/3722838118 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6cc80b0710 0x7f6cc815a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:54.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.518+0000 7f6cd038e700 1 --2- 172.21.15.79:0/3722838118 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6cc80b1d50 0x7f6cc815d0f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:54.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.518+0000 7f6cd038e700 1 -- 172.21.15.79:0/3722838118 >> 172.21.15.79:0/3722838118 conn(0x7f6cc809a0b0 msgr2=0x7f6cc80af6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:54.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.518+0000 7f6cd038e700 1 -- 172.21.15.79:0/3722838118 shutdown_connections 2023-10-19T08:38:54.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.518+0000 7f6cd038e700 1 -- 172.21.15.79:0/3722838118 wait complete. 2023-10-19T08:38:54.534 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:54.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.652+0000 7f86844b1700 1 Processor -- start 2023-10-19T08:38:54.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.652+0000 7f86844b1700 1 -- start start 2023-10-19T08:38:54.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.652+0000 7f86844b1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f867c0b4cb0 0x7f867c0ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:54.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.652+0000 7f86844b1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f867c06ed60 0x7f867c0b2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:54.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.652+0000 7f86844b1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c06f4b0 con 0x7f867c06b5b0 2023-10-19T08:38:54.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.652+0000 7f86844b1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c06f700 con 0x7f867c06ed60 2023-10-19T08:38:54.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.652+0000 7f86844b1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867c06f9e0 con 0x7f867c0b4cb0 2023-10-19T08:38:54.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.652+0000 7f8682a4e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f867c06ed60 0x7f867c0b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:54.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.652+0000 7f8682a4e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f867c06ed60 0x7f867c0b2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47514/0 (socket says 172.21.15.79:47514) 2023-10-19T08:38:54.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.652+0000 7f8682a4e700 1 -- 172.21.15.79:0/4156167737 learned_addr learned my addr 172.21.15.79:0/4156167737 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:54.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.652+0000 7f868224d700 1 --2- 172.21.15.79:0/4156167737 >> v2:172.21.15.89:3300/0 conn(0x7f867c0b4cb0 0x7f867c0ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:54.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.652+0000 7f8682a4e700 1 -- 172.21.15.79:0/4156167737 >> v2:172.21.15.89:3300/0 conn(0x7f867c0b4cb0 msgr2=0x7f867c0ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:54.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.652+0000 7f8682a4e700 1 --2- 172.21.15.79:0/4156167737 >> v2:172.21.15.89:3300/0 conn(0x7f867c0b4cb0 0x7f867c0ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:54.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.652+0000 7f8682a4e700 1 -- 172.21.15.79:0/4156167737 >> v1:172.21.15.89:6789/0 conn(0x7f867c06b5b0 legacy=0x7f867c06e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:54.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.652+0000 7f8682a4e700 1 -- 172.21.15.79:0/4156167737 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c06adb0 con 0x7f867c06ed60 2023-10-19T08:38:54.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.652+0000 7f8682a4e700 1 --2- 172.21.15.79:0/4156167737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f867c06ed60 0x7f867c0b2290 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8674009e50 tx=0x7f867400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617403ef898e5df0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:54.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.652+0000 7f868124b700 1 -- 172.21.15.79:0/4156167737 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867400e070 con 0x7f867c06ed60 2023-10-19T08:38:54.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.652+0000 7f868124b700 1 -- 172.21.15.79:0/4156167737 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8674003a20 con 0x7f867c06ed60 2023-10-19T08:38:54.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.652+0000 7f868124b700 1 -- 172.21.15.79:0/4156167737 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674003dd0 con 0x7f867c06ed60 2023-10-19T08:38:54.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.653+0000 7f86844b1700 1 -- 172.21.15.79:0/4156167737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f867c06ed60 msgr2=0x7f867c0b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:54.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.653+0000 7f86844b1700 1 --2- 172.21.15.79:0/4156167737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f867c06ed60 0x7f867c0b2290 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8674009e50 tx=0x7f867400b330 comp rx=0 tx=0).stop 2023-10-19T08:38:54.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.653+0000 7f86844b1700 1 -- 172.21.15.79:0/4156167737 shutdown_connections 2023-10-19T08:38:54.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.653+0000 7f86844b1700 1 --2- 172.21.15.79:0/4156167737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f867c06ed60 0x7f867c0b2290 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:54.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.653+0000 7f86844b1700 1 --2- 172.21.15.79:0/4156167737 >> v2:172.21.15.89:3300/0 conn(0x7f867c0b4cb0 0x7f867c0ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:54.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.653+0000 7f86844b1700 1 -- 172.21.15.79:0/4156167737 >> 172.21.15.79:0/4156167737 conn(0x7f867c06d000 msgr2=0x7f867c06d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:54.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.653+0000 7f86844b1700 1 -- 172.21.15.79:0/4156167737 shutdown_connections 2023-10-19T08:38:54.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.653+0000 7f86844b1700 1 -- 172.21.15.79:0/4156167737 wait complete. 2023-10-19T08:38:54.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.654+0000 7f86844b1700 1 Processor -- start 2023-10-19T08:38:54.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.654+0000 7f86844b1700 1 -- start start 2023-10-19T08:38:54.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f86844b1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f867c06b5b0 0x7f867c153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:54.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f86844b1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f867c06ed60 0x7f867c0c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:54.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f86844b1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f867c0b4cb0 0x7f867c0c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:54.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f86844b1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0c4070 con 0x7f867c06ed60 2023-10-19T08:38:54.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f86844b1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0c5890 con 0x7f867c0b4cb0 2023-10-19T08:38:54.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f86844b1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0c4260 con 0x7f867c06b5b0 2023-10-19T08:38:54.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f8681a4c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f867c06ed60 0x7f867c0c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:54.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f8681a4c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f867c06ed60 0x7f867c0c3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47518/0 (socket says 172.21.15.79:47518) 2023-10-19T08:38:54.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f8681a4c700 1 -- 172.21.15.79:0/1012685704 learned_addr learned my addr 172.21.15.79:0/1012685704 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:54.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f8682a4e700 1 --2- 172.21.15.79:0/1012685704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f867c0b4cb0 0x7f867c0c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:54.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f868224d700 1 --2- 172.21.15.79:0/1012685704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f867c06b5b0 0x7f867c153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:54.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f8681a4c700 1 -- 172.21.15.79:0/1012685704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f867c06b5b0 msgr2=0x7f867c153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:54.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f8681a4c700 1 --2- 172.21.15.79:0/1012685704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f867c06b5b0 0x7f867c153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:54.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f8681a4c700 1 -- 172.21.15.79:0/1012685704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f867c0b4cb0 msgr2=0x7f867c0c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:54.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f8681a4c700 1 --2- 172.21.15.79:0/1012685704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f867c0b4cb0 0x7f867c0c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:54.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f8681a4c700 1 -- 172.21.15.79:0/1012685704 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8674009b30 con 0x7f867c06ed60 2023-10-19T08:38:54.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f868224d700 1 --2- 172.21.15.79:0/1012685704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f867c06b5b0 0x7f867c153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:54.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f8681a4c700 1 --2- 172.21.15.79:0/1012685704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f867c06ed60 0x7f867c0c3b30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f866c00b4a0 tx=0x7f866c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:54.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f8672ffd700 1 -- 172.21.15.79:0/1012685704 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c011830 con 0x7f867c06ed60 2023-10-19T08:38:54.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f8672ffd700 1 -- 172.21.15.79:0/1012685704 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866c0119b0 con 0x7f867c06ed60 2023-10-19T08:38:54.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f86844b1700 1 -- 172.21.15.79:0/1012685704 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c0c4590 con 0x7f867c06ed60 2023-10-19T08:38:54.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f8672ffd700 1 -- 172.21.15.79:0/1012685704 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866c011d60 con 0x7f867c06ed60 2023-10-19T08:38:54.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.655+0000 7f86844b1700 1 -- 172.21.15.79:0/1012685704 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c0c4b50 con 0x7f867c06ed60 2023-10-19T08:38:54.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.656+0000 7f86844b1700 1 -- 172.21.15.79:0/1012685704 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c04ee70 con 0x7f867c06ed60 2023-10-19T08:38:54.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.657+0000 7f8672ffd700 1 -- 172.21.15.79:0/1012685704 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f866c01a400 con 0x7f867c06ed60 2023-10-19T08:38:54.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.657+0000 7f8672ffd700 1 --2- 172.21.15.79:0/1012685704 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f866006a0e0 0x7f866006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:54.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.657+0000 7f8672ffd700 1 -- 172.21.15.79:0/1012685704 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f866c088980 con 0x7f867c06ed60 2023-10-19T08:38:54.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.657+0000 7f868224d700 1 --2- 172.21.15.79:0/1012685704 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f866006a0e0 0x7f866006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:54.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.658+0000 7f868224d700 1 --2- 172.21.15.79:0/1012685704 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f866006a0e0 0x7f866006c5a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8678006fd0 tx=0x7f8678008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:54.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.662+0000 7f8672ffd700 1 -- 172.21.15.79:0/1012685704 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f866c053cb0 con 0x7f867c06ed60 2023-10-19T08:38:54.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.852+0000 7f86844b1700 1 -- 172.21.15.79:0/1012685704 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f867c066610 con 0x7f867c06ed60 2023-10-19T08:38:54.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.853+0000 7f8672ffd700 1 -- 172.21.15.79:0/1012685704 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20155 (secure 0 0 0) 0x7f866c015020 con 0x7f867c06ed60 2023-10-19T08:38:54.858 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:54.858 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:44.473795+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:54.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.856+0000 7f86844b1700 1 -- 172.21.15.79:0/1012685704 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f866006a0e0 msgr2=0x7f866006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:54.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.856+0000 7f86844b1700 1 --2- 172.21.15.79:0/1012685704 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f866006a0e0 0x7f866006c5a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8678006fd0 tx=0x7f8678008040 comp rx=0 tx=0).stop 2023-10-19T08:38:54.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.856+0000 7f86844b1700 1 -- 172.21.15.79:0/1012685704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f867c06ed60 msgr2=0x7f867c0c3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:54.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.856+0000 7f86844b1700 1 --2- 172.21.15.79:0/1012685704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f867c06ed60 0x7f867c0c3b30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f866c00b4a0 tx=0x7f866c00b860 comp rx=0 tx=0).stop 2023-10-19T08:38:54.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.856+0000 7f86844b1700 1 -- 172.21.15.79:0/1012685704 shutdown_connections 2023-10-19T08:38:54.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.856+0000 7f86844b1700 1 --2- 172.21.15.79:0/1012685704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f867c0b4cb0 0x7f867c0c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:54.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.856+0000 7f86844b1700 1 --2- 172.21.15.79:0/1012685704 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f866006a0e0 0x7f866006c5a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:54.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.856+0000 7f86844b1700 1 --2- 172.21.15.79:0/1012685704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f867c06b5b0 0x7f867c153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:54.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.856+0000 7f86844b1700 1 --2- 172.21.15.79:0/1012685704 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f867c06ed60 0x7f867c0c3b30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:54.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.856+0000 7f86844b1700 1 -- 172.21.15.79:0/1012685704 >> 172.21.15.79:0/1012685704 conn(0x7f867c06d000 msgr2=0x7f867c15a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:54.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.856+0000 7f86844b1700 1 -- 172.21.15.79:0/1012685704 shutdown_connections 2023-10-19T08:38:54.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.856+0000 7f86844b1700 1 -- 172.21.15.79:0/1012685704 wait complete. 2023-10-19T08:38:54.872 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T08:37:54.318159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T08:37:55.629862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T08:37:59.333062+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T08:38:54.873 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:38:54.996 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.992+0000 7fcad9077700 1 Processor -- start 2023-10-19T08:38:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.992+0000 7fcad9077700 1 -- start start 2023-10-19T08:38:55.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad9077700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcad40d14f0 0x7fcad40ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad9077700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40adee0 0x7fcad40b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.000 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad9077700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad406c5a0 con 0x7fcad40b0710 2023-10-19T08:38:55.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad9077700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad4160cb0 con 0x7fcad40d14f0 2023-10-19T08:38:55.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad9077700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad406bd40 con 0x7fcad40adee0 2023-10-19T08:38:55.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad2d9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcad40b0710 0x7fcad40b0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57596/0 (socket says 172.21.15.79:57596) 2023-10-19T08:38:55.001 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad2d9d700 1 -- 172.21.15.79:0/401009470 learned_addr learned my addr 172.21.15.79:0/401009470 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:55.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad359e700 1 --2- 172.21.15.79:0/401009470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40adee0 0x7fcad40b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad259c700 1 --2- 172.21.15.79:0/401009470 >> v2:172.21.15.89:3300/0 conn(0x7fcad40d14f0 0x7fcad40ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad1d9b700 1 -- 172.21.15.79:0/401009470 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370709699 0 0) 0x7fcad406c5a0 con 0x7fcad40b0710 2023-10-19T08:38:55.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad1d9b700 1 -- 172.21.15.79:0/401009470 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcabc0035b0 con 0x7fcad40b0710 2023-10-19T08:38:55.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad1d9b700 1 -- 172.21.15.79:0/401009470 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1499563451 0 0) 0x7fcabc0035b0 con 0x7fcad40b0710 2023-10-19T08:38:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad1d9b700 1 -- 172.21.15.79:0/401009470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40adee0 msgr2=0x7fcad40b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad1d9b700 1 --2- 172.21.15.79:0/401009470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40adee0 0x7fcad40b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad1d9b700 1 -- 172.21.15.79:0/401009470 >> v2:172.21.15.89:3300/0 conn(0x7fcad40d14f0 msgr2=0x7fcad40ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad1d9b700 1 --2- 172.21.15.79:0/401009470 >> v2:172.21.15.89:3300/0 conn(0x7fcad40d14f0 0x7fcad40ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad1d9b700 1 -- 172.21.15.79:0/401009470 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad406bfe0 con 0x7fcad40b0710 2023-10-19T08:38:55.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad1d9b700 1 -- 172.21.15.79:0/401009470 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7fcac4001670 con 0x7fcad40b0710 2023-10-19T08:38:55.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad259c700 1 --2- 172.21.15.79:0/401009470 >> v2:172.21.15.89:3300/0 conn(0x7fcad40d14f0 0x7fcad40ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:38:55.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad1d9b700 1 -- 172.21.15.79:0/401009470 >> v1:172.21.15.79:6789/0 conn(0x7fcad40b0710 legacy=0x7fcad40b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:55.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad1d9b700 1 --2- 172.21.15.79:0/401009470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40adee0 0x7fcabc003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.004 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad1d9b700 1 --2- 172.21.15.79:0/401009470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcabc003ff0 0x7fcabc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad1d9b700 1 --2- 172.21.15.79:0/401009470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcabc004d90 0x7fcabc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad1d9b700 1 -- 172.21.15.79:0/401009470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad4160cb0 con 0x7fcabc003ff0 2023-10-19T08:38:55.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad1d9b700 1 -- 172.21.15.79:0/401009470 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad406bd40 con 0x7fcabc004d90 2023-10-19T08:38:55.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad1d9b700 1 -- 172.21.15.79:0/401009470 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcabc00ba40 con 0x7fcad40adee0 2023-10-19T08:38:55.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad259c700 1 --2- 172.21.15.79:0/401009470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcabc003ff0 0x7fcabc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.993+0000 7fcad2d9d700 1 --2- 172.21.15.79:0/401009470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40adee0 0x7fcabc003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.994+0000 7fcad359e700 1 --2- 172.21.15.79:0/401009470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcabc004d90 0x7fcabc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.994+0000 7fcad259c700 1 -- 172.21.15.79:0/401009470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40adee0 msgr2=0x7fcabc003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.994+0000 7fcad259c700 1 --2- 172.21.15.79:0/401009470 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcad40adee0 0x7fcabc003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.994+0000 7fcad259c700 1 -- 172.21.15.79:0/401009470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcabc004d90 msgr2=0x7fcabc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:55.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.994+0000 7fcad259c700 1 --2- 172.21.15.79:0/401009470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcabc004d90 0x7fcabc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.994+0000 7fcad259c700 1 -- 172.21.15.79:0/401009470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc0035b0 con 0x7fcabc003ff0 2023-10-19T08:38:55.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.994+0000 7fcad359e700 1 --2- 172.21.15.79:0/401009470 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcabc004d90 0x7fcabc005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:55.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.994+0000 7fcad259c700 1 --2- 172.21.15.79:0/401009470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcabc003ff0 0x7fcabc004850 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009d30 tx=0x7fcabc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84bcda5e8257ce84 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:55.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.994+0000 7fcad1d9b700 1 -- 172.21.15.79:0/401009470 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac8009e80 con 0x7fcabc003ff0 2023-10-19T08:38:55.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.994+0000 7fcad1d9b700 1 -- 172.21.15.79:0/401009470 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac800e9a0 con 0x7fcabc003ff0 2023-10-19T08:38:55.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.994+0000 7fcad1d9b700 1 -- 172.21.15.79:0/401009470 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac800ed30 con 0x7fcabc003ff0 2023-10-19T08:38:55.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.994+0000 7fcad9077700 1 -- 172.21.15.79:0/401009470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcabc003ff0 msgr2=0x7fcabc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:55.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.994+0000 7fcad9077700 1 --2- 172.21.15.79:0/401009470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcabc003ff0 0x7fcabc004850 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcac8009d30 tx=0x7fcabc005880 comp rx=0 tx=0).stop 2023-10-19T08:38:55.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.994+0000 7fcad359e700 1 -- 172.21.15.79:0/401009470 reap_dead start 2023-10-19T08:38:55.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.994+0000 7fcad9077700 1 -- 172.21.15.79:0/401009470 shutdown_connections 2023-10-19T08:38:55.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.994+0000 7fcad9077700 1 -- 172.21.15.79:0/401009470 >> 172.21.15.79:0/401009470 conn(0x7fcad409a0b0 msgr2=0x7fcad40d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:55.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.995+0000 7fcad9077700 1 -- 172.21.15.79:0/401009470 shutdown_connections 2023-10-19T08:38:55.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.995+0000 7fcad9077700 1 -- 172.21.15.79:0/401009470 wait complete. 2023-10-19T08:38:55.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.996+0000 7fcad9077700 1 Processor -- start 2023-10-19T08:38:55.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.996+0000 7fcad9077700 1 -- start start 2023-10-19T08:38:55.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcad9077700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcabc003ff0 0x7fcad40b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcad9077700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad40b65f0 0x7fcad40b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcad9077700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcad41573e0 0x7fcad40af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcad9077700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad40b5430 con 0x7fcad41573e0 2023-10-19T08:38:55.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcad9077700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad40b5240 con 0x7fcad40b65f0 2023-10-19T08:38:55.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcad9077700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad40b49c0 con 0x7fcabc003ff0 2023-10-19T08:38:55.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcad359e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcad41573e0 0x7fcad40af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcad359e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcad41573e0 0x7fcad40af450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47540/0 (socket says 172.21.15.79:47540) 2023-10-19T08:38:55.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcad359e700 1 -- 172.21.15.79:0/2682158939 learned_addr learned my addr 172.21.15.79:0/2682158939 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:55.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcad2d9d700 1 --2- 172.21.15.79:0/2682158939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcabc003ff0 0x7fcad40b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcad259c700 1 --2- 172.21.15.79:0/2682158939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad40b65f0 0x7fcad40b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcad359e700 1 -- 172.21.15.79:0/2682158939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcabc003ff0 msgr2=0x7fcad40b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:55.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcad359e700 1 --2- 172.21.15.79:0/2682158939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcabc003ff0 0x7fcad40b4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcad359e700 1 -- 172.21.15.79:0/2682158939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad40b65f0 msgr2=0x7fcad40b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:55.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcad359e700 1 --2- 172.21.15.79:0/2682158939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad40b65f0 0x7fcad40b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcad359e700 1 -- 172.21.15.79:0/2682158939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad4157890 con 0x7fcad41573e0 2023-10-19T08:38:55.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcad359e700 1 --2- 172.21.15.79:0/2682158939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcad41573e0 0x7fcad40af450 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcad408b2e0 tx=0x7fcacc0104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:55.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcabb7fe700 1 -- 172.21.15.79:0/2682158939 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc01b070 con 0x7fcad41573e0 2023-10-19T08:38:55.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcabb7fe700 1 -- 172.21.15.79:0/2682158939 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc00f040 con 0x7fcad41573e0 2023-10-19T08:38:55.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.997+0000 7fcad9077700 1 -- 172.21.15.79:0/2682158939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad40b5830 con 0x7fcad41573e0 2023-10-19T08:38:55.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.998+0000 7fcabb7fe700 1 -- 172.21.15.79:0/2682158939 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc00e050 con 0x7fcad41573e0 2023-10-19T08:38:55.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.998+0000 7fcad9077700 1 -- 172.21.15.79:0/2682158939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad40b5df0 con 0x7fcad41573e0 2023-10-19T08:38:55.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.998+0000 7fcad9077700 1 -- 172.21.15.79:0/2682158939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad40b5580 con 0x7fcad41573e0 2023-10-19T08:38:55.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.999+0000 7fcabb7fe700 1 -- 172.21.15.79:0/2682158939 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcacc015440 con 0x7fcad41573e0 2023-10-19T08:38:55.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.999+0000 7fcabb7fe700 1 --2- 172.21.15.79:0/2682158939 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fcac006a0e0 0x7fcac006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:54.999+0000 7fcad2d9d700 1 --2- 172.21.15.79:0/2682158939 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fcac006a0e0 0x7fcac006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.000+0000 7fcabb7fe700 1 -- 172.21.15.79:0/2682158939 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcacc0888d0 con 0x7fcad41573e0 2023-10-19T08:38:55.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.000+0000 7fcad2d9d700 1 --2- 172.21.15.79:0/2682158939 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fcac006a0e0 0x7fcac006c5a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcac4000fb0 tx=0x7fcac4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:55.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.004+0000 7fcabb7fe700 1 -- 172.21.15.79:0/2682158939 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fcacc053dd0 con 0x7fcad41573e0 2023-10-19T08:38:55.199 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.194+0000 7fcad9077700 1 -- 172.21.15.79:0/2682158939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcad404ee70 con 0x7fcad41573e0 2023-10-19T08:38:55.200 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.195+0000 7fcabb7fe700 1 -- 172.21.15.79:0/2682158939 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcacc0573f0 con 0x7fcad41573e0 2023-10-19T08:38:55.200 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:38:55.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.197+0000 7fcad9077700 1 -- 172.21.15.79:0/2682158939 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fcac006a0e0 msgr2=0x7fcac006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:55.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.197+0000 7fcad9077700 1 --2- 172.21.15.79:0/2682158939 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fcac006a0e0 0x7fcac006c5a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcac4000fb0 tx=0x7fcac4009040 comp rx=0 tx=0).stop 2023-10-19T08:38:55.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.197+0000 7fcad9077700 1 -- 172.21.15.79:0/2682158939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcad41573e0 msgr2=0x7fcad40af450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:55.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.197+0000 7fcad9077700 1 --2- 172.21.15.79:0/2682158939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcad41573e0 0x7fcad40af450 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcad408b2e0 tx=0x7fcacc0104a0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.202 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.197+0000 7fcad9077700 1 -- 172.21.15.79:0/2682158939 shutdown_connections 2023-10-19T08:38:55.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.197+0000 7fcad9077700 1 --2- 172.21.15.79:0/2682158939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcad41573e0 0x7fcad40af450 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.197+0000 7fcad9077700 1 --2- 172.21.15.79:0/2682158939 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fcac006a0e0 0x7fcac006c5a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.197+0000 7fcad9077700 1 --2- 172.21.15.79:0/2682158939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcabc003ff0 0x7fcad40b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.197+0000 7fcad9077700 1 --2- 172.21.15.79:0/2682158939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcad40b65f0 0x7fcad40b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.197+0000 7fcad9077700 1 -- 172.21.15.79:0/2682158939 >> 172.21.15.79:0/2682158939 conn(0x7fcad409a0b0 msgr2=0x7fcad40b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:55.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.197+0000 7fcad9077700 1 -- 172.21.15.79:0/2682158939 shutdown_connections 2023-10-19T08:38:55.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.197+0000 7fcad9077700 1 -- 172.21.15.79:0/2682158939 wait complete. 2023-10-19T08:38:55.213 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:38:55.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.331+0000 7f596cc00700 1 Processor -- start 2023-10-19T08:38:55.336 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.332+0000 7f596cc00700 1 -- start start 2023-10-19T08:38:55.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.332+0000 7f596cc00700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59680b0c00 0x7f59680d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.332+0000 7f596cc00700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f59680cb6f0 0x7f59680ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.332+0000 7f596cc00700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59680b25f0 con 0x7f596815e570 2023-10-19T08:38:55.339 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.332+0000 7f596cc00700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59680afd60 con 0x7f59680cb6f0 2023-10-19T08:38:55.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.333+0000 7f596cc00700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59680af810 con 0x7f59680b0c00 2023-10-19T08:38:55.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.333+0000 7f596659c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f596815e570 0x7f59680b04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57616/0 (socket says 172.21.15.79:57616) 2023-10-19T08:38:55.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.333+0000 7f596659c700 1 -- 172.21.15.79:0/519138787 learned_addr learned my addr 172.21.15.79:0/519138787 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:55.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.333+0000 7f5965d9b700 1 --2- 172.21.15.79:0/519138787 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59680b0c00 0x7f59680d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.333+0000 7f5966d9d700 1 --2- 172.21.15.79:0/519138787 >> v2:172.21.15.89:3300/0 conn(0x7f59680cb6f0 0x7f59680ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.333+0000 7f596559a700 1 -- 172.21.15.79:0/519138787 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670276805 0 0) 0x7f59680b25f0 con 0x7f596815e570 2023-10-19T08:38:55.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.333+0000 7f596559a700 1 -- 172.21.15.79:0/519138787 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59500035b0 con 0x7f596815e570 2023-10-19T08:38:55.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.333+0000 7f5966d9d700 1 -- 172.21.15.79:0/519138787 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59680b0c00 msgr2=0x7f59680d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:55.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.333+0000 7f5966d9d700 1 --2- 172.21.15.79:0/519138787 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59680b0c00 0x7f59680d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.333+0000 7f596559a700 1 -- 172.21.15.79:0/519138787 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 210221705 0 0) 0x7f59500035b0 con 0x7f596815e570 2023-10-19T08:38:55.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.333+0000 7f5966d9d700 1 -- 172.21.15.79:0/519138787 >> v1:172.21.15.79:6789/0 conn(0x7f596815e570 legacy=0x7f59680b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:55.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.333+0000 7f5966d9d700 1 -- 172.21.15.79:0/519138787 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59680aef70 con 0x7f59680cb6f0 2023-10-19T08:38:55.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.333+0000 7f5965d9b700 1 --2- 172.21.15.79:0/519138787 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59680b0c00 0x7f59680d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:38:55.342 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.333+0000 7f5966d9d700 1 --2- 172.21.15.79:0/519138787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59680cb6f0 0x7f59680ad9a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5960009d90 tx=0x7f596000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23d582e79db4f579 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:55.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.333+0000 7f596559a700 1 -- 172.21.15.79:0/519138787 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596000e070 con 0x7f59680cb6f0 2023-10-19T08:38:55.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.334+0000 7f596559a700 1 -- 172.21.15.79:0/519138787 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5960003a20 con 0x7f59680cb6f0 2023-10-19T08:38:55.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.334+0000 7f596559a700 1 -- 172.21.15.79:0/519138787 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c001670 con 0x7f59680cb6f0 2023-10-19T08:38:55.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.334+0000 7f596cc00700 1 -- 172.21.15.79:0/519138787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59680cb6f0 msgr2=0x7f59680ad9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:55.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.334+0000 7f596cc00700 1 --2- 172.21.15.79:0/519138787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59680cb6f0 0x7f59680ad9a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5960009d90 tx=0x7f596000b330 comp rx=0 tx=0).stop 2023-10-19T08:38:55.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.334+0000 7f596cc00700 1 -- 172.21.15.79:0/519138787 shutdown_connections 2023-10-19T08:38:55.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.334+0000 7f596cc00700 1 --2- 172.21.15.79:0/519138787 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f59680cb6f0 0x7f59680ad9a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.334+0000 7f596cc00700 1 --2- 172.21.15.79:0/519138787 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59680b0c00 0x7f59680d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.334+0000 7f596cc00700 1 -- 172.21.15.79:0/519138787 >> 172.21.15.79:0/519138787 conn(0x7f596809a0b0 msgr2=0x7f59680d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:55.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.334+0000 7f596cc00700 1 -- 172.21.15.79:0/519138787 shutdown_connections 2023-10-19T08:38:55.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.334+0000 7f596cc00700 1 -- 172.21.15.79:0/519138787 wait complete. 2023-10-19T08:38:55.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.335+0000 7f596cc00700 1 Processor -- start 2023-10-19T08:38:55.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.336+0000 7f596cc00700 1 -- start start 2023-10-19T08:38:55.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.336+0000 7f596cc00700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59680b0c00 0x7f5968159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.336+0000 7f596cc00700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59680cb6f0 0x7f596806cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.336+0000 7f596cc00700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f596815e570 0x7f596806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.336+0000 7f596cc00700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59681e3900 con 0x7f59680cb6f0 2023-10-19T08:38:55.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.336+0000 7f596cc00700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596806bec0 con 0x7f596815e570 2023-10-19T08:38:55.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.336+0000 7f596cc00700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596806c1a0 con 0x7f59680b0c00 2023-10-19T08:38:55.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.336+0000 7f5965d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59680cb6f0 0x7f596806cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.336+0000 7f5965d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59680cb6f0 0x7f596806cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47552/0 (socket says 172.21.15.79:47552) 2023-10-19T08:38:55.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.336+0000 7f5965d9b700 1 -- 172.21.15.79:0/2417715419 learned_addr learned my addr 172.21.15.79:0/2417715419 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:55.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.336+0000 7f5966d9d700 1 --2- 172.21.15.79:0/2417715419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f596815e570 0x7f596806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.336+0000 7f596659c700 1 --2- 172.21.15.79:0/2417715419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59680b0c00 0x7f5968159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.337+0000 7f5965d9b700 1 -- 172.21.15.79:0/2417715419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59680b0c00 msgr2=0x7f5968159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:55.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.337+0000 7f5965d9b700 1 --2- 172.21.15.79:0/2417715419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59680b0c00 0x7f5968159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.337+0000 7f5965d9b700 1 -- 172.21.15.79:0/2417715419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f596815e570 msgr2=0x7f596806ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:55.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.337+0000 7f5965d9b700 1 --2- 172.21.15.79:0/2417715419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f596815e570 0x7f596806ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.337+0000 7f5965d9b700 1 -- 172.21.15.79:0/2417715419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59580094a0 con 0x7f59680cb6f0 2023-10-19T08:38:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.337+0000 7f5965d9b700 1 --2- 172.21.15.79:0/2417715419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59680cb6f0 0x7f596806cc50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f595800ebe0 tx=0x7f595800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.337+0000 7f5956ffd700 1 -- 172.21.15.79:0/2417715419 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595800c850 con 0x7f59680cb6f0 2023-10-19T08:38:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.337+0000 7f5956ffd700 1 -- 172.21.15.79:0/2417715419 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595800c9b0 con 0x7f59680cb6f0 2023-10-19T08:38:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.337+0000 7f596cc00700 1 -- 172.21.15.79:0/2417715419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5960009a70 con 0x7f59680cb6f0 2023-10-19T08:38:55.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.337+0000 7f5956ffd700 1 -- 172.21.15.79:0/2417715419 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595800cd40 con 0x7f59680cb6f0 2023-10-19T08:38:55.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.337+0000 7f596cc00700 1 -- 172.21.15.79:0/2417715419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596806c760 con 0x7f59680cb6f0 2023-10-19T08:38:55.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.338+0000 7f596cc00700 1 -- 172.21.15.79:0/2417715419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59681e3a70 con 0x7f59680cb6f0 2023-10-19T08:38:55.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.338+0000 7f5956ffd700 1 -- 172.21.15.79:0/2417715419 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5958013470 con 0x7f59680cb6f0 2023-10-19T08:38:55.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.339+0000 7f5956ffd700 1 --2- 172.21.15.79:0/2417715419 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f594806a0e0 0x7f594806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.339+0000 7f5956ffd700 1 -- 172.21.15.79:0/2417715419 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5958088920 con 0x7f59680cb6f0 2023-10-19T08:38:55.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.339+0000 7f596659c700 1 --2- 172.21.15.79:0/2417715419 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f594806a0e0 0x7f594806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.339+0000 7f596659c700 1 --2- 172.21.15.79:0/2417715419 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f594806a0e0 0x7f594806c5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f595c000f60 tx=0x7f595c001e00 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:55.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.343+0000 7f5956ffd700 1 -- 172.21.15.79:0/2417715419 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f5958053ce0 con 0x7f59680cb6f0 2023-10-19T08:38:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.531+0000 7f596cc00700 1 -- 172.21.15.79:0/2417715419 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f596804ee70 con 0x7f59680cb6f0 2023-10-19T08:38:55.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.531+0000 7f5956ffd700 1 -- 172.21.15.79:0/2417715419 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f595800cea0 con 0x7f59680cb6f0 2023-10-19T08:38:55.536 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:38:55.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.534+0000 7f596cc00700 1 -- 172.21.15.79:0/2417715419 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f594806a0e0 msgr2=0x7f594806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:55.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.534+0000 7f596cc00700 1 --2- 172.21.15.79:0/2417715419 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f594806a0e0 0x7f594806c5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f595c000f60 tx=0x7f595c001e00 comp rx=0 tx=0).stop 2023-10-19T08:38:55.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.534+0000 7f596cc00700 1 -- 172.21.15.79:0/2417715419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59680cb6f0 msgr2=0x7f596806cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.534+0000 7f596cc00700 1 --2- 172.21.15.79:0/2417715419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59680cb6f0 0x7f596806cc50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f595800ebe0 tx=0x7f595800eef0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.534+0000 7f596cc00700 1 -- 172.21.15.79:0/2417715419 shutdown_connections 2023-10-19T08:38:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.534+0000 7f596cc00700 1 --2- 172.21.15.79:0/2417715419 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f596815e570 0x7f596806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.534+0000 7f596cc00700 1 --2- 172.21.15.79:0/2417715419 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f594806a0e0 0x7f594806c5a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.534+0000 7f596cc00700 1 --2- 172.21.15.79:0/2417715419 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f59680b0c00 0x7f5968159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.534+0000 7f596cc00700 1 --2- 172.21.15.79:0/2417715419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59680cb6f0 0x7f596806cc50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.534+0000 7f596cc00700 1 -- 172.21.15.79:0/2417715419 >> 172.21.15.79:0/2417715419 conn(0x7f596809a0b0 msgr2=0x7f5968070600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:55.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.534+0000 7f596cc00700 1 -- 172.21.15.79:0/2417715419 shutdown_connections 2023-10-19T08:38:55.541 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.534+0000 7f596cc00700 1 -- 172.21.15.79:0/2417715419 wait complete. 2023-10-19T08:38:55.549 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T08:38:55.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.668+0000 7f837b3a3700 1 Processor -- start 2023-10-19T08:38:55.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.669+0000 7f837b3a3700 1 -- start start 2023-10-19T08:38:55.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.669+0000 7f837b3a3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f837406a930 0x7f83740cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f837b3a3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f83740703b0 0x7f83740cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f837b3a3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83740b1fe0 con 0x7f83740cd270 2023-10-19T08:38:55.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f837b3a3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8374160a80 con 0x7f83740703b0 2023-10-19T08:38:55.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f837b3a3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83740ce2b0 con 0x7f837406a930 2023-10-19T08:38:55.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f837913f700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f83740cd270 0x7f837406a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57630/0 (socket says 172.21.15.79:57630) 2023-10-19T08:38:55.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f837913f700 1 -- 172.21.15.79:0/3662372384 learned_addr learned my addr 172.21.15.79:0/3662372384 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:55.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f8379940700 1 --2- 172.21.15.79:0/3662372384 >> v2:172.21.15.89:3300/0 conn(0x7f83740703b0 0x7f83740cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f837893e700 1 --2- 172.21.15.79:0/3662372384 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f837406a930 0x7f83740cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f836bfff700 1 -- 172.21.15.79:0/3662372384 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844436701 0 0) 0x7f83740b1fe0 con 0x7f83740cd270 2023-10-19T08:38:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f836bfff700 1 -- 172.21.15.79:0/3662372384 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83600035b0 con 0x7f83740cd270 2023-10-19T08:38:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f836bfff700 1 -- 172.21.15.79:0/3662372384 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 998147561 0 0) 0x7f83600035b0 con 0x7f83740cd270 2023-10-19T08:38:55.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f836bfff700 1 -- 172.21.15.79:0/3662372384 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f837406a930 msgr2=0x7f83740cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:55.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f836bfff700 1 --2- 172.21.15.79:0/3662372384 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f837406a930 0x7f83740cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f836bfff700 1 -- 172.21.15.79:0/3662372384 >> v2:172.21.15.89:3300/0 conn(0x7f83740703b0 msgr2=0x7f83740cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:55.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f836bfff700 1 --2- 172.21.15.79:0/3662372384 >> v2:172.21.15.89:3300/0 conn(0x7f83740703b0 0x7f83740cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f836bfff700 1 -- 172.21.15.79:0/3662372384 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83740ce550 con 0x7f83740cd270 2023-10-19T08:38:55.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f836bfff700 1 -- 172.21.15.79:0/3662372384 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f8364001670 con 0x7f83740cd270 2023-10-19T08:38:55.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f836bfff700 1 -- 172.21.15.79:0/3662372384 >> v1:172.21.15.79:6789/0 conn(0x7f83740cd270 legacy=0x7f837406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:55.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f836bfff700 1 --2- 172.21.15.79:0/3662372384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8360003a70 0x7f8360003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f836bfff700 1 --2- 172.21.15.79:0/3662372384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8360004850 0x7f8360004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f836bfff700 1 --2- 172.21.15.79:0/3662372384 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f837406a930 0x7f8360005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f836bfff700 1 -- 172.21.15.79:0/3662372384 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8374160a80 con 0x7f8360004850 2023-10-19T08:38:55.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f836bfff700 1 -- 172.21.15.79:0/3662372384 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83740ce2b0 con 0x7f8360003a70 2023-10-19T08:38:55.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f836bfff700 1 -- 172.21.15.79:0/3662372384 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836000ba10 con 0x7f837406a930 2023-10-19T08:38:55.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f837893e700 1 --2- 172.21.15.79:0/3662372384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8360004850 0x7f8360004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f837913f700 1 --2- 172.21.15.79:0/3662372384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8360003a70 0x7f8360003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.670+0000 7f8379940700 1 --2- 172.21.15.79:0/3662372384 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f837406a930 0x7f8360005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.671+0000 7f837893e700 1 -- 172.21.15.79:0/3662372384 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f837406a930 msgr2=0x7f8360005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:55.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.671+0000 7f837893e700 1 --2- 172.21.15.79:0/3662372384 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f837406a930 0x7f8360005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.671+0000 7f837893e700 1 -- 172.21.15.79:0/3662372384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8360003a70 msgr2=0x7f8360003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:55.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.671+0000 7f837893e700 1 --2- 172.21.15.79:0/3662372384 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8360003a70 0x7f8360003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.671+0000 7f837893e700 1 -- 172.21.15.79:0/3662372384 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83600035b0 con 0x7f8360004850 2023-10-19T08:38:55.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.671+0000 7f837893e700 1 --2- 172.21.15.79:0/3662372384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8360004850 0x7f8360004cd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8370009b90 tx=0x7f8360005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8d40ade8ef116b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:55.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.671+0000 7f836bfff700 1 -- 172.21.15.79:0/3662372384 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837000e6c0 con 0x7f8360004850 2023-10-19T08:38:55.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.671+0000 7f836bfff700 1 -- 172.21.15.79:0/3662372384 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837000e820 con 0x7f8360004850 2023-10-19T08:38:55.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.671+0000 7f836bfff700 1 -- 172.21.15.79:0/3662372384 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837000eb90 con 0x7f8360004850 2023-10-19T08:38:55.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.671+0000 7f837b3a3700 1 -- 172.21.15.79:0/3662372384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8360004850 msgr2=0x7f8360004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:55.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.671+0000 7f837b3a3700 1 --2- 172.21.15.79:0/3662372384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8360004850 0x7f8360004cd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8370009b90 tx=0x7f8360005880 comp rx=0 tx=0).stop 2023-10-19T08:38:55.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.671+0000 7f8379940700 1 -- 172.21.15.79:0/3662372384 reap_dead start 2023-10-19T08:38:55.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.672+0000 7f837b3a3700 1 -- 172.21.15.79:0/3662372384 shutdown_connections 2023-10-19T08:38:55.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.672+0000 7f837b3a3700 1 -- 172.21.15.79:0/3662372384 >> 172.21.15.79:0/3662372384 conn(0x7f837406dcc0 msgr2=0x7f837406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:55.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.672+0000 7f837b3a3700 1 -- 172.21.15.79:0/3662372384 shutdown_connections 2023-10-19T08:38:55.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.672+0000 7f837b3a3700 1 -- 172.21.15.79:0/3662372384 wait complete. 2023-10-19T08:38:55.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.673+0000 7f837b3a3700 1 Processor -- start 2023-10-19T08:38:55.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.673+0000 7f837b3a3700 1 -- start start 2023-10-19T08:38:55.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.674+0000 7f837b3a3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8360004850 0x7f8374155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.674+0000 7f837b3a3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f837415e2e0 0x7f83740ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.674+0000 7f837b3a3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83740b0480 0x7f83740b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.674+0000 7f837b3a3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83740b3c80 con 0x7f8360004850 2023-10-19T08:38:55.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.674+0000 7f837b3a3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83740b4240 con 0x7f837415e2e0 2023-10-19T08:38:55.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.674+0000 7f837b3a3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83740b0e40 con 0x7f83740b0480 2023-10-19T08:38:55.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.674+0000 7f837913f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8360004850 0x7f8374155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.674+0000 7f837913f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8360004850 0x7f8374155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47570/0 (socket says 172.21.15.79:47570) 2023-10-19T08:38:55.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.674+0000 7f837913f700 1 -- 172.21.15.79:0/4077756655 learned_addr learned my addr 172.21.15.79:0/4077756655 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:55.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.674+0000 7f837893e700 1 --2- 172.21.15.79:0/4077756655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f837415e2e0 0x7f83740ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.674+0000 7f8379940700 1 --2- 172.21.15.79:0/4077756655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83740b0480 0x7f83740b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.674+0000 7f837913f700 1 -- 172.21.15.79:0/4077756655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83740b0480 msgr2=0x7f83740b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:55.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.674+0000 7f837913f700 1 --2- 172.21.15.79:0/4077756655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83740b0480 0x7f83740b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.674+0000 7f837913f700 1 -- 172.21.15.79:0/4077756655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f837415e2e0 msgr2=0x7f83740ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:55.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.674+0000 7f837913f700 1 --2- 172.21.15.79:0/4077756655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f837415e2e0 0x7f83740ac380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.674+0000 7f837913f700 1 -- 172.21.15.79:0/4077756655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8374155b70 con 0x7f8360004850 2023-10-19T08:38:55.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.674+0000 7f837893e700 1 --2- 172.21.15.79:0/4077756655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f837415e2e0 0x7f83740ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:55.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.674+0000 7f8379940700 1 --2- 172.21.15.79:0/4077756655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83740b0480 0x7f83740b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:55.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.675+0000 7f837913f700 1 --2- 172.21.15.79:0/4077756655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8360004850 0x7f8374155220 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8364007310 tx=0x7f8364007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:55.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.675+0000 7f8369ffb700 1 -- 172.21.15.79:0/4077756655 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836400f660 con 0x7f8360004850 2023-10-19T08:38:55.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.675+0000 7f8369ffb700 1 -- 172.21.15.79:0/4077756655 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836400f7e0 con 0x7f8360004850 2023-10-19T08:38:55.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.675+0000 7f8369ffb700 1 -- 172.21.15.79:0/4077756655 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836400fb90 con 0x7f8360004850 2023-10-19T08:38:55.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.675+0000 7f837b3a3700 1 -- 172.21.15.79:0/4077756655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83740ac8c0 con 0x7f8360004850 2023-10-19T08:38:55.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.675+0000 7f837b3a3700 1 -- 172.21.15.79:0/4077756655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83740ad0b0 con 0x7f8360004850 2023-10-19T08:38:55.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.676+0000 7f837b3a3700 1 -- 172.21.15.79:0/4077756655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837404ee70 con 0x7f8360004850 2023-10-19T08:38:55.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.676+0000 7f8369ffb700 1 -- 172.21.15.79:0/4077756655 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f836400fcf0 con 0x7f8360004850 2023-10-19T08:38:55.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.676+0000 7f8369ffb700 1 --2- 172.21.15.79:0/4077756655 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f835806a0e0 0x7f835806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.677+0000 7f8369ffb700 1 -- 172.21.15.79:0/4077756655 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8364088750 con 0x7f8360004850 2023-10-19T08:38:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.677+0000 7f837893e700 1 --2- 172.21.15.79:0/4077756655 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f835806a0e0 0x7f835806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.677+0000 7f837893e700 1 --2- 172.21.15.79:0/4077756655 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f835806a0e0 0x7f835806c5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f83740b1450 tx=0x7f8370008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:55.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.681+0000 7f8369ffb700 1 -- 172.21.15.79:0/4077756655 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f8364053ba0 con 0x7f8360004850 2023-10-19T08:38:55.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.868+0000 7f837b3a3700 1 -- 172.21.15.79:0/4077756655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8374160740 con 0x7f8360004850 2023-10-19T08:38:55.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.868+0000 7f8369ffb700 1 -- 172.21.15.79:0/4077756655 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f83640571c0 con 0x7f8360004850 2023-10-19T08:38:55.872 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:55.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.870+0000 7f837b3a3700 1 -- 172.21.15.79:0/4077756655 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f835806a0e0 msgr2=0x7f835806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:55.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.870+0000 7f837b3a3700 1 --2- 172.21.15.79:0/4077756655 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f835806a0e0 0x7f835806c5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f83740b1450 tx=0x7f8370008030 comp rx=0 tx=0).stop 2023-10-19T08:38:55.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.870+0000 7f837b3a3700 1 -- 172.21.15.79:0/4077756655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8360004850 msgr2=0x7f8374155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:55.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.870+0000 7f837b3a3700 1 --2- 172.21.15.79:0/4077756655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8360004850 0x7f8374155220 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8364007310 tx=0x7f8364007620 comp rx=0 tx=0).stop 2023-10-19T08:38:55.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.870+0000 7f837b3a3700 1 -- 172.21.15.79:0/4077756655 shutdown_connections 2023-10-19T08:38:55.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.870+0000 7f837b3a3700 1 --2- 172.21.15.79:0/4077756655 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f835806a0e0 0x7f835806c5a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.870+0000 7f837b3a3700 1 --2- 172.21.15.79:0/4077756655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f83740b0480 0x7f83740b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.870+0000 7f837b3a3700 1 --2- 172.21.15.79:0/4077756655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8360004850 0x7f8374155220 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.870+0000 7f837b3a3700 1 --2- 172.21.15.79:0/4077756655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f837415e2e0 0x7f83740ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:55.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.871+0000 7f837b3a3700 1 -- 172.21.15.79:0/4077756655 >> 172.21.15.79:0/4077756655 conn(0x7f837406dcc0 msgr2=0x7f83740cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:55.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.871+0000 7f837b3a3700 1 -- 172.21.15.79:0/4077756655 shutdown_connections 2023-10-19T08:38:55.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:55.871+0000 7f837b3a3700 1 -- 172.21.15.79:0/4077756655 wait complete. 2023-10-19T08:38:55.886 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T08:38:56.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.008+0000 7f7e9f544700 1 Processor -- start 2023-10-19T08:38:56.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.008+0000 7f7e9f544700 1 -- start start 2023-10-19T08:38:56.014 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.009+0000 7f7e9f544700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e980b0c00 0x7f7e980d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:56.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.009+0000 7f7e9f544700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7e980cb6f0 0x7f7e980ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:56.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.009+0000 7f7e9f544700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e980b25f0 con 0x7f7e9815e570 2023-10-19T08:38:56.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.009+0000 7f7e9f544700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e980afd60 con 0x7f7e980cb6f0 2023-10-19T08:38:56.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.009+0000 7f7e9f544700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980af810 con 0x7f7e980b0c00 2023-10-19T08:38:56.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.009+0000 7f7e9d2e0700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7e9815e570 0x7f7e980b04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57650/0 (socket says 172.21.15.79:57650) 2023-10-19T08:38:56.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.009+0000 7f7e9dae1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7e980cb6f0 0x7f7e980ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:56.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.009+0000 7f7e9d2e0700 1 -- 172.21.15.79:0/1754933689 learned_addr learned my addr 172.21.15.79:0/1754933689 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:56.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.010+0000 7f7e9cadf700 1 --2- 172.21.15.79:0/1754933689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e980b0c00 0x7f7e980d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:56.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.010+0000 7f7e9dae1700 1 -- 172.21.15.79:0/1754933689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e980b0c00 msgr2=0x7f7e980d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:56.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.010+0000 7f7e9dae1700 1 --2- 172.21.15.79:0/1754933689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e980b0c00 0x7f7e980d1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.010+0000 7f7e9dae1700 1 -- 172.21.15.79:0/1754933689 >> v1:172.21.15.79:6789/0 conn(0x7f7e9815e570 legacy=0x7f7e980b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:56.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.010+0000 7f7e9dae1700 1 -- 172.21.15.79:0/1754933689 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e980aef70 con 0x7f7e980cb6f0 2023-10-19T08:38:56.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.010+0000 7f7e97fff700 1 -- 172.21.15.79:0/1754933689 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380655541 0 0) 0x7f7e980b25f0 con 0x7f7e9815e570 2023-10-19T08:38:56.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.010+0000 7f7e9dae1700 1 --2- 172.21.15.79:0/1754933689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e980cb6f0 0x7f7e980ad9a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009840 tx=0x7f7e88009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd50f8bdc8c884a server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:56.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.010+0000 7f7e97fff700 1 -- 172.21.15.79:0/1754933689 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88011830 con 0x7f7e980cb6f0 2023-10-19T08:38:56.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.010+0000 7f7e97fff700 1 -- 172.21.15.79:0/1754933689 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e88011990 con 0x7f7e980cb6f0 2023-10-19T08:38:56.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.010+0000 7f7e97fff700 1 -- 172.21.15.79:0/1754933689 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88011d20 con 0x7f7e980cb6f0 2023-10-19T08:38:56.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.010+0000 7f7e9f544700 1 -- 172.21.15.79:0/1754933689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e980cb6f0 msgr2=0x7f7e980ad9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:56.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.010+0000 7f7e9f544700 1 --2- 172.21.15.79:0/1754933689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e980cb6f0 0x7f7e980ad9a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009840 tx=0x7f7e88009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:56.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.010+0000 7f7e9f544700 1 -- 172.21.15.79:0/1754933689 shutdown_connections 2023-10-19T08:38:56.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.010+0000 7f7e9f544700 1 --2- 172.21.15.79:0/1754933689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e980cb6f0 0x7f7e980ad9a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.010+0000 7f7e9f544700 1 --2- 172.21.15.79:0/1754933689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e980b0c00 0x7f7e980d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.010+0000 7f7e9f544700 1 -- 172.21.15.79:0/1754933689 >> 172.21.15.79:0/1754933689 conn(0x7f7e9809a0b0 msgr2=0x7f7e980d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:56.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.011+0000 7f7e9f544700 1 -- 172.21.15.79:0/1754933689 shutdown_connections 2023-10-19T08:38:56.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.011+0000 7f7e9f544700 1 -- 172.21.15.79:0/1754933689 wait complete. 2023-10-19T08:38:56.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.012+0000 7f7e9f544700 1 Processor -- start 2023-10-19T08:38:56.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.012+0000 7f7e9f544700 1 -- start start 2023-10-19T08:38:56.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.012+0000 7f7e9f544700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e980b0c00 0x7f7e9815b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:56.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.012+0000 7f7e9f544700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e980cb6f0 0x7f7e9809e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:56.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.013+0000 7f7e9f544700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9815e570 0x7f7e980b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:56.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.013+0000 7f7e9f544700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980c9270 con 0x7f7e9815e570 2023-10-19T08:38:56.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.013+0000 7f7e9f544700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980c9550 con 0x7f7e980b0c00 2023-10-19T08:38:56.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.013+0000 7f7e9f544700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980c9830 con 0x7f7e980cb6f0 2023-10-19T08:38:56.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.013+0000 7f7e9dae1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9815e570 0x7f7e980b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:56.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.013+0000 7f7e9dae1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9815e570 0x7f7e980b1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47588/0 (socket says 172.21.15.79:47588) 2023-10-19T08:38:56.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.013+0000 7f7e9dae1700 1 -- 172.21.15.79:0/1426384619 learned_addr learned my addr 172.21.15.79:0/1426384619 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:56.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.013+0000 7f7e9dae1700 1 -- 172.21.15.79:0/1426384619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e980cb6f0 msgr2=0x7f7e9809e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:56.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.013+0000 7f7e9dae1700 1 --2- 172.21.15.79:0/1426384619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e980cb6f0 0x7f7e9809e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.013+0000 7f7e9dae1700 1 -- 172.21.15.79:0/1426384619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e980b0c00 msgr2=0x7f7e9815b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:56.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.013+0000 7f7e9dae1700 1 --2- 172.21.15.79:0/1426384619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e980b0c00 0x7f7e9815b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.013+0000 7f7e9dae1700 1 -- 172.21.15.79:0/1426384619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e880094a0 con 0x7f7e9815e570 2023-10-19T08:38:56.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.013+0000 7f7e9dae1700 1 --2- 172.21.15.79:0/1426384619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9815e570 0x7f7e980b1430 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009b90 tx=0x7f7e88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:56.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.013+0000 7f7e95ffb700 1 -- 172.21.15.79:0/1426384619 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e880036a0 con 0x7f7e9815e570 2023-10-19T08:38:56.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.013+0000 7f7e95ffb700 1 -- 172.21.15.79:0/1426384619 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8801f070 con 0x7f7e9815e570 2023-10-19T08:38:56.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.013+0000 7f7e9f544700 1 -- 172.21.15.79:0/1426384619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e980c9b10 con 0x7f7e9815e570 2023-10-19T08:38:56.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.013+0000 7f7e95ffb700 1 -- 172.21.15.79:0/1426384619 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88003a40 con 0x7f7e9815e570 2023-10-19T08:38:56.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.013+0000 7f7e9f544700 1 -- 172.21.15.79:0/1426384619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e980c8f00 con 0x7f7e9815e570 2023-10-19T08:38:56.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.014+0000 7f7e9f544700 1 -- 172.21.15.79:0/1426384619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e980ca030 con 0x7f7e9815e570 2023-10-19T08:38:56.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.015+0000 7f7e95ffb700 1 -- 172.21.15.79:0/1426384619 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7e88003ba0 con 0x7f7e9815e570 2023-10-19T08:38:56.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.015+0000 7f7e95ffb700 1 --2- 172.21.15.79:0/1426384619 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7e8406a0e0 0x7f7e8406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:56.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.015+0000 7f7e95ffb700 1 -- 172.21.15.79:0/1426384619 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7e88021070 con 0x7f7e9815e570 2023-10-19T08:38:56.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.015+0000 7f7e9d2e0700 1 --2- 172.21.15.79:0/1426384619 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7e8406a0e0 0x7f7e8406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:56.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.016+0000 7f7e9d2e0700 1 --2- 172.21.15.79:0/1426384619 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7e8406a0e0 0x7f7e8406c5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7e980c7e20 tx=0x7f7e90001690 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:56.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.019+0000 7f7e95ffb700 1 -- 172.21.15.79:0/1426384619 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f7e980ca030 con 0x7f7e9815e570 2023-10-19T08:38:56.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.207+0000 7f7e9f544700 1 -- 172.21.15.79:0/1426384619 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e980ca030 con 0x7f7e9815e570 2023-10-19T08:38:56.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.207+0000 7f7e95ffb700 1 -- 172.21.15.79:0/1426384619 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e980ca030 con 0x7f7e9815e570 2023-10-19T08:38:56.211 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-19T08:38:56.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.209+0000 7f7e9f544700 1 -- 172.21.15.79:0/1426384619 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7e8406a0e0 msgr2=0x7f7e8406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:56.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.209+0000 7f7e9f544700 1 --2- 172.21.15.79:0/1426384619 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7e8406a0e0 0x7f7e8406c5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7e980c7e20 tx=0x7f7e90001690 comp rx=0 tx=0).stop 2023-10-19T08:38:56.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.209+0000 7f7e9f544700 1 -- 172.21.15.79:0/1426384619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9815e570 msgr2=0x7f7e980b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:56.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.209+0000 7f7e9f544700 1 --2- 172.21.15.79:0/1426384619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9815e570 0x7f7e980b1430 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009b90 tx=0x7f7e88004750 comp rx=0 tx=0).stop 2023-10-19T08:38:56.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.209+0000 7f7e9f544700 1 -- 172.21.15.79:0/1426384619 shutdown_connections 2023-10-19T08:38:56.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.209+0000 7f7e9f544700 1 --2- 172.21.15.79:0/1426384619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9815e570 0x7f7e980b1430 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.209+0000 7f7e9f544700 1 --2- 172.21.15.79:0/1426384619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e980b0c00 0x7f7e9815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.209+0000 7f7e9f544700 1 --2- 172.21.15.79:0/1426384619 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7e8406a0e0 0x7f7e8406c5a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.209+0000 7f7e9f544700 1 --2- 172.21.15.79:0/1426384619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e980cb6f0 0x7f7e9809e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.209+0000 7f7e9f544700 1 -- 172.21.15.79:0/1426384619 >> 172.21.15.79:0/1426384619 conn(0x7f7e9809a0b0 msgr2=0x7f7e980ae7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:56.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.209+0000 7f7e9f544700 1 -- 172.21.15.79:0/1426384619 shutdown_connections 2023-10-19T08:38:56.215 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.209+0000 7f7e9f544700 1 -- 172.21.15.79:0/1426384619 wait complete. 2023-10-19T08:38:56.225 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T08:38:56.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.345+0000 7f9280672700 1 Processor -- start 2023-10-19T08:38:56.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.345+0000 7f9280672700 1 -- start start 2023-10-19T08:38:56.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.346+0000 7f9280672700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f92780cd270 0x7f927806a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:56.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.346+0000 7f9280672700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9278161a90 con 0x7f92780703b0 2023-10-19T08:38:56.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.346+0000 7f9280672700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92780b1fe0 con 0x7f92780cc2a0 2023-10-19T08:38:56.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.346+0000 7f9280672700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9278160a80 con 0x7f92780cd270 2023-10-19T08:38:56.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.347+0000 7f927e40e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f92780cd270 0x7f927806a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:56.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.347+0000 7f927dc0d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f92780703b0 0x7f9278160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57664/0 (socket says 172.21.15.79:57664) 2023-10-19T08:38:56.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.347+0000 7f927dc0d700 1 -- 172.21.15.79:0/1874945427 learned_addr learned my addr 172.21.15.79:0/1874945427 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:56.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.347+0000 7f927e40e700 1 -- 172.21.15.79:0/1874945427 >> v1:172.21.15.89:6789/0 conn(0x7f92780cc2a0 legacy=0x7f9278161380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:56.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.347+0000 7f927e40e700 1 -- 172.21.15.79:0/1874945427 >> v1:172.21.15.79:6789/0 conn(0x7f92780703b0 legacy=0x7f9278160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:56.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.347+0000 7f927e40e700 1 -- 172.21.15.79:0/1874945427 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92780ce2b0 con 0x7f92780cd270 2023-10-19T08:38:56.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.347+0000 7f927d40c700 1 -- 172.21.15.79:0/1874945427 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266238979 0 0) 0x7f9278161a90 con 0x7f92780703b0 2023-10-19T08:38:56.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.347+0000 7f927e40e700 1 --2- 172.21.15.79:0/1874945427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92780cd270 0x7f927806a220 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9268009840 tx=0x7f9268009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802279c22e47c70e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:56.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.347+0000 7f927d40c700 1 -- 172.21.15.79:0/1874945427 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268004230 con 0x7f92780cd270 2023-10-19T08:38:56.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.347+0000 7f927d40c700 1 -- 172.21.15.79:0/1874945427 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9268004390 con 0x7f92780cd270 2023-10-19T08:38:56.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.347+0000 7f927d40c700 1 -- 172.21.15.79:0/1874945427 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92680036a0 con 0x7f92780cd270 2023-10-19T08:38:56.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.348+0000 7f9280672700 1 -- 172.21.15.79:0/1874945427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92780cd270 msgr2=0x7f927806a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:56.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.348+0000 7f9280672700 1 --2- 172.21.15.79:0/1874945427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92780cd270 0x7f927806a220 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9268009840 tx=0x7f9268009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:56.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.348+0000 7f9280672700 1 -- 172.21.15.79:0/1874945427 shutdown_connections 2023-10-19T08:38:56.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.348+0000 7f9280672700 1 --2- 172.21.15.79:0/1874945427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92780cd270 0x7f927806a220 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.348+0000 7f9280672700 1 -- 172.21.15.79:0/1874945427 >> 172.21.15.79:0/1874945427 conn(0x7f927806dcc0 msgr2=0x7f927806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:56.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.348+0000 7f9280672700 1 -- 172.21.15.79:0/1874945427 shutdown_connections 2023-10-19T08:38:56.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.348+0000 7f9280672700 1 -- 172.21.15.79:0/1874945427 wait complete. 2023-10-19T08:38:56.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.349+0000 7f9280672700 1 Processor -- start 2023-10-19T08:38:56.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.349+0000 7f9280672700 1 -- start start 2023-10-19T08:38:56.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f9280672700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92780703b0 0x7f92781f6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:56.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f9280672700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92780cc2a0 0x7f92781f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:56.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f9280672700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92780cd270 0x7f9278153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:56.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f9280672700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92781f6a50 con 0x7f92780cd270 2023-10-19T08:38:56.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f9280672700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92780c8000 con 0x7f92780cc2a0 2023-10-19T08:38:56.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f9280672700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92780c73f0 con 0x7f92780703b0 2023-10-19T08:38:56.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f927ec0f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92780cd270 0x7f9278153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:56.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f927ec0f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92780cd270 0x7f9278153af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47600/0 (socket says 172.21.15.79:47600) 2023-10-19T08:38:56.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f927ec0f700 1 -- 172.21.15.79:0/1906889555 learned_addr learned my addr 172.21.15.79:0/1906889555 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:56.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f927e40e700 1 --2- 172.21.15.79:0/1906889555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92780703b0 0x7f92781f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:56.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f927dc0d700 1 --2- 172.21.15.79:0/1906889555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92780cc2a0 0x7f92781f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:56.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f927ec0f700 1 -- 172.21.15.79:0/1906889555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92780703b0 msgr2=0x7f92781f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:56.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f927ec0f700 1 --2- 172.21.15.79:0/1906889555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92780703b0 0x7f92781f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f927ec0f700 1 -- 172.21.15.79:0/1906889555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92780cc2a0 msgr2=0x7f92781f51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:56.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f927ec0f700 1 --2- 172.21.15.79:0/1906889555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92780cc2a0 0x7f92781f51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f927ec0f700 1 -- 172.21.15.79:0/1906889555 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92680094a0 con 0x7f92780cd270 2023-10-19T08:38:56.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f927ec0f700 1 --2- 172.21.15.79:0/1906889555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92780cd270 0x7f9278153af0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f927000cc10 tx=0x7f927000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:56.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f926effd700 1 -- 172.21.15.79:0/1906889555 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927000abb0 con 0x7f92780cd270 2023-10-19T08:38:56.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f926effd700 1 -- 172.21.15.79:0/1906889555 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927000ad10 con 0x7f92780cd270 2023-10-19T08:38:56.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f9280672700 1 -- 172.21.15.79:0/1906889555 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92780c76d0 con 0x7f92780cd270 2023-10-19T08:38:56.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f926effd700 1 -- 172.21.15.79:0/1906889555 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270012660 con 0x7f92780cd270 2023-10-19T08:38:56.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.350+0000 7f9280672700 1 -- 172.21.15.79:0/1906889555 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92780c7c90 con 0x7f92780cd270 2023-10-19T08:38:56.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.351+0000 7f9280672700 1 -- 172.21.15.79:0/1906889555 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927804ee70 con 0x7f92780cd270 2023-10-19T08:38:56.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.352+0000 7f926effd700 1 -- 172.21.15.79:0/1906889555 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f92700127c0 con 0x7f92780cd270 2023-10-19T08:38:56.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.352+0000 7f926effd700 1 --2- 172.21.15.79:0/1906889555 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f925c06a110 0x7f925c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:56.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.352+0000 7f927e40e700 1 --2- 172.21.15.79:0/1906889555 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f925c06a110 0x7f925c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:56.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.352+0000 7f926effd700 1 -- 172.21.15.79:0/1906889555 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9270088fe0 con 0x7f92780cd270 2023-10-19T08:38:56.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.353+0000 7f927e40e700 1 --2- 172.21.15.79:0/1906889555 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f925c06a110 0x7f925c06c5d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f92680090b0 tx=0x7f9268008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:56.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.357+0000 7f926effd700 1 -- 172.21.15.79:0/1906889555 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f92700543a0 con 0x7f92780cd270 2023-10-19T08:38:56.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.546+0000 7f9280672700 1 -- 172.21.15.79:0/1906889555 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f92780b1820 con 0x7f92780cd270 2023-10-19T08:38:56.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.547+0000 7f926effd700 1 -- 172.21.15.79:0/1906889555 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9270016020 con 0x7f92780cd270 2023-10-19T08:38:56.551 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:56.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.549+0000 7f9280672700 1 -- 172.21.15.79:0/1906889555 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f925c06a110 msgr2=0x7f925c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:56.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.549+0000 7f9280672700 1 --2- 172.21.15.79:0/1906889555 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f925c06a110 0x7f925c06c5d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f92680090b0 tx=0x7f9268008030 comp rx=0 tx=0).stop 2023-10-19T08:38:56.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.549+0000 7f9280672700 1 -- 172.21.15.79:0/1906889555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92780cd270 msgr2=0x7f9278153af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:56.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.549+0000 7f9280672700 1 --2- 172.21.15.79:0/1906889555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92780cd270 0x7f9278153af0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f927000cc10 tx=0x7f927000a060 comp rx=0 tx=0).stop 2023-10-19T08:38:56.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.549+0000 7f9280672700 1 -- 172.21.15.79:0/1906889555 shutdown_connections 2023-10-19T08:38:56.553 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.549+0000 7f9280672700 1 --2- 172.21.15.79:0/1906889555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92780cd270 0x7f9278153af0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.549+0000 7f9280672700 1 --2- 172.21.15.79:0/1906889555 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f925c06a110 0x7f925c06c5d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.549+0000 7f9280672700 1 --2- 172.21.15.79:0/1906889555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f92780703b0 0x7f92781f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.549+0000 7f9280672700 1 --2- 172.21.15.79:0/1906889555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92780cc2a0 0x7f92781f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.549+0000 7f9280672700 1 -- 172.21.15.79:0/1906889555 >> 172.21.15.79:0/1906889555 conn(0x7f927806dcc0 msgr2=0x7f9278160bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:56.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.549+0000 7f9280672700 1 -- 172.21.15.79:0/1906889555 shutdown_connections 2023-10-19T08:38:56.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.549+0000 7f9280672700 1 -- 172.21.15.79:0/1906889555 wait complete. 2023-10-19T08:38:56.564 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-19T08:38:56.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.684+0000 7fc8d8d43700 1 Processor -- start 2023-10-19T08:38:56.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.684+0000 7fc8d8d43700 1 -- start start 2023-10-19T08:38:56.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.685+0000 7fc8d8d43700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc8d40cd270 0x7fc8d406a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:56.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.685+0000 7fc8d8d43700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8d40703b0 0x7fc8d406a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:56.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.685+0000 7fc8d8d43700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d40b1fe0 con 0x7fc8d406f910 2023-10-19T08:38:56.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.685+0000 7fc8d8d43700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d4160a80 con 0x7fc8d40cd270 2023-10-19T08:38:56.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.685+0000 7fc8d8d43700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d40ce2b0 con 0x7fc8d40703b0 2023-10-19T08:38:56.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.685+0000 7fc8d259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc8d40cd270 0x7fc8d406a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:56.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.685+0000 7fc8d2d9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc8d406f910 0x7fc8d4160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57680/0 (socket says 172.21.15.79:57680) 2023-10-19T08:38:56.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.685+0000 7fc8d2d9d700 1 -- 172.21.15.79:0/2092426057 learned_addr learned my addr 172.21.15.79:0/2092426057 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:56.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.685+0000 7fc8d259c700 1 -- 172.21.15.79:0/2092426057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8d40703b0 msgr2=0x7fc8d406a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:56.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.685+0000 7fc8d259c700 1 --2- 172.21.15.79:0/2092426057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8d40703b0 0x7fc8d406a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.685+0000 7fc8d259c700 1 -- 172.21.15.79:0/2092426057 >> v1:172.21.15.79:6789/0 conn(0x7fc8d406f910 legacy=0x7fc8d4160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:56.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.685+0000 7fc8d259c700 1 -- 172.21.15.79:0/2092426057 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d40ce550 con 0x7fc8d40cd270 2023-10-19T08:38:56.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.685+0000 7fc8d159a700 1 -- 172.21.15.79:0/2092426057 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806737369 0 0) 0x7fc8d40b1fe0 con 0x7fc8d406f910 2023-10-19T08:38:56.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.685+0000 7fc8d259c700 1 --2- 172.21.15.79:0/2092426057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40cd270 0x7fc8d406a220 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009840 tx=0x7fc8c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e695ec535f4d670 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:56.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.685+0000 7fc8d159a700 1 -- 172.21.15.79:0/2092426057 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4011830 con 0x7fc8d40cd270 2023-10-19T08:38:56.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.686+0000 7fc8d159a700 1 -- 172.21.15.79:0/2092426057 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c4011990 con 0x7fc8d40cd270 2023-10-19T08:38:56.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.686+0000 7fc8d159a700 1 -- 172.21.15.79:0/2092426057 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c4011d20 con 0x7fc8d40cd270 2023-10-19T08:38:56.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.686+0000 7fc8d8d43700 1 -- 172.21.15.79:0/2092426057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40cd270 msgr2=0x7fc8d406a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:56.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.686+0000 7fc8d8d43700 1 --2- 172.21.15.79:0/2092426057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40cd270 0x7fc8d406a220 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4009840 tx=0x7fc8c4009b50 comp rx=0 tx=0).stop 2023-10-19T08:38:56.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.686+0000 7fc8d8d43700 1 -- 172.21.15.79:0/2092426057 shutdown_connections 2023-10-19T08:38:56.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.686+0000 7fc8d8d43700 1 --2- 172.21.15.79:0/2092426057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40cd270 0x7fc8d406a220 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.686+0000 7fc8d8d43700 1 --2- 172.21.15.79:0/2092426057 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8d40703b0 0x7fc8d406a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.686+0000 7fc8d8d43700 1 -- 172.21.15.79:0/2092426057 >> 172.21.15.79:0/2092426057 conn(0x7fc8d406dcc0 msgr2=0x7fc8d406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:56.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.686+0000 7fc8d8d43700 1 -- 172.21.15.79:0/2092426057 shutdown_connections 2023-10-19T08:38:56.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.686+0000 7fc8d8d43700 1 -- 172.21.15.79:0/2092426057 wait complete. 2023-10-19T08:38:56.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.688+0000 7fc8d8d43700 1 Processor -- start 2023-10-19T08:38:56.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.688+0000 7fc8d8d43700 1 -- start start 2023-10-19T08:38:56.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.689+0000 7fc8d8d43700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8d406f910 0x7fc8d40c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:56.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.689+0000 7fc8d8d43700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40703b0 0x7fc8d40b2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:56.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.689+0000 7fc8d8d43700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8d40cd270 0x7fc8d40af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:56.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.689+0000 7fc8d8d43700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d40ac2c0 con 0x7fc8d40703b0 2023-10-19T08:38:56.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.689+0000 7fc8d8d43700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d40b3080 con 0x7fc8d40cd270 2023-10-19T08:38:56.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.689+0000 7fc8d8d43700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d40b3360 con 0x7fc8d406f910 2023-10-19T08:38:56.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.689+0000 7fc8d1d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40703b0 0x7fc8d40b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:56.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.689+0000 7fc8d1d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40703b0 0x7fc8d40b2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47612/0 (socket says 172.21.15.79:47612) 2023-10-19T08:38:56.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.689+0000 7fc8d1d9b700 1 -- 172.21.15.79:0/838148806 learned_addr learned my addr 172.21.15.79:0/838148806 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:56.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.689+0000 7fc8d2d9d700 1 --2- 172.21.15.79:0/838148806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8d40cd270 0x7fc8d40af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:56.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.689+0000 7fc8d259c700 1 --2- 172.21.15.79:0/838148806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8d406f910 0x7fc8d40c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:56.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.689+0000 7fc8d1d9b700 1 -- 172.21.15.79:0/838148806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8d406f910 msgr2=0x7fc8d40c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:56.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.689+0000 7fc8d1d9b700 1 --2- 172.21.15.79:0/838148806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8d406f910 0x7fc8d40c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.689+0000 7fc8d1d9b700 1 -- 172.21.15.79:0/838148806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8d40cd270 msgr2=0x7fc8d40af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:56.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.689+0000 7fc8d1d9b700 1 --2- 172.21.15.79:0/838148806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8d40cd270 0x7fc8d40af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.689+0000 7fc8d1d9b700 1 -- 172.21.15.79:0/838148806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c40094a0 con 0x7fc8d40703b0 2023-10-19T08:38:56.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.689+0000 7fc8d1d9b700 1 --2- 172.21.15.79:0/838148806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40703b0 0x7fc8d40b2850 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800b4a0 tx=0x7fc8c800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:56.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.689+0000 7fc8c2ffd700 1 -- 172.21.15.79:0/838148806 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8011830 con 0x7fc8d40703b0 2023-10-19T08:38:56.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.690+0000 7fc8c2ffd700 1 -- 172.21.15.79:0/838148806 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c8011990 con 0x7fc8d40703b0 2023-10-19T08:38:56.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.690+0000 7fc8d8d43700 1 -- 172.21.15.79:0/838148806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d40b3640 con 0x7fc8d40703b0 2023-10-19T08:38:56.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.690+0000 7fc8c2ffd700 1 -- 172.21.15.79:0/838148806 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8011d40 con 0x7fc8d40703b0 2023-10-19T08:38:56.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.690+0000 7fc8d8d43700 1 -- 172.21.15.79:0/838148806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d40b2d90 con 0x7fc8d40703b0 2023-10-19T08:38:56.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.691+0000 7fc8d8d43700 1 -- 172.21.15.79:0/838148806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d40b3b60 con 0x7fc8d40703b0 2023-10-19T08:38:56.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.691+0000 7fc8c2ffd700 1 -- 172.21.15.79:0/838148806 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc8c801a400 con 0x7fc8d40703b0 2023-10-19T08:38:56.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.691+0000 7fc8c2ffd700 1 --2- 172.21.15.79:0/838148806 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc8b406a0e0 0x7fc8b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:56.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.691+0000 7fc8c2ffd700 1 -- 172.21.15.79:0/838148806 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc8c80888b0 con 0x7fc8d40703b0 2023-10-19T08:38:56.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.691+0000 7fc8d259c700 1 --2- 172.21.15.79:0/838148806 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc8b406a0e0 0x7fc8b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:56.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.692+0000 7fc8d259c700 1 --2- 172.21.15.79:0/838148806 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc8b406a0e0 0x7fc8b406c5a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4000c00 tx=0x7fc8c4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:56.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.696+0000 7fc8c2ffd700 1 -- 172.21.15.79:0/838148806 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc8d40b3b60 con 0x7fc8d40703b0 2023-10-19T08:38:56.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.886+0000 7fc8d8d43700 1 -- 172.21.15.79:0/838148806 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc8d40b3b60 con 0x7fc8d40703b0 2023-10-19T08:38:56.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.886+0000 7fc8c2ffd700 1 -- 172.21.15.79:0/838148806 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc8d40b3b60 con 0x7fc8d40703b0 2023-10-19T08:38:56.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.888+0000 7fc8d8d43700 1 -- 172.21.15.79:0/838148806 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc8b406a0e0 msgr2=0x7fc8b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:56.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.888+0000 7fc8d8d43700 1 --2- 172.21.15.79:0/838148806 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc8b406a0e0 0x7fc8b406c5a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4000c00 tx=0x7fc8c4008030 comp rx=0 tx=0).stop 2023-10-19T08:38:56.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.888+0000 7fc8d8d43700 1 -- 172.21.15.79:0/838148806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40703b0 msgr2=0x7fc8d40b2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:56.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.888+0000 7fc8d8d43700 1 --2- 172.21.15.79:0/838148806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40703b0 0x7fc8d40b2850 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800b4a0 tx=0x7fc8c800b860 comp rx=0 tx=0).stop 2023-10-19T08:38:56.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.888+0000 7fc8d8d43700 1 -- 172.21.15.79:0/838148806 shutdown_connections 2023-10-19T08:38:56.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.888+0000 7fc8d8d43700 1 --2- 172.21.15.79:0/838148806 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc8d40cd270 0x7fc8d40af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.888+0000 7fc8d8d43700 1 --2- 172.21.15.79:0/838148806 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc8b406a0e0 0x7fc8b406c5a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.888+0000 7fc8d8d43700 1 --2- 172.21.15.79:0/838148806 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc8d406f910 0x7fc8d40c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.888+0000 7fc8d8d43700 1 --2- 172.21.15.79:0/838148806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc8d40703b0 0x7fc8d40b2850 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:56.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.888+0000 7fc8d8d43700 1 -- 172.21.15.79:0/838148806 >> 172.21.15.79:0/838148806 conn(0x7fc8d406dcc0 msgr2=0x7fc8d40cd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:56.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.888+0000 7fc8d8d43700 1 -- 172.21.15.79:0/838148806 shutdown_connections 2023-10-19T08:38:56.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:56.888+0000 7fc8d8d43700 1 -- 172.21.15.79:0/838148806 wait complete. 2023-10-19T08:38:56.903 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-19T08:38:56.904 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-19T08:38:56.944 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-19T08:38:56.996 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-19T08:38:56.996 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:38:56.997 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T08:38:57.015 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:38:57.015 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T08:38:57.073 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:57.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.229+0000 7fa7f0c73700 1 Processor -- start 2023-10-19T08:38:57.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.229+0000 7fa7f0c73700 1 -- start start 2023-10-19T08:38:57.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7f0c73700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa7ec0af170 0x7fa7ec0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7f0c73700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ec15de50 con 0x7fa7ec0b1de0 2023-10-19T08:38:57.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7f0c73700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ec15e130 con 0x7fa7ec0b2270 2023-10-19T08:38:57.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7f0c73700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ec0af550 con 0x7fa7ec0af170 2023-10-19T08:38:57.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7e9d9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fa7ec0b1de0 0x7fa7ec0cd800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57690/0 (socket says 172.21.15.79:57690) 2023-10-19T08:38:57.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7e9d9b700 1 -- 172.21.15.79:0/1269656572 learned_addr learned my addr 172.21.15.79:0/1269656572 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:57.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7e959a700 1 -- 172.21.15.79:0/1269656572 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319480627 0 0) 0x7fa7ec15de50 con 0x7fa7ec0b1de0 2023-10-19T08:38:57.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7e959a700 1 -- 172.21.15.79:0/1269656572 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7d40035b0 con 0x7fa7ec0b1de0 2023-10-19T08:38:57.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7ea59c700 1 --2- 172.21.15.79:0/1269656572 >> v2:172.21.15.89:3300/0 conn(0x7fa7ec0af170 0x7fa7ec0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7e959a700 1 -- 172.21.15.79:0/1269656572 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 143290693 0 0) 0x7fa7d40035b0 con 0x7fa7ec0b1de0 2023-10-19T08:38:57.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7e959a700 1 -- 172.21.15.79:0/1269656572 >> v2:172.21.15.89:3300/0 conn(0x7fa7ec0af170 msgr2=0x7fa7ec0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:57.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7e959a700 1 --2- 172.21.15.79:0/1269656572 >> v2:172.21.15.89:3300/0 conn(0x7fa7ec0af170 0x7fa7ec0cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7e959a700 1 -- 172.21.15.79:0/1269656572 >> v1:172.21.15.89:6789/0 conn(0x7fa7ec0b2270 legacy=0x7fa7ec06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:57.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7e959a700 1 -- 172.21.15.79:0/1269656572 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec15e410 con 0x7fa7ec0b1de0 2023-10-19T08:38:57.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7e959a700 1 -- 172.21.15.79:0/1269656572 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7fa7e0001670 con 0x7fa7ec0b1de0 2023-10-19T08:38:57.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7e959a700 1 -- 172.21.15.79:0/1269656572 >> v1:172.21.15.79:6789/0 conn(0x7fa7ec0b1de0 legacy=0x7fa7ec0cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:57.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7e959a700 1 --2- 172.21.15.79:0/1269656572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7d4003a50 0x7fa7d4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7e959a700 1 --2- 172.21.15.79:0/1269656572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7d4004850 0x7fa7d4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7e959a700 1 --2- 172.21.15.79:0/1269656572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7d4005260 0x7fa7d400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7e959a700 1 -- 172.21.15.79:0/1269656572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec0af550 con 0x7fa7d4003a50 2023-10-19T08:38:57.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7e959a700 1 -- 172.21.15.79:0/1269656572 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d400c1b0 con 0x7fa7d4004850 2023-10-19T08:38:57.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7e959a700 1 -- 172.21.15.79:0/1269656572 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d400c370 con 0x7fa7d4005260 2023-10-19T08:38:57.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.230+0000 7fa7ea59c700 1 --2- 172.21.15.79:0/1269656572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7d4003a50 0x7fa7d4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.231+0000 7fa7e9d9b700 1 --2- 172.21.15.79:0/1269656572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7d4004850 0x7fa7d4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.231+0000 7fa7ead9d700 1 --2- 172.21.15.79:0/1269656572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7d4005260 0x7fa7d400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.231+0000 7fa7ea59c700 1 -- 172.21.15.79:0/1269656572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7d4005260 msgr2=0x7fa7d400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:57.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.231+0000 7fa7ea59c700 1 --2- 172.21.15.79:0/1269656572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7d4005260 0x7fa7d400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.231+0000 7fa7ea59c700 1 -- 172.21.15.79:0/1269656572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7d4004850 msgr2=0x7fa7d4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:57.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.231+0000 7fa7ea59c700 1 --2- 172.21.15.79:0/1269656572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7d4004850 0x7fa7d4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.231+0000 7fa7ea59c700 1 -- 172.21.15.79:0/1269656572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d40035b0 con 0x7fa7d4003a50 2023-10-19T08:38:57.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.231+0000 7fa7ead9d700 1 -- 172.21.15.79:0/1269656572 reap_dead start 2023-10-19T08:38:57.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.231+0000 7fa7e9d9b700 1 --2- 172.21.15.79:0/1269656572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7d4004850 0x7fa7d4004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:57.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.231+0000 7fa7ea59c700 1 --2- 172.21.15.79:0/1269656572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7d4003a50 0x7fa7d4003e70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc009890 tx=0x7fa7d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741a601a8ecf167f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:57.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.231+0000 7fa7e959a700 1 -- 172.21.15.79:0/1269656572 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc00c070 con 0x7fa7d4003a50 2023-10-19T08:38:57.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.231+0000 7fa7e959a700 1 -- 172.21.15.79:0/1269656572 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc013610 con 0x7fa7d4003a50 2023-10-19T08:38:57.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.231+0000 7fa7e959a700 1 -- 172.21.15.79:0/1269656572 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc0139a0 con 0x7fa7d4003a50 2023-10-19T08:38:57.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.231+0000 7fa7f0c73700 1 -- 172.21.15.79:0/1269656572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7d4003a50 msgr2=0x7fa7d4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:57.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.231+0000 7fa7f0c73700 1 --2- 172.21.15.79:0/1269656572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7d4003a50 0x7fa7d4003e70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc009890 tx=0x7fa7d4005880 comp rx=0 tx=0).stop 2023-10-19T08:38:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.232+0000 7fa7f0c73700 1 -- 172.21.15.79:0/1269656572 shutdown_connections 2023-10-19T08:38:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.232+0000 7fa7f0c73700 1 --2- 172.21.15.79:0/1269656572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7d4003a50 0x7fa7d4003e70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.232+0000 7fa7f0c73700 1 -- 172.21.15.79:0/1269656572 >> 172.21.15.79:0/1269656572 conn(0x7fa7ec06dcc0 msgr2=0x7fa7ec06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.232+0000 7fa7f0c73700 1 -- 172.21.15.79:0/1269656572 shutdown_connections 2023-10-19T08:38:57.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.232+0000 7fa7f0c73700 1 -- 172.21.15.79:0/1269656572 wait complete. 2023-10-19T08:38:57.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.233+0000 7fa7f0c73700 1 Processor -- start 2023-10-19T08:38:57.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.233+0000 7fa7f0c73700 1 -- start start 2023-10-19T08:38:57.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7f0c73700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7d4003a50 0x7fa7ec1f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7f0c73700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7ec0ad1d0 0x7fa7ec0c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7f0c73700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7ec0cd770 0x7fa7ec0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7f0c73700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec0ce140 con 0x7fa7ec0ad1d0 2023-10-19T08:38:57.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7f0c73700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec155c00 con 0x7fa7ec0cd770 2023-10-19T08:38:57.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7f0c73700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec0ab8e0 con 0x7fa7d4003a50 2023-10-19T08:38:57.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7e9d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7ec0ad1d0 0x7fa7ec0c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7e9d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7ec0ad1d0 0x7fa7ec0c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47632/0 (socket says 172.21.15.79:47632) 2023-10-19T08:38:57.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7e9d9b700 1 -- 172.21.15.79:0/1876608973 learned_addr learned my addr 172.21.15.79:0/1876608973 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:57.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7ead9d700 1 --2- 172.21.15.79:0/1876608973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7ec0cd770 0x7fa7ec0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7ea59c700 1 --2- 172.21.15.79:0/1876608973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7d4003a50 0x7fa7ec1f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7e9d9b700 1 -- 172.21.15.79:0/1876608973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7d4003a50 msgr2=0x7fa7ec1f70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:57.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7e9d9b700 1 --2- 172.21.15.79:0/1876608973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7d4003a50 0x7fa7ec1f70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7e9d9b700 1 -- 172.21.15.79:0/1876608973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7ec0cd770 msgr2=0x7fa7ec0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:57.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7e9d9b700 1 --2- 172.21.15.79:0/1876608973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7ec0cd770 0x7fa7ec0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7e9d9b700 1 -- 172.21.15.79:0/1876608973 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec0c7240 con 0x7fa7ec0ad1d0 2023-10-19T08:38:57.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7ead9d700 1 --2- 172.21.15.79:0/1876608973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7ec0cd770 0x7fa7ec0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:57.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7ea59c700 1 --2- 172.21.15.79:0/1876608973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7d4003a50 0x7fa7ec1f70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:57.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7e9d9b700 1 --2- 172.21.15.79:0/1876608973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7ec0ad1d0 0x7fa7ec0c6d00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000eaf0 tx=0x7fa7e000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:57.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7daffd700 1 -- 172.21.15.79:0/1876608973 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0005e20 con 0x7fa7ec0ad1d0 2023-10-19T08:38:57.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7daffd700 1 -- 172.21.15.79:0/1876608973 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e000c7b0 con 0x7fa7ec0ad1d0 2023-10-19T08:38:57.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7daffd700 1 -- 172.21.15.79:0/1876608973 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e000cb40 con 0x7fa7ec0ad1d0 2023-10-19T08:38:57.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7f0c73700 1 -- 172.21.15.79:0/1876608973 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ec0c7d10 con 0x7fa7ec0ad1d0 2023-10-19T08:38:57.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.234+0000 7fa7f0c73700 1 -- 172.21.15.79:0/1876608973 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ec0c7750 con 0x7fa7ec0ad1d0 2023-10-19T08:38:57.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.235+0000 7fa7f0c73700 1 -- 172.21.15.79:0/1876608973 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ec04ee70 con 0x7fa7ec0ad1d0 2023-10-19T08:38:57.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.236+0000 7fa7daffd700 1 -- 172.21.15.79:0/1876608973 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa7e000cca0 con 0x7fa7ec0ad1d0 2023-10-19T08:38:57.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.236+0000 7fa7daffd700 1 --2- 172.21.15.79:0/1876608973 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa7cc06a0e0 0x7fa7cc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.236+0000 7fa7daffd700 1 -- 172.21.15.79:0/1876608973 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa7e00885e0 con 0x7fa7ec0ad1d0 2023-10-19T08:38:57.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.236+0000 7fa7ea59c700 1 --2- 172.21.15.79:0/1876608973 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa7cc06a0e0 0x7fa7cc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.237+0000 7fa7ea59c700 1 --2- 172.21.15.79:0/1876608973 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa7cc06a0e0 0x7fa7cc06c5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc008010 tx=0x7fa7dc00c000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:57.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.241+0000 7fa7daffd700 1 -- 172.21.15.79:0/1876608973 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa7e0053a30 con 0x7fa7ec0ad1d0 2023-10-19T08:38:57.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.434+0000 7fa7f0c73700 1 -- 172.21.15.79:0/1876608973 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7ec0c6940 con 0x7fa7ec0ad1d0 2023-10-19T08:38:57.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.436+0000 7fa7daffd700 1 -- 172.21.15.79:0/1876608973 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20155 (secure 0 0 0) 0x7fa7e00014b0 con 0x7fa7ec0ad1d0 2023-10-19T08:38:57.440 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:57.440 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:44.473795+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:57.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.438+0000 7fa7f0c73700 1 -- 172.21.15.79:0/1876608973 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa7cc06a0e0 msgr2=0x7fa7cc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:57.442 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.438+0000 7fa7f0c73700 1 --2- 172.21.15.79:0/1876608973 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa7cc06a0e0 0x7fa7cc06c5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc008010 tx=0x7fa7dc00c000 comp rx=0 tx=0).stop 2023-10-19T08:38:57.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.438+0000 7fa7f0c73700 1 -- 172.21.15.79:0/1876608973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7ec0ad1d0 msgr2=0x7fa7ec0c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:57.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.438+0000 7fa7f0c73700 1 --2- 172.21.15.79:0/1876608973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7ec0ad1d0 0x7fa7ec0c6d00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000eaf0 tx=0x7fa7e000eeb0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.438+0000 7fa7f0c73700 1 -- 172.21.15.79:0/1876608973 shutdown_connections 2023-10-19T08:38:57.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.438+0000 7fa7f0c73700 1 --2- 172.21.15.79:0/1876608973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7ec0cd770 0x7fa7ec0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.438+0000 7fa7f0c73700 1 --2- 172.21.15.79:0/1876608973 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa7cc06a0e0 0x7fa7cc06c5a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.438+0000 7fa7f0c73700 1 --2- 172.21.15.79:0/1876608973 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7d4003a50 0x7fa7ec1f70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.438+0000 7fa7f0c73700 1 --2- 172.21.15.79:0/1876608973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7ec0ad1d0 0x7fa7ec0c6d00 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.438+0000 7fa7f0c73700 1 -- 172.21.15.79:0/1876608973 >> 172.21.15.79:0/1876608973 conn(0x7fa7ec06dcc0 msgr2=0x7fa7ec0ca700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:57.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.438+0000 7fa7f0c73700 1 -- 172.21.15.79:0/1876608973 shutdown_connections 2023-10-19T08:38:57.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.438+0000 7fa7f0c73700 1 -- 172.21.15.79:0/1876608973 wait complete. 2023-10-19T08:38:57.454 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T08:37:54.318159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T08:37:55.629862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T08:37:59.333062+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T08:38:57.455 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:38:57.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.579+0000 7f79863ec700 1 Processor -- start 2023-10-19T08:38:57.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.579+0000 7f79863ec700 1 -- start start 2023-10-19T08:38:57.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.580+0000 7f79863ec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79800703b0 0x7f79800cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.580+0000 7f79863ec700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79800b1fe0 con 0x7f79800cd270 2023-10-19T08:38:57.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.580+0000 7f79863ec700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79800ce2b0 con 0x7f798006a930 2023-10-19T08:38:57.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.580+0000 7f79863ec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7980160a80 con 0x7f79800703b0 2023-10-19T08:38:57.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.580+0000 7f797ffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f79800cd270 0x7f798006a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57710/0 (socket says 172.21.15.79:57710) 2023-10-19T08:38:57.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.580+0000 7f797ffff700 1 -- 172.21.15.79:0/1199031270 learned_addr learned my addr 172.21.15.79:0/1199031270 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:57.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.580+0000 7f797effd700 1 -- 172.21.15.79:0/1199031270 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72471485 0 0) 0x7f79800b1fe0 con 0x7f79800cd270 2023-10-19T08:38:57.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.580+0000 7f797effd700 1 -- 172.21.15.79:0/1199031270 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79680035b0 con 0x7f79800cd270 2023-10-19T08:38:57.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.580+0000 7f7984989700 1 --2- 172.21.15.79:0/1199031270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79800703b0 0x7f79800cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.580+0000 7f797effd700 1 -- 172.21.15.79:0/1199031270 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3890260424 0 0) 0x7f79680035b0 con 0x7f79800cd270 2023-10-19T08:38:57.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.580+0000 7f797effd700 1 -- 172.21.15.79:0/1199031270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79800703b0 msgr2=0x7f79800cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:57.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.580+0000 7f797effd700 1 --2- 172.21.15.79:0/1199031270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79800703b0 0x7f79800cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.580+0000 7f797effd700 1 -- 172.21.15.79:0/1199031270 >> v1:172.21.15.89:6789/0 conn(0x7f798006a930 legacy=0x7f79800cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:57.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.580+0000 7f797effd700 1 -- 172.21.15.79:0/1199031270 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79800ce550 con 0x7f79800cd270 2023-10-19T08:38:57.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.580+0000 7f797effd700 1 -- 172.21.15.79:0/1199031270 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f7974001670 con 0x7f79800cd270 2023-10-19T08:38:57.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.580+0000 7f797effd700 1 -- 172.21.15.79:0/1199031270 >> v1:172.21.15.79:6789/0 conn(0x7f79800cd270 legacy=0x7f798006a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:57.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.580+0000 7f797effd700 1 --2- 172.21.15.79:0/1199031270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79800703b0 0x7f7968003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.581+0000 7f797effd700 1 --2- 172.21.15.79:0/1199031270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79680040d0 0x7f7968004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.581+0000 7f797effd700 1 --2- 172.21.15.79:0/1199031270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7968004de0 0x7f7968005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.581+0000 7f797effd700 1 -- 172.21.15.79:0/1199031270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7980160a80 con 0x7f7968004de0 2023-10-19T08:38:57.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.581+0000 7f797effd700 1 -- 172.21.15.79:0/1199031270 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796800bc20 con 0x7f79680040d0 2023-10-19T08:38:57.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.581+0000 7f797effd700 1 -- 172.21.15.79:0/1199031270 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796800bde0 con 0x7f79800703b0 2023-10-19T08:38:57.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.581+0000 7f7984989700 1 --2- 172.21.15.79:0/1199031270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7968004de0 0x7f7968005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.581+0000 7f797ffff700 1 --2- 172.21.15.79:0/1199031270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79800703b0 0x7f7968003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.581+0000 7f797f7fe700 1 --2- 172.21.15.79:0/1199031270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79680040d0 0x7f7968004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.581+0000 7f7984989700 1 -- 172.21.15.79:0/1199031270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79800703b0 msgr2=0x7f7968003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:57.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.581+0000 7f7984989700 1 --2- 172.21.15.79:0/1199031270 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79800703b0 0x7f7968003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.581+0000 7f7984989700 1 -- 172.21.15.79:0/1199031270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79680040d0 msgr2=0x7f7968004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:57.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.581+0000 7f7984989700 1 --2- 172.21.15.79:0/1199031270 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79680040d0 0x7f7968004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.581+0000 7f7984989700 1 -- 172.21.15.79:0/1199031270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79680035b0 con 0x7f7968004de0 2023-10-19T08:38:57.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.581+0000 7f7984989700 1 --2- 172.21.15.79:0/1199031270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7968004de0 0x7f7968005260 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7978007360 tx=0x7f7968005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b08febccb2d52f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:57.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.581+0000 7f797effd700 1 -- 172.21.15.79:0/1199031270 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7978007e80 con 0x7f7968004de0 2023-10-19T08:38:57.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.581+0000 7f797effd700 1 -- 172.21.15.79:0/1199031270 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7978014400 con 0x7f7968004de0 2023-10-19T08:38:57.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.581+0000 7f797effd700 1 -- 172.21.15.79:0/1199031270 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7978014790 con 0x7f7968004de0 2023-10-19T08:38:57.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.582+0000 7f79863ec700 1 -- 172.21.15.79:0/1199031270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7968004de0 msgr2=0x7f7968005260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:57.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.582+0000 7f79863ec700 1 --2- 172.21.15.79:0/1199031270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7968004de0 0x7f7968005260 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7978007360 tx=0x7f7968005880 comp rx=0 tx=0).stop 2023-10-19T08:38:57.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.582+0000 7f7984989700 1 -- 172.21.15.79:0/1199031270 reap_dead start 2023-10-19T08:38:57.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.582+0000 7f79863ec700 1 -- 172.21.15.79:0/1199031270 shutdown_connections 2023-10-19T08:38:57.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.582+0000 7f79863ec700 1 -- 172.21.15.79:0/1199031270 >> 172.21.15.79:0/1199031270 conn(0x7f798006dcc0 msgr2=0x7f798006e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:57.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.582+0000 7f79863ec700 1 -- 172.21.15.79:0/1199031270 shutdown_connections 2023-10-19T08:38:57.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.582+0000 7f79863ec700 1 -- 172.21.15.79:0/1199031270 wait complete. 2023-10-19T08:38:57.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.583+0000 7f79863ec700 1 Processor -- start 2023-10-19T08:38:57.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.583+0000 7f79863ec700 1 -- start start 2023-10-19T08:38:57.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.584+0000 7f79863ec700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7980155120 0x7f79800b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.584+0000 7f79863ec700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79800c7550 0x7f79800c2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.584+0000 7f79863ec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79800c28b0 0x7f79800c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.584+0000 7f79863ec700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79800b43a0 con 0x7f79800c7550 2023-10-19T08:38:57.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.584+0000 7f79863ec700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79800c2d30 con 0x7f7980155120 2023-10-19T08:38:57.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.584+0000 7f79863ec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79800ac5e0 con 0x7f79800c28b0 2023-10-19T08:38:57.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.584+0000 7f797f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79800c7550 0x7f79800c2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.584+0000 7f797f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79800c7550 0x7f79800c2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47650/0 (socket says 172.21.15.79:47650) 2023-10-19T08:38:57.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.584+0000 7f797f7fe700 1 -- 172.21.15.79:0/1195370889 learned_addr learned my addr 172.21.15.79:0/1195370889 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:57.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.584+0000 7f797f7fe700 1 -- 172.21.15.79:0/1195370889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79800c28b0 msgr2=0x7f79800c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:57.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.584+0000 7f797ffff700 1 --2- 172.21.15.79:0/1195370889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7980155120 0x7f79800b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.584+0000 7f7984989700 1 --2- 172.21.15.79:0/1195370889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79800c28b0 0x7f79800c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.584+0000 7f797f7fe700 1 --2- 172.21.15.79:0/1195370889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79800c28b0 0x7f79800c8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.584+0000 7f797f7fe700 1 -- 172.21.15.79:0/1195370889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7980155120 msgr2=0x7f79800b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:57.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.584+0000 7f797f7fe700 1 --2- 172.21.15.79:0/1195370889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7980155120 0x7f79800b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.584+0000 7f797f7fe700 1 -- 172.21.15.79:0/1195370889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79800b4590 con 0x7f79800c7550 2023-10-19T08:38:57.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.584+0000 7f797f7fe700 1 --2- 172.21.15.79:0/1195370889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79800c7550 0x7f79800c2370 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f797000f850 tx=0x7f797000fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:57.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.584+0000 7f797cff9700 1 -- 172.21.15.79:0/1195370889 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79700050d0 con 0x7f79800c7550 2023-10-19T08:38:57.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.584+0000 7f797cff9700 1 -- 172.21.15.79:0/1195370889 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7970005230 con 0x7f79800c7550 2023-10-19T08:38:57.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.585+0000 7f797cff9700 1 -- 172.21.15.79:0/1195370889 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7970003680 con 0x7f79800c7550 2023-10-19T08:38:57.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.585+0000 7f79863ec700 1 -- 172.21.15.79:0/1195370889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79800b4870 con 0x7f79800c7550 2023-10-19T08:38:57.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.585+0000 7f79863ec700 1 -- 172.21.15.79:0/1195370889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79800c79d0 con 0x7f79800c7550 2023-10-19T08:38:57.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.586+0000 7f79863ec700 1 -- 172.21.15.79:0/1195370889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79800b4d90 con 0x7f79800c7550 2023-10-19T08:38:57.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.586+0000 7f797cff9700 1 -- 172.21.15.79:0/1195370889 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f79700037e0 con 0x7f79800c7550 2023-10-19T08:38:57.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.586+0000 7f797cff9700 1 --2- 172.21.15.79:0/1195370889 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f796c06a0e0 0x7f796c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.586+0000 7f797cff9700 1 -- 172.21.15.79:0/1195370889 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7970088600 con 0x7f79800c7550 2023-10-19T08:38:57.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.586+0000 7f797ffff700 1 --2- 172.21.15.79:0/1195370889 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f796c06a0e0 0x7f796c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.587+0000 7f797ffff700 1 --2- 172.21.15.79:0/1195370889 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f796c06a0e0 0x7f796c06c5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7974001eb0 tx=0x7f7974009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:57.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.591+0000 7f797cff9700 1 -- 172.21.15.79:0/1195370889 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f79800b4d90 con 0x7f79800c7550 2023-10-19T08:38:57.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.777+0000 7f79863ec700 1 -- 172.21.15.79:0/1195370889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79800ac3b0 con 0x7f79800c7550 2023-10-19T08:38:57.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.778+0000 7f797cff9700 1 -- 172.21.15.79:0/1195370889 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79800ac3b0 con 0x7f79800c7550 2023-10-19T08:38:57.782 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:38:57.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.779+0000 7f79863ec700 1 -- 172.21.15.79:0/1195370889 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f796c06a0e0 msgr2=0x7f796c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:57.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.779+0000 7f79863ec700 1 --2- 172.21.15.79:0/1195370889 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f796c06a0e0 0x7f796c06c5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7974001eb0 tx=0x7f7974009040 comp rx=0 tx=0).stop 2023-10-19T08:38:57.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.779+0000 7f79863ec700 1 -- 172.21.15.79:0/1195370889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79800c7550 msgr2=0x7f79800c2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:57.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.779+0000 7f79863ec700 1 --2- 172.21.15.79:0/1195370889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79800c7550 0x7f79800c2370 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f797000f850 tx=0x7f797000fc10 comp rx=0 tx=0).stop 2023-10-19T08:38:57.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.780+0000 7f79863ec700 1 -- 172.21.15.79:0/1195370889 shutdown_connections 2023-10-19T08:38:57.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.780+0000 7f79863ec700 1 --2- 172.21.15.79:0/1195370889 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f796c06a0e0 0x7f796c06c5a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.780+0000 7f79863ec700 1 --2- 172.21.15.79:0/1195370889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79800c28b0 0x7f79800c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.780+0000 7f79863ec700 1 --2- 172.21.15.79:0/1195370889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7980155120 0x7f79800b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.780+0000 7f79863ec700 1 --2- 172.21.15.79:0/1195370889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79800c7550 0x7f79800c2370 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.780+0000 7f79863ec700 1 -- 172.21.15.79:0/1195370889 >> 172.21.15.79:0/1195370889 conn(0x7f798006dcc0 msgr2=0x7f79800b5640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:57.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.780+0000 7f79863ec700 1 -- 172.21.15.79:0/1195370889 shutdown_connections 2023-10-19T08:38:57.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.780+0000 7f79863ec700 1 -- 172.21.15.79:0/1195370889 wait complete. 2023-10-19T08:38:57.795 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:38:57.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.915+0000 7fd5db7b5700 1 Processor -- start 2023-10-19T08:38:57.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.915+0000 7fd5db7b5700 1 -- start start 2023-10-19T08:38:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.916+0000 7fd5db7b5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd5d4159db0 0x7fd5d40cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.916+0000 7fd5db7b5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd5d406fdc0 0x7fd5d40ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.916+0000 7fd5db7b5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d415d760 con 0x7fd5d40cc640 2023-10-19T08:38:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.916+0000 7fd5db7b5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d415da40 con 0x7fd5d4159db0 2023-10-19T08:38:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.916+0000 7fd5db7b5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d415dd20 con 0x7fd5d406fdc0 2023-10-19T08:38:57.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.916+0000 7fd5d8d50700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd5d4159db0 0x7fd5d40cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.916+0000 7fd5d8d50700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd5d4159db0 0x7fd5d40cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47658/0 (socket says 172.21.15.79:47658) 2023-10-19T08:38:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.916+0000 7fd5d8d50700 1 -- 172.21.15.79:0/516564886 learned_addr learned my addr 172.21.15.79:0/516564886 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.916+0000 7fd5d9d52700 1 --2- 172.21.15.79:0/516564886 >> v2:172.21.15.89:3300/0 conn(0x7fd5d406fdc0 0x7fd5d40ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.916+0000 7fd5d8d50700 1 -- 172.21.15.79:0/516564886 >> v2:172.21.15.89:3300/0 conn(0x7fd5d406fdc0 msgr2=0x7fd5d40ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:57.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.916+0000 7fd5d8d50700 1 --2- 172.21.15.79:0/516564886 >> v2:172.21.15.89:3300/0 conn(0x7fd5d406fdc0 0x7fd5d40ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.916+0000 7fd5d8d50700 1 -- 172.21.15.79:0/516564886 >> v1:172.21.15.89:6789/0 conn(0x7fd5d40cc640 legacy=0x7fd5d40cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.916+0000 7fd5d8d50700 1 -- 172.21.15.79:0/516564886 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d415e000 con 0x7fd5d4159db0 2023-10-19T08:38:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.916+0000 7fd5d8d50700 1 --2- 172.21.15.79:0/516564886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d4159db0 0x7fd5d40cdae0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd5d415a190 tx=0x7fd5c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8eb1547ffdb6dce server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:57.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.916+0000 7fd5cbfff700 1 -- 172.21.15.79:0/516564886 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4011830 con 0x7fd5d4159db0 2023-10-19T08:38:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.917+0000 7fd5cbfff700 1 -- 172.21.15.79:0/516564886 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c4011990 con 0x7fd5d4159db0 2023-10-19T08:38:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.917+0000 7fd5cbfff700 1 -- 172.21.15.79:0/516564886 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4011d20 con 0x7fd5d4159db0 2023-10-19T08:38:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.917+0000 7fd5db7b5700 1 -- 172.21.15.79:0/516564886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d4159db0 msgr2=0x7fd5d40cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.917+0000 7fd5db7b5700 1 --2- 172.21.15.79:0/516564886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d4159db0 0x7fd5d40cdae0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd5d415a190 tx=0x7fd5c4009bd0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.917+0000 7fd5db7b5700 1 -- 172.21.15.79:0/516564886 shutdown_connections 2023-10-19T08:38:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.917+0000 7fd5db7b5700 1 --2- 172.21.15.79:0/516564886 >> v2:172.21.15.89:3300/0 conn(0x7fd5d406fdc0 0x7fd5d40ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.917+0000 7fd5db7b5700 1 --2- 172.21.15.79:0/516564886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d4159db0 0x7fd5d40cdae0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.917+0000 7fd5db7b5700 1 -- 172.21.15.79:0/516564886 >> 172.21.15.79:0/516564886 conn(0x7fd5d406dcc0 msgr2=0x7fd5d406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:57.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.917+0000 7fd5db7b5700 1 -- 172.21.15.79:0/516564886 shutdown_connections 2023-10-19T08:38:57.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.917+0000 7fd5db7b5700 1 -- 172.21.15.79:0/516564886 wait complete. 2023-10-19T08:38:57.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.918+0000 7fd5db7b5700 1 Processor -- start 2023-10-19T08:38:57.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.918+0000 7fd5db7b5700 1 -- start start 2023-10-19T08:38:57.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.919+0000 7fd5db7b5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5d406fdc0 0x7fd5d40c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.919+0000 7fd5db7b5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5d40cc640 0x7fd5d415abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.919+0000 7fd5db7b5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d4159db0 0x7fd5d415b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.919+0000 7fd5db7b5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d41e51b0 con 0x7fd5d4159db0 2023-10-19T08:38:57.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.919+0000 7fd5db7b5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d40c3900 con 0x7fd5d40cc640 2023-10-19T08:38:57.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.919+0000 7fd5db7b5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d415b7e0 con 0x7fd5d406fdc0 2023-10-19T08:38:57.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.919+0000 7fd5d9d52700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d4159db0 0x7fd5d415b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.919+0000 7fd5d9d52700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d4159db0 0x7fd5d415b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47666/0 (socket says 172.21.15.79:47666) 2023-10-19T08:38:57.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.919+0000 7fd5d9d52700 1 -- 172.21.15.79:0/3408139609 learned_addr learned my addr 172.21.15.79:0/3408139609 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:57.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.919+0000 7fd5d9551700 1 --2- 172.21.15.79:0/3408139609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5d406fdc0 0x7fd5d40c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.919+0000 7fd5d8d50700 1 --2- 172.21.15.79:0/3408139609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5d40cc640 0x7fd5d415abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.920+0000 7fd5d9d52700 1 -- 172.21.15.79:0/3408139609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5d406fdc0 msgr2=0x7fd5d40c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:57.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.920+0000 7fd5d9d52700 1 --2- 172.21.15.79:0/3408139609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5d406fdc0 0x7fd5d40c92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.920+0000 7fd5d9d52700 1 -- 172.21.15.79:0/3408139609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5d40cc640 msgr2=0x7fd5d415abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:57.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.920+0000 7fd5d9d52700 1 --2- 172.21.15.79:0/3408139609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5d40cc640 0x7fd5d415abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:57.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.920+0000 7fd5d9d52700 1 -- 172.21.15.79:0/3408139609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c4009550 con 0x7fd5d4159db0 2023-10-19T08:38:57.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.920+0000 7fd5d9d52700 1 --2- 172.21.15.79:0/3408139609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d4159db0 0x7fd5d415b110 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00efc0 tx=0x7fd5cc00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:57.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.920+0000 7fd5c9ffb700 1 -- 172.21.15.79:0/3408139609 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc00cad0 con 0x7fd5d4159db0 2023-10-19T08:38:57.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.920+0000 7fd5c9ffb700 1 -- 172.21.15.79:0/3408139609 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc00f040 con 0x7fd5d4159db0 2023-10-19T08:38:57.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.920+0000 7fd5c9ffb700 1 -- 172.21.15.79:0/3408139609 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc00ce70 con 0x7fd5d4159db0 2023-10-19T08:38:57.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.920+0000 7fd5db7b5700 1 -- 172.21.15.79:0/3408139609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d415bac0 con 0x7fd5d4159db0 2023-10-19T08:38:57.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.920+0000 7fd5db7b5700 1 -- 172.21.15.79:0/3408139609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d415bda0 con 0x7fd5d4159db0 2023-10-19T08:38:57.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.921+0000 7fd5db7b5700 1 -- 172.21.15.79:0/3408139609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d404ee70 con 0x7fd5d4159db0 2023-10-19T08:38:57.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.921+0000 7fd5c9ffb700 1 -- 172.21.15.79:0/3408139609 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd5cc014480 con 0x7fd5d4159db0 2023-10-19T08:38:57.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.922+0000 7fd5c9ffb700 1 --2- 172.21.15.79:0/3408139609 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd5b806a0e0 0x7fd5b806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:57.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.922+0000 7fd5c9ffb700 1 -- 172.21.15.79:0/3408139609 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd5cc088f70 con 0x7fd5d4159db0 2023-10-19T08:38:57.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.922+0000 7fd5d9551700 1 --2- 172.21.15.79:0/3408139609 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd5b806a0e0 0x7fd5b806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:57.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.922+0000 7fd5d9551700 1 --2- 172.21.15.79:0/3408139609 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd5b806a0e0 0x7fd5b806c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0007fd0 tx=0x7fd5d0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:57.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:57.926+0000 7fd5c9ffb700 1 -- 172.21.15.79:0/3408139609 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd5cc0bb940 con 0x7fd5d4159db0 2023-10-19T08:38:58.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.114+0000 7fd5db7b5700 1 -- 172.21.15.79:0/3408139609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd5d40b4160 con 0x7fd5d4159db0 2023-10-19T08:38:58.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.114+0000 7fd5c9ffb700 1 -- 172.21.15.79:0/3408139609 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd5cc0180a0 con 0x7fd5d4159db0 2023-10-19T08:38:58.118 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:38:58.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.116+0000 7fd5db7b5700 1 -- 172.21.15.79:0/3408139609 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd5b806a0e0 msgr2=0x7fd5b806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:58.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.116+0000 7fd5db7b5700 1 --2- 172.21.15.79:0/3408139609 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd5b806a0e0 0x7fd5b806c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0007fd0 tx=0x7fd5d0009040 comp rx=0 tx=0).stop 2023-10-19T08:38:58.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.116+0000 7fd5db7b5700 1 -- 172.21.15.79:0/3408139609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d4159db0 msgr2=0x7fd5d415b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:58.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.116+0000 7fd5db7b5700 1 --2- 172.21.15.79:0/3408139609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d4159db0 0x7fd5d415b110 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00efc0 tx=0x7fd5cc00c0c0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.116+0000 7fd5db7b5700 1 -- 172.21.15.79:0/3408139609 shutdown_connections 2023-10-19T08:38:58.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.116+0000 7fd5db7b5700 1 --2- 172.21.15.79:0/3408139609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5d4159db0 0x7fd5d415b110 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.116+0000 7fd5db7b5700 1 --2- 172.21.15.79:0/3408139609 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd5b806a0e0 0x7fd5b806c5a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.116+0000 7fd5db7b5700 1 --2- 172.21.15.79:0/3408139609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5d406fdc0 0x7fd5d40c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.116+0000 7fd5db7b5700 1 --2- 172.21.15.79:0/3408139609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5d40cc640 0x7fd5d415abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.116+0000 7fd5db7b5700 1 -- 172.21.15.79:0/3408139609 >> 172.21.15.79:0/3408139609 conn(0x7fd5d406dcc0 msgr2=0x7fd5d40b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:58.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.117+0000 7fd5db7b5700 1 -- 172.21.15.79:0/3408139609 shutdown_connections 2023-10-19T08:38:58.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.117+0000 7fd5db7b5700 1 -- 172.21.15.79:0/3408139609 wait complete. 2023-10-19T08:38:58.132 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T08:38:58.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.253+0000 7fbd2fa24700 1 Processor -- start 2023-10-19T08:38:58.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.254+0000 7fbd2fa24700 1 -- start start 2023-10-19T08:38:58.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.254+0000 7fbd2fa24700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbd28159db0 0x7fbd280cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.254+0000 7fbd2fa24700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbd2806fdc0 0x7fbd280ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.254+0000 7fbd2fa24700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2815d760 con 0x7fbd280cc640 2023-10-19T08:38:58.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.254+0000 7fbd2fa24700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2815da40 con 0x7fbd28159db0 2023-10-19T08:38:58.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.254+0000 7fbd2fa24700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2815dd20 con 0x7fbd2806fdc0 2023-10-19T08:38:58.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.255+0000 7fbd2cfbf700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbd28159db0 0x7fbd280cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.255+0000 7fbd2d7c0700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbd280cc640 0x7fbd280cca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57742/0 (socket says 172.21.15.79:57742) 2023-10-19T08:38:58.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.255+0000 7fbd2d7c0700 1 -- 172.21.15.79:0/1635968992 learned_addr learned my addr 172.21.15.79:0/1635968992 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:58.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.255+0000 7fbd2dfc1700 1 --2- 172.21.15.79:0/1635968992 >> v2:172.21.15.89:3300/0 conn(0x7fbd2806fdc0 0x7fbd280ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.255+0000 7fbd2cfbf700 1 -- 172.21.15.79:0/1635968992 >> v2:172.21.15.89:3300/0 conn(0x7fbd2806fdc0 msgr2=0x7fbd280ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:58.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.255+0000 7fbd2cfbf700 1 --2- 172.21.15.79:0/1635968992 >> v2:172.21.15.89:3300/0 conn(0x7fbd2806fdc0 0x7fbd280ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.255+0000 7fbd2cfbf700 1 -- 172.21.15.79:0/1635968992 >> v1:172.21.15.79:6789/0 conn(0x7fbd280cc640 legacy=0x7fbd280cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:58.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.255+0000 7fbd1ffff700 1 -- 172.21.15.79:0/1635968992 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290769844 0 0) 0x7fbd2815d760 con 0x7fbd280cc640 2023-10-19T08:38:58.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.255+0000 7fbd2cfbf700 1 -- 172.21.15.79:0/1635968992 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2815e000 con 0x7fbd28159db0 2023-10-19T08:38:58.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.255+0000 7fbd2dfc1700 1 --2- 172.21.15.79:0/1635968992 >> v2:172.21.15.89:3300/0 conn(0x7fbd2806fdc0 0x7fbd280ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:38:58.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.255+0000 7fbd2cfbf700 1 --2- 172.21.15.79:0/1635968992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd28159db0 0x7fbd280cdae0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbd2815a190 tx=0x7fbd24009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669300495fa5218f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:58.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.255+0000 7fbd1ffff700 1 -- 172.21.15.79:0/1635968992 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24011830 con 0x7fbd28159db0 2023-10-19T08:38:58.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.255+0000 7fbd1ffff700 1 -- 172.21.15.79:0/1635968992 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd24011990 con 0x7fbd28159db0 2023-10-19T08:38:58.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.255+0000 7fbd1ffff700 1 -- 172.21.15.79:0/1635968992 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24011d20 con 0x7fbd28159db0 2023-10-19T08:38:58.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.256+0000 7fbd2fa24700 1 -- 172.21.15.79:0/1635968992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd28159db0 msgr2=0x7fbd280cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:58.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.256+0000 7fbd2fa24700 1 --2- 172.21.15.79:0/1635968992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd28159db0 0x7fbd280cdae0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbd2815a190 tx=0x7fbd24009b20 comp rx=0 tx=0).stop 2023-10-19T08:38:58.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.256+0000 7fbd2fa24700 1 -- 172.21.15.79:0/1635968992 shutdown_connections 2023-10-19T08:38:58.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.256+0000 7fbd2fa24700 1 --2- 172.21.15.79:0/1635968992 >> v2:172.21.15.89:3300/0 conn(0x7fbd2806fdc0 0x7fbd280ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.256+0000 7fbd2fa24700 1 --2- 172.21.15.79:0/1635968992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd28159db0 0x7fbd280cdae0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.256+0000 7fbd2fa24700 1 -- 172.21.15.79:0/1635968992 >> 172.21.15.79:0/1635968992 conn(0x7fbd2806dcc0 msgr2=0x7fbd2806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:58.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.256+0000 7fbd2fa24700 1 -- 172.21.15.79:0/1635968992 shutdown_connections 2023-10-19T08:38:58.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.256+0000 7fbd2fa24700 1 -- 172.21.15.79:0/1635968992 wait complete. 2023-10-19T08:38:58.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.257+0000 7fbd2fa24700 1 Processor -- start 2023-10-19T08:38:58.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.257+0000 7fbd2fa24700 1 -- start start 2023-10-19T08:38:58.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.258+0000 7fbd2fa24700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd2806fdc0 0x7fbd280c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.258+0000 7fbd2fa24700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd280cc640 0x7fbd28151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.258+0000 7fbd2fa24700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd28159db0 0x7fbd280cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.258+0000 7fbd2fa24700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2815c4b0 con 0x7fbd2806fdc0 2023-10-19T08:38:58.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.258+0000 7fbd2fa24700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2815c790 con 0x7fbd280cc640 2023-10-19T08:38:58.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.258+0000 7fbd2fa24700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2815ca70 con 0x7fbd28159db0 2023-10-19T08:38:58.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.258+0000 7fbd2d7c0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd2806fdc0 0x7fbd280c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.258+0000 7fbd2d7c0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd2806fdc0 0x7fbd280c93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47676/0 (socket says 172.21.15.79:47676) 2023-10-19T08:38:58.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.258+0000 7fbd2d7c0700 1 -- 172.21.15.79:0/3844066803 learned_addr learned my addr 172.21.15.79:0/3844066803 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:58.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.258+0000 7fbd2d7c0700 1 -- 172.21.15.79:0/3844066803 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd28159db0 msgr2=0x7fbd280cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:58.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.258+0000 7fbd2d7c0700 1 --2- 172.21.15.79:0/3844066803 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd28159db0 0x7fbd280cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.258+0000 7fbd2d7c0700 1 -- 172.21.15.79:0/3844066803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd280cc640 msgr2=0x7fbd28151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:58.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.258+0000 7fbd2d7c0700 1 --2- 172.21.15.79:0/3844066803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd280cc640 0x7fbd28151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.258+0000 7fbd2d7c0700 1 -- 172.21.15.79:0/3844066803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd240094a0 con 0x7fbd2806fdc0 2023-10-19T08:38:58.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.258+0000 7fbd2d7c0700 1 --2- 172.21.15.79:0/3844066803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd2806fdc0 0x7fbd280c93f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbd180011e0 tx=0x7fbd1800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:58.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.258+0000 7fbd1dffb700 1 -- 172.21.15.79:0/3844066803 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18004c80 con 0x7fbd2806fdc0 2023-10-19T08:38:58.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.258+0000 7fbd1dffb700 1 -- 172.21.15.79:0/3844066803 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd18004e00 con 0x7fbd2806fdc0 2023-10-19T08:38:58.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.258+0000 7fbd2fa24700 1 -- 172.21.15.79:0/3844066803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2815a2f0 con 0x7fbd2806fdc0 2023-10-19T08:38:58.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.258+0000 7fbd1dffb700 1 -- 172.21.15.79:0/3844066803 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18007310 con 0x7fbd2806fdc0 2023-10-19T08:38:58.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.259+0000 7fbd2fa24700 1 -- 172.21.15.79:0/3844066803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd280c9930 con 0x7fbd2806fdc0 2023-10-19T08:38:58.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.259+0000 7fbd2fa24700 1 -- 172.21.15.79:0/3844066803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2815e5a0 con 0x7fbd2806fdc0 2023-10-19T08:38:58.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.260+0000 7fbd1dffb700 1 -- 172.21.15.79:0/3844066803 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbd18007470 con 0x7fbd2806fdc0 2023-10-19T08:38:58.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.260+0000 7fbd1dffb700 1 --2- 172.21.15.79:0/3844066803 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbd0c06a0e0 0x7fbd0c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.260+0000 7fbd1dffb700 1 -- 172.21.15.79:0/3844066803 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbd18088640 con 0x7fbd2806fdc0 2023-10-19T08:38:58.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.260+0000 7fbd2cfbf700 1 --2- 172.21.15.79:0/3844066803 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbd0c06a0e0 0x7fbd0c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.260+0000 7fbd2cfbf700 1 --2- 172.21.15.79:0/3844066803 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbd0c06a0e0 0x7fbd0c06c5a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbd280b4ea0 tx=0x7fbd24010000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:58.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.264+0000 7fbd1dffb700 1 -- 172.21.15.79:0/3844066803 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fbd2815e5a0 con 0x7fbd2806fdc0 2023-10-19T08:38:58.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.452+0000 7fbd2fa24700 1 -- 172.21.15.79:0/3844066803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd2815e570 con 0x7fbd2806fdc0 2023-10-19T08:38:58.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.453+0000 7fbd1dffb700 1 -- 172.21.15.79:0/3844066803 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd18053a00 con 0x7fbd2806fdc0 2023-10-19T08:38:58.457 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:58.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.455+0000 7fbd2fa24700 1 -- 172.21.15.79:0/3844066803 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbd0c06a0e0 msgr2=0x7fbd0c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:58.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.455+0000 7fbd2fa24700 1 --2- 172.21.15.79:0/3844066803 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbd0c06a0e0 0x7fbd0c06c5a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbd280b4ea0 tx=0x7fbd24010000 comp rx=0 tx=0).stop 2023-10-19T08:38:58.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.455+0000 7fbd2fa24700 1 -- 172.21.15.79:0/3844066803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd2806fdc0 msgr2=0x7fbd280c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:58.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.455+0000 7fbd2fa24700 1 --2- 172.21.15.79:0/3844066803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd2806fdc0 0x7fbd280c93f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fbd180011e0 tx=0x7fbd1800cae0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.455+0000 7fbd2fa24700 1 -- 172.21.15.79:0/3844066803 shutdown_connections 2023-10-19T08:38:58.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.455+0000 7fbd2fa24700 1 --2- 172.21.15.79:0/3844066803 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbd0c06a0e0 0x7fbd0c06c5a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.455+0000 7fbd2fa24700 1 --2- 172.21.15.79:0/3844066803 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbd28159db0 0x7fbd280cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.455+0000 7fbd2fa24700 1 --2- 172.21.15.79:0/3844066803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbd2806fdc0 0x7fbd280c93f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.455+0000 7fbd2fa24700 1 --2- 172.21.15.79:0/3844066803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbd280cc640 0x7fbd28151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.455+0000 7fbd2fa24700 1 -- 172.21.15.79:0/3844066803 >> 172.21.15.79:0/3844066803 conn(0x7fbd2806dcc0 msgr2=0x7fbd280b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:58.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.455+0000 7fbd2fa24700 1 -- 172.21.15.79:0/3844066803 shutdown_connections 2023-10-19T08:38:58.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.455+0000 7fbd2fa24700 1 -- 172.21.15.79:0/3844066803 wait complete. 2023-10-19T08:38:58.470 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T08:38:58.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.591+0000 7f688dc92700 1 Processor -- start 2023-10-19T08:38:58.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.591+0000 7f688dc92700 1 -- start start 2023-10-19T08:38:58.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f688dc92700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68880cd270 0x7f688806a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f688dc92700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f68880703b0 0x7f688806a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f688dc92700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68880b1fe0 con 0x7f688806f910 2023-10-19T08:38:58.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f688dc92700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6888160a80 con 0x7f68880703b0 2023-10-19T08:38:58.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f688dc92700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68880ce2b0 con 0x7f68880cd270 2023-10-19T08:38:58.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f6887fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f688806f910 0x7f6888160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57760/0 (socket says 172.21.15.79:57760) 2023-10-19T08:38:58.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f6887fff700 1 -- 172.21.15.79:0/1787978002 learned_addr learned my addr 172.21.15.79:0/1787978002 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:58.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f68877fe700 1 --2- 172.21.15.79:0/1787978002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68880cd270 0x7f688806a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f68867fc700 1 -- 172.21.15.79:0/1787978002 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235105684 0 0) 0x7f68880b1fe0 con 0x7f688806f910 2023-10-19T08:38:58.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f6886ffd700 1 --2- 172.21.15.79:0/1787978002 >> v2:172.21.15.89:3300/0 conn(0x7f68880703b0 0x7f688806a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f68867fc700 1 -- 172.21.15.79:0/1787978002 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68700035b0 con 0x7f688806f910 2023-10-19T08:38:58.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f68867fc700 1 -- 172.21.15.79:0/1787978002 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2669014433 0 0) 0x7f68700035b0 con 0x7f688806f910 2023-10-19T08:38:58.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f68867fc700 1 -- 172.21.15.79:0/1787978002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68880cd270 msgr2=0x7f688806a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:58.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f68867fc700 1 --2- 172.21.15.79:0/1787978002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68880cd270 0x7f688806a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f68867fc700 1 -- 172.21.15.79:0/1787978002 >> v2:172.21.15.89:3300/0 conn(0x7f68880703b0 msgr2=0x7f688806a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:58.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f68867fc700 1 --2- 172.21.15.79:0/1787978002 >> v2:172.21.15.89:3300/0 conn(0x7f68880703b0 0x7f688806a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f68867fc700 1 -- 172.21.15.79:0/1787978002 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68880ce550 con 0x7f688806f910 2023-10-19T08:38:58.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f68867fc700 1 -- 172.21.15.79:0/1787978002 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f68800019f0 con 0x7f688806f910 2023-10-19T08:38:58.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f68867fc700 1 -- 172.21.15.79:0/1787978002 >> v1:172.21.15.79:6789/0 conn(0x7f688806f910 legacy=0x7f6888160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:58.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.592+0000 7f68867fc700 1 --2- 172.21.15.79:0/1787978002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68880cd270 0x7f6870003a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.593+0000 7f68867fc700 1 --2- 172.21.15.79:0/1787978002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6870003ff0 0x7f6870004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.593+0000 7f68867fc700 1 --2- 172.21.15.79:0/1787978002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6870004d90 0x7f6870005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.593+0000 7f68867fc700 1 -- 172.21.15.79:0/1787978002 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6888160a80 con 0x7f6870004d90 2023-10-19T08:38:58.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.593+0000 7f68867fc700 1 -- 172.21.15.79:0/1787978002 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68880ce2b0 con 0x7f6870003ff0 2023-10-19T08:38:58.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.593+0000 7f68867fc700 1 -- 172.21.15.79:0/1787978002 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687000ba40 con 0x7f68880cd270 2023-10-19T08:38:58.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.593+0000 7f6887fff700 1 --2- 172.21.15.79:0/1787978002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6870004d90 0x7f6870005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.593+0000 7f68877fe700 1 --2- 172.21.15.79:0/1787978002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68880cd270 0x7f6870003a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.593+0000 7f6886ffd700 1 --2- 172.21.15.79:0/1787978002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6870003ff0 0x7f6870004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.593+0000 7f6887fff700 1 -- 172.21.15.79:0/1787978002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68880cd270 msgr2=0x7f6870003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:58.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.593+0000 7f6887fff700 1 --2- 172.21.15.79:0/1787978002 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68880cd270 0x7f6870003a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.593+0000 7f6887fff700 1 -- 172.21.15.79:0/1787978002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6870003ff0 msgr2=0x7f6870004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:58.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.593+0000 7f6887fff700 1 --2- 172.21.15.79:0/1787978002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6870003ff0 0x7f6870004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.593+0000 7f6887fff700 1 -- 172.21.15.79:0/1787978002 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68700035b0 con 0x7f6870004d90 2023-10-19T08:38:58.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.593+0000 7f6887fff700 1 --2- 172.21.15.79:0/1787978002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6870004d90 0x7f6870005210 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f688000a8d0 tx=0x7f6870005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302fbcd5db6ecc96 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:58.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.593+0000 7f68867fc700 1 -- 172.21.15.79:0/1787978002 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688000a340 con 0x7f6870004d90 2023-10-19T08:38:58.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.593+0000 7f68867fc700 1 -- 172.21.15.79:0/1787978002 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6880012600 con 0x7f6870004d90 2023-10-19T08:38:58.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.593+0000 7f68867fc700 1 -- 172.21.15.79:0/1787978002 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68800129b0 con 0x7f6870004d90 2023-10-19T08:38:58.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.594+0000 7f688dc92700 1 -- 172.21.15.79:0/1787978002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6870004d90 msgr2=0x7f6870005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:58.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.594+0000 7f688dc92700 1 --2- 172.21.15.79:0/1787978002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6870004d90 0x7f6870005210 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f688000a8d0 tx=0x7f6870005880 comp rx=0 tx=0).stop 2023-10-19T08:38:58.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.594+0000 7f6887fff700 1 -- 172.21.15.79:0/1787978002 reap_dead start 2023-10-19T08:38:58.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.594+0000 7f688dc92700 1 -- 172.21.15.79:0/1787978002 shutdown_connections 2023-10-19T08:38:58.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.594+0000 7f688dc92700 1 -- 172.21.15.79:0/1787978002 >> 172.21.15.79:0/1787978002 conn(0x7f688806dcc0 msgr2=0x7f688806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:58.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.594+0000 7f688dc92700 1 -- 172.21.15.79:0/1787978002 shutdown_connections 2023-10-19T08:38:58.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.594+0000 7f688dc92700 1 -- 172.21.15.79:0/1787978002 wait complete. 2023-10-19T08:38:58.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.595+0000 7f688dc92700 1 Processor -- start 2023-10-19T08:38:58.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.595+0000 7f688dc92700 1 -- start start 2023-10-19T08:38:58.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f688dc92700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6888154ff0 0x7f68881f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f688dc92700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68880b45d0 0x7f68880b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f688dc92700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68880ae530 0x7f68880ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f688dc92700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68880b4f90 con 0x7f68880ae530 2023-10-19T08:38:58.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f688dc92700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68881f2ac0 con 0x7f6888154ff0 2023-10-19T08:38:58.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f688dc92700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68880c7ea0 con 0x7f68880b45d0 2023-10-19T08:38:58.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f6887fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68880ae530 0x7f68880ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f6887fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68880ae530 0x7f68880ae9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47698/0 (socket says 172.21.15.79:47698) 2023-10-19T08:38:58.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f6887fff700 1 -- 172.21.15.79:0/1552176589 learned_addr learned my addr 172.21.15.79:0/1552176589 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:58.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f68877fe700 1 --2- 172.21.15.79:0/1552176589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6888154ff0 0x7f68881f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f6886ffd700 1 --2- 172.21.15.79:0/1552176589 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68880b45d0 0x7f68880b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f6887fff700 1 -- 172.21.15.79:0/1552176589 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68880b45d0 msgr2=0x7f68880b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:58.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f6887fff700 1 --2- 172.21.15.79:0/1552176589 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68880b45d0 0x7f68880b4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f6887fff700 1 -- 172.21.15.79:0/1552176589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6888154ff0 msgr2=0x7f68881f2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:58.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f6887fff700 1 --2- 172.21.15.79:0/1552176589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6888154ff0 0x7f68881f2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f6887fff700 1 -- 172.21.15.79:0/1552176589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68880c8180 con 0x7f68880ae530 2023-10-19T08:38:58.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f68877fe700 1 --2- 172.21.15.79:0/1552176589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6888154ff0 0x7f68881f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:58.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f6886ffd700 1 --2- 172.21.15.79:0/1552176589 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68880b45d0 0x7f68880b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:58.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f6887fff700 1 --2- 172.21.15.79:0/1552176589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68880ae530 0x7f68880ae9b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6880012000 tx=0x7f6880001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:58.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f686ffff700 1 -- 172.21.15.79:0/1552176589 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688000a340 con 0x7f68880ae530 2023-10-19T08:38:58.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f686ffff700 1 -- 172.21.15.79:0/1552176589 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68800011c0 con 0x7f68880ae530 2023-10-19T08:38:58.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f688dc92700 1 -- 172.21.15.79:0/1552176589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68880c8460 con 0x7f68880ae530 2023-10-19T08:38:58.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.596+0000 7f686ffff700 1 -- 172.21.15.79:0/1552176589 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68800019c0 con 0x7f68880ae530 2023-10-19T08:38:58.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.597+0000 7f688dc92700 1 -- 172.21.15.79:0/1552176589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68880c8a20 con 0x7f68880ae530 2023-10-19T08:38:58.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.598+0000 7f688dc92700 1 -- 172.21.15.79:0/1552176589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f688804ee70 con 0x7f68880ae530 2023-10-19T08:38:58.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.598+0000 7f686ffff700 1 -- 172.21.15.79:0/1552176589 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6880019070 con 0x7f68880ae530 2023-10-19T08:38:58.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.598+0000 7f686ffff700 1 --2- 172.21.15.79:0/1552176589 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f687406a0e0 0x7f687406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.598+0000 7f686ffff700 1 -- 172.21.15.79:0/1552176589 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6880089c10 con 0x7f68880ae530 2023-10-19T08:38:58.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.598+0000 7f68877fe700 1 --2- 172.21.15.79:0/1552176589 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f687406a0e0 0x7f687406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.599+0000 7f68877fe700 1 --2- 172.21.15.79:0/1552176589 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f687406a0e0 0x7f687406c5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f687c009b50 tx=0x7f687c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:58.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.603+0000 7f686ffff700 1 -- 172.21.15.79:0/1552176589 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6880055060 con 0x7f68880ae530 2023-10-19T08:38:58.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.791+0000 7f688dc92700 1 -- 172.21.15.79:0/1552176589 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f68880cdb60 con 0x7f68880ae530 2023-10-19T08:38:58.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.791+0000 7f686ffff700 1 -- 172.21.15.79:0/1552176589 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f68800220a0 con 0x7f68880ae530 2023-10-19T08:38:58.795 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-19T08:38:58.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.793+0000 7f688dc92700 1 -- 172.21.15.79:0/1552176589 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f687406a0e0 msgr2=0x7f687406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:58.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.793+0000 7f688dc92700 1 --2- 172.21.15.79:0/1552176589 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f687406a0e0 0x7f687406c5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f687c009b50 tx=0x7f687c008040 comp rx=0 tx=0).stop 2023-10-19T08:38:58.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.793+0000 7f688dc92700 1 -- 172.21.15.79:0/1552176589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68880ae530 msgr2=0x7f68880ae9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:58.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.793+0000 7f688dc92700 1 --2- 172.21.15.79:0/1552176589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68880ae530 0x7f68880ae9b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6880012000 tx=0x7f6880001360 comp rx=0 tx=0).stop 2023-10-19T08:38:58.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.793+0000 7f688dc92700 1 -- 172.21.15.79:0/1552176589 shutdown_connections 2023-10-19T08:38:58.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.793+0000 7f688dc92700 1 --2- 172.21.15.79:0/1552176589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68880ae530 0x7f68880ae9b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.793+0000 7f688dc92700 1 --2- 172.21.15.79:0/1552176589 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6888154ff0 0x7f68881f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.793+0000 7f688dc92700 1 --2- 172.21.15.79:0/1552176589 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f687406a0e0 0x7f687406c5a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.793+0000 7f688dc92700 1 --2- 172.21.15.79:0/1552176589 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68880b45d0 0x7f68880b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.793+0000 7f688dc92700 1 -- 172.21.15.79:0/1552176589 >> 172.21.15.79:0/1552176589 conn(0x7f688806dcc0 msgr2=0x7f6888160bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:58.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.793+0000 7f688dc92700 1 -- 172.21.15.79:0/1552176589 shutdown_connections 2023-10-19T08:38:58.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.793+0000 7f688dc92700 1 -- 172.21.15.79:0/1552176589 wait complete. 2023-10-19T08:38:58.808 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T08:38:58.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.928+0000 7f65d4416700 1 Processor -- start 2023-10-19T08:38:58.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.928+0000 7f65d4416700 1 -- start start 2023-10-19T08:38:58.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.929+0000 7f65d4416700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65cc0cd270 0x7f65cc06a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.929+0000 7f65d4416700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65cc161a90 con 0x7f65cc0703b0 2023-10-19T08:38:58.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.929+0000 7f65d4416700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65cc0b1fe0 con 0x7f65cc0cc2a0 2023-10-19T08:38:58.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.929+0000 7f65d4416700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc160a80 con 0x7f65cc0cd270 2023-10-19T08:38:58.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.929+0000 7f65d19b1700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f65cc0703b0 0x7f65cc160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57776/0 (socket says 172.21.15.79:57776) 2023-10-19T08:38:58.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.929+0000 7f65d19b1700 1 -- 172.21.15.79:0/4190228928 learned_addr learned my addr 172.21.15.79:0/4190228928 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:58.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d21b2700 1 --2- 172.21.15.79:0/4190228928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65cc0cd270 0x7f65cc06a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d11b0700 1 -- 172.21.15.79:0/4190228928 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495654413 0 0) 0x7f65cc161a90 con 0x7f65cc0703b0 2023-10-19T08:38:58.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d11b0700 1 -- 172.21.15.79:0/4190228928 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65b80035b0 con 0x7f65cc0703b0 2023-10-19T08:38:58.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d11b0700 1 -- 172.21.15.79:0/4190228928 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 627068705 0 0) 0x7f65b80035b0 con 0x7f65cc0703b0 2023-10-19T08:38:58.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d11b0700 1 -- 172.21.15.79:0/4190228928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65cc0cd270 msgr2=0x7f65cc06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:58.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d11b0700 1 --2- 172.21.15.79:0/4190228928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65cc0cd270 0x7f65cc06a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d11b0700 1 -- 172.21.15.79:0/4190228928 >> v1:172.21.15.89:6789/0 conn(0x7f65cc0cc2a0 legacy=0x7f65cc161380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:58.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d11b0700 1 -- 172.21.15.79:0/4190228928 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc0ce2b0 con 0x7f65cc0703b0 2023-10-19T08:38:58.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d11b0700 1 -- 172.21.15.79:0/4190228928 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f65c8001670 con 0x7f65cc0703b0 2023-10-19T08:38:58.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d11b0700 1 -- 172.21.15.79:0/4190228928 >> v1:172.21.15.79:6789/0 conn(0x7f65cc0703b0 legacy=0x7f65cc160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:58.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d11b0700 1 --2- 172.21.15.79:0/4190228928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b8003aa0 0x7f65b8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d11b0700 1 --2- 172.21.15.79:0/4190228928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65cc0cd270 0x7f65b8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d11b0700 1 --2- 172.21.15.79:0/4190228928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65b8004d90 0x7f65b8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d11b0700 1 -- 172.21.15.79:0/4190228928 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc160a80 con 0x7f65b8004d90 2023-10-19T08:38:58.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d11b0700 1 -- 172.21.15.79:0/4190228928 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b800bb20 con 0x7f65b8003aa0 2023-10-19T08:38:58.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d11b0700 1 -- 172.21.15.79:0/4190228928 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b800bce0 con 0x7f65cc0cd270 2023-10-19T08:38:58.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d29b3700 1 --2- 172.21.15.79:0/4190228928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65b8004d90 0x7f65b8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d19b1700 1 --2- 172.21.15.79:0/4190228928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65cc0cd270 0x7f65b8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d21b2700 1 --2- 172.21.15.79:0/4190228928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b8003aa0 0x7f65b8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d29b3700 1 -- 172.21.15.79:0/4190228928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65cc0cd270 msgr2=0x7f65b8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:58.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d29b3700 1 --2- 172.21.15.79:0/4190228928 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65cc0cd270 0x7f65b8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d29b3700 1 -- 172.21.15.79:0/4190228928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b8003aa0 msgr2=0x7f65b8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:58.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d29b3700 1 --2- 172.21.15.79:0/4190228928 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65b8003aa0 0x7f65b8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.930+0000 7f65d29b3700 1 -- 172.21.15.79:0/4190228928 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b80035b0 con 0x7f65b8004d90 2023-10-19T08:38:58.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.931+0000 7f65d29b3700 1 --2- 172.21.15.79:0/4190228928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65b8004d90 0x7f65b8005210 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f65c400c160 tx=0x7f65b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d903e6ddbbb46e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:58.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.931+0000 7f65d11b0700 1 -- 172.21.15.79:0/4190228928 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4001db0 con 0x7f65b8004d90 2023-10-19T08:38:58.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.931+0000 7f65d11b0700 1 -- 172.21.15.79:0/4190228928 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c400cca0 con 0x7f65b8004d90 2023-10-19T08:38:58.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.931+0000 7f65d11b0700 1 -- 172.21.15.79:0/4190228928 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4003c40 con 0x7f65b8004d90 2023-10-19T08:38:58.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.931+0000 7f65d4416700 1 -- 172.21.15.79:0/4190228928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65b8004d90 msgr2=0x7f65b8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:58.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.931+0000 7f65d4416700 1 --2- 172.21.15.79:0/4190228928 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65b8004d90 0x7f65b8005210 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f65c400c160 tx=0x7f65b8005880 comp rx=0 tx=0).stop 2023-10-19T08:38:58.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.931+0000 7f65d29b3700 1 -- 172.21.15.79:0/4190228928 reap_dead start 2023-10-19T08:38:58.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.931+0000 7f65d4416700 1 -- 172.21.15.79:0/4190228928 shutdown_connections 2023-10-19T08:38:58.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.931+0000 7f65d4416700 1 -- 172.21.15.79:0/4190228928 >> 172.21.15.79:0/4190228928 conn(0x7f65cc06dcc0 msgr2=0x7f65cc06e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:58.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.931+0000 7f65d4416700 1 -- 172.21.15.79:0/4190228928 shutdown_connections 2023-10-19T08:38:58.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.931+0000 7f65d4416700 1 -- 172.21.15.79:0/4190228928 wait complete. 2023-10-19T08:38:58.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.933+0000 7f65d4416700 1 Processor -- start 2023-10-19T08:38:58.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.933+0000 7f65d4416700 1 -- start start 2023-10-19T08:38:58.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.933+0000 7f65d4416700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65b8004d90 0x7f65cc150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.933+0000 7f65d4416700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65cc0c8de0 0x7f65cc0c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.933+0000 7f65d4416700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65cc0c6d00 0x7f65cc0c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.933+0000 7f65d4416700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc0ae450 con 0x7f65cc0c6d00 2023-10-19T08:38:58.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.933+0000 7f65d4416700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc0c97a0 con 0x7f65cc0c8de0 2023-10-19T08:38:58.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.933+0000 7f65d4416700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc0c8a20 con 0x7f65b8004d90 2023-10-19T08:38:58.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.933+0000 7f65d29b3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65cc0c6d00 0x7f65cc0c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.934+0000 7f65d29b3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65cc0c6d00 0x7f65cc0c71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47718/0 (socket says 172.21.15.79:47718) 2023-10-19T08:38:58.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.934+0000 7f65d29b3700 1 -- 172.21.15.79:0/3605102683 learned_addr learned my addr 172.21.15.79:0/3605102683 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:58.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.934+0000 7f65d21b2700 1 --2- 172.21.15.79:0/3605102683 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65b8004d90 0x7f65cc150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.934+0000 7f65d19b1700 1 --2- 172.21.15.79:0/3605102683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65cc0c8de0 0x7f65cc0c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.934+0000 7f65d29b3700 1 -- 172.21.15.79:0/3605102683 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65b8004d90 msgr2=0x7f65cc150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:58.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.934+0000 7f65d29b3700 1 --2- 172.21.15.79:0/3605102683 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65b8004d90 0x7f65cc150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.934+0000 7f65d29b3700 1 -- 172.21.15.79:0/3605102683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65cc0c8de0 msgr2=0x7f65cc0c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:58.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.934+0000 7f65d29b3700 1 --2- 172.21.15.79:0/3605102683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65cc0c8de0 0x7f65cc0c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:58.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.934+0000 7f65d29b3700 1 -- 172.21.15.79:0/3605102683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc0c76f0 con 0x7f65cc0c6d00 2023-10-19T08:38:58.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.934+0000 7f65d29b3700 1 --2- 172.21.15.79:0/3605102683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65cc0c6d00 0x7f65cc0c71b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f65c4004000 tx=0x7f65c40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:58.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.934+0000 7f65c2ffd700 1 -- 172.21.15.79:0/3605102683 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4003c10 con 0x7f65cc0c6d00 2023-10-19T08:38:58.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.934+0000 7f65c2ffd700 1 -- 172.21.15.79:0/3605102683 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c4003d90 con 0x7f65cc0c6d00 2023-10-19T08:38:58.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.934+0000 7f65d4416700 1 -- 172.21.15.79:0/3605102683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65cc150660 con 0x7f65cc0c6d00 2023-10-19T08:38:58.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.934+0000 7f65c2ffd700 1 -- 172.21.15.79:0/3605102683 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4005310 con 0x7f65cc0c6d00 2023-10-19T08:38:58.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.934+0000 7f65d4416700 1 -- 172.21.15.79:0/3605102683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65cc0c7c60 con 0x7f65cc0c6d00 2023-10-19T08:38:58.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.935+0000 7f65d4416700 1 -- 172.21.15.79:0/3605102683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65cc0ce530 con 0x7f65cc0c6d00 2023-10-19T08:38:58.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.936+0000 7f65c2ffd700 1 -- 172.21.15.79:0/3605102683 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f65c4019070 con 0x7f65cc0c6d00 2023-10-19T08:38:58.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.936+0000 7f65c2ffd700 1 --2- 172.21.15.79:0/3605102683 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f65b006a0e0 0x7f65b006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:58.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.936+0000 7f65c2ffd700 1 -- 172.21.15.79:0/3605102683 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f65c4089390 con 0x7f65cc0c6d00 2023-10-19T08:38:58.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.936+0000 7f65d21b2700 1 --2- 172.21.15.79:0/3605102683 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f65b006a0e0 0x7f65b006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:58.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.936+0000 7f65d21b2700 1 --2- 172.21.15.79:0/3605102683 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f65b006a0e0 0x7f65b006c5a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009c60 tx=0x7f65bc009210 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:58.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:58.940+0000 7f65c2ffd700 1 -- 172.21.15.79:0/3605102683 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f65cc0ce530 con 0x7f65cc0c6d00 2023-10-19T08:38:59.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.132+0000 7f65d4416700 1 -- 172.21.15.79:0/3605102683 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f65cc0ce530 con 0x7f65cc0c6d00 2023-10-19T08:38:59.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.132+0000 7f65c2ffd700 1 -- 172.21.15.79:0/3605102683 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f65cc0ce530 con 0x7f65cc0c6d00 2023-10-19T08:38:59.136 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:38:59.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.135+0000 7f65d4416700 1 -- 172.21.15.79:0/3605102683 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f65b006a0e0 msgr2=0x7f65b006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:59.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.135+0000 7f65d4416700 1 --2- 172.21.15.79:0/3605102683 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f65b006a0e0 0x7f65b006c5a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009c60 tx=0x7f65bc009210 comp rx=0 tx=0).stop 2023-10-19T08:38:59.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.135+0000 7f65d4416700 1 -- 172.21.15.79:0/3605102683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65cc0c6d00 msgr2=0x7f65cc0c71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:59.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.135+0000 7f65d4416700 1 --2- 172.21.15.79:0/3605102683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65cc0c6d00 0x7f65cc0c71b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f65c4004000 tx=0x7f65c40014a0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.135+0000 7f65d4416700 1 -- 172.21.15.79:0/3605102683 shutdown_connections 2023-10-19T08:38:59.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.135+0000 7f65d4416700 1 --2- 172.21.15.79:0/3605102683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65cc0c6d00 0x7f65cc0c71b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.135+0000 7f65d4416700 1 --2- 172.21.15.79:0/3605102683 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f65b006a0e0 0x7f65b006c5a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.135+0000 7f65d4416700 1 --2- 172.21.15.79:0/3605102683 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65b8004d90 0x7f65cc150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.135+0000 7f65d4416700 1 --2- 172.21.15.79:0/3605102683 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65cc0c8de0 0x7f65cc0c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.135+0000 7f65d4416700 1 -- 172.21.15.79:0/3605102683 >> 172.21.15.79:0/3605102683 conn(0x7f65cc06dcc0 msgr2=0x7f65cc0b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:59.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.135+0000 7f65d4416700 1 -- 172.21.15.79:0/3605102683 shutdown_connections 2023-10-19T08:38:59.141 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.135+0000 7f65d4416700 1 -- 172.21.15.79:0/3605102683 wait complete. 2023-10-19T08:38:59.150 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-19T08:38:59.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.268+0000 7f6c885a5700 1 Processor -- start 2023-10-19T08:38:59.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.268+0000 7f6c885a5700 1 -- start start 2023-10-19T08:38:59.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.269+0000 7f6c885a5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6c800d0890 0x7f6c800d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:59.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.269+0000 7f6c885a5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c800cedf0 0x7f6c800b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:59.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.269+0000 7f6c885a5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c800cfd90 con 0x7f6c8015af90 2023-10-19T08:38:59.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.269+0000 7f6c885a5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c800b3f20 con 0x7f6c800cedf0 2023-10-19T08:38:59.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.269+0000 7f6c885a5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c800cf280 con 0x7f6c800d0890 2023-10-19T08:38:59.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.269+0000 7f6c86b42700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c800cedf0 0x7f6c800b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:59.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.269+0000 7f6c86341700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6c8015af90 0x7f6c800d0180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57794/0 (socket says 172.21.15.79:57794) 2023-10-19T08:38:59.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.270+0000 7f6c86341700 1 -- 172.21.15.79:0/868312991 learned_addr learned my addr 172.21.15.79:0/868312991 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:38:59.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.270+0000 7f6c85b40700 1 --2- 172.21.15.79:0/868312991 >> v2:172.21.15.89:3300/0 conn(0x7f6c800d0890 0x7f6c800d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:59.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.270+0000 7f6c8533f700 1 -- 172.21.15.79:0/868312991 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714438154 0 0) 0x7f6c800cfd90 con 0x7f6c8015af90 2023-10-19T08:38:59.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.270+0000 7f6c8533f700 1 -- 172.21.15.79:0/868312991 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c6c0035b0 con 0x7f6c8015af90 2023-10-19T08:38:59.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.270+0000 7f6c86b42700 1 -- 172.21.15.79:0/868312991 >> v2:172.21.15.89:3300/0 conn(0x7f6c800d0890 msgr2=0x7f6c800d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:59.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.270+0000 7f6c86b42700 1 --2- 172.21.15.79:0/868312991 >> v2:172.21.15.89:3300/0 conn(0x7f6c800d0890 0x7f6c800d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.270+0000 7f6c86b42700 1 -- 172.21.15.79:0/868312991 >> v1:172.21.15.79:6789/0 conn(0x7f6c8015af90 legacy=0x7f6c800d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:59.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.270+0000 7f6c86b42700 1 -- 172.21.15.79:0/868312991 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c800cf4f0 con 0x7f6c800cedf0 2023-10-19T08:38:59.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.270+0000 7f6c86b42700 1 --2- 172.21.15.79:0/868312991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c800cedf0 0x7f6c800b43b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6c8015e840 tx=0x7f6c7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886ddd4da802f863 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:59.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.270+0000 7f6c8533f700 1 -- 172.21.15.79:0/868312991 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7800e070 con 0x7f6c800cedf0 2023-10-19T08:38:59.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.270+0000 7f6c8533f700 1 -- 172.21.15.79:0/868312991 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7800bb20 con 0x7f6c800cedf0 2023-10-19T08:38:59.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.270+0000 7f6c8533f700 1 -- 172.21.15.79:0/868312991 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7800be90 con 0x7f6c800cedf0 2023-10-19T08:38:59.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.271+0000 7f6c885a5700 1 -- 172.21.15.79:0/868312991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c800cedf0 msgr2=0x7f6c800b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:59.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.271+0000 7f6c885a5700 1 --2- 172.21.15.79:0/868312991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c800cedf0 0x7f6c800b43b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6c8015e840 tx=0x7f6c7800b330 comp rx=0 tx=0).stop 2023-10-19T08:38:59.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.271+0000 7f6c885a5700 1 -- 172.21.15.79:0/868312991 shutdown_connections 2023-10-19T08:38:59.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.271+0000 7f6c885a5700 1 --2- 172.21.15.79:0/868312991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c800cedf0 0x7f6c800b43b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.271+0000 7f6c885a5700 1 --2- 172.21.15.79:0/868312991 >> v2:172.21.15.89:3300/0 conn(0x7f6c800d0890 0x7f6c800d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.271+0000 7f6c885a5700 1 -- 172.21.15.79:0/868312991 >> 172.21.15.79:0/868312991 conn(0x7f6c8006a400 msgr2=0x7f6c8006a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:59.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.271+0000 7f6c885a5700 1 -- 172.21.15.79:0/868312991 shutdown_connections 2023-10-19T08:38:59.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.271+0000 7f6c885a5700 1 -- 172.21.15.79:0/868312991 wait complete. 2023-10-19T08:38:59.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.272+0000 7f6c885a5700 1 Processor -- start 2023-10-19T08:38:59.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.272+0000 7f6c885a5700 1 -- start start 2023-10-19T08:38:59.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c885a5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c800cedf0 0x7f6c801f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:59.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c885a5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c800d0890 0x7f6c800c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:59.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c885a5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c8015af90 0x7f6c801e4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:59.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c885a5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c801e53f0 con 0x7f6c800d0890 2023-10-19T08:38:59.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c885a5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c801f22c0 con 0x7f6c8015af90 2023-10-19T08:38:59.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c885a5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8015bfc0 con 0x7f6c800cedf0 2023-10-19T08:38:59.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c85b40700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c800d0890 0x7f6c800c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:59.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c85b40700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c800d0890 0x7f6c800c7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47730/0 (socket says 172.21.15.79:47730) 2023-10-19T08:38:59.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c85b40700 1 -- 172.21.15.79:0/1914268046 learned_addr learned my addr 172.21.15.79:0/1914268046 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:59.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c86b42700 1 --2- 172.21.15.79:0/1914268046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c8015af90 0x7f6c801e4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:59.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c86341700 1 --2- 172.21.15.79:0/1914268046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c800cedf0 0x7f6c801f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:59.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c85b40700 1 -- 172.21.15.79:0/1914268046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c800cedf0 msgr2=0x7f6c801f1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:59.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c85b40700 1 --2- 172.21.15.79:0/1914268046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c800cedf0 0x7f6c801f1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c85b40700 1 -- 172.21.15.79:0/1914268046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c8015af90 msgr2=0x7f6c801e4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:59.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c85b40700 1 --2- 172.21.15.79:0/1914268046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c8015af90 0x7f6c801e4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c85b40700 1 -- 172.21.15.79:0/1914268046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c78009a70 con 0x7f6c800d0890 2023-10-19T08:38:59.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c86b42700 1 --2- 172.21.15.79:0/1914268046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c8015af90 0x7f6c801e4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:59.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c86341700 1 --2- 172.21.15.79:0/1914268046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c800cedf0 0x7f6c801f1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:38:59.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c85b40700 1 --2- 172.21.15.79:0/1914268046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c800d0890 0x7f6c800c7dc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00e9b0 tx=0x7f6c7c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:59.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c76ffd700 1 -- 172.21.15.79:0/1914268046 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c009710 con 0x7f6c800d0890 2023-10-19T08:38:59.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c76ffd700 1 -- 172.21.15.79:0/1914268046 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c00c7f0 con 0x7f6c800d0890 2023-10-19T08:38:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c885a5700 1 -- 172.21.15.79:0/1914268046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c801e3620 con 0x7f6c800d0890 2023-10-19T08:38:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c76ffd700 1 -- 172.21.15.79:0/1914268046 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00cb60 con 0x7f6c800d0890 2023-10-19T08:38:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.273+0000 7f6c885a5700 1 -- 172.21.15.79:0/1914268046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c801e3be0 con 0x7f6c800d0890 2023-10-19T08:38:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.274+0000 7f6c885a5700 1 -- 172.21.15.79:0/1914268046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8004ee70 con 0x7f6c800d0890 2023-10-19T08:38:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.275+0000 7f6c76ffd700 1 -- 172.21.15.79:0/1914268046 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6c7c00ccc0 con 0x7f6c800d0890 2023-10-19T08:38:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.275+0000 7f6c76ffd700 1 --2- 172.21.15.79:0/1914268046 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6c6406a0e0 0x7f6c6406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:59.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.275+0000 7f6c76ffd700 1 -- 172.21.15.79:0/1914268046 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6c7c0889c0 con 0x7f6c800d0890 2023-10-19T08:38:59.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.275+0000 7f6c86341700 1 --2- 172.21.15.79:0/1914268046 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6c6406a0e0 0x7f6c6406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:59.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.276+0000 7f6c86341700 1 --2- 172.21.15.79:0/1914268046 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6c6406a0e0 0x7f6c6406c5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6c70005910 tx=0x7f6c70009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:59.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.280+0000 7f6c76ffd700 1 -- 172.21.15.79:0/1914268046 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6c7c057810 con 0x7f6c800d0890 2023-10-19T08:38:59.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.488+0000 7f6c885a5700 1 -- 172.21.15.79:0/1914268046 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6c800d0380 con 0x7f6c800d0890 2023-10-19T08:38:59.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.488+0000 7f6c76ffd700 1 -- 172.21.15.79:0/1914268046 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6c7c0573a0 con 0x7f6c800d0890 2023-10-19T08:38:59.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.490+0000 7f6c885a5700 1 -- 172.21.15.79:0/1914268046 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6c6406a0e0 msgr2=0x7f6c6406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:59.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.490+0000 7f6c885a5700 1 --2- 172.21.15.79:0/1914268046 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6c6406a0e0 0x7f6c6406c5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6c70005910 tx=0x7f6c70009040 comp rx=0 tx=0).stop 2023-10-19T08:38:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.490+0000 7f6c885a5700 1 -- 172.21.15.79:0/1914268046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c800d0890 msgr2=0x7f6c800c7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.490+0000 7f6c885a5700 1 --2- 172.21.15.79:0/1914268046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c800d0890 0x7f6c800c7dc0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c00e9b0 tx=0x7f6c7c00ed70 comp rx=0 tx=0).stop 2023-10-19T08:38:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.490+0000 7f6c885a5700 1 -- 172.21.15.79:0/1914268046 shutdown_connections 2023-10-19T08:38:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.490+0000 7f6c885a5700 1 --2- 172.21.15.79:0/1914268046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c8015af90 0x7f6c801e4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.490+0000 7f6c885a5700 1 --2- 172.21.15.79:0/1914268046 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6c6406a0e0 0x7f6c6406c5a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.490+0000 7f6c885a5700 1 --2- 172.21.15.79:0/1914268046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c800cedf0 0x7f6c801f1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.490+0000 7f6c885a5700 1 --2- 172.21.15.79:0/1914268046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c800d0890 0x7f6c800c7dc0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.490+0000 7f6c885a5700 1 -- 172.21.15.79:0/1914268046 >> 172.21.15.79:0/1914268046 conn(0x7f6c8006a400 msgr2=0x7f6c80150020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.490+0000 7f6c885a5700 1 -- 172.21.15.79:0/1914268046 shutdown_connections 2023-10-19T08:38:59.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.490+0000 7f6c885a5700 1 -- 172.21.15.79:0/1914268046 wait complete. 2023-10-19T08:38:59.497 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2023-10-19T08:38:59.506 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:38:59.506 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T08:38:59.524 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:38:59.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.681+0000 7f784bdc2700 1 Processor -- start 2023-10-19T08:38:59.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.682+0000 7f784bdc2700 1 -- start start 2023-10-19T08:38:59.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.682+0000 7f784bdc2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f78440af170 0x7f78440cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:59.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.682+0000 7f784bdc2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78440b1de0 0x7f78440b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:59.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.682+0000 7f784bdc2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f784415de50 con 0x7f78440cd800 2023-10-19T08:38:59.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.682+0000 7f784bdc2700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78440af550 con 0x7f78440af170 2023-10-19T08:38:59.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.682+0000 7f784bdc2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78440b16b0 con 0x7f78440b1de0 2023-10-19T08:38:59.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.683+0000 7f7849b5e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f78440af170 0x7f78440cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:59.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.683+0000 7f7849b5e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f78440af170 0x7f78440cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47736/0 (socket says 172.21.15.79:47736) 2023-10-19T08:38:59.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.683+0000 7f7849b5e700 1 -- 172.21.15.79:0/1362060656 learned_addr learned my addr 172.21.15.79:0/1362060656 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:59.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.683+0000 7f784935d700 1 --2- 172.21.15.79:0/1362060656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78440b1de0 0x7f78440b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:59.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.683+0000 7f7849b5e700 1 -- 172.21.15.79:0/1362060656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78440b1de0 msgr2=0x7f78440b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:38:59.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.683+0000 7f7849b5e700 1 --2- 172.21.15.79:0/1362060656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78440b1de0 0x7f78440b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.683+0000 7f7849b5e700 1 -- 172.21.15.79:0/1362060656 >> v1:172.21.15.89:6789/0 conn(0x7f78440cd800 legacy=0x7f784406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:59.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.683+0000 7f7849b5e700 1 -- 172.21.15.79:0/1362060656 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784415e130 con 0x7f78440af170 2023-10-19T08:38:59.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.683+0000 7f7849b5e700 1 --2- 172.21.15.79:0/1362060656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78440af170 0x7f78440cd0c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f78340098f0 tx=0x7f7834009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c538375cc6b7bf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:59.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.683+0000 7f7848b5c700 1 -- 172.21.15.79:0/1362060656 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783400b8a0 con 0x7f78440af170 2023-10-19T08:38:59.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.683+0000 7f7848b5c700 1 -- 172.21.15.79:0/1362060656 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783400ba00 con 0x7f78440af170 2023-10-19T08:38:59.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.683+0000 7f7848b5c700 1 -- 172.21.15.79:0/1362060656 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783400bd90 con 0x7f78440af170 2023-10-19T08:38:59.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.684+0000 7f784bdc2700 1 -- 172.21.15.79:0/1362060656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78440af170 msgr2=0x7f78440cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:59.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.684+0000 7f784bdc2700 1 --2- 172.21.15.79:0/1362060656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78440af170 0x7f78440cd0c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f78340098f0 tx=0x7f7834009c00 comp rx=0 tx=0).stop 2023-10-19T08:38:59.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.684+0000 7f784bdc2700 1 -- 172.21.15.79:0/1362060656 shutdown_connections 2023-10-19T08:38:59.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.684+0000 7f784bdc2700 1 --2- 172.21.15.79:0/1362060656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78440af170 0x7f78440cd0c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.684+0000 7f784bdc2700 1 --2- 172.21.15.79:0/1362060656 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78440b1de0 0x7f78440b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.684+0000 7f784bdc2700 1 -- 172.21.15.79:0/1362060656 >> 172.21.15.79:0/1362060656 conn(0x7f784406dcc0 msgr2=0x7f784406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:59.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.684+0000 7f784bdc2700 1 -- 172.21.15.79:0/1362060656 shutdown_connections 2023-10-19T08:38:59.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.684+0000 7f784bdc2700 1 -- 172.21.15.79:0/1362060656 wait complete. 2023-10-19T08:38:59.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.685+0000 7f784bdc2700 1 Processor -- start 2023-10-19T08:38:59.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.685+0000 7f784bdc2700 1 -- start start 2023-10-19T08:38:59.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f784bdc2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78440af170 0x7f78441e8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:59.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f784bdc2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440b1de0 0x7f784415d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:59.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f784bdc2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78440cd800 0x7f78440ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:59.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f784bdc2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78441e7de0 con 0x7f78440cd800 2023-10-19T08:38:59.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f784bdc2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78440ad8f0 con 0x7f78440b1de0 2023-10-19T08:38:59.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f784bdc2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78441e74f0 con 0x7f78440af170 2023-10-19T08:38:59.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f784a35f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78440cd800 0x7f78440ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:59.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f784a35f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78440cd800 0x7f78440ad110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47746/0 (socket says 172.21.15.79:47746) 2023-10-19T08:38:59.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f784a35f700 1 -- 172.21.15.79:0/2679165838 learned_addr learned my addr 172.21.15.79:0/2679165838 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:38:59.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f784935d700 1 --2- 172.21.15.79:0/2679165838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440b1de0 0x7f784415d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:59.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f7849b5e700 1 --2- 172.21.15.79:0/2679165838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78440af170 0x7f78441e8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:59.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f784a35f700 1 -- 172.21.15.79:0/2679165838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78440af170 msgr2=0x7f78441e8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:59.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f784a35f700 1 --2- 172.21.15.79:0/2679165838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78440af170 0x7f78441e8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f784a35f700 1 -- 172.21.15.79:0/2679165838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440b1de0 msgr2=0x7f784415d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:59.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f784a35f700 1 --2- 172.21.15.79:0/2679165838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440b1de0 0x7f784415d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f784a35f700 1 -- 172.21.15.79:0/2679165838 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7834009550 con 0x7f78440cd800 2023-10-19T08:38:59.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f784a35f700 1 --2- 172.21.15.79:0/2679165838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78440cd800 0x7f78440ad110 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f783c00cc50 tx=0x7f783c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:59.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f783a7fc700 1 -- 172.21.15.79:0/2679165838 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c003c00 con 0x7f78440cd800 2023-10-19T08:38:59.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f783a7fc700 1 -- 172.21.15.79:0/2679165838 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783c003d60 con 0x7f78440cd800 2023-10-19T08:38:59.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f784bdc2700 1 -- 172.21.15.79:0/2679165838 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78440ad650 con 0x7f78440cd800 2023-10-19T08:38:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f783a7fc700 1 -- 172.21.15.79:0/2679165838 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c00ab60 con 0x7f78440cd800 2023-10-19T08:38:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.686+0000 7f784bdc2700 1 -- 172.21.15.79:0/2679165838 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78441e7a70 con 0x7f78440cd800 2023-10-19T08:38:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.688+0000 7f784bdc2700 1 -- 172.21.15.79:0/2679165838 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784404ee70 con 0x7f78440cd800 2023-10-19T08:38:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.688+0000 7f783a7fc700 1 -- 172.21.15.79:0/2679165838 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f783c00acc0 con 0x7f78440cd800 2023-10-19T08:38:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.688+0000 7f783a7fc700 1 --2- 172.21.15.79:0/2679165838 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f782806a0e0 0x7f782806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:38:59.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.688+0000 7f783a7fc700 1 -- 172.21.15.79:0/2679165838 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f783c0888c0 con 0x7f78440cd800 2023-10-19T08:38:59.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.688+0000 7f7849b5e700 1 --2- 172.21.15.79:0/2679165838 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f782806a0e0 0x7f782806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:38:59.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.689+0000 7f7849b5e700 1 --2- 172.21.15.79:0/2679165838 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f782806a0e0 0x7f782806c5a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7834000c00 tx=0x7f7834008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:38:59.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.693+0000 7f783a7fc700 1 -- 172.21.15.79:0/2679165838 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f783c053d10 con 0x7f78440cd800 2023-10-19T08:38:59.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.881+0000 7f784bdc2700 1 -- 172.21.15.79:0/2679165838 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78441e7f20 con 0x7f78440cd800 2023-10-19T08:38:59.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.883+0000 7f783a7fc700 1 -- 172.21.15.79:0/2679165838 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20155 (secure 0 0 0) 0x7f783c057330 con 0x7f78440cd800 2023-10-19T08:38:59.886 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:38:59.887 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:44.473795+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:38:59.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.885+0000 7f784bdc2700 1 -- 172.21.15.79:0/2679165838 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f782806a0e0 msgr2=0x7f782806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.885+0000 7f784bdc2700 1 --2- 172.21.15.79:0/2679165838 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f782806a0e0 0x7f782806c5a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7834000c00 tx=0x7f7834008030 comp rx=0 tx=0).stop 2023-10-19T08:38:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.885+0000 7f784bdc2700 1 -- 172.21.15.79:0/2679165838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78440cd800 msgr2=0x7f78440ad110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:38:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.885+0000 7f784bdc2700 1 --2- 172.21.15.79:0/2679165838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78440cd800 0x7f78440ad110 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f783c00cc50 tx=0x7f783c00cf60 comp rx=0 tx=0).stop 2023-10-19T08:38:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.885+0000 7f784bdc2700 1 -- 172.21.15.79:0/2679165838 shutdown_connections 2023-10-19T08:38:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.885+0000 7f784bdc2700 1 --2- 172.21.15.79:0/2679165838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78440cd800 0x7f78440ad110 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.885+0000 7f784bdc2700 1 --2- 172.21.15.79:0/2679165838 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f782806a0e0 0x7f782806c5a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.885+0000 7f784bdc2700 1 --2- 172.21.15.79:0/2679165838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78440af170 0x7f78441e8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.885+0000 7f784bdc2700 1 --2- 172.21.15.79:0/2679165838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78440b1de0 0x7f784415d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:38:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.885+0000 7f784bdc2700 1 -- 172.21.15.79:0/2679165838 >> 172.21.15.79:0/2679165838 conn(0x7f784406dcc0 msgr2=0x7f784406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:38:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.885+0000 7f784bdc2700 1 -- 172.21.15.79:0/2679165838 shutdown_connections 2023-10-19T08:38:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:38:59.885+0000 7f784bdc2700 1 -- 172.21.15.79:0/2679165838 wait complete. 2023-10-19T08:38:59.900 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T08:37:54.318159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T08:37:55.629862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T08:37:59.333062+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T08:38:59.901 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:39:00.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.020+0000 7fc4cf980700 1 Processor -- start 2023-10-19T08:39:00.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.021+0000 7fc4cf980700 1 -- start start 2023-10-19T08:39:00.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.022+0000 7fc4cf980700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc4c80b0c00 0x7fc4c80d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.022+0000 7fc4cf980700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4c80cb6f0 0x7fc4c80ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.022+0000 7fc4cf980700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c80b25f0 con 0x7fc4c815e570 2023-10-19T08:39:00.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.022+0000 7fc4cf980700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c80afd60 con 0x7fc4c80b0c00 2023-10-19T08:39:00.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.022+0000 7fc4cf980700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80af810 con 0x7fc4c80cb6f0 2023-10-19T08:39:00.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.022+0000 7fc4ccf1b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc4c80b0c00 0x7fc4c80d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.022+0000 7fc4cd71c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc4c815e570 0x7fc4c80b04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57822/0 (socket says 172.21.15.79:57822) 2023-10-19T08:39:00.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.022+0000 7fc4cd71c700 1 -- 172.21.15.79:0/3256659199 learned_addr learned my addr 172.21.15.79:0/3256659199 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:00.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.022+0000 7fc4ccf1b700 1 -- 172.21.15.79:0/3256659199 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4c80cb6f0 msgr2=0x7fc4c80ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:00.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.022+0000 7fc4ccf1b700 1 --2- 172.21.15.79:0/3256659199 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4c80cb6f0 0x7fc4c80ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.022+0000 7fc4ccf1b700 1 -- 172.21.15.79:0/3256659199 >> v1:172.21.15.79:6789/0 conn(0x7fc4c815e570 legacy=0x7fc4c80b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:00.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.022+0000 7fc4ccf1b700 1 -- 172.21.15.79:0/3256659199 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c80aef70 con 0x7fc4c80b0c00 2023-10-19T08:39:00.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.022+0000 7fc4bffff700 1 -- 172.21.15.79:0/3256659199 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285253728 0 0) 0x7fc4c80b25f0 con 0x7fc4c815e570 2023-10-19T08:39:00.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.022+0000 7fc4ccf1b700 1 --2- 172.21.15.79:0/3256659199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4c80b0c00 0x7fc4c80d1990 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009840 tx=0x7fc4c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e43f24484d5e0b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:00.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.022+0000 7fc4bffff700 1 -- 172.21.15.79:0/3256659199 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4011830 con 0x7fc4c80b0c00 2023-10-19T08:39:00.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.022+0000 7fc4bffff700 1 -- 172.21.15.79:0/3256659199 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c4011990 con 0x7fc4c80b0c00 2023-10-19T08:39:00.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.022+0000 7fc4bffff700 1 -- 172.21.15.79:0/3256659199 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4011d20 con 0x7fc4c80b0c00 2023-10-19T08:39:00.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.023+0000 7fc4cf980700 1 -- 172.21.15.79:0/3256659199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4c80b0c00 msgr2=0x7fc4c80d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:00.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.023+0000 7fc4cf980700 1 --2- 172.21.15.79:0/3256659199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4c80b0c00 0x7fc4c80d1990 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009840 tx=0x7fc4c4009b50 comp rx=0 tx=0).stop 2023-10-19T08:39:00.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.023+0000 7fc4cf980700 1 -- 172.21.15.79:0/3256659199 shutdown_connections 2023-10-19T08:39:00.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.023+0000 7fc4cf980700 1 --2- 172.21.15.79:0/3256659199 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4c80cb6f0 0x7fc4c80ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.023+0000 7fc4cf980700 1 --2- 172.21.15.79:0/3256659199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4c80b0c00 0x7fc4c80d1990 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.023+0000 7fc4cf980700 1 -- 172.21.15.79:0/3256659199 >> 172.21.15.79:0/3256659199 conn(0x7fc4c809a0b0 msgr2=0x7fc4c80d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:00.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.023+0000 7fc4cf980700 1 -- 172.21.15.79:0/3256659199 shutdown_connections 2023-10-19T08:39:00.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.023+0000 7fc4cf980700 1 -- 172.21.15.79:0/3256659199 wait complete. 2023-10-19T08:39:00.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.024+0000 7fc4cf980700 1 Processor -- start 2023-10-19T08:39:00.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.024+0000 7fc4cf980700 1 -- start start 2023-10-19T08:39:00.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4cf980700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c80b0c00 0x7fc4c8159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4cf980700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4c80cb6f0 0x7fc4c80c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4cf980700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4c815e570 0x7fc4c81f0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4cf980700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c81f1480 con 0x7fc4c80cb6f0 2023-10-19T08:39:00.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4cf980700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80c4b40 con 0x7fc4c80b0c00 2023-10-19T08:39:00.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4cf980700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c81f0960 con 0x7fc4c815e570 2023-10-19T08:39:00.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4ccf1b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4c80cb6f0 0x7fc4c80c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4ccf1b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4c80cb6f0 0x7fc4c80c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47758/0 (socket says 172.21.15.79:47758) 2023-10-19T08:39:00.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4ccf1b700 1 -- 172.21.15.79:0/2829078944 learned_addr learned my addr 172.21.15.79:0/2829078944 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:00.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4cd71c700 1 --2- 172.21.15.79:0/2829078944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c80b0c00 0x7fc4c8159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4cdf1d700 1 --2- 172.21.15.79:0/2829078944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4c815e570 0x7fc4c81f0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4ccf1b700 1 -- 172.21.15.79:0/2829078944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4c815e570 msgr2=0x7fc4c81f0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:00.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4ccf1b700 1 --2- 172.21.15.79:0/2829078944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4c815e570 0x7fc4c81f0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4ccf1b700 1 -- 172.21.15.79:0/2829078944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c80b0c00 msgr2=0x7fc4c8159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:00.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4ccf1b700 1 --2- 172.21.15.79:0/2829078944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c80b0c00 0x7fc4c8159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4ccf1b700 1 -- 172.21.15.79:0/2829078944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c40094a0 con 0x7fc4c80cb6f0 2023-10-19T08:39:00.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4cd71c700 1 --2- 172.21.15.79:0/2829078944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c80b0c00 0x7fc4c8159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:00.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4cdf1d700 1 --2- 172.21.15.79:0/2829078944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4c815e570 0x7fc4c81f0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:00.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4ccf1b700 1 --2- 172.21.15.79:0/2829078944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4c80cb6f0 0x7fc4c80c9ae0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80727f0 tx=0x7fc4c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:00.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.025+0000 7fc4bdffb700 1 -- 172.21.15.79:0/2829078944 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c40038a0 con 0x7fc4c80cb6f0 2023-10-19T08:39:00.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.026+0000 7fc4bdffb700 1 -- 172.21.15.79:0/2829078944 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c401f070 con 0x7fc4c80cb6f0 2023-10-19T08:39:00.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.026+0000 7fc4cf980700 1 -- 172.21.15.79:0/2829078944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c81f0be0 con 0x7fc4c80cb6f0 2023-10-19T08:39:00.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.026+0000 7fc4bdffb700 1 -- 172.21.15.79:0/2829078944 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4003c60 con 0x7fc4c80cb6f0 2023-10-19T08:39:00.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.026+0000 7fc4cf980700 1 -- 172.21.15.79:0/2829078944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c81f11a0 con 0x7fc4c80cb6f0 2023-10-19T08:39:00.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.027+0000 7fc4cf980700 1 -- 172.21.15.79:0/2829078944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c80c4cf0 con 0x7fc4c80cb6f0 2023-10-19T08:39:00.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.027+0000 7fc4bdffb700 1 -- 172.21.15.79:0/2829078944 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc4c401a430 con 0x7fc4c80cb6f0 2023-10-19T08:39:00.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.027+0000 7fc4bdffb700 1 --2- 172.21.15.79:0/2829078944 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc4ac06a0e0 0x7fc4ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.028+0000 7fc4bdffb700 1 -- 172.21.15.79:0/2829078944 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc4c4021070 con 0x7fc4c80cb6f0 2023-10-19T08:39:00.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.028+0000 7fc4cd71c700 1 --2- 172.21.15.79:0/2829078944 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc4ac06a0e0 0x7fc4ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.028+0000 7fc4cd71c700 1 --2- 172.21.15.79:0/2829078944 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc4ac06a0e0 0x7fc4ac06c5a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8007fd0 tx=0x7fc4b8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:00.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.032+0000 7fc4bdffb700 1 -- 172.21.15.79:0/2829078944 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc4c80c4cf0 con 0x7fc4c80cb6f0 2023-10-19T08:39:00.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.218+0000 7fc4cf980700 1 -- 172.21.15.79:0/2829078944 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc4c80c4cf0 con 0x7fc4c80cb6f0 2023-10-19T08:39:00.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.218+0000 7fc4bdffb700 1 -- 172.21.15.79:0/2829078944 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc4c80c4cf0 con 0x7fc4c80cb6f0 2023-10-19T08:39:00.222 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:39:00.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.221+0000 7fc4cf980700 1 -- 172.21.15.79:0/2829078944 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc4ac06a0e0 msgr2=0x7fc4ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.221+0000 7fc4cf980700 1 --2- 172.21.15.79:0/2829078944 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc4ac06a0e0 0x7fc4ac06c5a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8007fd0 tx=0x7fc4b8009040 comp rx=0 tx=0).stop 2023-10-19T08:39:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.221+0000 7fc4cf980700 1 -- 172.21.15.79:0/2829078944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4c80cb6f0 msgr2=0x7fc4c80c9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.221+0000 7fc4cf980700 1 --2- 172.21.15.79:0/2829078944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4c80cb6f0 0x7fc4c80c9ae0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80727f0 tx=0x7fc4c4004750 comp rx=0 tx=0).stop 2023-10-19T08:39:00.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.221+0000 7fc4cf980700 1 -- 172.21.15.79:0/2829078944 shutdown_connections 2023-10-19T08:39:00.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.221+0000 7fc4cf980700 1 --2- 172.21.15.79:0/2829078944 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc4ac06a0e0 0x7fc4ac06c5a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.221+0000 7fc4cf980700 1 --2- 172.21.15.79:0/2829078944 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc4c815e570 0x7fc4c81f0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.221+0000 7fc4cf980700 1 --2- 172.21.15.79:0/2829078944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c80b0c00 0x7fc4c8159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.221+0000 7fc4cf980700 1 --2- 172.21.15.79:0/2829078944 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4c80cb6f0 0x7fc4c80c9ae0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.221+0000 7fc4cf980700 1 -- 172.21.15.79:0/2829078944 >> 172.21.15.79:0/2829078944 conn(0x7fc4c809a0b0 msgr2=0x7fc4c80706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.221+0000 7fc4cf980700 1 -- 172.21.15.79:0/2829078944 shutdown_connections 2023-10-19T08:39:00.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.221+0000 7fc4cf980700 1 -- 172.21.15.79:0/2829078944 wait complete. 2023-10-19T08:39:00.236 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:39:00.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.357+0000 7f3ea6508700 1 Processor -- start 2023-10-19T08:39:00.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.357+0000 7f3ea6508700 1 -- start start 2023-10-19T08:39:00.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.358+0000 7f3ea6508700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3ea00cd270 0x7f3ea006a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.358+0000 7f3ea6508700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea00cc2a0 0x7f3ea006a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.358+0000 7f3ea6508700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea00b1fe0 con 0x7f3ea00703b0 2023-10-19T08:39:00.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.358+0000 7f3ea6508700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea0160a80 con 0x7f3ea00cd270 2023-10-19T08:39:00.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.358+0000 7f3ea6508700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea00ce2b0 con 0x7f3ea00cc2a0 2023-10-19T08:39:00.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.358+0000 7f3e9f7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3ea00703b0 0x7f3ea0160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57836/0 (socket says 172.21.15.79:57836) 2023-10-19T08:39:00.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.358+0000 7f3e9f7fe700 1 -- 172.21.15.79:0/1704928971 learned_addr learned my addr 172.21.15.79:0/1704928971 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:00.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.358+0000 7f3ea4aa5700 1 --2- 172.21.15.79:0/1704928971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea00cc2a0 0x7f3ea006a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.358+0000 7f3e9ffff700 1 --2- 172.21.15.79:0/1704928971 >> v2:172.21.15.89:3300/0 conn(0x7f3ea00cd270 0x7f3ea006a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.358+0000 7f3e9effd700 1 -- 172.21.15.79:0/1704928971 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176195712 0 0) 0x7f3ea00b1fe0 con 0x7f3ea00703b0 2023-10-19T08:39:00.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.358+0000 7f3e9effd700 1 -- 172.21.15.79:0/1704928971 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e880035b0 con 0x7f3ea00703b0 2023-10-19T08:39:00.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.358+0000 7f3e9ffff700 1 -- 172.21.15.79:0/1704928971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea00cc2a0 msgr2=0x7f3ea006a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:00.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.358+0000 7f3e9ffff700 1 --2- 172.21.15.79:0/1704928971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea00cc2a0 0x7f3ea006a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.358+0000 7f3e9ffff700 1 -- 172.21.15.79:0/1704928971 >> v1:172.21.15.79:6789/0 conn(0x7f3ea00703b0 legacy=0x7f3ea0160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:00.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.358+0000 7f3e9ffff700 1 -- 172.21.15.79:0/1704928971 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea00ce550 con 0x7f3ea00cd270 2023-10-19T08:39:00.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.358+0000 7f3e9ffff700 1 --2- 172.21.15.79:0/1704928971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea00cd270 0x7f3ea006a220 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009840 tx=0x7f3e94009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8288d64ac1386279 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:00.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.359+0000 7f3e9effd700 1 -- 172.21.15.79:0/1704928971 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e94011830 con 0x7f3ea00cd270 2023-10-19T08:39:00.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.359+0000 7f3e9effd700 1 -- 172.21.15.79:0/1704928971 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e94011990 con 0x7f3ea00cd270 2023-10-19T08:39:00.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.359+0000 7f3e9effd700 1 -- 172.21.15.79:0/1704928971 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e94011d00 con 0x7f3ea00cd270 2023-10-19T08:39:00.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.359+0000 7f3ea6508700 1 -- 172.21.15.79:0/1704928971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea00cd270 msgr2=0x7f3ea006a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:00.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.359+0000 7f3ea6508700 1 --2- 172.21.15.79:0/1704928971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea00cd270 0x7f3ea006a220 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009840 tx=0x7f3e94009b50 comp rx=0 tx=0).stop 2023-10-19T08:39:00.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.359+0000 7f3ea6508700 1 -- 172.21.15.79:0/1704928971 shutdown_connections 2023-10-19T08:39:00.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.359+0000 7f3ea6508700 1 --2- 172.21.15.79:0/1704928971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea00cd270 0x7f3ea006a220 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.359+0000 7f3ea6508700 1 --2- 172.21.15.79:0/1704928971 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea00cc2a0 0x7f3ea006a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.359+0000 7f3ea6508700 1 -- 172.21.15.79:0/1704928971 >> 172.21.15.79:0/1704928971 conn(0x7f3ea006dcc0 msgr2=0x7f3ea006e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:00.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.359+0000 7f3ea6508700 1 -- 172.21.15.79:0/1704928971 shutdown_connections 2023-10-19T08:39:00.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.359+0000 7f3ea6508700 1 -- 172.21.15.79:0/1704928971 wait complete. 2023-10-19T08:39:00.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.360+0000 7f3ea6508700 1 Processor -- start 2023-10-19T08:39:00.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.361+0000 7f3ea6508700 1 -- start start 2023-10-19T08:39:00.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.361+0000 7f3ea6508700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea00703b0 0x7f3ea014d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.361+0000 7f3ea6508700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea00cc2a0 0x7f3ea01f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.361+0000 7f3ea6508700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ea00cd270 0x7f3ea00c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.361+0000 7f3ea6508700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea014d670 con 0x7f3ea00cd270 2023-10-19T08:39:00.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.361+0000 7f3ea6508700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea00c7d50 con 0x7f3ea00703b0 2023-10-19T08:39:00.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.361+0000 7f3ea6508700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea00c8bb0 con 0x7f3ea00cc2a0 2023-10-19T08:39:00.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.361+0000 7f3ea4aa5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ea00cd270 0x7f3ea00c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.361+0000 7f3ea4aa5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ea00cd270 0x7f3ea00c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47774/0 (socket says 172.21.15.79:47774) 2023-10-19T08:39:00.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.361+0000 7f3ea4aa5700 1 -- 172.21.15.79:0/2020547654 learned_addr learned my addr 172.21.15.79:0/2020547654 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:00.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.361+0000 7f3e9ffff700 1 --2- 172.21.15.79:0/2020547654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea00703b0 0x7f3ea014d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.361+0000 7f3e9f7fe700 1 --2- 172.21.15.79:0/2020547654 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea00cc2a0 0x7f3ea01f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.362+0000 7f3ea4aa5700 1 -- 172.21.15.79:0/2020547654 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea00cc2a0 msgr2=0x7f3ea01f3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:00.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.362+0000 7f3ea4aa5700 1 --2- 172.21.15.79:0/2020547654 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea00cc2a0 0x7f3ea01f3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.362+0000 7f3ea4aa5700 1 -- 172.21.15.79:0/2020547654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea00703b0 msgr2=0x7f3ea014d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:00.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.362+0000 7f3ea4aa5700 1 --2- 172.21.15.79:0/2020547654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea00703b0 0x7f3ea014d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.362+0000 7f3ea4aa5700 1 -- 172.21.15.79:0/2020547654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e940094a0 con 0x7f3ea00cd270 2023-10-19T08:39:00.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.362+0000 7f3ea4aa5700 1 --2- 172.21.15.79:0/2020547654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ea00cd270 0x7f3ea00c9040 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009dd0 tx=0x7f3e9800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:00.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.362+0000 7f3e9cff9700 1 -- 172.21.15.79:0/2020547654 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e98009c40 con 0x7f3ea00cd270 2023-10-19T08:39:00.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.362+0000 7f3e9cff9700 1 -- 172.21.15.79:0/2020547654 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9800f040 con 0x7f3ea00cd270 2023-10-19T08:39:00.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.362+0000 7f3ea6508700 1 -- 172.21.15.79:0/2020547654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea01f38c0 con 0x7f3ea00cd270 2023-10-19T08:39:00.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.362+0000 7f3e9cff9700 1 -- 172.21.15.79:0/2020547654 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9800ce50 con 0x7f3ea00cd270 2023-10-19T08:39:00.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.362+0000 7f3ea6508700 1 -- 172.21.15.79:0/2020547654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea00c8280 con 0x7f3ea00cd270 2023-10-19T08:39:00.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.363+0000 7f3ea6508700 1 -- 172.21.15.79:0/2020547654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea004ee70 con 0x7f3ea00cd270 2023-10-19T08:39:00.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.363+0000 7f3e9cff9700 1 -- 172.21.15.79:0/2020547654 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3e98014480 con 0x7f3ea00cd270 2023-10-19T08:39:00.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.364+0000 7f3e9cff9700 1 --2- 172.21.15.79:0/2020547654 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f3e8c06a0e0 0x7f3e8c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.364+0000 7f3e9cff9700 1 -- 172.21.15.79:0/2020547654 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3e98089080 con 0x7f3ea00cd270 2023-10-19T08:39:00.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.364+0000 7f3e9ffff700 1 --2- 172.21.15.79:0/2020547654 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f3e8c06a0e0 0x7f3e8c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.364+0000 7f3e9ffff700 1 --2- 172.21.15.79:0/2020547654 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f3e8c06a0e0 0x7f3e8c06c5a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009fd0 tx=0x7f3e94008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:00.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.368+0000 7f3e9cff9700 1 -- 172.21.15.79:0/2020547654 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f3e98057ed0 con 0x7f3ea00cd270 2023-10-19T08:39:00.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.557+0000 7f3ea6508700 1 -- 172.21.15.79:0/2020547654 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3ea00c8cf0 con 0x7f3ea00cd270 2023-10-19T08:39:00.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.557+0000 7f3e9cff9700 1 -- 172.21.15.79:0/2020547654 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3e980180a0 con 0x7f3ea00cd270 2023-10-19T08:39:00.562 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:39:00.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.559+0000 7f3ea6508700 1 -- 172.21.15.79:0/2020547654 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f3e8c06a0e0 msgr2=0x7f3e8c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.559+0000 7f3ea6508700 1 --2- 172.21.15.79:0/2020547654 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f3e8c06a0e0 0x7f3e8c06c5a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009fd0 tx=0x7f3e94008030 comp rx=0 tx=0).stop 2023-10-19T08:39:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.559+0000 7f3ea6508700 1 -- 172.21.15.79:0/2020547654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ea00cd270 msgr2=0x7f3ea00c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.559+0000 7f3ea6508700 1 --2- 172.21.15.79:0/2020547654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ea00cd270 0x7f3ea00c9040 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009dd0 tx=0x7f3e9800c3a0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.559+0000 7f3ea6508700 1 -- 172.21.15.79:0/2020547654 shutdown_connections 2023-10-19T08:39:00.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.559+0000 7f3ea6508700 1 --2- 172.21.15.79:0/2020547654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ea00cd270 0x7f3ea00c9040 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.559+0000 7f3ea6508700 1 --2- 172.21.15.79:0/2020547654 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ea00703b0 0x7f3ea014d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.560+0000 7f3ea6508700 1 --2- 172.21.15.79:0/2020547654 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f3e8c06a0e0 0x7f3e8c06c5a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.560+0000 7f3ea6508700 1 --2- 172.21.15.79:0/2020547654 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ea00cc2a0 0x7f3ea01f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.560+0000 7f3ea6508700 1 -- 172.21.15.79:0/2020547654 >> 172.21.15.79:0/2020547654 conn(0x7f3ea006dcc0 msgr2=0x7f3ea006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:00.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.560+0000 7f3ea6508700 1 -- 172.21.15.79:0/2020547654 shutdown_connections 2023-10-19T08:39:00.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.560+0000 7f3ea6508700 1 -- 172.21.15.79:0/2020547654 wait complete. 2023-10-19T08:39:00.575 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T08:39:00.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.695+0000 7f434a980700 1 Processor -- start 2023-10-19T08:39:00.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.695+0000 7f434a980700 1 -- start start 2023-10-19T08:39:00.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.695+0000 7f434a980700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f434415e570 0x7f43440d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.695+0000 7f434a980700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43440cb6f0 0x7f43440b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.695+0000 7f434a980700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43440afd60 con 0x7f43440b0a30 2023-10-19T08:39:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.695+0000 7f434a980700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43440b0ec0 con 0x7f434415e570 2023-10-19T08:39:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.695+0000 7f434a980700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43440af810 con 0x7f43440cb6f0 2023-10-19T08:39:00.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4348f1d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f43440b0a30 0x7f43440b15e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57852/0 (socket says 172.21.15.79:57852) 2023-10-19T08:39:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4348f1d700 1 -- 172.21.15.79:0/302701347 learned_addr learned my addr 172.21.15.79:0/302701347 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4342ffd700 1 -- 172.21.15.79:0/302701347 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596650387 0 0) 0x7f43440afd60 con 0x7f43440b0a30 2023-10-19T08:39:00.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4343fff700 1 --2- 172.21.15.79:0/302701347 >> v2:172.21.15.89:3300/0 conn(0x7f434415e570 0x7f43440d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f43437fe700 1 --2- 172.21.15.79:0/302701347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43440cb6f0 0x7f43440b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4342ffd700 1 -- 172.21.15.79:0/302701347 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f432c0035b0 con 0x7f43440b0a30 2023-10-19T08:39:00.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4342ffd700 1 -- 172.21.15.79:0/302701347 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3914721079 0 0) 0x7f432c0035b0 con 0x7f43440b0a30 2023-10-19T08:39:00.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4342ffd700 1 -- 172.21.15.79:0/302701347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43440cb6f0 msgr2=0x7f43440b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:00.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4342ffd700 1 --2- 172.21.15.79:0/302701347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43440cb6f0 0x7f43440b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4342ffd700 1 -- 172.21.15.79:0/302701347 >> v2:172.21.15.89:3300/0 conn(0x7f434415e570 msgr2=0x7f43440d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:00.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4342ffd700 1 --2- 172.21.15.79:0/302701347 >> v2:172.21.15.89:3300/0 conn(0x7f434415e570 0x7f43440d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4342ffd700 1 -- 172.21.15.79:0/302701347 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43440aef70 con 0x7f43440b0a30 2023-10-19T08:39:00.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4342ffd700 1 -- 172.21.15.79:0/302701347 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f433c0019f0 con 0x7f43440b0a30 2023-10-19T08:39:00.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4342ffd700 1 -- 172.21.15.79:0/302701347 >> v1:172.21.15.79:6789/0 conn(0x7f43440b0a30 legacy=0x7f43440b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:00.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4342ffd700 1 --2- 172.21.15.79:0/302701347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f432c003a70 0x7f432c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4342ffd700 1 --2- 172.21.15.79:0/302701347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43440cb6f0 0x7f432c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4342ffd700 1 --2- 172.21.15.79:0/302701347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f432c004d90 0x7f432c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4342ffd700 1 -- 172.21.15.79:0/302701347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43440b0ec0 con 0x7f432c003a70 2023-10-19T08:39:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4342ffd700 1 -- 172.21.15.79:0/302701347 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43440af810 con 0x7f432c004d90 2023-10-19T08:39:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4342ffd700 1 -- 172.21.15.79:0/302701347 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c00ba10 con 0x7f43440cb6f0 2023-10-19T08:39:00.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4343fff700 1 --2- 172.21.15.79:0/302701347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f432c003a70 0x7f432c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f43437fe700 1 --2- 172.21.15.79:0/302701347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43440cb6f0 0x7f432c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.696+0000 7f4348f1d700 1 --2- 172.21.15.79:0/302701347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f432c004d90 0x7f432c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.697+0000 7f4343fff700 1 -- 172.21.15.79:0/302701347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43440cb6f0 msgr2=0x7f432c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.697+0000 7f4343fff700 1 --2- 172.21.15.79:0/302701347 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43440cb6f0 0x7f432c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.697+0000 7f4343fff700 1 -- 172.21.15.79:0/302701347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f432c004d90 msgr2=0x7f432c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:00.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.697+0000 7f4343fff700 1 --2- 172.21.15.79:0/302701347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f432c004d90 0x7f432c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.697+0000 7f4343fff700 1 -- 172.21.15.79:0/302701347 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c0035b0 con 0x7f432c003a70 2023-10-19T08:39:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.697+0000 7f4348f1d700 1 --2- 172.21.15.79:0/302701347 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f432c004d90 0x7f432c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:00.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.697+0000 7f4343fff700 1 --2- 172.21.15.79:0/302701347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f432c003a70 0x7f432c003e90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4334009b60 tx=0x7f432c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ebb0545d5c8c03 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:00.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.697+0000 7f4342ffd700 1 -- 172.21.15.79:0/302701347 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433400e6c0 con 0x7f432c003a70 2023-10-19T08:39:00.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.697+0000 7f4342ffd700 1 -- 172.21.15.79:0/302701347 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433400e820 con 0x7f432c003a70 2023-10-19T08:39:00.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.697+0000 7f4342ffd700 1 -- 172.21.15.79:0/302701347 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433400eb90 con 0x7f432c003a70 2023-10-19T08:39:00.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.697+0000 7f434a980700 1 -- 172.21.15.79:0/302701347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f432c003a70 msgr2=0x7f432c003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:00.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.697+0000 7f434a980700 1 --2- 172.21.15.79:0/302701347 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f432c003a70 0x7f432c003e90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4334009b60 tx=0x7f432c005880 comp rx=0 tx=0).stop 2023-10-19T08:39:00.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.697+0000 7f4348f1d700 1 -- 172.21.15.79:0/302701347 reap_dead start 2023-10-19T08:39:00.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.697+0000 7f434a980700 1 -- 172.21.15.79:0/302701347 shutdown_connections 2023-10-19T08:39:00.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.697+0000 7f434a980700 1 -- 172.21.15.79:0/302701347 >> 172.21.15.79:0/302701347 conn(0x7f434409a0b0 msgr2=0x7f43440d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:00.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.697+0000 7f434a980700 1 -- 172.21.15.79:0/302701347 shutdown_connections 2023-10-19T08:39:00.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.697+0000 7f434a980700 1 -- 172.21.15.79:0/302701347 wait complete. 2023-10-19T08:39:00.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.699+0000 7f434a980700 1 Processor -- start 2023-10-19T08:39:00.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.699+0000 7f434a980700 1 -- start start 2023-10-19T08:39:00.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f434a980700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f432c003a70 0x7f4344157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f434a980700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43441e5260 0x7f4344147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f434a980700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4344157c30 0x7f4344159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f434a980700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43441e4530 con 0x7f4344157c30 2023-10-19T08:39:00.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f434a980700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43441e4dd0 con 0x7f432c003a70 2023-10-19T08:39:00.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f434a980700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43441578d0 con 0x7f43441e5260 2023-10-19T08:39:00.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f4348f1d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4344157c30 0x7f4344159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f4348f1d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4344157c30 0x7f4344159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47792/0 (socket says 172.21.15.79:47792) 2023-10-19T08:39:00.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f4348f1d700 1 -- 172.21.15.79:0/2256530605 learned_addr learned my addr 172.21.15.79:0/2256530605 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:00.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f4343fff700 1 --2- 172.21.15.79:0/2256530605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f432c003a70 0x7f4344157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f43437fe700 1 --2- 172.21.15.79:0/2256530605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43441e5260 0x7f4344147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f4348f1d700 1 -- 172.21.15.79:0/2256530605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43441e5260 msgr2=0x7f4344147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:00.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f4348f1d700 1 --2- 172.21.15.79:0/2256530605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43441e5260 0x7f4344147030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f4348f1d700 1 -- 172.21.15.79:0/2256530605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f432c003a70 msgr2=0x7f4344157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:00.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f4348f1d700 1 --2- 172.21.15.79:0/2256530605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f432c003a70 0x7f4344157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f4348f1d700 1 -- 172.21.15.79:0/2256530605 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4344147570 con 0x7f4344157c30 2023-10-19T08:39:00.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f4348f1d700 1 --2- 172.21.15.79:0/2256530605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4344157c30 0x7f4344159890 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f434408a1d0 tx=0x7f433c0021e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:00.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f4340ff9700 1 -- 172.21.15.79:0/2256530605 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c00bba0 con 0x7f4344157c30 2023-10-19T08:39:00.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f4340ff9700 1 -- 172.21.15.79:0/2256530605 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c00bd20 con 0x7f4344157c30 2023-10-19T08:39:00.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f434a980700 1 -- 172.21.15.79:0/2256530605 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43441581d0 con 0x7f4344157c30 2023-10-19T08:39:00.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f4340ff9700 1 -- 172.21.15.79:0/2256530605 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c007310 con 0x7f4344157c30 2023-10-19T08:39:00.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.700+0000 7f434a980700 1 -- 172.21.15.79:0/2256530605 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43441e4a60 con 0x7f4344157c30 2023-10-19T08:39:00.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.701+0000 7f434a980700 1 -- 172.21.15.79:0/2256530605 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f434404ee70 con 0x7f4344157c30 2023-10-19T08:39:00.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.702+0000 7f4340ff9700 1 -- 172.21.15.79:0/2256530605 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f433c007470 con 0x7f4344157c30 2023-10-19T08:39:00.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.702+0000 7f4340ff9700 1 --2- 172.21.15.79:0/2256530605 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f433006a0e0 0x7f433006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:00.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.702+0000 7f4340ff9700 1 -- 172.21.15.79:0/2256530605 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f433c0887f0 con 0x7f4344157c30 2023-10-19T08:39:00.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.702+0000 7f4343fff700 1 --2- 172.21.15.79:0/2256530605 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f433006a0e0 0x7f433006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:00.729 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.702+0000 7f4343fff700 1 --2- 172.21.15.79:0/2256530605 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f433006a0e0 0x7f433006c5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f43340090b0 tx=0x7f4334008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:00.730 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.706+0000 7f4340ff9700 1 -- 172.21.15.79:0/2256530605 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f433c053c40 con 0x7f4344157c30 2023-10-19T08:39:00.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.896+0000 7f434a980700 1 -- 172.21.15.79:0/2256530605 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f434415c920 con 0x7f4344157c30 2023-10-19T08:39:00.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.896+0000 7f4340ff9700 1 -- 172.21.15.79:0/2256530605 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f433c057260 con 0x7f4344157c30 2023-10-19T08:39:00.900 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:39:00.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.898+0000 7f434a980700 1 -- 172.21.15.79:0/2256530605 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f433006a0e0 msgr2=0x7f433006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:00.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.898+0000 7f434a980700 1 --2- 172.21.15.79:0/2256530605 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f433006a0e0 0x7f433006c5a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f43340090b0 tx=0x7f4334008030 comp rx=0 tx=0).stop 2023-10-19T08:39:00.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.898+0000 7f434a980700 1 -- 172.21.15.79:0/2256530605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4344157c30 msgr2=0x7f4344159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:00.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.898+0000 7f434a980700 1 --2- 172.21.15.79:0/2256530605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4344157c30 0x7f4344159890 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f434408a1d0 tx=0x7f433c0021e0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.898+0000 7f434a980700 1 -- 172.21.15.79:0/2256530605 shutdown_connections 2023-10-19T08:39:00.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.898+0000 7f434a980700 1 --2- 172.21.15.79:0/2256530605 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4344157c30 0x7f4344159890 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.898+0000 7f434a980700 1 --2- 172.21.15.79:0/2256530605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f432c003a70 0x7f4344157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.898+0000 7f434a980700 1 --2- 172.21.15.79:0/2256530605 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f433006a0e0 0x7f433006c5a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.898+0000 7f434a980700 1 --2- 172.21.15.79:0/2256530605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f43441e5260 0x7f4344147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:00.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.898+0000 7f434a980700 1 -- 172.21.15.79:0/2256530605 >> 172.21.15.79:0/2256530605 conn(0x7f434409a0b0 msgr2=0x7f43440b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:00.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.898+0000 7f434a980700 1 -- 172.21.15.79:0/2256530605 shutdown_connections 2023-10-19T08:39:00.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:00.898+0000 7f434a980700 1 -- 172.21.15.79:0/2256530605 wait complete. 2023-10-19T08:39:00.915 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T08:39:01.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.035+0000 7fc53f54e700 1 Processor -- start 2023-10-19T08:39:01.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.035+0000 7fc53f54e700 1 -- start start 2023-10-19T08:39:01.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.036+0000 7fc53f54e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc5380cd270 0x7fc53806a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:01.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.036+0000 7fc53f54e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5380cc2a0 0x7fc53806a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:01.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.036+0000 7fc53f54e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5380b1fe0 con 0x7fc5380703b0 2023-10-19T08:39:01.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.036+0000 7fc53f54e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc538160a80 con 0x7fc5380cd270 2023-10-19T08:39:01.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.036+0000 7fc53f54e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5380ce2b0 con 0x7fc5380cc2a0 2023-10-19T08:39:01.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.036+0000 7fc53d2ea700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc5380cd270 0x7fc53806a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:01.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.036+0000 7fc53cae9700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc5380703b0 0x7fc538160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57868/0 (socket says 172.21.15.79:57868) 2023-10-19T08:39:01.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.036+0000 7fc53d2ea700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc5380cd270 0x7fc53806a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47796/0 (socket says 172.21.15.79:47796) 2023-10-19T08:39:01.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.036+0000 7fc53cae9700 1 -- 172.21.15.79:0/472443196 learned_addr learned my addr 172.21.15.79:0/472443196 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:01.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.036+0000 7fc53daeb700 1 --2- 172.21.15.79:0/472443196 >> v2:172.21.15.89:3300/0 conn(0x7fc5380cc2a0 0x7fc53806a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:01.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.036+0000 7fc53d2ea700 1 -- 172.21.15.79:0/472443196 >> v2:172.21.15.89:3300/0 conn(0x7fc5380cc2a0 msgr2=0x7fc53806a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:01.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.036+0000 7fc53d2ea700 1 --2- 172.21.15.79:0/472443196 >> v2:172.21.15.89:3300/0 conn(0x7fc5380cc2a0 0x7fc53806a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.036+0000 7fc53d2ea700 1 -- 172.21.15.79:0/472443196 >> v1:172.21.15.79:6789/0 conn(0x7fc5380703b0 legacy=0x7fc538160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.036+0000 7fc53d2ea700 1 -- 172.21.15.79:0/472443196 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5380ce550 con 0x7fc5380cd270 2023-10-19T08:39:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.036+0000 7fc52ffff700 1 -- 172.21.15.79:0/472443196 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191279733 0 0) 0x7fc5380b1fe0 con 0x7fc5380703b0 2023-10-19T08:39:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.037+0000 7fc53d2ea700 1 --2- 172.21.15.79:0/472443196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5380cd270 0x7fc53806a220 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc53806b2a0 tx=0x7fc528009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3076599c945ebd server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.037+0000 7fc52ffff700 1 -- 172.21.15.79:0/472443196 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528011830 con 0x7fc5380cd270 2023-10-19T08:39:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.037+0000 7fc52ffff700 1 -- 172.21.15.79:0/472443196 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc528011990 con 0x7fc5380cd270 2023-10-19T08:39:01.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.037+0000 7fc52ffff700 1 -- 172.21.15.79:0/472443196 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528011d20 con 0x7fc5380cd270 2023-10-19T08:39:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.037+0000 7fc53f54e700 1 -- 172.21.15.79:0/472443196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5380cd270 msgr2=0x7fc53806a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.037+0000 7fc53f54e700 1 --2- 172.21.15.79:0/472443196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5380cd270 0x7fc53806a220 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc53806b2a0 tx=0x7fc528009b20 comp rx=0 tx=0).stop 2023-10-19T08:39:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.037+0000 7fc53f54e700 1 -- 172.21.15.79:0/472443196 shutdown_connections 2023-10-19T08:39:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.037+0000 7fc53f54e700 1 --2- 172.21.15.79:0/472443196 >> v2:172.21.15.89:3300/0 conn(0x7fc5380cc2a0 0x7fc53806a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.037+0000 7fc53f54e700 1 --2- 172.21.15.79:0/472443196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5380cd270 0x7fc53806a220 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.037+0000 7fc53f54e700 1 -- 172.21.15.79:0/472443196 >> 172.21.15.79:0/472443196 conn(0x7fc53806dcc0 msgr2=0x7fc53806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:01.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.037+0000 7fc53f54e700 1 -- 172.21.15.79:0/472443196 shutdown_connections 2023-10-19T08:39:01.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.037+0000 7fc53f54e700 1 -- 172.21.15.79:0/472443196 wait complete. 2023-10-19T08:39:01.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.039+0000 7fc53f54e700 1 Processor -- start 2023-10-19T08:39:01.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.039+0000 7fc53f54e700 1 -- start start 2023-10-19T08:39:01.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.039+0000 7fc53f54e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5380703b0 0x7fc53815d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:01.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.039+0000 7fc53f54e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5380cc2a0 0x7fc538160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:01.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.039+0000 7fc53f54e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5380cd270 0x7fc538161100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:01.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.039+0000 7fc53f54e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5380b3a50 con 0x7fc5380703b0 2023-10-19T08:39:01.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.039+0000 7fc53f54e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53815db80 con 0x7fc5380cc2a0 2023-10-19T08:39:01.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.039+0000 7fc53f54e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5380b29f0 con 0x7fc5380cd270 2023-10-19T08:39:01.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.039+0000 7fc53d2ea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5380703b0 0x7fc53815d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:01.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.039+0000 7fc53d2ea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5380703b0 0x7fc53815d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47802/0 (socket says 172.21.15.79:47802) 2023-10-19T08:39:01.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.039+0000 7fc53d2ea700 1 -- 172.21.15.79:0/1667259089 learned_addr learned my addr 172.21.15.79:0/1667259089 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:01.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.040+0000 7fc53cae9700 1 --2- 172.21.15.79:0/1667259089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5380cc2a0 0x7fc538160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:01.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.040+0000 7fc53daeb700 1 --2- 172.21.15.79:0/1667259089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5380cd270 0x7fc538161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:01.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.040+0000 7fc53d2ea700 1 -- 172.21.15.79:0/1667259089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5380cd270 msgr2=0x7fc538161100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:01.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.040+0000 7fc53d2ea700 1 --2- 172.21.15.79:0/1667259089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5380cd270 0x7fc538161100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.040+0000 7fc53d2ea700 1 -- 172.21.15.79:0/1667259089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5380cc2a0 msgr2=0x7fc538160bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:01.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.040+0000 7fc53d2ea700 1 --2- 172.21.15.79:0/1667259089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5380cc2a0 0x7fc538160bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.040+0000 7fc53d2ea700 1 -- 172.21.15.79:0/1667259089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5280094a0 con 0x7fc5380703b0 2023-10-19T08:39:01.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.040+0000 7fc53cae9700 1 --2- 172.21.15.79:0/1667259089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5380cc2a0 0x7fc538160bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:01.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.040+0000 7fc53d2ea700 1 --2- 172.21.15.79:0/1667259089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5380703b0 0x7fc53815d640 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc5280090b0 tx=0x7fc528004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:01.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.040+0000 7fc52dffb700 1 -- 172.21.15.79:0/1667259089 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5280038a0 con 0x7fc5380703b0 2023-10-19T08:39:01.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.040+0000 7fc52dffb700 1 -- 172.21.15.79:0/1667259089 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52801f070 con 0x7fc5380703b0 2023-10-19T08:39:01.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.040+0000 7fc53f54e700 1 -- 172.21.15.79:0/1667259089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5380b2c90 con 0x7fc5380703b0 2023-10-19T08:39:01.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.040+0000 7fc52dffb700 1 -- 172.21.15.79:0/1667259089 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc528003c20 con 0x7fc5380703b0 2023-10-19T08:39:01.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.040+0000 7fc53f54e700 1 -- 172.21.15.79:0/1667259089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5380b3250 con 0x7fc5380703b0 2023-10-19T08:39:01.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.041+0000 7fc53f54e700 1 -- 172.21.15.79:0/1667259089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc538066b10 con 0x7fc5380703b0 2023-10-19T08:39:01.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.042+0000 7fc52dffb700 1 -- 172.21.15.79:0/1667259089 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc528026480 con 0x7fc5380703b0 2023-10-19T08:39:01.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.042+0000 7fc52dffb700 1 --2- 172.21.15.79:0/1667259089 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc51c06a0e0 0x7fc51c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:01.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.042+0000 7fc52dffb700 1 -- 172.21.15.79:0/1667259089 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc528021070 con 0x7fc5380703b0 2023-10-19T08:39:01.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.042+0000 7fc53cae9700 1 --2- 172.21.15.79:0/1667259089 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc51c06a0e0 0x7fc51c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:01.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.042+0000 7fc53cae9700 1 --2- 172.21.15.79:0/1667259089 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc51c06a0e0 0x7fc51c06c5a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc534000f60 tx=0x7fc534007d30 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:01.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.046+0000 7fc52dffb700 1 -- 172.21.15.79:0/1667259089 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc5280556b0 con 0x7fc5380703b0 2023-10-19T08:39:01.110 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-19T08:39:01.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-19T08:39:01.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.240+0000 7fc53f54e700 1 -- 172.21.15.79:0/1667259089 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc53806fbf0 con 0x7fc5380703b0 2023-10-19T08:39:01.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.240+0000 7fc52dffb700 1 -- 172.21.15.79:0/1667259089 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc528058cd0 con 0x7fc5380703b0 2023-10-19T08:39:01.244 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-19T08:39:01.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.242+0000 7fc53f54e700 1 -- 172.21.15.79:0/1667259089 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc51c06a0e0 msgr2=0x7fc51c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:01.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.242+0000 7fc53f54e700 1 --2- 172.21.15.79:0/1667259089 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc51c06a0e0 0x7fc51c06c5a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc534000f60 tx=0x7fc534007d30 comp rx=0 tx=0).stop 2023-10-19T08:39:01.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.242+0000 7fc53f54e700 1 -- 172.21.15.79:0/1667259089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5380703b0 msgr2=0x7fc53815d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:01.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.242+0000 7fc53f54e700 1 --2- 172.21.15.79:0/1667259089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5380703b0 0x7fc53815d640 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc5280090b0 tx=0x7fc528004750 comp rx=0 tx=0).stop 2023-10-19T08:39:01.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.242+0000 7fc53f54e700 1 -- 172.21.15.79:0/1667259089 shutdown_connections 2023-10-19T08:39:01.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.242+0000 7fc53f54e700 1 --2- 172.21.15.79:0/1667259089 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc51c06a0e0 0x7fc51c06c5a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.242+0000 7fc53f54e700 1 --2- 172.21.15.79:0/1667259089 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5380cd270 0x7fc538161100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.242+0000 7fc53f54e700 1 --2- 172.21.15.79:0/1667259089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5380703b0 0x7fc53815d640 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.242+0000 7fc53f54e700 1 --2- 172.21.15.79:0/1667259089 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5380cc2a0 0x7fc538160bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.242+0000 7fc53f54e700 1 -- 172.21.15.79:0/1667259089 >> 172.21.15.79:0/1667259089 conn(0x7fc53806dcc0 msgr2=0x7fc53806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:01.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.242+0000 7fc53f54e700 1 -- 172.21.15.79:0/1667259089 shutdown_connections 2023-10-19T08:39:01.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.243+0000 7fc53f54e700 1 -- 172.21.15.79:0/1667259089 wait complete. 2023-10-19T08:39:01.258 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T08:39:01.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.380+0000 7f2087dff700 1 Processor -- start 2023-10-19T08:39:01.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.380+0000 7f2087dff700 1 -- start start 2023-10-19T08:39:01.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.381+0000 7f2087dff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f20800cc640 0x7f20800cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:01.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.381+0000 7f2087dff700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20800b24d0 con 0x7f2080159db0 2023-10-19T08:39:01.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.381+0000 7f2087dff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20800ccf60 con 0x7f20800ceaf0 2023-10-19T08:39:01.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.381+0000 7f2087dff700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f208015d760 con 0x7f20800cc640 2023-10-19T08:39:01.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.381+0000 7f2085b9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f20800cc640 0x7f20800cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:01.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.381+0000 7f208539a700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2080159db0 0x7f20800b16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57884/0 (socket says 172.21.15.79:57884) 2023-10-19T08:39:01.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.381+0000 7f208539a700 1 -- 172.21.15.79:0/1500281964 learned_addr learned my addr 172.21.15.79:0/1500281964 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:01.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.381+0000 7f2085b9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f20800cc640 0x7f20800cca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47810/0 (socket says 172.21.15.79:47810) 2023-10-19T08:39:01.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.381+0000 7f2085b9b700 1 -- 172.21.15.79:0/1500281964 >> v1:172.21.15.89:6789/0 conn(0x7f20800ceaf0 legacy=0x7f20800b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:01.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.381+0000 7f2085b9b700 1 -- 172.21.15.79:0/1500281964 >> v1:172.21.15.79:6789/0 conn(0x7f2080159db0 legacy=0x7f20800b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:01.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.381+0000 7f2084b99700 1 -- 172.21.15.79:0/1500281964 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193764451 0 0) 0x7f20800b24d0 con 0x7f2080159db0 2023-10-19T08:39:01.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.381+0000 7f2085b9b700 1 -- 172.21.15.79:0/1500281964 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208015da40 con 0x7f20800cc640 2023-10-19T08:39:01.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.381+0000 7f2085b9b700 1 --2- 172.21.15.79:0/1500281964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20800cc640 0x7f20800cca20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f207c009840 tx=0x7f207c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce07af89fd0fbfb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:01.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.381+0000 7f2084b99700 1 -- 172.21.15.79:0/1500281964 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c004230 con 0x7f20800cc640 2023-10-19T08:39:01.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.381+0000 7f2084b99700 1 -- 172.21.15.79:0/1500281964 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207c004390 con 0x7f20800cc640 2023-10-19T08:39:01.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.381+0000 7f2084b99700 1 -- 172.21.15.79:0/1500281964 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c0036a0 con 0x7f20800cc640 2023-10-19T08:39:01.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.382+0000 7f2087dff700 1 -- 172.21.15.79:0/1500281964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20800cc640 msgr2=0x7f20800cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:01.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.382+0000 7f2087dff700 1 --2- 172.21.15.79:0/1500281964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20800cc640 0x7f20800cca20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f207c009840 tx=0x7f207c009b50 comp rx=0 tx=0).stop 2023-10-19T08:39:01.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.382+0000 7f2087dff700 1 -- 172.21.15.79:0/1500281964 shutdown_connections 2023-10-19T08:39:01.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.382+0000 7f2087dff700 1 --2- 172.21.15.79:0/1500281964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20800cc640 0x7f20800cca20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.382+0000 7f2087dff700 1 -- 172.21.15.79:0/1500281964 >> 172.21.15.79:0/1500281964 conn(0x7f208006dcc0 msgr2=0x7f208006e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:01.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.382+0000 7f2087dff700 1 -- 172.21.15.79:0/1500281964 shutdown_connections 2023-10-19T08:39:01.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.382+0000 7f2087dff700 1 -- 172.21.15.79:0/1500281964 wait complete. 2023-10-19T08:39:01.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.383+0000 7f2087dff700 1 Processor -- start 2023-10-19T08:39:01.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.383+0000 7f2087dff700 1 -- start start 2023-10-19T08:39:01.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.384+0000 7f2087dff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20800cc640 0x7f20801527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:01.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.384+0000 7f2087dff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20800ceaf0 0x7f20801f2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:01.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.384+0000 7f2087dff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2080159db0 0x7f20800c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:01.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.384+0000 7f2087dff700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2080152d10 con 0x7f20800ceaf0 2023-10-19T08:39:01.399 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.384+0000 7f2087dff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20800c6740 con 0x7f20800cc640 2023-10-19T08:39:01.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.384+0000 7f2087dff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208015b450 con 0x7f2080159db0 2023-10-19T08:39:01.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.384+0000 7f208539a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20800ceaf0 0x7f20801f2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:01.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.384+0000 7f208539a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20800ceaf0 0x7f20801f2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47816/0 (socket says 172.21.15.79:47816) 2023-10-19T08:39:01.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.384+0000 7f208539a700 1 -- 172.21.15.79:0/3090538016 learned_addr learned my addr 172.21.15.79:0/3090538016 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:01.400 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.384+0000 7f208539a700 1 -- 172.21.15.79:0/3090538016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2080159db0 msgr2=0x7f20800c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:01.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.384+0000 7f208539a700 1 --2- 172.21.15.79:0/3090538016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2080159db0 0x7f20800c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.384+0000 7f208539a700 1 -- 172.21.15.79:0/3090538016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20800cc640 msgr2=0x7f20801527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:01.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.384+0000 7f208539a700 1 --2- 172.21.15.79:0/3090538016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20800cc640 0x7f20801527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.384+0000 7f208539a700 1 -- 172.21.15.79:0/3090538016 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c0094a0 con 0x7f20800ceaf0 2023-10-19T08:39:01.401 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.384+0000 7f208539a700 1 --2- 172.21.15.79:0/3090538016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20800ceaf0 0x7f20801f2d40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f20700011e0 tx=0x7f207000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:01.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.385+0000 7f20767fc700 1 -- 172.21.15.79:0/3090538016 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2070004c80 con 0x7f20800ceaf0 2023-10-19T08:39:01.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.385+0000 7f20767fc700 1 -- 172.21.15.79:0/3090538016 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2070004e00 con 0x7f20800ceaf0 2023-10-19T08:39:01.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.385+0000 7f2087dff700 1 -- 172.21.15.79:0/3090538016 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f208015b730 con 0x7f20800ceaf0 2023-10-19T08:39:01.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.385+0000 7f20767fc700 1 -- 172.21.15.79:0/3090538016 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2070007310 con 0x7f20800ceaf0 2023-10-19T08:39:01.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.385+0000 7f2087dff700 1 -- 172.21.15.79:0/3090538016 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208015bcf0 con 0x7f20800ceaf0 2023-10-19T08:39:01.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.386+0000 7f2087dff700 1 -- 172.21.15.79:0/3090538016 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20800cada0 con 0x7f20800ceaf0 2023-10-19T08:39:01.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.386+0000 7f20767fc700 1 -- 172.21.15.79:0/3090538016 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2070007470 con 0x7f20800ceaf0 2023-10-19T08:39:01.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.386+0000 7f20767fc700 1 --2- 172.21.15.79:0/3090538016 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f206406a0e0 0x7f206406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:01.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.386+0000 7f20767fc700 1 -- 172.21.15.79:0/3090538016 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2070088540 con 0x7f20800ceaf0 2023-10-19T08:39:01.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.386+0000 7f2085b9b700 1 --2- 172.21.15.79:0/3090538016 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f206406a0e0 0x7f206406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:01.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.387+0000 7f2085b9b700 1 --2- 172.21.15.79:0/3090538016 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f206406a0e0 0x7f206406c5a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f207c0090b0 tx=0x7f207c013040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:01.404 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.391+0000 7f20767fc700 1 -- 172.21.15.79:0/3090538016 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2070053990 con 0x7f20800ceaf0 2023-10-19T08:39:01.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.581+0000 7f2087dff700 1 -- 172.21.15.79:0/3090538016 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f208004ee70 con 0x7f20800ceaf0 2023-10-19T08:39:01.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.581+0000 7f20767fc700 1 -- 172.21.15.79:0/3090538016 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2070056fb0 con 0x7f20800ceaf0 2023-10-19T08:39:01.585 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:39:01.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.583+0000 7f2087dff700 1 -- 172.21.15.79:0/3090538016 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f206406a0e0 msgr2=0x7f206406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:01.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.583+0000 7f2087dff700 1 --2- 172.21.15.79:0/3090538016 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f206406a0e0 0x7f206406c5a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f207c0090b0 tx=0x7f207c013040 comp rx=0 tx=0).stop 2023-10-19T08:39:01.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.583+0000 7f2087dff700 1 -- 172.21.15.79:0/3090538016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20800ceaf0 msgr2=0x7f20801f2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:01.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.583+0000 7f2087dff700 1 --2- 172.21.15.79:0/3090538016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20800ceaf0 0x7f20801f2d40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f20700011e0 tx=0x7f207000cae0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.583+0000 7f2087dff700 1 -- 172.21.15.79:0/3090538016 shutdown_connections 2023-10-19T08:39:01.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.583+0000 7f2087dff700 1 --2- 172.21.15.79:0/3090538016 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f206406a0e0 0x7f206406c5a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.583+0000 7f2087dff700 1 --2- 172.21.15.79:0/3090538016 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2080159db0 0x7f20800c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.583+0000 7f2087dff700 1 --2- 172.21.15.79:0/3090538016 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20800cc640 0x7f20801527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.583+0000 7f2087dff700 1 --2- 172.21.15.79:0/3090538016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20800ceaf0 0x7f20801f2d40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.583+0000 7f2087dff700 1 -- 172.21.15.79:0/3090538016 >> 172.21.15.79:0/3090538016 conn(0x7f208006dcc0 msgr2=0x7f20800d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:01.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.583+0000 7f2087dff700 1 -- 172.21.15.79:0/3090538016 shutdown_connections 2023-10-19T08:39:01.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.583+0000 7f2087dff700 1 -- 172.21.15.79:0/3090538016 wait complete. 2023-10-19T08:39:01.599 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-19T08:39:01.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.717+0000 7f915c246700 1 Processor -- start 2023-10-19T08:39:01.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.717+0000 7f915c246700 1 -- start start 2023-10-19T08:39:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.718+0000 7f915c246700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f91540af170 0x7f91540cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.718+0000 7f915c246700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f91540b2270 0x7f915406a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.718+0000 7f915c246700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915415de50 con 0x7f91540b1de0 2023-10-19T08:39:01.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.718+0000 7f915c246700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91540af550 con 0x7f91540b2270 2023-10-19T08:39:01.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.718+0000 7f915c246700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91540b26c0 con 0x7f91540af170 2023-10-19T08:39:01.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.718+0000 7f915a7e3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f91540b2270 0x7f915406a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:01.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.718+0000 7f91597e1700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f91540b1de0 0x7f91540cd800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57896/0 (socket says 172.21.15.79:57896) 2023-10-19T08:39:01.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.718+0000 7f91597e1700 1 -- 172.21.15.79:0/1049687935 learned_addr learned my addr 172.21.15.79:0/1049687935 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:01.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.718+0000 7f9159fe2700 1 --2- 172.21.15.79:0/1049687935 >> v2:172.21.15.89:3300/0 conn(0x7f91540af170 0x7f91540cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:01.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.718+0000 7f9158fe0700 1 -- 172.21.15.79:0/1049687935 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284103559 0 0) 0x7f915415de50 con 0x7f91540b1de0 2023-10-19T08:39:01.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.718+0000 7f9158fe0700 1 -- 172.21.15.79:0/1049687935 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91400035b0 con 0x7f91540b1de0 2023-10-19T08:39:01.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.718+0000 7f915a7e3700 1 -- 172.21.15.79:0/1049687935 >> v2:172.21.15.89:3300/0 conn(0x7f91540af170 msgr2=0x7f91540cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:01.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.718+0000 7f915a7e3700 1 --2- 172.21.15.79:0/1049687935 >> v2:172.21.15.89:3300/0 conn(0x7f91540af170 0x7f91540cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.718+0000 7f915a7e3700 1 -- 172.21.15.79:0/1049687935 >> v1:172.21.15.79:6789/0 conn(0x7f91540b1de0 legacy=0x7f91540cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:01.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.718+0000 7f915a7e3700 1 -- 172.21.15.79:0/1049687935 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915415e130 con 0x7f91540b2270 2023-10-19T08:39:01.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.718+0000 7f9159fe2700 1 --2- 172.21.15.79:0/1049687935 >> v2:172.21.15.89:3300/0 conn(0x7f91540af170 0x7f91540cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:01.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.718+0000 7f915a7e3700 1 --2- 172.21.15.79:0/1049687935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91540b2270 0x7f915406a220 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f914c009d90 tx=0x7f914c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5079895b749a43e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:01.726 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.719+0000 7f9158fe0700 1 -- 172.21.15.79:0/1049687935 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c00e070 con 0x7f91540b2270 2023-10-19T08:39:01.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.719+0000 7f9158fe0700 1 -- 172.21.15.79:0/1049687935 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c00bae0 con 0x7f91540b2270 2023-10-19T08:39:01.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.719+0000 7f9158fe0700 1 -- 172.21.15.79:0/1049687935 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c00be90 con 0x7f91540b2270 2023-10-19T08:39:01.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.719+0000 7f915c246700 1 -- 172.21.15.79:0/1049687935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91540b2270 msgr2=0x7f915406a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:01.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.719+0000 7f915c246700 1 --2- 172.21.15.79:0/1049687935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91540b2270 0x7f915406a220 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f914c009d90 tx=0x7f914c00b330 comp rx=0 tx=0).stop 2023-10-19T08:39:01.727 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.719+0000 7f915c246700 1 -- 172.21.15.79:0/1049687935 shutdown_connections 2023-10-19T08:39:01.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.719+0000 7f915c246700 1 --2- 172.21.15.79:0/1049687935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91540b2270 0x7f915406a220 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.719+0000 7f915c246700 1 --2- 172.21.15.79:0/1049687935 >> v2:172.21.15.89:3300/0 conn(0x7f91540af170 0x7f91540cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.719+0000 7f915c246700 1 -- 172.21.15.79:0/1049687935 >> 172.21.15.79:0/1049687935 conn(0x7f915406dcc0 msgr2=0x7f915406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:01.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.719+0000 7f915c246700 1 -- 172.21.15.79:0/1049687935 shutdown_connections 2023-10-19T08:39:01.728 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.719+0000 7f915c246700 1 -- 172.21.15.79:0/1049687935 wait complete. 2023-10-19T08:39:01.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.720+0000 7f915c246700 1 Processor -- start 2023-10-19T08:39:01.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.720+0000 7f915c246700 1 -- start start 2023-10-19T08:39:01.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.721+0000 7f915c246700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91540af170 0x7f915415b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:01.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.721+0000 7f915c246700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91540b1de0 0x7f91540b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:01.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.721+0000 7f915c246700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91540b2270 0x7f91540b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:01.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.721+0000 7f915c246700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91540ad8f0 con 0x7f91540b2270 2023-10-19T08:39:01.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.721+0000 7f915c246700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91540b3210 con 0x7f91540af170 2023-10-19T08:39:01.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.721+0000 7f915c246700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91540b4f20 con 0x7f91540b1de0 2023-10-19T08:39:01.732 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.721+0000 7f915a7e3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91540b2270 0x7f91540b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:01.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.721+0000 7f915a7e3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91540b2270 0x7f91540b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47834/0 (socket says 172.21.15.79:47834) 2023-10-19T08:39:01.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.721+0000 7f915a7e3700 1 -- 172.21.15.79:0/2282985858 learned_addr learned my addr 172.21.15.79:0/2282985858 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:01.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.721+0000 7f9159fe2700 1 --2- 172.21.15.79:0/2282985858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91540af170 0x7f915415b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:01.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.721+0000 7f91597e1700 1 --2- 172.21.15.79:0/2282985858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91540b1de0 0x7f91540b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:01.733 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.722+0000 7f915a7e3700 1 -- 172.21.15.79:0/2282985858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91540b1de0 msgr2=0x7f91540b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:01.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.722+0000 7f915a7e3700 1 --2- 172.21.15.79:0/2282985858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91540b1de0 0x7f91540b3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.722+0000 7f915a7e3700 1 -- 172.21.15.79:0/2282985858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91540af170 msgr2=0x7f915415b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:01.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.722+0000 7f915a7e3700 1 --2- 172.21.15.79:0/2282985858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91540af170 0x7f915415b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.722+0000 7f915a7e3700 1 -- 172.21.15.79:0/2282985858 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c009a70 con 0x7f91540b2270 2023-10-19T08:39:01.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.722+0000 7f915a7e3700 1 --2- 172.21.15.79:0/2282985858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91540b2270 0x7f91540b4160 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f914c014040 tx=0x7f914c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:01.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.722+0000 7f914a7fc700 1 -- 172.21.15.79:0/2282985858 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c004730 con 0x7f91540b2270 2023-10-19T08:39:01.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.722+0000 7f914a7fc700 1 -- 172.21.15.79:0/2282985858 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f914c020070 con 0x7f91540b2270 2023-10-19T08:39:01.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.722+0000 7f915c246700 1 -- 172.21.15.79:0/2282985858 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91540b51c0 con 0x7f91540b2270 2023-10-19T08:39:01.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.722+0000 7f914a7fc700 1 -- 172.21.15.79:0/2282985858 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914c027480 con 0x7f91540b2270 2023-10-19T08:39:01.735 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.722+0000 7f915c246700 1 -- 172.21.15.79:0/2282985858 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91540b3420 con 0x7f91540b2270 2023-10-19T08:39:01.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.723+0000 7f915c246700 1 -- 172.21.15.79:0/2282985858 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f915404ee70 con 0x7f91540b2270 2023-10-19T08:39:01.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.723+0000 7f914a7fc700 1 -- 172.21.15.79:0/2282985858 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f914c012430 con 0x7f91540b2270 2023-10-19T08:39:01.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.724+0000 7f914a7fc700 1 --2- 172.21.15.79:0/2282985858 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f913806a0e0 0x7f913806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:01.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.724+0000 7f914a7fc700 1 -- 172.21.15.79:0/2282985858 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f914c022070 con 0x7f91540b2270 2023-10-19T08:39:01.736 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.724+0000 7f9159fe2700 1 --2- 172.21.15.79:0/2282985858 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f913806a0e0 0x7f913806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:01.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.724+0000 7f9159fe2700 1 --2- 172.21.15.79:0/2282985858 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f913806a0e0 0x7f913806c5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9150009930 tx=0x7f9150008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:01.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.728+0000 7f914a7fc700 1 -- 172.21.15.79:0/2282985858 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f914c059960 con 0x7f91540b2270 2023-10-19T08:39:01.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.931+0000 7f915c246700 1 -- 172.21.15.79:0/2282985858 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f915406b110 con 0x7f91540b2270 2023-10-19T08:39:01.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.932+0000 7f914a7fc700 1 -- 172.21.15.79:0/2282985858 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f914c0594f0 con 0x7f91540b2270 2023-10-19T08:39:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.934+0000 7f915c246700 1 -- 172.21.15.79:0/2282985858 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f913806a0e0 msgr2=0x7f913806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:01.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.934+0000 7f915c246700 1 --2- 172.21.15.79:0/2282985858 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f913806a0e0 0x7f913806c5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9150009930 tx=0x7f9150008040 comp rx=0 tx=0).stop 2023-10-19T08:39:01.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.934+0000 7f915c246700 1 -- 172.21.15.79:0/2282985858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91540b2270 msgr2=0x7f91540b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:01.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.934+0000 7f915c246700 1 --2- 172.21.15.79:0/2282985858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91540b2270 0x7f91540b4160 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f914c014040 tx=0x7f914c004ad0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.934+0000 7f915c246700 1 -- 172.21.15.79:0/2282985858 shutdown_connections 2023-10-19T08:39:01.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.934+0000 7f915c246700 1 --2- 172.21.15.79:0/2282985858 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f91540b2270 0x7f91540b4160 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.934+0000 7f915c246700 1 --2- 172.21.15.79:0/2282985858 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91540af170 0x7f915415b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.934+0000 7f915c246700 1 --2- 172.21.15.79:0/2282985858 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f913806a0e0 0x7f913806c5a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.934+0000 7f915c246700 1 --2- 172.21.15.79:0/2282985858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f91540b1de0 0x7f91540b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:01.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.934+0000 7f915c246700 1 -- 172.21.15.79:0/2282985858 >> 172.21.15.79:0/2282985858 conn(0x7f915406dcc0 msgr2=0x7f91540afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:01.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.934+0000 7f915c246700 1 -- 172.21.15.79:0/2282985858 shutdown_connections 2023-10-19T08:39:01.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:01.934+0000 7f915c246700 1 -- 172.21.15.79:0/2282985858 wait complete. 2023-10-19T08:39:01.940 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2023-10-19T08:39:01.950 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2023-10-19T08:39:01.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:01.951 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-19T08:39:01.985 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:39:01.986 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-10-19T08:39:01.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:01.986 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-19T08:39:02.042 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:39:02.042 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T08:39:02.063 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:39:02.063 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T08:39:02.122 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:39:02.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.239+0000 7f3507c1f700 1 Processor -- start 2023-10-19T08:39:02.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.239+0000 7f3507c1f700 1 -- start start 2023-10-19T08:39:02.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.240+0000 7f3507c1f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35000cd0c0 0x7f35000cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:02.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.240+0000 7f3507c1f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f35000cdd40 0x7f350006a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:02.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.240+0000 7f3507c1f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35000cd520 con 0x7f35000af170 2023-10-19T08:39:02.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.240+0000 7f3507c1f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35000af550 con 0x7f35000cdd40 2023-10-19T08:39:02.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.240+0000 7f3507c1f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35000b16b0 con 0x7f35000cd0c0 2023-10-19T08:39:02.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.241+0000 7f35051ba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35000cd0c0 0x7f35000cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:02.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.241+0000 7f35061bc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f35000cdd40 0x7f350006a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:02.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.241+0000 7f35051ba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35000cd0c0 0x7f35000cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:50464/0 (socket says 172.21.15.79:50464) 2023-10-19T08:39:02.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.241+0000 7f35051ba700 1 -- 172.21.15.79:0/3811780670 learned_addr learned my addr 172.21.15.79:0/3811780670 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:02.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.241+0000 7f35061bc700 1 -- 172.21.15.79:0/3811780670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35000cd0c0 msgr2=0x7f35000cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:02.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.241+0000 7f35061bc700 1 --2- 172.21.15.79:0/3811780670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35000cd0c0 0x7f35000cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.241+0000 7f35061bc700 1 -- 172.21.15.79:0/3811780670 >> v1:172.21.15.89:6789/0 conn(0x7f35000af170 legacy=0x7f35000b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:02.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.241+0000 7f35061bc700 1 -- 172.21.15.79:0/3811780670 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350015de50 con 0x7f35000cdd40 2023-10-19T08:39:02.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.241+0000 7f35061bc700 1 --2- 172.21.15.79:0/3811780670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35000cdd40 0x7f350006a220 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009d90 tx=0x7f34f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76ff1cc7717a2a79 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:02.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.241+0000 7f35049b9700 1 -- 172.21.15.79:0/3811780670 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f800e070 con 0x7f35000cdd40 2023-10-19T08:39:02.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.241+0000 7f35049b9700 1 -- 172.21.15.79:0/3811780670 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f800bb20 con 0x7f35000cdd40 2023-10-19T08:39:02.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.241+0000 7f35049b9700 1 -- 172.21.15.79:0/3811780670 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f8012430 con 0x7f35000cdd40 2023-10-19T08:39:02.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.242+0000 7f3507c1f700 1 -- 172.21.15.79:0/3811780670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35000cdd40 msgr2=0x7f350006a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:02.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.242+0000 7f3507c1f700 1 --2- 172.21.15.79:0/3811780670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35000cdd40 0x7f350006a220 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009d90 tx=0x7f34f800b330 comp rx=0 tx=0).stop 2023-10-19T08:39:02.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.242+0000 7f3507c1f700 1 -- 172.21.15.79:0/3811780670 shutdown_connections 2023-10-19T08:39:02.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.242+0000 7f3507c1f700 1 --2- 172.21.15.79:0/3811780670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35000cdd40 0x7f350006a220 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.242+0000 7f3507c1f700 1 --2- 172.21.15.79:0/3811780670 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35000cd0c0 0x7f35000cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.242+0000 7f3507c1f700 1 -- 172.21.15.79:0/3811780670 >> 172.21.15.79:0/3811780670 conn(0x7f350006dcc0 msgr2=0x7f350006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:02.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.242+0000 7f3507c1f700 1 -- 172.21.15.79:0/3811780670 shutdown_connections 2023-10-19T08:39:02.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.242+0000 7f3507c1f700 1 -- 172.21.15.79:0/3811780670 wait complete. 2023-10-19T08:39:02.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.243+0000 7f3507c1f700 1 Processor -- start 2023-10-19T08:39:02.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.243+0000 7f3507c1f700 1 -- start start 2023-10-19T08:39:02.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.244+0000 7f3507c1f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35000af170 0x7f35000c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:02.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.244+0000 7f3507c1f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35000cd0c0 0x7f35001e8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:02.253 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.244+0000 7f3507c1f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35000cdd40 0x7f35001e8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:02.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.244+0000 7f3507c1f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35001e91e0 con 0x7f35000af170 2023-10-19T08:39:02.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.244+0000 7f3507c1f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3500157940 con 0x7f35000cdd40 2023-10-19T08:39:02.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.244+0000 7f3507c1f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35000c3900 con 0x7f35000cd0c0 2023-10-19T08:39:02.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.244+0000 7f35059bb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35000af170 0x7f35000c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:02.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.244+0000 7f35059bb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35000af170 0x7f35000c92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47844/0 (socket says 172.21.15.79:47844) 2023-10-19T08:39:02.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.244+0000 7f35059bb700 1 -- 172.21.15.79:0/3824537346 learned_addr learned my addr 172.21.15.79:0/3824537346 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:02.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.244+0000 7f35051ba700 1 --2- 172.21.15.79:0/3824537346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35000cd0c0 0x7f35001e8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:02.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.244+0000 7f35061bc700 1 --2- 172.21.15.79:0/3824537346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35000cdd40 0x7f35001e8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:02.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.244+0000 7f35059bb700 1 -- 172.21.15.79:0/3824537346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35000cd0c0 msgr2=0x7f35001e8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:02.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.244+0000 7f35059bb700 1 --2- 172.21.15.79:0/3824537346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35000cd0c0 0x7f35001e8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.244+0000 7f35059bb700 1 -- 172.21.15.79:0/3824537346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35000cdd40 msgr2=0x7f35001e8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:02.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.244+0000 7f35059bb700 1 --2- 172.21.15.79:0/3824537346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35000cdd40 0x7f35001e8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.244+0000 7f35059bb700 1 -- 172.21.15.79:0/3824537346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f8009a70 con 0x7f35000af170 2023-10-19T08:39:02.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.245+0000 7f35059bb700 1 --2- 172.21.15.79:0/3824537346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35000af170 0x7f35000c92a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f34f000c510 tx=0x7f34f000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:02.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.245+0000 7f34f67fc700 1 -- 172.21.15.79:0/3824537346 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f00052d0 con 0x7f35000af170 2023-10-19T08:39:02.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.245+0000 7f34f67fc700 1 -- 172.21.15.79:0/3824537346 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f0005430 con 0x7f35000af170 2023-10-19T08:39:02.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.245+0000 7f34f67fc700 1 -- 172.21.15.79:0/3824537346 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f00038c0 con 0x7f35000af170 2023-10-19T08:39:02.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.245+0000 7f3507c1f700 1 -- 172.21.15.79:0/3824537346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35000c3be0 con 0x7f35000af170 2023-10-19T08:39:02.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.245+0000 7f3507c1f700 1 -- 172.21.15.79:0/3824537346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35000c41a0 con 0x7f35000af170 2023-10-19T08:39:02.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.246+0000 7f3507c1f700 1 -- 172.21.15.79:0/3824537346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350004ee70 con 0x7f35000af170 2023-10-19T08:39:02.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.246+0000 7f34f67fc700 1 -- 172.21.15.79:0/3824537346 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f34f0003a20 con 0x7f35000af170 2023-10-19T08:39:02.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.247+0000 7f34f67fc700 1 --2- 172.21.15.79:0/3824537346 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f34e406a0e0 0x7f34e406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:02.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.247+0000 7f35051ba700 1 --2- 172.21.15.79:0/3824537346 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f34e406a0e0 0x7f34e406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:02.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.247+0000 7f34f67fc700 1 -- 172.21.15.79:0/3824537346 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f34f0087cd0 con 0x7f35000af170 2023-10-19T08:39:02.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.247+0000 7f35051ba700 1 --2- 172.21.15.79:0/3824537346 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f34e406a0e0 0x7f34e406c5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f35001e9880 tx=0x7f34fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:02.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.251+0000 7f34f67fc700 1 -- 172.21.15.79:0/3824537346 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f34f0053120 con 0x7f35000af170 2023-10-19T08:39:02.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.443+0000 7f3507c1f700 1 -- 172.21.15.79:0/3824537346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35000b5940 con 0x7f35000af170 2023-10-19T08:39:02.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.444+0000 7f34f67fc700 1 -- 172.21.15.79:0/3824537346 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20155 (secure 0 0 0) 0x7f34f0073ed0 con 0x7f35000af170 2023-10-19T08:39:02.448 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:02.448 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:44.473795+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:39:02.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.446+0000 7f3507c1f700 1 -- 172.21.15.79:0/3824537346 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f34e406a0e0 msgr2=0x7f34e406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:02.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.446+0000 7f3507c1f700 1 --2- 172.21.15.79:0/3824537346 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f34e406a0e0 0x7f34e406c5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f35001e9880 tx=0x7f34fc008040 comp rx=0 tx=0).stop 2023-10-19T08:39:02.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.446+0000 7f3507c1f700 1 -- 172.21.15.79:0/3824537346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35000af170 msgr2=0x7f35000c92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:02.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.446+0000 7f3507c1f700 1 --2- 172.21.15.79:0/3824537346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35000af170 0x7f35000c92a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f34f000c510 tx=0x7f34f000c8d0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.446+0000 7f3507c1f700 1 -- 172.21.15.79:0/3824537346 shutdown_connections 2023-10-19T08:39:02.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.446+0000 7f3507c1f700 1 --2- 172.21.15.79:0/3824537346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35000cdd40 0x7f35001e8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.446+0000 7f3507c1f700 1 --2- 172.21.15.79:0/3824537346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f35000af170 0x7f35000c92a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.446+0000 7f3507c1f700 1 --2- 172.21.15.79:0/3824537346 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f34e406a0e0 0x7f34e406c5a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.446+0000 7f3507c1f700 1 --2- 172.21.15.79:0/3824537346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35000cd0c0 0x7f35001e8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.446+0000 7f3507c1f700 1 -- 172.21.15.79:0/3824537346 >> 172.21.15.79:0/3824537346 conn(0x7f350006dcc0 msgr2=0x7f35000c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:02.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.446+0000 7f3507c1f700 1 -- 172.21.15.79:0/3824537346 shutdown_connections 2023-10-19T08:39:02.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.446+0000 7f3507c1f700 1 -- 172.21.15.79:0/3824537346 wait complete. 2023-10-19T08:39:02.462 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T08:37:54.318159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T08:37:55.629862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T08:37:59.333062+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T08:39:02.463 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:39:02.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.585+0000 7f9310b60700 1 Processor -- start 2023-10-19T08:39:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.585+0000 7f9310b60700 1 -- start start 2023-10-19T08:39:02.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.586+0000 7f9310b60700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f930c159db0 0x7f930c0cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.586+0000 7f9310b60700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c06fdc0 0x7f930c0ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.586+0000 7f9310b60700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930c15d760 con 0x7f930c0cc640 2023-10-19T08:39:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.586+0000 7f9310b60700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f930c15da40 con 0x7f930c159db0 2023-10-19T08:39:02.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.586+0000 7f9310b60700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c15dd20 con 0x7f930c06fdc0 2023-10-19T08:39:02.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.586+0000 7f9309d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f930c159db0 0x7f930c0cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:02.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.586+0000 7f930ad9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c06fdc0 0x7f930c0ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:02.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.586+0000 7f930a59c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f930c0cc640 0x7f930c0cca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:42766/0 (socket says 172.21.15.79:42766) 2023-10-19T08:39:02.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.587+0000 7f930a59c700 1 -- 172.21.15.79:0/1665448302 learned_addr learned my addr 172.21.15.79:0/1665448302 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:02.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.587+0000 7f930ad9d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c06fdc0 0x7f930c0ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:50480/0 (socket says 172.21.15.79:50480) 2023-10-19T08:39:02.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.587+0000 7f9309d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f930c159db0 0x7f930c0cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:34100/0 (socket says 172.21.15.79:34100) 2023-10-19T08:39:02.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.587+0000 7f9309d9b700 1 -- 172.21.15.79:0/1665448302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c06fdc0 msgr2=0x7f930c0ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:02.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.587+0000 7f9309d9b700 1 --2- 172.21.15.79:0/1665448302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c06fdc0 0x7f930c0ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.587+0000 7f9309d9b700 1 -- 172.21.15.79:0/1665448302 >> v1:172.21.15.89:6789/0 conn(0x7f930c0cc640 legacy=0x7f930c0cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.587+0000 7f9309d9b700 1 -- 172.21.15.79:0/1665448302 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c15e000 con 0x7f930c159db0 2023-10-19T08:39:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.587+0000 7f930ad9d700 1 --2- 172.21.15.79:0/1665448302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c06fdc0 0x7f930c0ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:39:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.587+0000 7f9309d9b700 1 --2- 172.21.15.79:0/1665448302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c159db0 0x7f930c0cdae0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00bae0 tx=0x7f92fc00bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ddfa408d397cef6 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.587+0000 7f930959a700 1 -- 172.21.15.79:0/1665448302 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc00dc70 con 0x7f930c159db0 2023-10-19T08:39:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.587+0000 7f930959a700 1 -- 172.21.15.79:0/1665448302 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92fc00ddd0 con 0x7f930c159db0 2023-10-19T08:39:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.587+0000 7f930959a700 1 -- 172.21.15.79:0/1665448302 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc010690 con 0x7f930c159db0 2023-10-19T08:39:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.588+0000 7f9310b60700 1 -- 172.21.15.79:0/1665448302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c159db0 msgr2=0x7f930c0cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.588+0000 7f9310b60700 1 --2- 172.21.15.79:0/1665448302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c159db0 0x7f930c0cdae0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00bae0 tx=0x7f92fc00bdf0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.588+0000 7f9310b60700 1 -- 172.21.15.79:0/1665448302 shutdown_connections 2023-10-19T08:39:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.588+0000 7f9310b60700 1 --2- 172.21.15.79:0/1665448302 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c06fdc0 0x7f930c0ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.588+0000 7f9310b60700 1 --2- 172.21.15.79:0/1665448302 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c159db0 0x7f930c0cdae0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.588+0000 7f9310b60700 1 -- 172.21.15.79:0/1665448302 >> 172.21.15.79:0/1665448302 conn(0x7f930c06dcc0 msgr2=0x7f930c06e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:02.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.588+0000 7f9310b60700 1 -- 172.21.15.79:0/1665448302 shutdown_connections 2023-10-19T08:39:02.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.588+0000 7f9310b60700 1 -- 172.21.15.79:0/1665448302 wait complete. 2023-10-19T08:39:02.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.589+0000 7f9310b60700 1 Processor -- start 2023-10-19T08:39:02.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.589+0000 7f9310b60700 1 -- start start 2023-10-19T08:39:02.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.590+0000 7f9310b60700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930c06fdc0 0x7f930c15cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:02.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.590+0000 7f9310b60700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c0cc640 0x7f930c14cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:02.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.590+0000 7f9310b60700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c159db0 0x7f930c0c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:02.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.590+0000 7f9310b60700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c0c9370 con 0x7f930c06fdc0 2023-10-19T08:39:02.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.590+0000 7f9310b60700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c0c8a00 con 0x7f930c159db0 2023-10-19T08:39:02.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.590+0000 7f9310b60700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c15afd0 con 0x7f930c0cc640 2023-10-19T08:39:02.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.590+0000 7f930a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930c06fdc0 0x7f930c15cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:02.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.590+0000 7f930a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930c06fdc0 0x7f930c15cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47858/0 (socket says 172.21.15.79:47858) 2023-10-19T08:39:02.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.590+0000 7f930a59c700 1 -- 172.21.15.79:0/3360951579 learned_addr learned my addr 172.21.15.79:0/3360951579 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:02.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.590+0000 7f930ad9d700 1 --2- 172.21.15.79:0/3360951579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c159db0 0x7f930c0c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:02.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.590+0000 7f9309d9b700 1 --2- 172.21.15.79:0/3360951579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c0cc640 0x7f930c14cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:02.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.590+0000 7f930a59c700 1 -- 172.21.15.79:0/3360951579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c0cc640 msgr2=0x7f930c14cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:02.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.590+0000 7f930a59c700 1 --2- 172.21.15.79:0/3360951579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c0cc640 0x7f930c14cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.590+0000 7f930a59c700 1 -- 172.21.15.79:0/3360951579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c159db0 msgr2=0x7f930c0c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:02.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.590+0000 7f930a59c700 1 --2- 172.21.15.79:0/3360951579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c159db0 0x7f930c0c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.590+0000 7f930a59c700 1 -- 172.21.15.79:0/3360951579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9304009a70 con 0x7f930c06fdc0 2023-10-19T08:39:02.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.591+0000 7f930a59c700 1 --2- 172.21.15.79:0/3360951579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930c06fdc0 0x7f930c15cca0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f930000c520 tx=0x7f930000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:02.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.591+0000 7f92faffd700 1 -- 172.21.15.79:0/3360951579 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300005d70 con 0x7f930c06fdc0 2023-10-19T08:39:02.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.591+0000 7f92faffd700 1 -- 172.21.15.79:0/3360951579 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93000070d0 con 0x7f930c06fdc0 2023-10-19T08:39:02.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.591+0000 7f92faffd700 1 -- 172.21.15.79:0/3360951579 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300007440 con 0x7f930c06fdc0 2023-10-19T08:39:02.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.591+0000 7f9310b60700 1 -- 172.21.15.79:0/3360951579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92fc00b740 con 0x7f930c06fdc0 2023-10-19T08:39:02.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.591+0000 7f9310b60700 1 -- 172.21.15.79:0/3360951579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930c15c4a0 con 0x7f930c06fdc0 2023-10-19T08:39:02.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.592+0000 7f9310b60700 1 -- 172.21.15.79:0/3360951579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f930c15b4f0 con 0x7f930c06fdc0 2023-10-19T08:39:02.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.592+0000 7f92faffd700 1 -- 172.21.15.79:0/3360951579 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f93000075a0 con 0x7f930c06fdc0 2023-10-19T08:39:02.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.592+0000 7f92faffd700 1 --2- 172.21.15.79:0/3360951579 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f92ec06a0e0 0x7f92ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:02.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.593+0000 7f9309d9b700 1 --2- 172.21.15.79:0/3360951579 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f92ec06a0e0 0x7f92ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:02.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.593+0000 7f92faffd700 1 -- 172.21.15.79:0/3360951579 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9300087c80 con 0x7f930c06fdc0 2023-10-19T08:39:02.604 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.593+0000 7f9309d9b700 1 --2- 172.21.15.79:0/3360951579 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f92ec06a0e0 0x7f92ec06c5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00be30 tx=0x7f92fc013000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:02.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.597+0000 7f92faffd700 1 -- 172.21.15.79:0/3360951579 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f930c15b4f0 con 0x7f930c06fdc0 2023-10-19T08:39:02.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.786+0000 7f9310b60700 1 -- 172.21.15.79:0/3360951579 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f930c15c300 con 0x7f930c06fdc0 2023-10-19T08:39:02.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.786+0000 7f92faffd700 1 -- 172.21.15.79:0/3360951579 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9300017020 con 0x7f930c06fdc0 2023-10-19T08:39:02.790 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:39:02.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.788+0000 7f9310b60700 1 -- 172.21.15.79:0/3360951579 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f92ec06a0e0 msgr2=0x7f92ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:02.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.789+0000 7f9310b60700 1 --2- 172.21.15.79:0/3360951579 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f92ec06a0e0 0x7f92ec06c5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00be30 tx=0x7f92fc013000 comp rx=0 tx=0).stop 2023-10-19T08:39:02.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.789+0000 7f9310b60700 1 -- 172.21.15.79:0/3360951579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930c06fdc0 msgr2=0x7f930c15cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:02.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.789+0000 7f9310b60700 1 --2- 172.21.15.79:0/3360951579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930c06fdc0 0x7f930c15cca0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f930000c520 tx=0x7f930000c8e0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.789+0000 7f9310b60700 1 -- 172.21.15.79:0/3360951579 shutdown_connections 2023-10-19T08:39:02.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.789+0000 7f9310b60700 1 --2- 172.21.15.79:0/3360951579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f930c159db0 0x7f930c0c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.789+0000 7f9310b60700 1 --2- 172.21.15.79:0/3360951579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f930c06fdc0 0x7f930c15cca0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.789+0000 7f9310b60700 1 --2- 172.21.15.79:0/3360951579 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f92ec06a0e0 0x7f92ec06c5a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.789+0000 7f9310b60700 1 --2- 172.21.15.79:0/3360951579 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f930c0cc640 0x7f930c14cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.789+0000 7f9310b60700 1 -- 172.21.15.79:0/3360951579 >> 172.21.15.79:0/3360951579 conn(0x7f930c06dcc0 msgr2=0x7f930c0b2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:02.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.789+0000 7f9310b60700 1 -- 172.21.15.79:0/3360951579 shutdown_connections 2023-10-19T08:39:02.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.789+0000 7f9310b60700 1 -- 172.21.15.79:0/3360951579 wait complete. 2023-10-19T08:39:02.804 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:39:02.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.924+0000 7f0b6d6d1700 1 Processor -- start 2023-10-19T08:39:02.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.924+0000 7f0b6d6d1700 1 -- start start 2023-10-19T08:39:02.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.925+0000 7f0b6d6d1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0b680c5600 0x7f0b68165c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:02.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.925+0000 7f0b6d6d1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6806cf60 con 0x7f0b6815adb0 2023-10-19T08:39:02.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.925+0000 7f0b6d6d1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b68071160 con 0x7f0b680ad9a0 2023-10-19T08:39:02.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.925+0000 7f0b6d6d1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b68071440 con 0x7f0b680c5600 2023-10-19T08:39:02.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.925+0000 7f0b677fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0b680c5600 0x7f0b68165c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:02.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.925+0000 7f0b66ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0b6815adb0 0x7f0b680709a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57938/0 (socket says 172.21.15.79:57938) 2023-10-19T08:39:02.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.925+0000 7f0b66ffd700 1 -- 172.21.15.79:0/1084011835 learned_addr learned my addr 172.21.15.79:0/1084011835 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:02.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.925+0000 7f0b677fe700 1 -- 172.21.15.79:0/1084011835 >> v1:172.21.15.89:6789/0 conn(0x7f0b680ad9a0 legacy=0x7f0b6806a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:02.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.925+0000 7f0b677fe700 1 -- 172.21.15.79:0/1084011835 >> v1:172.21.15.79:6789/0 conn(0x7f0b6815adb0 legacy=0x7f0b680709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:02.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.925+0000 7f0b677fe700 1 -- 172.21.15.79:0/1084011835 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b68071720 con 0x7f0b680c5600 2023-10-19T08:39:02.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.925+0000 7f0b65ffb700 1 -- 172.21.15.79:0/1084011835 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173974824 0 0) 0x7f0b6806cf60 con 0x7f0b6815adb0 2023-10-19T08:39:02.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.925+0000 7f0b677fe700 1 --2- 172.21.15.79:0/1084011835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b680c5600 0x7f0b68165c80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009d90 tx=0x7f0b6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7d601a626f1ef4 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:02.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.925+0000 7f0b65ffb700 1 -- 172.21.15.79:0/1084011835 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6000e070 con 0x7f0b680c5600 2023-10-19T08:39:02.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.925+0000 7f0b65ffb700 1 -- 172.21.15.79:0/1084011835 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6000bbd0 con 0x7f0b680c5600 2023-10-19T08:39:02.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.925+0000 7f0b65ffb700 1 -- 172.21.15.79:0/1084011835 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60003a20 con 0x7f0b680c5600 2023-10-19T08:39:02.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.926+0000 7f0b6d6d1700 1 -- 172.21.15.79:0/1084011835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b680c5600 msgr2=0x7f0b68165c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:02.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.926+0000 7f0b6d6d1700 1 --2- 172.21.15.79:0/1084011835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b680c5600 0x7f0b68165c80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0b60009d90 tx=0x7f0b6000b330 comp rx=0 tx=0).stop 2023-10-19T08:39:02.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.926+0000 7f0b6d6d1700 1 -- 172.21.15.79:0/1084011835 shutdown_connections 2023-10-19T08:39:02.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.926+0000 7f0b6d6d1700 1 --2- 172.21.15.79:0/1084011835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b680c5600 0x7f0b68165c80 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.926+0000 7f0b6d6d1700 1 -- 172.21.15.79:0/1084011835 >> 172.21.15.79:0/1084011835 conn(0x7f0b680ce960 msgr2=0x7f0b680ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:02.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.926+0000 7f0b6d6d1700 1 -- 172.21.15.79:0/1084011835 shutdown_connections 2023-10-19T08:39:02.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.926+0000 7f0b6d6d1700 1 -- 172.21.15.79:0/1084011835 wait complete. 2023-10-19T08:39:02.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.927+0000 7f0b6d6d1700 1 Processor -- start 2023-10-19T08:39:02.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.927+0000 7f0b6d6d1700 1 -- start start 2023-10-19T08:39:02.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.928+0000 7f0b6d6d1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b680ad9a0 0x7f0b6814c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:02.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.928+0000 7f0b6d6d1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b680c5600 0x7f0b681546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:02.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.928+0000 7f0b6d6d1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b6815adb0 0x7f0b68154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:02.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.928+0000 7f0b6d6d1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b68152e90 con 0x7f0b680c5600 2023-10-19T08:39:02.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.928+0000 7f0b6d6d1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b681530e0 con 0x7f0b6815adb0 2023-10-19T08:39:02.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.928+0000 7f0b6d6d1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b681533c0 con 0x7f0b680ad9a0 2023-10-19T08:39:02.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.928+0000 7f0b667fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b680c5600 0x7f0b681546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:02.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.928+0000 7f0b667fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b680c5600 0x7f0b681546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47874/0 (socket says 172.21.15.79:47874) 2023-10-19T08:39:02.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.928+0000 7f0b667fc700 1 -- 172.21.15.79:0/675968295 learned_addr learned my addr 172.21.15.79:0/675968295 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:02.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.928+0000 7f0b667fc700 1 -- 172.21.15.79:0/675968295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b680ad9a0 msgr2=0x7f0b6814c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:02.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.928+0000 7f0b667fc700 1 --2- 172.21.15.79:0/675968295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b680ad9a0 0x7f0b6814c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.928+0000 7f0b667fc700 1 -- 172.21.15.79:0/675968295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b6815adb0 msgr2=0x7f0b68154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:02.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.928+0000 7f0b667fc700 1 --2- 172.21.15.79:0/675968295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b6815adb0 0x7f0b68154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:02.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.928+0000 7f0b667fc700 1 -- 172.21.15.79:0/675968295 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b60009a70 con 0x7f0b680c5600 2023-10-19T08:39:02.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.929+0000 7f0b667fc700 1 --2- 172.21.15.79:0/675968295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b680c5600 0x7f0b681546a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00c4a0 tx=0x7f0b5c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:02.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.929+0000 7f0b4f7fe700 1 -- 172.21.15.79:0/675968295 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c0054e0 con 0x7f0b680c5600 2023-10-19T08:39:02.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.929+0000 7f0b4f7fe700 1 -- 172.21.15.79:0/675968295 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5c003680 con 0x7f0b680c5600 2023-10-19T08:39:02.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.929+0000 7f0b6d6d1700 1 -- 172.21.15.79:0/675968295 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b681536a0 con 0x7f0b680c5600 2023-10-19T08:39:02.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.929+0000 7f0b4f7fe700 1 -- 172.21.15.79:0/675968295 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c003a30 con 0x7f0b680c5600 2023-10-19T08:39:02.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.929+0000 7f0b6d6d1700 1 -- 172.21.15.79:0/675968295 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b68153c60 con 0x7f0b680c5600 2023-10-19T08:39:02.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.930+0000 7f0b6d6d1700 1 -- 172.21.15.79:0/675968295 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6815a610 con 0x7f0b680c5600 2023-10-19T08:39:02.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.930+0000 7f0b4f7fe700 1 -- 172.21.15.79:0/675968295 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0b5c003b90 con 0x7f0b680c5600 2023-10-19T08:39:02.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.930+0000 7f0b4f7fe700 1 --2- 172.21.15.79:0/675968295 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0b5406a0e0 0x7f0b5406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:02.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.930+0000 7f0b4f7fe700 1 -- 172.21.15.79:0/675968295 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0b5c087db0 con 0x7f0b680c5600 2023-10-19T08:39:02.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.930+0000 7f0b66ffd700 1 --2- 172.21.15.79:0/675968295 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0b5406a0e0 0x7f0b5406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:02.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.931+0000 7f0b66ffd700 1 --2- 172.21.15.79:0/675968295 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0b5406a0e0 0x7f0b5406c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0b58001610 tx=0x7f0b580079f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:02.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:02.935+0000 7f0b4f7fe700 1 -- 172.21.15.79:0/675968295 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f0b5c053170 con 0x7f0b680c5600 2023-10-19T08:39:03.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.126+0000 7f0b6d6d1700 1 -- 172.21.15.79:0/675968295 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0b680c7300 con 0x7f0b680c5600 2023-10-19T08:39:03.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.127+0000 7f0b4f7fe700 1 -- 172.21.15.79:0/675968295 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0b5c0170a0 con 0x7f0b680c5600 2023-10-19T08:39:03.131 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:39:03.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.129+0000 7f0b6d6d1700 1 -- 172.21.15.79:0/675968295 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0b5406a0e0 msgr2=0x7f0b5406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.129+0000 7f0b6d6d1700 1 --2- 172.21.15.79:0/675968295 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0b5406a0e0 0x7f0b5406c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0b58001610 tx=0x7f0b580079f0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.129+0000 7f0b6d6d1700 1 -- 172.21.15.79:0/675968295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b680c5600 msgr2=0x7f0b681546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.129+0000 7f0b6d6d1700 1 --2- 172.21.15.79:0/675968295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b680c5600 0x7f0b681546a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00c4a0 tx=0x7f0b5c00c860 comp rx=0 tx=0).stop 2023-10-19T08:39:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.129+0000 7f0b6d6d1700 1 -- 172.21.15.79:0/675968295 shutdown_connections 2023-10-19T08:39:03.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.129+0000 7f0b6d6d1700 1 --2- 172.21.15.79:0/675968295 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b6815adb0 0x7f0b68154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.129+0000 7f0b6d6d1700 1 --2- 172.21.15.79:0/675968295 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0b5406a0e0 0x7f0b5406c5a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.129+0000 7f0b6d6d1700 1 --2- 172.21.15.79:0/675968295 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0b680ad9a0 0x7f0b6814c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.129+0000 7f0b6d6d1700 1 --2- 172.21.15.79:0/675968295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b680c5600 0x7f0b681546a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.129+0000 7f0b6d6d1700 1 -- 172.21.15.79:0/675968295 >> 172.21.15.79:0/675968295 conn(0x7f0b680ce960 msgr2=0x7f0b681569f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.129+0000 7f0b6d6d1700 1 -- 172.21.15.79:0/675968295 shutdown_connections 2023-10-19T08:39:03.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.129+0000 7f0b6d6d1700 1 -- 172.21.15.79:0/675968295 wait complete. 2023-10-19T08:39:03.144 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T08:39:03.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.264+0000 7fdbaf104700 1 Processor -- start 2023-10-19T08:39:03.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.264+0000 7fdbaf104700 1 -- start start 2023-10-19T08:39:03.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.265+0000 7fdbaf104700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdba806a930 0x7fdba80cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.265+0000 7fdbaf104700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba80b1fe0 con 0x7fdba80cd270 2023-10-19T08:39:03.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.265+0000 7fdbaf104700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba80ce2b0 con 0x7fdba80703b0 2023-10-19T08:39:03.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.265+0000 7fdbaf104700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba8160a80 con 0x7fdba806a930 2023-10-19T08:39:03.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.265+0000 7fdbacea0700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fdba80cd270 0x7fdba806a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57952/0 (socket says 172.21.15.79:57952) 2023-10-19T08:39:03.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.265+0000 7fdbacea0700 1 -- 172.21.15.79:0/2177452646 learned_addr learned my addr 172.21.15.79:0/2177452646 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:03.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.265+0000 7fdba7fff700 1 --2- 172.21.15.79:0/2177452646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdba806a930 0x7fdba80cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdba77fe700 1 -- 172.21.15.79:0/2177452646 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110110716 0 0) 0x7fdba80b1fe0 con 0x7fdba80cd270 2023-10-19T08:39:03.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdba77fe700 1 -- 172.21.15.79:0/2177452646 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb980035b0 con 0x7fdba80cd270 2023-10-19T08:39:03.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdba77fe700 1 -- 172.21.15.79:0/2177452646 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3530389276 0 0) 0x7fdb980035b0 con 0x7fdba80cd270 2023-10-19T08:39:03.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdba77fe700 1 -- 172.21.15.79:0/2177452646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdba806a930 msgr2=0x7fdba80cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:03.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdba77fe700 1 --2- 172.21.15.79:0/2177452646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdba806a930 0x7fdba80cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdba77fe700 1 -- 172.21.15.79:0/2177452646 >> v1:172.21.15.89:6789/0 conn(0x7fdba80703b0 legacy=0x7fdba80cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:03.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdba77fe700 1 -- 172.21.15.79:0/2177452646 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba80ce550 con 0x7fdba80cd270 2023-10-19T08:39:03.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdba77fe700 1 -- 172.21.15.79:0/2177452646 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7fdb9c001670 con 0x7fdba80cd270 2023-10-19T08:39:03.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdba77fe700 1 -- 172.21.15.79:0/2177452646 >> v1:172.21.15.79:6789/0 conn(0x7fdba80cd270 legacy=0x7fdba806a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:03.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdba77fe700 1 --2- 172.21.15.79:0/2177452646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb98003aa0 0x7fdb98003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdba77fe700 1 --2- 172.21.15.79:0/2177452646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdba806a930 0x7fdb98004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdba77fe700 1 --2- 172.21.15.79:0/2177452646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb98004d90 0x7fdb98005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdba77fe700 1 -- 172.21.15.79:0/2177452646 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba8160a80 con 0x7fdb98004d90 2023-10-19T08:39:03.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdba77fe700 1 -- 172.21.15.79:0/2177452646 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9800bb50 con 0x7fdb98003aa0 2023-10-19T08:39:03.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdba77fe700 1 -- 172.21.15.79:0/2177452646 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9800bd10 con 0x7fdba806a930 2023-10-19T08:39:03.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdbad6a1700 1 --2- 172.21.15.79:0/2177452646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb98004d90 0x7fdb98005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdbacea0700 1 --2- 172.21.15.79:0/2177452646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb98003aa0 0x7fdb98003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdba7fff700 1 --2- 172.21.15.79:0/2177452646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdba806a930 0x7fdb98004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdbad6a1700 1 -- 172.21.15.79:0/2177452646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdba806a930 msgr2=0x7fdb98004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:03.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdbad6a1700 1 --2- 172.21.15.79:0/2177452646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdba806a930 0x7fdb98004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdbad6a1700 1 -- 172.21.15.79:0/2177452646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb98003aa0 msgr2=0x7fdb98003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:03.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdbad6a1700 1 --2- 172.21.15.79:0/2177452646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb98003aa0 0x7fdb98003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdbad6a1700 1 -- 172.21.15.79:0/2177452646 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb980035b0 con 0x7fdb98004d90 2023-10-19T08:39:03.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.266+0000 7fdbad6a1700 1 --2- 172.21.15.79:0/2177452646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb98004d90 0x7fdb98005210 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdba000c160 tx=0x7fdb98005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec3a0f87fee1fba server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:03.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.267+0000 7fdba77fe700 1 -- 172.21.15.79:0/2177452646 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0001db0 con 0x7fdb98004d90 2023-10-19T08:39:03.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.267+0000 7fdba77fe700 1 -- 172.21.15.79:0/2177452646 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba000cca0 con 0x7fdb98004d90 2023-10-19T08:39:03.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.267+0000 7fdba77fe700 1 -- 172.21.15.79:0/2177452646 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0003c40 con 0x7fdb98004d90 2023-10-19T08:39:03.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.267+0000 7fdbaf104700 1 -- 172.21.15.79:0/2177452646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb98004d90 msgr2=0x7fdb98005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:03.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.267+0000 7fdbaf104700 1 --2- 172.21.15.79:0/2177452646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdb98004d90 0x7fdb98005210 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fdba000c160 tx=0x7fdb98005880 comp rx=0 tx=0).stop 2023-10-19T08:39:03.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.267+0000 7fdbad6a1700 1 -- 172.21.15.79:0/2177452646 reap_dead start 2023-10-19T08:39:03.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.267+0000 7fdbaf104700 1 -- 172.21.15.79:0/2177452646 shutdown_connections 2023-10-19T08:39:03.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.267+0000 7fdbaf104700 1 -- 172.21.15.79:0/2177452646 >> 172.21.15.79:0/2177452646 conn(0x7fdba806dcc0 msgr2=0x7fdba806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:03.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.267+0000 7fdbaf104700 1 -- 172.21.15.79:0/2177452646 shutdown_connections 2023-10-19T08:39:03.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.267+0000 7fdbaf104700 1 -- 172.21.15.79:0/2177452646 wait complete. 2023-10-19T08:39:03.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.268+0000 7fdbaf104700 1 Processor -- start 2023-10-19T08:39:03.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.268+0000 7fdbaf104700 1 -- start start 2023-10-19T08:39:03.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.269+0000 7fdbaf104700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb98004d90 0x7fdba8157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.269+0000 7fdbaf104700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdba80ae400 0x7fdba80c9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.269+0000 7fdbaf104700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdba80ae880 0x7fdba80b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.269+0000 7fdbaf104700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80ad0c0 con 0x7fdba80ae400 2023-10-19T08:39:03.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.269+0000 7fdbaf104700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80ad360 con 0x7fdb98004d90 2023-10-19T08:39:03.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.269+0000 7fdbaf104700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80ad640 con 0x7fdba80ae880 2023-10-19T08:39:03.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.269+0000 7fdba7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdba80ae400 0x7fdba80c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.269+0000 7fdba7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdba80ae400 0x7fdba80c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47894/0 (socket says 172.21.15.79:47894) 2023-10-19T08:39:03.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.269+0000 7fdba7fff700 1 -- 172.21.15.79:0/1313456181 learned_addr learned my addr 172.21.15.79:0/1313456181 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:03.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.270+0000 7fdbacea0700 1 --2- 172.21.15.79:0/1313456181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb98004d90 0x7fdba8157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.270+0000 7fdbad6a1700 1 --2- 172.21.15.79:0/1313456181 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdba80ae880 0x7fdba80b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.270+0000 7fdba7fff700 1 -- 172.21.15.79:0/1313456181 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdba80ae880 msgr2=0x7fdba80b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:03.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.270+0000 7fdba7fff700 1 --2- 172.21.15.79:0/1313456181 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdba80ae880 0x7fdba80b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.270+0000 7fdba7fff700 1 -- 172.21.15.79:0/1313456181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb98004d90 msgr2=0x7fdba8157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:03.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.270+0000 7fdba7fff700 1 --2- 172.21.15.79:0/1313456181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb98004d90 0x7fdba8157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.270+0000 7fdba7fff700 1 -- 172.21.15.79:0/1313456181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba80ad920 con 0x7fdba80ae400 2023-10-19T08:39:03.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.270+0000 7fdbad6a1700 1 --2- 172.21.15.79:0/1313456181 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdba80ae880 0x7fdba80b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:03.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.270+0000 7fdba7fff700 1 --2- 172.21.15.79:0/1313456181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdba80ae400 0x7fdba80c9470 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fdb94011aa0 tx=0x7fdb94011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:03.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.270+0000 7fdba57fa700 1 -- 172.21.15.79:0/1313456181 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9400f8c0 con 0x7fdba80ae400 2023-10-19T08:39:03.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.270+0000 7fdba57fa700 1 -- 172.21.15.79:0/1313456181 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9400fa20 con 0x7fdba80ae400 2023-10-19T08:39:03.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.270+0000 7fdba57fa700 1 -- 172.21.15.79:0/1313456181 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9400fdd0 con 0x7fdba80ae400 2023-10-19T08:39:03.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.270+0000 7fdbaf104700 1 -- 172.21.15.79:0/1313456181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba80adc00 con 0x7fdba80ae400 2023-10-19T08:39:03.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.270+0000 7fdbaf104700 1 -- 172.21.15.79:0/1313456181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba81f6d70 con 0x7fdba80ae400 2023-10-19T08:39:03.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.271+0000 7fdbaf104700 1 -- 172.21.15.79:0/1313456181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba80ae250 con 0x7fdba80ae400 2023-10-19T08:39:03.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.271+0000 7fdba57fa700 1 -- 172.21.15.79:0/1313456181 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdb94014440 con 0x7fdba80ae400 2023-10-19T08:39:03.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.272+0000 7fdba57fa700 1 --2- 172.21.15.79:0/1313456181 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdb8c06a0e0 0x7fdb8c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.272+0000 7fdba57fa700 1 -- 172.21.15.79:0/1313456181 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdb94088fc0 con 0x7fdba80ae400 2023-10-19T08:39:03.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.272+0000 7fdbacea0700 1 --2- 172.21.15.79:0/1313456181 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdb8c06a0e0 0x7fdb8c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.272+0000 7fdbacea0700 1 --2- 172.21.15.79:0/1313456181 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdb8c06a0e0 0x7fdb8c06c5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c000f60 tx=0x7fdb9c000ef0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:03.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.276+0000 7fdba57fa700 1 -- 172.21.15.79:0/1313456181 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fdb940bb940 con 0x7fdba80ae400 2023-10-19T08:39:03.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.465+0000 7fdbaf104700 1 -- 172.21.15.79:0/1313456181 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdba804ee70 con 0x7fdba80ae400 2023-10-19T08:39:03.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.466+0000 7fdba57fa700 1 -- 172.21.15.79:0/1313456181 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdb940220a0 con 0x7fdba80ae400 2023-10-19T08:39:03.470 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:39:03.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.468+0000 7fdbaf104700 1 -- 172.21.15.79:0/1313456181 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdb8c06a0e0 msgr2=0x7fdb8c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:03.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.468+0000 7fdbaf104700 1 --2- 172.21.15.79:0/1313456181 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdb8c06a0e0 0x7fdb8c06c5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c000f60 tx=0x7fdb9c000ef0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.468+0000 7fdbaf104700 1 -- 172.21.15.79:0/1313456181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdba80ae400 msgr2=0x7fdba80c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:03.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.468+0000 7fdbaf104700 1 --2- 172.21.15.79:0/1313456181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdba80ae400 0x7fdba80c9470 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fdb94011aa0 tx=0x7fdb94011e60 comp rx=0 tx=0).stop 2023-10-19T08:39:03.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.468+0000 7fdbaf104700 1 -- 172.21.15.79:0/1313456181 shutdown_connections 2023-10-19T08:39:03.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.468+0000 7fdbaf104700 1 --2- 172.21.15.79:0/1313456181 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdb8c06a0e0 0x7fdb8c06c5a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.468+0000 7fdbaf104700 1 --2- 172.21.15.79:0/1313456181 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdba80ae880 0x7fdba80b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.468+0000 7fdbaf104700 1 --2- 172.21.15.79:0/1313456181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb98004d90 0x7fdba8157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.468+0000 7fdbaf104700 1 --2- 172.21.15.79:0/1313456181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdba80ae400 0x7fdba80c9470 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.468+0000 7fdbaf104700 1 -- 172.21.15.79:0/1313456181 >> 172.21.15.79:0/1313456181 conn(0x7fdba806dcc0 msgr2=0x7fdba80cd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:03.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.468+0000 7fdbaf104700 1 -- 172.21.15.79:0/1313456181 shutdown_connections 2023-10-19T08:39:03.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.468+0000 7fdbaf104700 1 -- 172.21.15.79:0/1313456181 wait complete. 2023-10-19T08:39:03.483 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T08:39:03.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.606+0000 7efc22471700 1 Processor -- start 2023-10-19T08:39:03.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.606+0000 7efc22471700 1 -- start start 2023-10-19T08:39:03.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.606+0000 7efc22471700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efc1c0cc640 0x7efc1c0cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.606+0000 7efc22471700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc1c159db0 0x7efc1c0b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.613 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.606+0000 7efc22471700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1c0ccf60 con 0x7efc1c06fdc0 2023-10-19T08:39:03.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.606+0000 7efc22471700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1c15d760 con 0x7efc1c0cc640 2023-10-19T08:39:03.614 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.606+0000 7efc22471700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c15da40 con 0x7efc1c159db0 2023-10-19T08:39:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc20a0e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7efc1c06fdc0 0x7efc1c0b1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:57976/0 (socket says 172.21.15.79:57976) 2023-10-19T08:39:03.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc20a0e700 1 -- 172.21.15.79:0/2309371362 learned_addr learned my addr 172.21.15.79:0/2309371362 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:03.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1bfff700 1 --2- 172.21.15.79:0/2309371362 >> v2:172.21.15.89:3300/0 conn(0x7efc1c0cc640 0x7efc1c0cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1b7fe700 1 --2- 172.21.15.79:0/2309371362 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc1c159db0 0x7efc1c0b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1affd700 1 -- 172.21.15.79:0/2309371362 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144223345 0 0) 0x7efc1c0ccf60 con 0x7efc1c06fdc0 2023-10-19T08:39:03.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1affd700 1 -- 172.21.15.79:0/2309371362 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc040035b0 con 0x7efc1c06fdc0 2023-10-19T08:39:03.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1affd700 1 -- 172.21.15.79:0/2309371362 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2096375608 0 0) 0x7efc040035b0 con 0x7efc1c06fdc0 2023-10-19T08:39:03.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1affd700 1 -- 172.21.15.79:0/2309371362 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc1c159db0 msgr2=0x7efc1c0b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:03.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1affd700 1 --2- 172.21.15.79:0/2309371362 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc1c159db0 0x7efc1c0b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1affd700 1 -- 172.21.15.79:0/2309371362 >> v2:172.21.15.89:3300/0 conn(0x7efc1c0cc640 msgr2=0x7efc1c0cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:03.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1affd700 1 --2- 172.21.15.79:0/2309371362 >> v2:172.21.15.89:3300/0 conn(0x7efc1c0cc640 0x7efc1c0cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1affd700 1 -- 172.21.15.79:0/2309371362 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c15dd20 con 0x7efc1c06fdc0 2023-10-19T08:39:03.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1affd700 1 -- 172.21.15.79:0/2309371362 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7efc140019f0 con 0x7efc1c06fdc0 2023-10-19T08:39:03.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1affd700 1 -- 172.21.15.79:0/2309371362 >> v1:172.21.15.79:6789/0 conn(0x7efc1c06fdc0 legacy=0x7efc1c0b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:03.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1affd700 1 --2- 172.21.15.79:0/2309371362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc04003a70 0x7efc04003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1affd700 1 --2- 172.21.15.79:0/2309371362 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc1c159db0 0x7efc04004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1affd700 1 --2- 172.21.15.79:0/2309371362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc04004d90 0x7efc04005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1affd700 1 -- 172.21.15.79:0/2309371362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c15d760 con 0x7efc04004d90 2023-10-19T08:39:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1affd700 1 -- 172.21.15.79:0/2309371362 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c15da40 con 0x7efc04003a70 2023-10-19T08:39:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1affd700 1 -- 172.21.15.79:0/2309371362 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0400ba10 con 0x7efc1c159db0 2023-10-19T08:39:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc20a0e700 1 --2- 172.21.15.79:0/2309371362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc04004d90 0x7efc04005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1bfff700 1 --2- 172.21.15.79:0/2309371362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc04003a70 0x7efc04003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.607+0000 7efc1b7fe700 1 --2- 172.21.15.79:0/2309371362 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc1c159db0 0x7efc04004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.608+0000 7efc20a0e700 1 -- 172.21.15.79:0/2309371362 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc1c159db0 msgr2=0x7efc04004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:03.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.608+0000 7efc20a0e700 1 --2- 172.21.15.79:0/2309371362 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc1c159db0 0x7efc04004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.608+0000 7efc20a0e700 1 -- 172.21.15.79:0/2309371362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc04003a70 msgr2=0x7efc04003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:03.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.608+0000 7efc20a0e700 1 --2- 172.21.15.79:0/2309371362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc04003a70 0x7efc04003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.608+0000 7efc20a0e700 1 -- 172.21.15.79:0/2309371362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc040035b0 con 0x7efc04004d90 2023-10-19T08:39:03.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.608+0000 7efc20a0e700 1 --2- 172.21.15.79:0/2309371362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc04004d90 0x7efc04005210 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efc1400a860 tx=0x7efc04005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce09469f4dd56c70 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:03.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.608+0000 7efc1affd700 1 -- 172.21.15.79:0/2309371362 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc14012600 con 0x7efc04004d90 2023-10-19T08:39:03.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.608+0000 7efc1affd700 1 -- 172.21.15.79:0/2309371362 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc14012780 con 0x7efc04004d90 2023-10-19T08:39:03.621 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.608+0000 7efc1affd700 1 -- 172.21.15.79:0/2309371362 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc14012b30 con 0x7efc04004d90 2023-10-19T08:39:03.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.608+0000 7efc22471700 1 -- 172.21.15.79:0/2309371362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc04004d90 msgr2=0x7efc04005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:03.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.608+0000 7efc22471700 1 --2- 172.21.15.79:0/2309371362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc04004d90 0x7efc04005210 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efc1400a860 tx=0x7efc04005880 comp rx=0 tx=0).stop 2023-10-19T08:39:03.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.608+0000 7efc20a0e700 1 -- 172.21.15.79:0/2309371362 reap_dead start 2023-10-19T08:39:03.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.608+0000 7efc22471700 1 -- 172.21.15.79:0/2309371362 shutdown_connections 2023-10-19T08:39:03.622 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.608+0000 7efc22471700 1 -- 172.21.15.79:0/2309371362 >> 172.21.15.79:0/2309371362 conn(0x7efc1c06dcc0 msgr2=0x7efc1c06e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:03.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.608+0000 7efc22471700 1 -- 172.21.15.79:0/2309371362 shutdown_connections 2023-10-19T08:39:03.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.608+0000 7efc22471700 1 -- 172.21.15.79:0/2309371362 wait complete. 2023-10-19T08:39:03.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.610+0000 7efc22471700 1 Processor -- start 2023-10-19T08:39:03.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.610+0000 7efc22471700 1 -- start start 2023-10-19T08:39:03.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.610+0000 7efc22471700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc1c1efc90 0x7efc1c152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc22471700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc1c1f0070 0x7efc1c1f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc22471700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc1c152a90 0x7efc1c1f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc22471700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c155650 con 0x7efc1c1f0070 2023-10-19T08:39:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc22471700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c155fe0 con 0x7efc1c152a90 2023-10-19T08:39:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc22471700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c155090 con 0x7efc1c1efc90 2023-10-19T08:39:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc1b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc1c1f0070 0x7efc1c1f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc1b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc1c1f0070 0x7efc1c1f5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47914/0 (socket says 172.21.15.79:47914) 2023-10-19T08:39:03.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc1b7fe700 1 -- 172.21.15.79:0/1016872607 learned_addr learned my addr 172.21.15.79:0/1016872607 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:03.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc1bfff700 1 --2- 172.21.15.79:0/1016872607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc1c1efc90 0x7efc1c152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc1b7fe700 1 -- 172.21.15.79:0/1016872607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc1c1efc90 msgr2=0x7efc1c152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:03.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc1b7fe700 1 --2- 172.21.15.79:0/1016872607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc1c1efc90 0x7efc1c152550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc20a0e700 1 --2- 172.21.15.79:0/1016872607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc1c152a90 0x7efc1c1f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc1b7fe700 1 -- 172.21.15.79:0/1016872607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc1c152a90 msgr2=0x7efc1c1f6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:03.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc1b7fe700 1 --2- 172.21.15.79:0/1016872607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc1c152a90 0x7efc1c1f6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc1b7fe700 1 -- 172.21.15.79:0/1016872607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c155370 con 0x7efc1c1f0070 2023-10-19T08:39:03.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc1b7fe700 1 --2- 172.21.15.79:0/1016872607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc1c1f0070 0x7efc1c1f5e50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7efc100119c0 tx=0x7efc10011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:03.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc18ff9700 1 -- 172.21.15.79:0/1016872607 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10004240 con 0x7efc1c1f0070 2023-10-19T08:39:03.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc18ff9700 1 -- 172.21.15.79:0/1016872607 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc100043a0 con 0x7efc1c1f0070 2023-10-19T08:39:03.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc22471700 1 -- 172.21.15.79:0/1016872607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1c155c70 con 0x7efc1c1f0070 2023-10-19T08:39:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc18ff9700 1 -- 172.21.15.79:0/1016872607 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1000f730 con 0x7efc1c1f0070 2023-10-19T08:39:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.611+0000 7efc22471700 1 -- 172.21.15.79:0/1016872607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1c154c60 con 0x7efc1c1f0070 2023-10-19T08:39:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.612+0000 7efc22471700 1 -- 172.21.15.79:0/1016872607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1c155ad0 con 0x7efc1c1f0070 2023-10-19T08:39:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.613+0000 7efc18ff9700 1 -- 172.21.15.79:0/1016872607 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efc1000f890 con 0x7efc1c1f0070 2023-10-19T08:39:03.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.613+0000 7efc18ff9700 1 --2- 172.21.15.79:0/1016872607 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efc0806a0e0 0x7efc0806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.613+0000 7efc18ff9700 1 -- 172.21.15.79:0/1016872607 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efc10088e20 con 0x7efc1c1f0070 2023-10-19T08:39:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.613+0000 7efc1bfff700 1 --2- 172.21.15.79:0/1016872607 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efc0806a0e0 0x7efc0806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.613+0000 7efc1bfff700 1 --2- 172.21.15.79:0/1016872607 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efc0806a0e0 0x7efc0806c5a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0c98b0 tx=0x7efc0c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:03.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.617+0000 7efc18ff9700 1 -- 172.21.15.79:0/1016872607 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7efc1c155ad0 con 0x7efc1c1f0070 2023-10-19T08:39:03.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.807+0000 7efc22471700 1 -- 172.21.15.79:0/1016872607 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc1c155ad0 con 0x7efc1c1f0070 2023-10-19T08:39:03.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.807+0000 7efc18ff9700 1 -- 172.21.15.79:0/1016872607 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7efc1c155ad0 con 0x7efc1c1f0070 2023-10-19T08:39:03.811 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-19T08:39:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.809+0000 7efc22471700 1 -- 172.21.15.79:0/1016872607 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efc0806a0e0 msgr2=0x7efc0806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.809+0000 7efc22471700 1 --2- 172.21.15.79:0/1016872607 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efc0806a0e0 0x7efc0806c5a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efc1c0c98b0 tx=0x7efc0c008040 comp rx=0 tx=0).stop 2023-10-19T08:39:03.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.809+0000 7efc22471700 1 -- 172.21.15.79:0/1016872607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc1c1f0070 msgr2=0x7efc1c1f5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.809+0000 7efc22471700 1 --2- 172.21.15.79:0/1016872607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc1c1f0070 0x7efc1c1f5e50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7efc100119c0 tx=0x7efc10011d80 comp rx=0 tx=0).stop 2023-10-19T08:39:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.809+0000 7efc22471700 1 -- 172.21.15.79:0/1016872607 shutdown_connections 2023-10-19T08:39:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.809+0000 7efc22471700 1 --2- 172.21.15.79:0/1016872607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc1c152a90 0x7efc1c1f6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.809+0000 7efc22471700 1 --2- 172.21.15.79:0/1016872607 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efc0806a0e0 0x7efc0806c5a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.809+0000 7efc22471700 1 --2- 172.21.15.79:0/1016872607 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc1c1efc90 0x7efc1c152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.809+0000 7efc22471700 1 --2- 172.21.15.79:0/1016872607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc1c1f0070 0x7efc1c1f5e50 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.809+0000 7efc22471700 1 -- 172.21.15.79:0/1016872607 >> 172.21.15.79:0/1016872607 conn(0x7efc1c06dcc0 msgr2=0x7efc1c0cecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.810+0000 7efc22471700 1 -- 172.21.15.79:0/1016872607 shutdown_connections 2023-10-19T08:39:03.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.810+0000 7efc22471700 1 -- 172.21.15.79:0/1016872607 wait complete. 2023-10-19T08:39:03.825 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T08:39:03.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.944+0000 7f602bee4700 1 Processor -- start 2023-10-19T08:39:03.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.944+0000 7f602bee4700 1 -- start start 2023-10-19T08:39:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.945+0000 7f602bee4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60240cc640 0x7f60240cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.945+0000 7f602bee4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6024159db0 0x7f60240b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.945+0000 7f602bee4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f602406fdc0 0x7f60240b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.945+0000 7f602bee4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60240ccf60 con 0x7f60240cc640 2023-10-19T08:39:03.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.945+0000 7f602bee4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602415d760 con 0x7f6024159db0 2023-10-19T08:39:03.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.945+0000 7f602bee4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602415da40 con 0x7f602406fdc0 2023-10-19T08:39:03.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.945+0000 7f6029c80700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60240cc640 0x7f60240cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.945+0000 7f6029c80700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f60240cc640 0x7f60240cca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47920/0 (socket says 172.21.15.79:47920) 2023-10-19T08:39:03.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.945+0000 7f6029c80700 1 -- 172.21.15.79:0/3301832943 learned_addr learned my addr 172.21.15.79:0/3301832943 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:03.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.945+0000 7f602a481700 1 --2- 172.21.15.79:0/3301832943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f602406fdc0 0x7f60240b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.945+0000 7f602947f700 1 --2- 172.21.15.79:0/3301832943 >> v2:172.21.15.89:3300/0 conn(0x7f6024159db0 0x7f60240b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.945+0000 7f6029c80700 1 -- 172.21.15.79:0/3301832943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f602406fdc0 msgr2=0x7f60240b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:03.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.945+0000 7f6029c80700 1 --2- 172.21.15.79:0/3301832943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f602406fdc0 0x7f60240b1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.945+0000 7f6029c80700 1 -- 172.21.15.79:0/3301832943 >> v2:172.21.15.89:3300/0 conn(0x7f6024159db0 msgr2=0x7f60240b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:03.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.945+0000 7f6029c80700 1 --2- 172.21.15.79:0/3301832943 >> v2:172.21.15.89:3300/0 conn(0x7f6024159db0 0x7f60240b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.945+0000 7f6029c80700 1 -- 172.21.15.79:0/3301832943 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602415dd20 con 0x7f60240cc640 2023-10-19T08:39:03.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.945+0000 7f602a481700 1 --2- 172.21.15.79:0/3301832943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f602406fdc0 0x7f60240b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:03.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.945+0000 7f602947f700 1 --2- 172.21.15.79:0/3301832943 >> v2:172.21.15.89:3300/0 conn(0x7f6024159db0 0x7f60240b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:03.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.946+0000 7f6029c80700 1 --2- 172.21.15.79:0/3301832943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60240cc640 0x7f60240cca20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f602406e980 tx=0x7f601400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc01baddbb2372ce server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:03.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.946+0000 7f6028c7e700 1 -- 172.21.15.79:0/3301832943 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601400dd30 con 0x7f60240cc640 2023-10-19T08:39:03.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.946+0000 7f6028c7e700 1 -- 172.21.15.79:0/3301832943 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601400de90 con 0x7f60240cc640 2023-10-19T08:39:03.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.946+0000 7f6028c7e700 1 -- 172.21.15.79:0/3301832943 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014010690 con 0x7f60240cc640 2023-10-19T08:39:03.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.946+0000 7f602bee4700 1 -- 172.21.15.79:0/3301832943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60240cc640 msgr2=0x7f60240cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:03.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.946+0000 7f602bee4700 1 --2- 172.21.15.79:0/3301832943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60240cc640 0x7f60240cca20 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f602406e980 tx=0x7f601400be70 comp rx=0 tx=0).stop 2023-10-19T08:39:03.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.946+0000 7f602bee4700 1 -- 172.21.15.79:0/3301832943 shutdown_connections 2023-10-19T08:39:03.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.946+0000 7f602bee4700 1 --2- 172.21.15.79:0/3301832943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f602406fdc0 0x7f60240b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.946+0000 7f602bee4700 1 --2- 172.21.15.79:0/3301832943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60240cc640 0x7f60240cca20 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.946+0000 7f602bee4700 1 --2- 172.21.15.79:0/3301832943 >> v2:172.21.15.89:3300/0 conn(0x7f6024159db0 0x7f60240b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.946+0000 7f602bee4700 1 -- 172.21.15.79:0/3301832943 >> 172.21.15.79:0/3301832943 conn(0x7f602406dcc0 msgr2=0x7f602406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:03.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.946+0000 7f602bee4700 1 -- 172.21.15.79:0/3301832943 shutdown_connections 2023-10-19T08:39:03.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.946+0000 7f602bee4700 1 -- 172.21.15.79:0/3301832943 wait complete. 2023-10-19T08:39:03.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.947+0000 7f602bee4700 1 Processor -- start 2023-10-19T08:39:03.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.948+0000 7f602bee4700 1 -- start start 2023-10-19T08:39:03.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.948+0000 7f602bee4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f602406fdc0 0x7f60240ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.948+0000 7f602bee4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60240cc640 0x7f602414d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.948+0000 7f602bee4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6024159db0 0x7f60240c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.948+0000 7f602bee4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60240ce980 con 0x7f60240cc640 2023-10-19T08:39:03.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.948+0000 7f602bee4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602414d670 con 0x7f6024159db0 2023-10-19T08:39:03.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.948+0000 7f602bee4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602415c610 con 0x7f602406fdc0 2023-10-19T08:39:03.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.948+0000 7f602947f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60240cc640 0x7f602414d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.948+0000 7f602947f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60240cc640 0x7f602414d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47928/0 (socket says 172.21.15.79:47928) 2023-10-19T08:39:03.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.948+0000 7f602947f700 1 -- 172.21.15.79:0/2807906716 learned_addr learned my addr 172.21.15.79:0/2807906716 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:03.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.948+0000 7f6029c80700 1 --2- 172.21.15.79:0/2807906716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f602406fdc0 0x7f60240ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.948+0000 7f602a481700 1 --2- 172.21.15.79:0/2807906716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6024159db0 0x7f60240c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.949+0000 7f602947f700 1 -- 172.21.15.79:0/2807906716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f602406fdc0 msgr2=0x7f60240ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:03.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.949+0000 7f602947f700 1 --2- 172.21.15.79:0/2807906716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f602406fdc0 0x7f60240ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.949+0000 7f602947f700 1 -- 172.21.15.79:0/2807906716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6024159db0 msgr2=0x7f60240c5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:03.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.949+0000 7f602947f700 1 --2- 172.21.15.79:0/2807906716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6024159db0 0x7f60240c5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:03.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.949+0000 7f602947f700 1 -- 172.21.15.79:0/2807906716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601400b7f0 con 0x7f60240cc640 2023-10-19T08:39:03.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.949+0000 7f602947f700 1 --2- 172.21.15.79:0/2807906716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60240cc640 0x7f602414d130 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f602000c7f0 tx=0x7f602000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:03.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.949+0000 7f601a7fc700 1 -- 172.21.15.79:0/2807906716 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020011800 con 0x7f60240cc640 2023-10-19T08:39:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.949+0000 7f601a7fc700 1 -- 172.21.15.79:0/2807906716 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6020011960 con 0x7f60240cc640 2023-10-19T08:39:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.949+0000 7f602bee4700 1 -- 172.21.15.79:0/2807906716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60240c3890 con 0x7f60240cc640 2023-10-19T08:39:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.949+0000 7f601a7fc700 1 -- 172.21.15.79:0/2807906716 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020011cf0 con 0x7f60240cc640 2023-10-19T08:39:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.949+0000 7f602bee4700 1 -- 172.21.15.79:0/2807906716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60240c3e50 con 0x7f60240cc640 2023-10-19T08:39:03.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.950+0000 7f602bee4700 1 -- 172.21.15.79:0/2807906716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60240c4010 con 0x7f60240cc640 2023-10-19T08:39:03.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.950+0000 7f601a7fc700 1 -- 172.21.15.79:0/2807906716 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6020018360 con 0x7f60240cc640 2023-10-19T08:39:03.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.951+0000 7f601a7fc700 1 --2- 172.21.15.79:0/2807906716 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f600806a0e0 0x7f600806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:03.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.951+0000 7f601a7fc700 1 -- 172.21.15.79:0/2807906716 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6020088670 con 0x7f60240cc640 2023-10-19T08:39:03.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.951+0000 7f6029c80700 1 --2- 172.21.15.79:0/2807906716 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f600806a0e0 0x7f600806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:03.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.951+0000 7f6029c80700 1 --2- 172.21.15.79:0/2807906716 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f600806a0e0 0x7f600806c5a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f601400beb0 tx=0x7f601401c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:03.955+0000 7f601a7fc700 1 -- 172.21.15.79:0/2807906716 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6020053ac0 con 0x7f60240cc640 2023-10-19T08:39:04.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.144+0000 7f602bee4700 1 -- 172.21.15.79:0/2807906716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f602415e2b0 con 0x7f60240cc640 2023-10-19T08:39:04.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.145+0000 7f601a7fc700 1 -- 172.21.15.79:0/2807906716 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f60200570e0 con 0x7f60240cc640 2023-10-19T08:39:04.148 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:39:04.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.146+0000 7f602bee4700 1 -- 172.21.15.79:0/2807906716 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f600806a0e0 msgr2=0x7f600806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:04.150 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.146+0000 7f602bee4700 1 --2- 172.21.15.79:0/2807906716 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f600806a0e0 0x7f600806c5a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f601400beb0 tx=0x7f601401c040 comp rx=0 tx=0).stop 2023-10-19T08:39:04.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.146+0000 7f602bee4700 1 -- 172.21.15.79:0/2807906716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60240cc640 msgr2=0x7f602414d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:04.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.146+0000 7f602bee4700 1 --2- 172.21.15.79:0/2807906716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60240cc640 0x7f602414d130 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f602000c7f0 tx=0x7f602000cb00 comp rx=0 tx=0).stop 2023-10-19T08:39:04.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.147+0000 7f602bee4700 1 -- 172.21.15.79:0/2807906716 shutdown_connections 2023-10-19T08:39:04.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.147+0000 7f602bee4700 1 --2- 172.21.15.79:0/2807906716 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6024159db0 0x7f60240c5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.147+0000 7f602bee4700 1 --2- 172.21.15.79:0/2807906716 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f600806a0e0 0x7f600806c5a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.147+0000 7f602bee4700 1 --2- 172.21.15.79:0/2807906716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f602406fdc0 0x7f60240ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.147+0000 7f602bee4700 1 --2- 172.21.15.79:0/2807906716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60240cc640 0x7f602414d130 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.147+0000 7f602bee4700 1 -- 172.21.15.79:0/2807906716 >> 172.21.15.79:0/2807906716 conn(0x7f602406dcc0 msgr2=0x7f60240b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:04.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.147+0000 7f602bee4700 1 -- 172.21.15.79:0/2807906716 shutdown_connections 2023-10-19T08:39:04.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.147+0000 7f602bee4700 1 -- 172.21.15.79:0/2807906716 wait complete. 2023-10-19T08:39:04.162 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-19T08:39:04.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.280+0000 7f47df58e700 1 Processor -- start 2023-10-19T08:39:04.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.281+0000 7f47df58e700 1 -- start start 2023-10-19T08:39:04.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.281+0000 7f47df58e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d806b330 0x7f47d806b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:04.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.281+0000 7f47df58e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f47d80d1080 0x7f47d80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:04.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.281+0000 7f47df58e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d80d1a10 con 0x7f47d8160380 2023-10-19T08:39:04.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.281+0000 7f47df58e700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d806c3f0 con 0x7f47d80d1080 2023-10-19T08:39:04.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.281+0000 7f47df58e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d80cf970 con 0x7f47d806b330 2023-10-19T08:39:04.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.281+0000 7f47ddb2b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f47d80d1080 0x7f47d80d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:04.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.281+0000 7f47ddb2b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f47d80d1080 0x7f47d80d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47938/0 (socket says 172.21.15.79:47938) 2023-10-19T08:39:04.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.282+0000 7f47ddb2b700 1 -- 172.21.15.79:0/3415574161 learned_addr learned my addr 172.21.15.79:0/3415574161 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:04.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.282+0000 7f47dcb29700 1 --2- 172.21.15.79:0/3415574161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d806b330 0x7f47d806b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:04.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.282+0000 7f47ddb2b700 1 -- 172.21.15.79:0/3415574161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d806b330 msgr2=0x7f47d806b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:04.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.282+0000 7f47ddb2b700 1 --2- 172.21.15.79:0/3415574161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d806b330 0x7f47d806b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.282+0000 7f47ddb2b700 1 -- 172.21.15.79:0/3415574161 >> v1:172.21.15.89:6789/0 conn(0x7f47d8160380 legacy=0x7f47d80cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:04.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.282+0000 7f47ddb2b700 1 -- 172.21.15.79:0/3415574161 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d806be30 con 0x7f47d80d1080 2023-10-19T08:39:04.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.282+0000 7f47ddb2b700 1 --2- 172.21.15.79:0/3415574161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d80d1080 0x7f47d80d14d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f47d0009e50 tx=0x7f47d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c566ce08ab411c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:04.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.282+0000 7f47cffff700 1 -- 172.21.15.79:0/3415574161 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d000e070 con 0x7f47d80d1080 2023-10-19T08:39:04.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.282+0000 7f47cffff700 1 -- 172.21.15.79:0/3415574161 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d000b910 con 0x7f47d80d1080 2023-10-19T08:39:04.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.282+0000 7f47cffff700 1 -- 172.21.15.79:0/3415574161 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d000bcc0 con 0x7f47d80d1080 2023-10-19T08:39:04.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.283+0000 7f47df58e700 1 -- 172.21.15.79:0/3415574161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d80d1080 msgr2=0x7f47d80d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:04.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.283+0000 7f47df58e700 1 --2- 172.21.15.79:0/3415574161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d80d1080 0x7f47d80d14d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f47d0009e50 tx=0x7f47d000b330 comp rx=0 tx=0).stop 2023-10-19T08:39:04.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.283+0000 7f47df58e700 1 -- 172.21.15.79:0/3415574161 shutdown_connections 2023-10-19T08:39:04.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.283+0000 7f47df58e700 1 --2- 172.21.15.79:0/3415574161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d80d1080 0x7f47d80d14d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.283+0000 7f47df58e700 1 --2- 172.21.15.79:0/3415574161 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d806b330 0x7f47d806b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.283+0000 7f47df58e700 1 -- 172.21.15.79:0/3415574161 >> 172.21.15.79:0/3415574161 conn(0x7f47d806a400 msgr2=0x7f47d806a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:04.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.283+0000 7f47df58e700 1 -- 172.21.15.79:0/3415574161 shutdown_connections 2023-10-19T08:39:04.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.283+0000 7f47df58e700 1 -- 172.21.15.79:0/3415574161 wait complete. 2023-10-19T08:39:04.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.284+0000 7f47df58e700 1 Processor -- start 2023-10-19T08:39:04.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.284+0000 7f47df58e700 1 -- start start 2023-10-19T08:39:04.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47df58e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d806b330 0x7f47d80ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:04.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47df58e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d80d1080 0x7f47d80cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:04.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47df58e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d8160380 0x7f47d80cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:04.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47df58e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d80cc7f0 con 0x7f47d806b330 2023-10-19T08:39:04.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47df58e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d80ccad0 con 0x7f47d8160380 2023-10-19T08:39:04.295 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47df58e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d80ccdb0 con 0x7f47d80d1080 2023-10-19T08:39:04.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47dd32a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d806b330 0x7f47d80ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:04.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47dd32a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d806b330 0x7f47d80ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47940/0 (socket says 172.21.15.79:47940) 2023-10-19T08:39:04.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47dd32a700 1 -- 172.21.15.79:0/2344572722 learned_addr learned my addr 172.21.15.79:0/2344572722 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:04.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47ddb2b700 1 --2- 172.21.15.79:0/2344572722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d8160380 0x7f47d80cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:04.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47dcb29700 1 --2- 172.21.15.79:0/2344572722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d80d1080 0x7f47d80cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:04.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47dd32a700 1 -- 172.21.15.79:0/2344572722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d80d1080 msgr2=0x7f47d80cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:04.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47dd32a700 1 --2- 172.21.15.79:0/2344572722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d80d1080 0x7f47d80cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47dd32a700 1 -- 172.21.15.79:0/2344572722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d8160380 msgr2=0x7f47d80cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:04.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47dd32a700 1 --2- 172.21.15.79:0/2344572722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d8160380 0x7f47d80cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47dd32a700 1 -- 172.21.15.79:0/2344572722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d0009b30 con 0x7f47d806b330 2023-10-19T08:39:04.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47ddb2b700 1 --2- 172.21.15.79:0/2344572722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d8160380 0x7f47d80cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:04.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47dd32a700 1 --2- 172.21.15.79:0/2344572722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d806b330 0x7f47d80ca4a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f47c800c450 tx=0x7f47c800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:04.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47cdffb700 1 -- 172.21.15.79:0/2344572722 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c80052d0 con 0x7f47d806b330 2023-10-19T08:39:04.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47cdffb700 1 -- 172.21.15.79:0/2344572722 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c8005430 con 0x7f47d806b330 2023-10-19T08:39:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47df58e700 1 -- 172.21.15.79:0/2344572722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d80c7dc0 con 0x7f47d806b330 2023-10-19T08:39:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.285+0000 7f47cdffb700 1 -- 172.21.15.79:0/2344572722 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c80038c0 con 0x7f47d806b330 2023-10-19T08:39:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.286+0000 7f47df58e700 1 -- 172.21.15.79:0/2344572722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d80cbef0 con 0x7f47d806b330 2023-10-19T08:39:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.286+0000 7f47df58e700 1 -- 172.21.15.79:0/2344572722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d80c82e0 con 0x7f47d806b330 2023-10-19T08:39:04.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.287+0000 7f47cdffb700 1 -- 172.21.15.79:0/2344572722 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f47c8003a20 con 0x7f47d806b330 2023-10-19T08:39:04.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.287+0000 7f47cdffb700 1 --2- 172.21.15.79:0/2344572722 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f47bc06a0e0 0x7f47bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:04.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.287+0000 7f47cdffb700 1 -- 172.21.15.79:0/2344572722 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f47c8087af0 con 0x7f47d806b330 2023-10-19T08:39:04.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.288+0000 7f47dcb29700 1 --2- 172.21.15.79:0/2344572722 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f47bc06a0e0 0x7f47bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:04.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.288+0000 7f47dcb29700 1 --2- 172.21.15.79:0/2344572722 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f47bc06a0e0 0x7f47bc06c5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f47d8150750 tx=0x7f47d4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:04.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.292+0000 7f47cdffb700 1 -- 172.21.15.79:0/2344572722 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f47d80c82e0 con 0x7f47d806b330 2023-10-19T08:39:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.499+0000 7f47df58e700 1 -- 172.21.15.79:0/2344572722 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f47d80d1a10 con 0x7f47d806b330 2023-10-19T08:39:04.503 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.499+0000 7f47cdffb700 1 -- 172.21.15.79:0/2344572722 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f47d80d1a10 con 0x7f47d806b330 2023-10-19T08:39:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.501+0000 7f47df58e700 1 -- 172.21.15.79:0/2344572722 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f47bc06a0e0 msgr2=0x7f47bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.501+0000 7f47df58e700 1 --2- 172.21.15.79:0/2344572722 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f47bc06a0e0 0x7f47bc06c5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f47d8150750 tx=0x7f47d4008040 comp rx=0 tx=0).stop 2023-10-19T08:39:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.501+0000 7f47df58e700 1 -- 172.21.15.79:0/2344572722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d806b330 msgr2=0x7f47d80ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.501+0000 7f47df58e700 1 --2- 172.21.15.79:0/2344572722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d806b330 0x7f47d80ca4a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f47c800c450 tx=0x7f47c800c810 comp rx=0 tx=0).stop 2023-10-19T08:39:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.501+0000 7f47df58e700 1 -- 172.21.15.79:0/2344572722 shutdown_connections 2023-10-19T08:39:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.501+0000 7f47df58e700 1 --2- 172.21.15.79:0/2344572722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d8160380 0x7f47d80cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.501+0000 7f47df58e700 1 --2- 172.21.15.79:0/2344572722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d806b330 0x7f47d80ca4a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.501+0000 7f47df58e700 1 --2- 172.21.15.79:0/2344572722 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f47bc06a0e0 0x7f47bc06c5a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.501+0000 7f47df58e700 1 --2- 172.21.15.79:0/2344572722 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d80d1080 0x7f47d80cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.501+0000 7f47df58e700 1 -- 172.21.15.79:0/2344572722 >> 172.21.15.79:0/2344572722 conn(0x7f47d806a400 msgr2=0x7f47d814cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:04.507 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.501+0000 7f47df58e700 1 -- 172.21.15.79:0/2344572722 shutdown_connections 2023-10-19T08:39:04.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.501+0000 7f47df58e700 1 -- 172.21.15.79:0/2344572722 wait complete. 2023-10-19T08:39:04.508 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2023-10-19T08:39:04.516 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:39:04.517 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T08:39:04.539 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:39:04.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.656+0000 7f7ff063a700 1 Processor -- start 2023-10-19T08:39:04.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.656+0000 7f7ff063a700 1 -- start start 2023-10-19T08:39:04.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7ff063a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe8159f40 0x7f7fe815e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:04.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7ff063a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7fe80cf710 0x7f7fe80cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:04.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7ff063a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe815e870 con 0x7f7fe80b5610 2023-10-19T08:39:04.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7ff063a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe80b5aa0 con 0x7f7fe80cf710 2023-10-19T08:39:04.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7ff063a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80cd800 con 0x7f7fe8159f40 2023-10-19T08:39:04.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7fedbd5700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7fe80b5610 0x7f7fe80cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58020/0 (socket says 172.21.15.79:58020) 2023-10-19T08:39:04.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7fedbd5700 1 -- 172.21.15.79:0/3943754769 learned_addr learned my addr 172.21.15.79:0/3943754769 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:04.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7fee3d6700 1 --2- 172.21.15.79:0/3943754769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe8159f40 0x7f7fe815e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:04.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7fed3d4700 1 -- 172.21.15.79:0/3943754769 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362032858 0 0) 0x7f7fe815e870 con 0x7f7fe80b5610 2023-10-19T08:39:04.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7feebd7700 1 --2- 172.21.15.79:0/3943754769 >> v2:172.21.15.89:3300/0 conn(0x7f7fe80cf710 0x7f7fe80cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:04.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7fed3d4700 1 -- 172.21.15.79:0/3943754769 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fd40035b0 con 0x7f7fe80b5610 2023-10-19T08:39:04.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7fed3d4700 1 -- 172.21.15.79:0/3943754769 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2767677103 0 0) 0x7f7fd40035b0 con 0x7f7fe80b5610 2023-10-19T08:39:04.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7fed3d4700 1 -- 172.21.15.79:0/3943754769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe8159f40 msgr2=0x7f7fe815e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:04.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7fed3d4700 1 --2- 172.21.15.79:0/3943754769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe8159f40 0x7f7fe815e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7fed3d4700 1 -- 172.21.15.79:0/3943754769 >> v2:172.21.15.89:3300/0 conn(0x7f7fe80cf710 msgr2=0x7f7fe80cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:04.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7fed3d4700 1 --2- 172.21.15.79:0/3943754769 >> v2:172.21.15.89:3300/0 conn(0x7f7fe80cf710 0x7f7fe80cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7fed3d4700 1 -- 172.21.15.79:0/3943754769 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe80cdae0 con 0x7f7fe80b5610 2023-10-19T08:39:04.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7fed3d4700 1 -- 172.21.15.79:0/3943754769 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f7fd8001670 con 0x7f7fe80b5610 2023-10-19T08:39:04.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7fed3d4700 1 -- 172.21.15.79:0/3943754769 >> v1:172.21.15.79:6789/0 conn(0x7f7fe80b5610 legacy=0x7f7fe80cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:04.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7fed3d4700 1 --2- 172.21.15.79:0/3943754769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fd4003a00 0x7f7fd4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:04.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7fed3d4700 1 --2- 172.21.15.79:0/3943754769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe8159f40 0x7f7fd4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:04.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7fed3d4700 1 --2- 172.21.15.79:0/3943754769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd4004d90 0x7f7fd4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:04.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7fed3d4700 1 -- 172.21.15.79:0/3943754769 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80b5aa0 con 0x7f7fd4003a00 2023-10-19T08:39:04.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7fed3d4700 1 -- 172.21.15.79:0/3943754769 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80cd800 con 0x7f7fd4004d90 2023-10-19T08:39:04.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.657+0000 7f7fed3d4700 1 -- 172.21.15.79:0/3943754769 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd400ba10 con 0x7f7fe8159f40 2023-10-19T08:39:04.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.658+0000 7f7fee3d6700 1 --2- 172.21.15.79:0/3943754769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fd4003a00 0x7f7fd4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:04.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.658+0000 7f7feebd7700 1 --2- 172.21.15.79:0/3943754769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd4004d90 0x7f7fd4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:04.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.658+0000 7f7fedbd5700 1 --2- 172.21.15.79:0/3943754769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe8159f40 0x7f7fd4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:04.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.658+0000 7f7fee3d6700 1 -- 172.21.15.79:0/3943754769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe8159f40 msgr2=0x7f7fd4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:04.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.658+0000 7f7fee3d6700 1 --2- 172.21.15.79:0/3943754769 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe8159f40 0x7f7fd4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.658+0000 7f7fee3d6700 1 -- 172.21.15.79:0/3943754769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd4004d90 msgr2=0x7f7fd4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:04.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.658+0000 7f7fee3d6700 1 --2- 172.21.15.79:0/3943754769 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd4004d90 0x7f7fd4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.658+0000 7f7fee3d6700 1 -- 172.21.15.79:0/3943754769 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd40035b0 con 0x7f7fd4003a00 2023-10-19T08:39:04.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.658+0000 7f7fee3d6700 1 --2- 172.21.15.79:0/3943754769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fd4003a00 0x7f7fd4003e20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4010b00 tx=0x7f7fd4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a974b451b7813a server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:04.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.658+0000 7f7fed3d4700 1 -- 172.21.15.79:0/3943754769 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4015070 con 0x7f7fd4003a00 2023-10-19T08:39:04.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.658+0000 7f7fed3d4700 1 -- 172.21.15.79:0/3943754769 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe4009a30 con 0x7f7fd4003a00 2023-10-19T08:39:04.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.658+0000 7f7fed3d4700 1 -- 172.21.15.79:0/3943754769 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe4009dc0 con 0x7f7fd4003a00 2023-10-19T08:39:04.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.659+0000 7f7ff063a700 1 -- 172.21.15.79:0/3943754769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fd4003a00 msgr2=0x7f7fd4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:04.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.659+0000 7f7ff063a700 1 --2- 172.21.15.79:0/3943754769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fd4003a00 0x7f7fd4003e20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4010b00 tx=0x7f7fd4005880 comp rx=0 tx=0).stop 2023-10-19T08:39:04.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.659+0000 7f7feebd7700 1 -- 172.21.15.79:0/3943754769 reap_dead start 2023-10-19T08:39:04.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.659+0000 7f7ff063a700 1 -- 172.21.15.79:0/3943754769 shutdown_connections 2023-10-19T08:39:04.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.659+0000 7f7ff063a700 1 -- 172.21.15.79:0/3943754769 >> 172.21.15.79:0/3943754769 conn(0x7f7fe806dcc0 msgr2=0x7f7fe806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:04.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.659+0000 7f7ff063a700 1 -- 172.21.15.79:0/3943754769 shutdown_connections 2023-10-19T08:39:04.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.659+0000 7f7ff063a700 1 -- 172.21.15.79:0/3943754769 wait complete. 2023-10-19T08:39:04.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.660+0000 7f7ff063a700 1 Processor -- start 2023-10-19T08:39:04.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.660+0000 7f7ff063a700 1 -- start start 2023-10-19T08:39:04.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7ff063a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd4003a00 0x7f7fe80c3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:04.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7ff063a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe81500b0 0x7f7fe8150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:04.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7ff063a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe80c5ac0 0x7f7fe80c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:04.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7ff063a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe815adf0 con 0x7f7fe81500b0 2023-10-19T08:39:04.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7ff063a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe8150a70 con 0x7f7fd4003a00 2023-10-19T08:39:04.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7ff063a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe80c3f00 con 0x7f7fe80c5ac0 2023-10-19T08:39:04.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7fedbd5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe81500b0 0x7f7fe8150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:04.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7fedbd5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe81500b0 0x7f7fe8150530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47962/0 (socket says 172.21.15.79:47962) 2023-10-19T08:39:04.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7fedbd5700 1 -- 172.21.15.79:0/1190487645 learned_addr learned my addr 172.21.15.79:0/1190487645 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:04.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7fee3d6700 1 --2- 172.21.15.79:0/1190487645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd4003a00 0x7f7fe80c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:04.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7fedbd5700 1 -- 172.21.15.79:0/1190487645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe80c5ac0 msgr2=0x7f7fe80c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:04.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7feebd7700 1 --2- 172.21.15.79:0/1190487645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe80c5ac0 0x7f7fe80c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:04.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7fedbd5700 1 --2- 172.21.15.79:0/1190487645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe80c5ac0 0x7f7fe80c5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7fedbd5700 1 -- 172.21.15.79:0/1190487645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd4003a00 msgr2=0x7f7fe80c3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:04.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7fedbd5700 1 --2- 172.21.15.79:0/1190487645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd4003a00 0x7f7fe80c3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7fedbd5700 1 -- 172.21.15.79:0/1190487645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe80c3ca0 con 0x7f7fe81500b0 2023-10-19T08:39:04.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7fee3d6700 1 --2- 172.21.15.79:0/1190487645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd4003a00 0x7f7fe80c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:04.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7fedbd5700 1 --2- 172.21.15.79:0/1190487645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe81500b0 0x7f7fe8150530 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800e8d0 tx=0x7f7fd800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:04.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7fdeffd700 1 -- 172.21.15.79:0/1190487645 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd800eed0 con 0x7f7fe81500b0 2023-10-19T08:39:04.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7fdeffd700 1 -- 172.21.15.79:0/1190487645 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd800c780 con 0x7f7fe81500b0 2023-10-19T08:39:04.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7ff063a700 1 -- 172.21.15.79:0/1190487645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe815a450 con 0x7f7fe81500b0 2023-10-19T08:39:04.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7fdeffd700 1 -- 172.21.15.79:0/1190487645 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd800cb10 con 0x7f7fe81500b0 2023-10-19T08:39:04.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.661+0000 7f7ff063a700 1 -- 172.21.15.79:0/1190487645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe815aa10 con 0x7f7fe81500b0 2023-10-19T08:39:04.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.662+0000 7f7ff063a700 1 -- 172.21.15.79:0/1190487645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe804ee70 con 0x7f7fe81500b0 2023-10-19T08:39:04.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.663+0000 7f7fdeffd700 1 -- 172.21.15.79:0/1190487645 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7fd800cc70 con 0x7f7fe81500b0 2023-10-19T08:39:04.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.663+0000 7f7fdeffd700 1 --2- 172.21.15.79:0/1190487645 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7fcc06a110 0x7f7fcc06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:04.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.663+0000 7f7fdeffd700 1 -- 172.21.15.79:0/1190487645 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7fd8088800 con 0x7f7fe81500b0 2023-10-19T08:39:04.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.663+0000 7f7fee3d6700 1 --2- 172.21.15.79:0/1190487645 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7fcc06a110 0x7f7fcc06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:04.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.664+0000 7f7fee3d6700 1 --2- 172.21.15.79:0/1190487645 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7fcc06a110 0x7f7fcc06c5d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40090b0 tx=0x7f7fe4016000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:04.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.667+0000 7f7fdeffd700 1 -- 172.21.15.79:0/1190487645 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f7fd8053bd0 con 0x7f7fe81500b0 2023-10-19T08:39:04.862 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.858+0000 7f7ff063a700 1 -- 172.21.15.79:0/1190487645 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fe80668a0 con 0x7f7fe81500b0 2023-10-19T08:39:04.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.860+0000 7f7fdeffd700 1 -- 172.21.15.79:0/1190487645 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20155 (secure 0 0 0) 0x7f7fd80571f0 con 0x7f7fe81500b0 2023-10-19T08:39:04.864 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:04.864 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:44.473795+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:39:04.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.862+0000 7f7ff063a700 1 -- 172.21.15.79:0/1190487645 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7fcc06a110 msgr2=0x7f7fcc06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:04.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.862+0000 7f7ff063a700 1 --2- 172.21.15.79:0/1190487645 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7fcc06a110 0x7f7fcc06c5d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40090b0 tx=0x7f7fe4016000 comp rx=0 tx=0).stop 2023-10-19T08:39:04.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.862+0000 7f7ff063a700 1 -- 172.21.15.79:0/1190487645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe81500b0 msgr2=0x7f7fe8150530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:04.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.862+0000 7f7ff063a700 1 --2- 172.21.15.79:0/1190487645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe81500b0 0x7f7fe8150530 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7fd800e8d0 tx=0x7f7fd800ec90 comp rx=0 tx=0).stop 2023-10-19T08:39:04.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.862+0000 7f7ff063a700 1 -- 172.21.15.79:0/1190487645 shutdown_connections 2023-10-19T08:39:04.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.862+0000 7f7ff063a700 1 --2- 172.21.15.79:0/1190487645 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7fcc06a110 0x7f7fcc06c5d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.862+0000 7f7ff063a700 1 --2- 172.21.15.79:0/1190487645 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7fe80c5ac0 0x7f7fe80c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.862+0000 7f7ff063a700 1 --2- 172.21.15.79:0/1190487645 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7fd4003a00 0x7f7fe80c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.862+0000 7f7ff063a700 1 --2- 172.21.15.79:0/1190487645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fe81500b0 0x7f7fe8150530 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:04.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.862+0000 7f7ff063a700 1 -- 172.21.15.79:0/1190487645 >> 172.21.15.79:0/1190487645 conn(0x7f7fe806dcc0 msgr2=0x7f7fe8151190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:04.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.862+0000 7f7ff063a700 1 -- 172.21.15.79:0/1190487645 shutdown_connections 2023-10-19T08:39:04.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.862+0000 7f7ff063a700 1 -- 172.21.15.79:0/1190487645 wait complete. 2023-10-19T08:39:04.878 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T08:37:54.318159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T08:37:55.629862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T08:37:59.333062+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T08:39:04.879 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:39:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.999+0000 7f215a0b8700 1 Processor -- start 2023-10-19T08:39:05.003 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:04.999+0000 7f215a0b8700 1 -- start start 2023-10-19T08:39:05.005 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.000+0000 7f215a0b8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f215415e570 0x7f21540d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:05.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.000+0000 7f215a0b8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21540cb6f0 0x7f21540b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:05.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.000+0000 7f215a0b8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21540afd60 con 0x7f21540b0a30 2023-10-19T08:39:05.006 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.000+0000 7f215a0b8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21540b0ec0 con 0x7f21540cb6f0 2023-10-19T08:39:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.000+0000 7f215a0b8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21540af810 con 0x7f215415e570 2023-10-19T08:39:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.000+0000 7f2152ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21540cb6f0 0x7f21540b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.000+0000 7f2152ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f21540cb6f0 0x7f21540b04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47970/0 (socket says 172.21.15.79:47970) 2023-10-19T08:39:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.000+0000 7f2152ffd700 1 -- 172.21.15.79:0/542604743 learned_addr learned my addr 172.21.15.79:0/542604743 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:05.007 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.000+0000 7f21537fe700 1 --2- 172.21.15.79:0/542604743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f215415e570 0x7f21540d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:05.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.000+0000 7f2152ffd700 1 -- 172.21.15.79:0/542604743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f215415e570 msgr2=0x7f21540d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:05.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.000+0000 7f2152ffd700 1 --2- 172.21.15.79:0/542604743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f215415e570 0x7f21540d1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.000+0000 7f2152ffd700 1 -- 172.21.15.79:0/542604743 >> v1:172.21.15.89:6789/0 conn(0x7f21540b0a30 legacy=0x7f21540b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:05.008 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.000+0000 7f2152ffd700 1 -- 172.21.15.79:0/542604743 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21540aef70 con 0x7f21540cb6f0 2023-10-19T08:39:05.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.000+0000 7f2152ffd700 1 --2- 172.21.15.79:0/542604743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21540cb6f0 0x7f21540b04f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f21440098f0 tx=0x7f2144009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea309a2a9114e53 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:05.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.000+0000 7f21527fc700 1 -- 172.21.15.79:0/542604743 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144004230 con 0x7f21540cb6f0 2023-10-19T08:39:05.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.000+0000 7f21527fc700 1 -- 172.21.15.79:0/542604743 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2144004390 con 0x7f21540cb6f0 2023-10-19T08:39:05.009 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.001+0000 7f21527fc700 1 -- 172.21.15.79:0/542604743 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21440036a0 con 0x7f21540cb6f0 2023-10-19T08:39:05.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.001+0000 7f215a0b8700 1 -- 172.21.15.79:0/542604743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21540cb6f0 msgr2=0x7f21540b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:05.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.001+0000 7f215a0b8700 1 --2- 172.21.15.79:0/542604743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21540cb6f0 0x7f21540b04f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f21440098f0 tx=0x7f2144009c00 comp rx=0 tx=0).stop 2023-10-19T08:39:05.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.001+0000 7f215a0b8700 1 -- 172.21.15.79:0/542604743 shutdown_connections 2023-10-19T08:39:05.010 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.001+0000 7f215a0b8700 1 --2- 172.21.15.79:0/542604743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f215415e570 0x7f21540d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.001+0000 7f215a0b8700 1 --2- 172.21.15.79:0/542604743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21540cb6f0 0x7f21540b04f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.001+0000 7f215a0b8700 1 -- 172.21.15.79:0/542604743 >> 172.21.15.79:0/542604743 conn(0x7f215409a0b0 msgr2=0x7f21540d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:05.011 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.001+0000 7f215a0b8700 1 -- 172.21.15.79:0/542604743 shutdown_connections 2023-10-19T08:39:05.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.001+0000 7f215a0b8700 1 -- 172.21.15.79:0/542604743 wait complete. 2023-10-19T08:39:05.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.002+0000 7f215a0b8700 1 Processor -- start 2023-10-19T08:39:05.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.002+0000 7f215a0b8700 1 -- start start 2023-10-19T08:39:05.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.003+0000 7f215a0b8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21540b0a30 0x7f21541434c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:05.015 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.003+0000 7f215a0b8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21540cb6f0 0x7f21541553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:05.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.003+0000 7f215a0b8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f215415e570 0x7f21541effb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:05.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.003+0000 7f215a0b8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2154156900 con 0x7f21540b0a30 2023-10-19T08:39:05.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.003+0000 7f215a0b8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2154156d20 con 0x7f215415e570 2023-10-19T08:39:05.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.003+0000 7f215a0b8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2154155c80 con 0x7f21540cb6f0 2023-10-19T08:39:05.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.003+0000 7f21537fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21540b0a30 0x7f21541434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:05.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.003+0000 7f21537fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21540b0a30 0x7f21541434c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47974/0 (socket says 172.21.15.79:47974) 2023-10-19T08:39:05.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.003+0000 7f21537fe700 1 -- 172.21.15.79:0/697907207 learned_addr learned my addr 172.21.15.79:0/697907207 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:05.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.004+0000 7f2152ffd700 1 --2- 172.21.15.79:0/697907207 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21540cb6f0 0x7f21541553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:05.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.004+0000 7f21537fe700 1 -- 172.21.15.79:0/697907207 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21540cb6f0 msgr2=0x7f21541553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:05.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.004+0000 7f21537fe700 1 --2- 172.21.15.79:0/697907207 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21540cb6f0 0x7f21541553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.004+0000 7f21537fe700 1 -- 172.21.15.79:0/697907207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f215415e570 msgr2=0x7f21541effb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:05.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.004+0000 7f2153fff700 1 --2- 172.21.15.79:0/697907207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f215415e570 0x7f21541effb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:05.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.004+0000 7f21537fe700 1 --2- 172.21.15.79:0/697907207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f215415e570 0x7f21541effb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.004+0000 7f21537fe700 1 -- 172.21.15.79:0/697907207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2144009550 con 0x7f21540b0a30 2023-10-19T08:39:05.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.004+0000 7f2153fff700 1 --2- 172.21.15.79:0/697907207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f215415e570 0x7f21541effb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:05.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.004+0000 7f21537fe700 1 --2- 172.21.15.79:0/697907207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21540b0a30 0x7f21541434c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f213c00c7f0 tx=0x7f213c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:05.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.004+0000 7f214bfff700 1 -- 172.21.15.79:0/697907207 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c011800 con 0x7f21540b0a30 2023-10-19T08:39:05.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.004+0000 7f214bfff700 1 -- 172.21.15.79:0/697907207 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c011960 con 0x7f21540b0a30 2023-10-19T08:39:05.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.004+0000 7f215a0b8700 1 -- 172.21.15.79:0/697907207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2154155f60 con 0x7f21540b0a30 2023-10-19T08:39:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.004+0000 7f214bfff700 1 -- 172.21.15.79:0/697907207 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c011cf0 con 0x7f21540b0a30 2023-10-19T08:39:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.004+0000 7f215a0b8700 1 -- 172.21.15.79:0/697907207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2154156520 con 0x7f21540b0a30 2023-10-19T08:39:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.005+0000 7f215a0b8700 1 -- 172.21.15.79:0/697907207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f215404ee70 con 0x7f21540b0a30 2023-10-19T08:39:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.005+0000 7f214bfff700 1 -- 172.21.15.79:0/697907207 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f213c018360 con 0x7f21540b0a30 2023-10-19T08:39:05.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.006+0000 7f214bfff700 1 --2- 172.21.15.79:0/697907207 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f213406a0e0 0x7f213406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.006+0000 7f214bfff700 1 -- 172.21.15.79:0/697907207 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f213c088810 con 0x7f21540b0a30 2023-10-19T08:39:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.006+0000 7f2152ffd700 1 --2- 172.21.15.79:0/697907207 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f213406a0e0 0x7f213406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.006+0000 7f2152ffd700 1 --2- 172.21.15.79:0/697907207 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f213406a0e0 0x7f213406c5a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f21540cbaf0 tx=0x7f2144008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:05.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.010+0000 7f214bfff700 1 -- 172.21.15.79:0/697907207 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f213c053bd0 con 0x7f21540b0a30 2023-10-19T08:39:05.203 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.200+0000 7f215a0b8700 1 -- 172.21.15.79:0/697907207 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2154072cf0 con 0x7f21540b0a30 2023-10-19T08:39:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.200+0000 7f214bfff700 1 -- 172.21.15.79:0/697907207 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f213c0571f0 con 0x7f21540b0a30 2023-10-19T08:39:05.204 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:39:05.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.202+0000 7f215a0b8700 1 -- 172.21.15.79:0/697907207 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f213406a0e0 msgr2=0x7f213406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:05.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.202+0000 7f215a0b8700 1 --2- 172.21.15.79:0/697907207 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f213406a0e0 0x7f213406c5a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f21540cbaf0 tx=0x7f2144008030 comp rx=0 tx=0).stop 2023-10-19T08:39:05.206 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.202+0000 7f215a0b8700 1 -- 172.21.15.79:0/697907207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21540b0a30 msgr2=0x7f21541434c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.202+0000 7f215a0b8700 1 --2- 172.21.15.79:0/697907207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21540b0a30 0x7f21541434c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f213c00c7f0 tx=0x7f213c00cbb0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.202+0000 7f215a0b8700 1 -- 172.21.15.79:0/697907207 shutdown_connections 2023-10-19T08:39:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.202+0000 7f215a0b8700 1 --2- 172.21.15.79:0/697907207 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f215415e570 0x7f21541effb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.202+0000 7f215a0b8700 1 --2- 172.21.15.79:0/697907207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21540b0a30 0x7f21541434c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.202+0000 7f215a0b8700 1 --2- 172.21.15.79:0/697907207 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f213406a0e0 0x7f213406c5a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.202+0000 7f215a0b8700 1 --2- 172.21.15.79:0/697907207 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f21540cb6f0 0x7f21541553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.202+0000 7f215a0b8700 1 -- 172.21.15.79:0/697907207 >> 172.21.15.79:0/697907207 conn(0x7f215409a0b0 msgr2=0x7f215406f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.202+0000 7f215a0b8700 1 -- 172.21.15.79:0/697907207 shutdown_connections 2023-10-19T08:39:05.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.202+0000 7f215a0b8700 1 -- 172.21.15.79:0/697907207 wait complete. 2023-10-19T08:39:05.218 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:39:05.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.337+0000 7f7e9c367700 1 Processor -- start 2023-10-19T08:39:05.341 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.337+0000 7f7e9c367700 1 -- start start 2023-10-19T08:39:05.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.338+0000 7f7e9c367700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7e9415aec0 0x7f7e94070120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:05.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.338+0000 7f7e9c367700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7e9406a930 0x7f7e940b3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:05.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.338+0000 7f7e9c367700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e940b31d0 con 0x7f7e940ca280 2023-10-19T08:39:05.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.338+0000 7f7e9c367700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9415b2a0 con 0x7f7e9406a930 2023-10-19T08:39:05.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.338+0000 7f7e9c367700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e940b2650 con 0x7f7e9415aec0 2023-10-19T08:39:05.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.338+0000 7f7e9a904700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7e9406a930 0x7f7e940b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:05.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.338+0000 7f7e9a904700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7e9406a930 0x7f7e940b3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47982/0 (socket says 172.21.15.79:47982) 2023-10-19T08:39:05.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.338+0000 7f7e9a904700 1 -- 172.21.15.79:0/1947468151 learned_addr learned my addr 172.21.15.79:0/1947468151 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:05.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.338+0000 7f7e9a103700 1 --2- 172.21.15.79:0/1947468151 >> v2:172.21.15.89:3300/0 conn(0x7f7e9415aec0 0x7f7e94070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:05.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.339+0000 7f7e9a904700 1 -- 172.21.15.79:0/1947468151 >> v2:172.21.15.89:3300/0 conn(0x7f7e9415aec0 msgr2=0x7f7e94070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:05.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.339+0000 7f7e9a904700 1 --2- 172.21.15.79:0/1947468151 >> v2:172.21.15.89:3300/0 conn(0x7f7e9415aec0 0x7f7e94070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.339+0000 7f7e9a904700 1 -- 172.21.15.79:0/1947468151 >> v1:172.21.15.89:6789/0 conn(0x7f7e940ca280 legacy=0x7f7e9406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:05.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.339+0000 7f7e9a904700 1 -- 172.21.15.79:0/1947468151 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e940cac60 con 0x7f7e9406a930 2023-10-19T08:39:05.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.339+0000 7f7e9a904700 1 --2- 172.21.15.79:0/1947468151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9406a930 0x7f7e940b3660 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7e940cd6c0 tx=0x7f7e8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bedb69d3729c054 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:05.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.339+0000 7f7e99101700 1 -- 172.21.15.79:0/1947468151 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00e070 con 0x7f7e9406a930 2023-10-19T08:39:05.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.339+0000 7f7e99101700 1 -- 172.21.15.79:0/1947468151 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c00b910 con 0x7f7e9406a930 2023-10-19T08:39:05.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.339+0000 7f7e99101700 1 -- 172.21.15.79:0/1947468151 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00bcc0 con 0x7f7e9406a930 2023-10-19T08:39:05.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.339+0000 7f7e9c367700 1 -- 172.21.15.79:0/1947468151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9406a930 msgr2=0x7f7e940b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:05.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.339+0000 7f7e9c367700 1 --2- 172.21.15.79:0/1947468151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9406a930 0x7f7e940b3660 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7e940cd6c0 tx=0x7f7e8c00b330 comp rx=0 tx=0).stop 2023-10-19T08:39:05.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.340+0000 7f7e9c367700 1 -- 172.21.15.79:0/1947468151 shutdown_connections 2023-10-19T08:39:05.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.340+0000 7f7e9c367700 1 --2- 172.21.15.79:0/1947468151 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9406a930 0x7f7e940b3660 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.340+0000 7f7e9c367700 1 --2- 172.21.15.79:0/1947468151 >> v2:172.21.15.89:3300/0 conn(0x7f7e9415aec0 0x7f7e94070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.340+0000 7f7e9c367700 1 -- 172.21.15.79:0/1947468151 >> 172.21.15.79:0/1947468151 conn(0x7f7e9406dcc0 msgr2=0x7f7e9406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:05.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.340+0000 7f7e9c367700 1 -- 172.21.15.79:0/1947468151 shutdown_connections 2023-10-19T08:39:05.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.340+0000 7f7e9c367700 1 -- 172.21.15.79:0/1947468151 wait complete. 2023-10-19T08:39:05.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.341+0000 7f7e9c367700 1 Processor -- start 2023-10-19T08:39:05.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.341+0000 7f7e9c367700 1 -- start start 2023-10-19T08:39:05.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.342+0000 7f7e9c367700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9406a930 0x7f7e940b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:05.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.342+0000 7f7e9c367700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e940ca280 0x7f7e940b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:05.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.342+0000 7f7e9c367700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e9415aec0 0x7f7e9415c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:05.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.342+0000 7f7e9c367700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9415d580 con 0x7f7e9406a930 2023-10-19T08:39:05.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.342+0000 7f7e9c367700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9415d860 con 0x7f7e9415aec0 2023-10-19T08:39:05.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.342+0000 7f7e9c367700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9415db40 con 0x7f7e940ca280 2023-10-19T08:39:05.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.342+0000 7f7e9a103700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9406a930 0x7f7e940b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:05.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.342+0000 7f7e9a103700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9406a930 0x7f7e940b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:47988/0 (socket says 172.21.15.79:47988) 2023-10-19T08:39:05.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.342+0000 7f7e9a103700 1 -- 172.21.15.79:0/407399074 learned_addr learned my addr 172.21.15.79:0/407399074 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:05.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.342+0000 7f7e9a904700 1 --2- 172.21.15.79:0/407399074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e9415aec0 0x7f7e9415c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:05.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.342+0000 7f7e99902700 1 --2- 172.21.15.79:0/407399074 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e940ca280 0x7f7e940b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:05.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.343+0000 7f7e9a103700 1 -- 172.21.15.79:0/407399074 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e940ca280 msgr2=0x7f7e940b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:05.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.343+0000 7f7e9a103700 1 --2- 172.21.15.79:0/407399074 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e940ca280 0x7f7e940b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.343+0000 7f7e9a103700 1 -- 172.21.15.79:0/407399074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e9415aec0 msgr2=0x7f7e9415c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:05.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.343+0000 7f7e9a103700 1 --2- 172.21.15.79:0/407399074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e9415aec0 0x7f7e9415c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.343+0000 7f7e9a103700 1 -- 172.21.15.79:0/407399074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c009b30 con 0x7f7e9406a930 2023-10-19T08:39:05.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.343+0000 7f7e9a904700 1 --2- 172.21.15.79:0/407399074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e9415aec0 0x7f7e9415c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:05.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.343+0000 7f7e9a103700 1 --2- 172.21.15.79:0/407399074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9406a930 0x7f7e940b05c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400e9b0 tx=0x7f7e8400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:05.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.343+0000 7f7e8affd700 1 -- 172.21.15.79:0/407399074 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84009710 con 0x7f7e9406a930 2023-10-19T08:39:05.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.343+0000 7f7e8affd700 1 -- 172.21.15.79:0/407399074 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8400c850 con 0x7f7e9406a930 2023-10-19T08:39:05.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.343+0000 7f7e9c367700 1 -- 172.21.15.79:0/407399074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9415de20 con 0x7f7e9406a930 2023-10-19T08:39:05.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.343+0000 7f7e8affd700 1 -- 172.21.15.79:0/407399074 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8400cbc0 con 0x7f7e9406a930 2023-10-19T08:39:05.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.343+0000 7f7e9c367700 1 -- 172.21.15.79:0/407399074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e94154750 con 0x7f7e9406a930 2023-10-19T08:39:05.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.344+0000 7f7e9c367700 1 -- 172.21.15.79:0/407399074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9414ed20 con 0x7f7e9406a930 2023-10-19T08:39:05.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.345+0000 7f7e8affd700 1 -- 172.21.15.79:0/407399074 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7e8400cd20 con 0x7f7e9406a930 2023-10-19T08:39:05.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.346+0000 7f7e8affd700 1 --2- 172.21.15.79:0/407399074 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7e7806a0e0 0x7f7e7806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:05.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.346+0000 7f7e8affd700 1 -- 172.21.15.79:0/407399074 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7e84089120 con 0x7f7e9406a930 2023-10-19T08:39:05.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.346+0000 7f7e99902700 1 --2- 172.21.15.79:0/407399074 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7e7806a0e0 0x7f7e7806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:05.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.346+0000 7f7e99902700 1 --2- 172.21.15.79:0/407399074 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7e7806a0e0 0x7f7e7806c5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7e94154d90 tx=0x7f7e90009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:05.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.350+0000 7f7e8affd700 1 -- 172.21.15.79:0/407399074 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f7e84058050 con 0x7f7e9406a930 2023-10-19T08:39:05.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.539+0000 7f7e9c367700 1 -- 172.21.15.79:0/407399074 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7e940c6600 con 0x7f7e9406a930 2023-10-19T08:39:05.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.540+0000 7f7e8affd700 1 -- 172.21.15.79:0/407399074 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7e840170a0 con 0x7f7e9406a930 2023-10-19T08:39:05.544 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:39:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.542+0000 7f7e9c367700 1 -- 172.21.15.79:0/407399074 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7e7806a0e0 msgr2=0x7f7e7806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:05.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.542+0000 7f7e9c367700 1 --2- 172.21.15.79:0/407399074 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7e7806a0e0 0x7f7e7806c5a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7e94154d90 tx=0x7f7e90009040 comp rx=0 tx=0).stop 2023-10-19T08:39:05.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.542+0000 7f7e9c367700 1 -- 172.21.15.79:0/407399074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9406a930 msgr2=0x7f7e940b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:05.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.542+0000 7f7e9c367700 1 --2- 172.21.15.79:0/407399074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9406a930 0x7f7e940b05c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400e9b0 tx=0x7f7e8400ed70 comp rx=0 tx=0).stop 2023-10-19T08:39:05.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.542+0000 7f7e9c367700 1 -- 172.21.15.79:0/407399074 shutdown_connections 2023-10-19T08:39:05.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.542+0000 7f7e9c367700 1 --2- 172.21.15.79:0/407399074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e9415aec0 0x7f7e9415c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.542+0000 7f7e9c367700 1 --2- 172.21.15.79:0/407399074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7e9406a930 0x7f7e940b05c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.542+0000 7f7e9c367700 1 --2- 172.21.15.79:0/407399074 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f7e7806a0e0 0x7f7e7806c5a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.542+0000 7f7e9c367700 1 --2- 172.21.15.79:0/407399074 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e940ca280 0x7f7e940b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.542+0000 7f7e9c367700 1 -- 172.21.15.79:0/407399074 >> 172.21.15.79:0/407399074 conn(0x7f7e9406dcc0 msgr2=0x7f7e940b3900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:05.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.542+0000 7f7e9c367700 1 -- 172.21.15.79:0/407399074 shutdown_connections 2023-10-19T08:39:05.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.542+0000 7f7e9c367700 1 -- 172.21.15.79:0/407399074 wait complete. 2023-10-19T08:39:05.557 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T08:39:05.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.677+0000 7fde114ed700 1 Processor -- start 2023-10-19T08:39:05.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.678+0000 7fde114ed700 1 -- start start 2023-10-19T08:39:05.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.678+0000 7fde114ed700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fde0c0b0c00 0x7fde0c0d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:05.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.678+0000 7fde114ed700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fde0c0cb6f0 0x7fde0c0ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:05.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.678+0000 7fde114ed700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c0b25f0 con 0x7fde0c15e570 2023-10-19T08:39:05.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.678+0000 7fde114ed700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0c0afd60 con 0x7fde0c0cb6f0 2023-10-19T08:39:05.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.678+0000 7fde114ed700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0c0af810 con 0x7fde0c0b0c00 2023-10-19T08:39:05.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.678+0000 7fde0b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fde0c0cb6f0 0x7fde0c0ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:05.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.678+0000 7fde0affd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fde0c15e570 0x7fde0c0b04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58068/0 (socket says 172.21.15.79:58068) 2023-10-19T08:39:05.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.678+0000 7fde0b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fde0c0cb6f0 0x7fde0c0ad9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48000/0 (socket says 172.21.15.79:48000) 2023-10-19T08:39:05.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.678+0000 7fde0affd700 1 -- 172.21.15.79:0/2094881001 learned_addr learned my addr 172.21.15.79:0/2094881001 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:05.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.679+0000 7fde0b7fe700 1 -- 172.21.15.79:0/2094881001 >> v2:172.21.15.89:3300/0 conn(0x7fde0c0b0c00 msgr2=0x7fde0c0d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:05.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.679+0000 7fde0b7fe700 1 --2- 172.21.15.79:0/2094881001 >> v2:172.21.15.89:3300/0 conn(0x7fde0c0b0c00 0x7fde0c0d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.679+0000 7fde0b7fe700 1 -- 172.21.15.79:0/2094881001 >> v1:172.21.15.79:6789/0 conn(0x7fde0c15e570 legacy=0x7fde0c0b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:05.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.679+0000 7fde0b7fe700 1 -- 172.21.15.79:0/2094881001 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c0aef70 con 0x7fde0c0cb6f0 2023-10-19T08:39:05.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.679+0000 7fde09ffb700 1 -- 172.21.15.79:0/2094881001 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429402733 0 0) 0x7fde0c0b25f0 con 0x7fde0c15e570 2023-10-19T08:39:05.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.679+0000 7fde0b7fe700 1 --2- 172.21.15.79:0/2094881001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c0cb6f0 0x7fde0c0ad9a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fde0c0ce960 tx=0x7fde0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea502644bee8cd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:05.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.679+0000 7fde09ffb700 1 -- 172.21.15.79:0/2094881001 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0400e070 con 0x7fde0c0cb6f0 2023-10-19T08:39:05.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.679+0000 7fde09ffb700 1 -- 172.21.15.79:0/2094881001 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0400bbd0 con 0x7fde0c0cb6f0 2023-10-19T08:39:05.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.679+0000 7fde09ffb700 1 -- 172.21.15.79:0/2094881001 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde04012430 con 0x7fde0c0cb6f0 2023-10-19T08:39:05.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.679+0000 7fde114ed700 1 -- 172.21.15.79:0/2094881001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c0cb6f0 msgr2=0x7fde0c0ad9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:05.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.679+0000 7fde114ed700 1 --2- 172.21.15.79:0/2094881001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c0cb6f0 0x7fde0c0ad9a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fde0c0ce960 tx=0x7fde0400b330 comp rx=0 tx=0).stop 2023-10-19T08:39:05.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.680+0000 7fde114ed700 1 -- 172.21.15.79:0/2094881001 shutdown_connections 2023-10-19T08:39:05.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.680+0000 7fde114ed700 1 --2- 172.21.15.79:0/2094881001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c0cb6f0 0x7fde0c0ad9a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.680+0000 7fde114ed700 1 --2- 172.21.15.79:0/2094881001 >> v2:172.21.15.89:3300/0 conn(0x7fde0c0b0c00 0x7fde0c0d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.680+0000 7fde114ed700 1 -- 172.21.15.79:0/2094881001 >> 172.21.15.79:0/2094881001 conn(0x7fde0c09a0b0 msgr2=0x7fde0c0d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:05.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.680+0000 7fde114ed700 1 -- 172.21.15.79:0/2094881001 shutdown_connections 2023-10-19T08:39:05.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.680+0000 7fde114ed700 1 -- 172.21.15.79:0/2094881001 wait complete. 2023-10-19T08:39:05.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.681+0000 7fde114ed700 1 Processor -- start 2023-10-19T08:39:05.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.681+0000 7fde114ed700 1 -- start start 2023-10-19T08:39:05.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fde114ed700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde0c0b0c00 0x7fde0c09e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:05.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fde114ed700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde0c0cb6f0 0x7fde0c0c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:05.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fde114ed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c15e570 0x7fde0c15afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:05.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fde114ed700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c15b510 con 0x7fde0c15e570 2023-10-19T08:39:05.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fde114ed700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c0c5890 con 0x7fde0c0b0c00 2023-10-19T08:39:05.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fde114ed700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c15b9c0 con 0x7fde0c0cb6f0 2023-10-19T08:39:05.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fde0b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c15e570 0x7fde0c15afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:05.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fde0b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c15e570 0x7fde0c15afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48006/0 (socket says 172.21.15.79:48006) 2023-10-19T08:39:05.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fde0b7fe700 1 -- 172.21.15.79:0/2172626375 learned_addr learned my addr 172.21.15.79:0/2172626375 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:05.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fde0a7fc700 1 --2- 172.21.15.79:0/2172626375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde0c0cb6f0 0x7fde0c0c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:05.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fde0affd700 1 --2- 172.21.15.79:0/2172626375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde0c0b0c00 0x7fde0c09e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:05.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fde0b7fe700 1 -- 172.21.15.79:0/2172626375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde0c0cb6f0 msgr2=0x7fde0c0c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:05.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fde0b7fe700 1 --2- 172.21.15.79:0/2172626375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde0c0cb6f0 0x7fde0c0c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fde0b7fe700 1 -- 172.21.15.79:0/2172626375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde0c0b0c00 msgr2=0x7fde0c09e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:05.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fde0b7fe700 1 --2- 172.21.15.79:0/2172626375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde0c0b0c00 0x7fde0c09e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fde0b7fe700 1 -- 172.21.15.79:0/2172626375 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde04009a70 con 0x7fde0c15e570 2023-10-19T08:39:05.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fde0b7fe700 1 --2- 172.21.15.79:0/2172626375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c15e570 0x7fde0c15afd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fde04013000 tx=0x7fde04004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:05.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fddf37fe700 1 -- 172.21.15.79:0/2172626375 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde04012430 con 0x7fde0c15e570 2023-10-19T08:39:05.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fddf37fe700 1 -- 172.21.15.79:0/2172626375 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde04020070 con 0x7fde0c15e570 2023-10-19T08:39:05.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fde114ed700 1 -- 172.21.15.79:0/2172626375 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0c0c5560 con 0x7fde0c15e570 2023-10-19T08:39:05.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fddf37fe700 1 -- 172.21.15.79:0/2172626375 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde04004280 con 0x7fde0c15e570 2023-10-19T08:39:05.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.682+0000 7fde114ed700 1 -- 172.21.15.79:0/2172626375 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0c0c8ba0 con 0x7fde0c15e570 2023-10-19T08:39:05.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.683+0000 7fde114ed700 1 -- 172.21.15.79:0/2172626375 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0c0c5a40 con 0x7fde0c15e570 2023-10-19T08:39:05.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.684+0000 7fddf37fe700 1 -- 172.21.15.79:0/2172626375 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fde040043e0 con 0x7fde0c15e570 2023-10-19T08:39:05.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.684+0000 7fddf37fe700 1 --2- 172.21.15.79:0/2172626375 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fddf806a0e0 0x7fddf806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:05.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.684+0000 7fde0affd700 1 --2- 172.21.15.79:0/2172626375 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fddf806a0e0 0x7fddf806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:05.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.684+0000 7fddf37fe700 1 -- 172.21.15.79:0/2172626375 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fde04022070 con 0x7fde0c15e570 2023-10-19T08:39:05.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.685+0000 7fde0affd700 1 --2- 172.21.15.79:0/2172626375 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fddf806a0e0 0x7fddf806c5a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fde00000f60 tx=0x7fde00007c90 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:05.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.689+0000 7fddf37fe700 1 -- 172.21.15.79:0/2172626375 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fde0c0c5a40 con 0x7fde0c15e570 2023-10-19T08:39:05.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.877+0000 7fde114ed700 1 -- 172.21.15.79:0/2172626375 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fde0c0c5a40 con 0x7fde0c15e570 2023-10-19T08:39:05.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.877+0000 7fddf37fe700 1 -- 172.21.15.79:0/2172626375 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fde0c0c5a40 con 0x7fde0c15e570 2023-10-19T08:39:05.881 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:39:05.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.879+0000 7fde114ed700 1 -- 172.21.15.79:0/2172626375 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fddf806a0e0 msgr2=0x7fddf806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:05.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.879+0000 7fde114ed700 1 --2- 172.21.15.79:0/2172626375 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fddf806a0e0 0x7fddf806c5a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fde00000f60 tx=0x7fde00007c90 comp rx=0 tx=0).stop 2023-10-19T08:39:05.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.879+0000 7fde114ed700 1 -- 172.21.15.79:0/2172626375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c15e570 msgr2=0x7fde0c15afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:05.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.879+0000 7fde114ed700 1 --2- 172.21.15.79:0/2172626375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c15e570 0x7fde0c15afd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fde04013000 tx=0x7fde04004ad0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.879+0000 7fde114ed700 1 -- 172.21.15.79:0/2172626375 shutdown_connections 2023-10-19T08:39:05.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.879+0000 7fde114ed700 1 --2- 172.21.15.79:0/2172626375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde0c15e570 0x7fde0c15afd0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.879+0000 7fde114ed700 1 --2- 172.21.15.79:0/2172626375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fde0c0b0c00 0x7fde0c09e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.879+0000 7fde114ed700 1 --2- 172.21.15.79:0/2172626375 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fddf806a0e0 0x7fddf806c5a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.879+0000 7fde114ed700 1 --2- 172.21.15.79:0/2172626375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fde0c0cb6f0 0x7fde0c0c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:05.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.879+0000 7fde114ed700 1 -- 172.21.15.79:0/2172626375 >> 172.21.15.79:0/2172626375 conn(0x7fde0c09a0b0 msgr2=0x7fde0c15bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:05.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.879+0000 7fde114ed700 1 -- 172.21.15.79:0/2172626375 shutdown_connections 2023-10-19T08:39:05.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:05.879+0000 7fde114ed700 1 -- 172.21.15.79:0/2172626375 wait complete. 2023-10-19T08:39:05.895 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T08:39:06.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.013+0000 7f25a96d2700 1 Processor -- start 2023-10-19T08:39:06.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.014+0000 7f25a96d2700 1 -- start start 2023-10-19T08:39:06.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.014+0000 7f25a96d2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f25a40c5320 0x7f25a406a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:06.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.014+0000 7f25a96d2700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a40caef0 con 0x7f25a4157830 2023-10-19T08:39:06.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.014+0000 7f25a96d2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a40cb150 con 0x7f25a40c3840 2023-10-19T08:39:06.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.014+0000 7f25a96d2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a40ad7d0 con 0x7f25a40c5320 2023-10-19T08:39:06.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.014+0000 7f25a2ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f25a4157830 0x7f25a40ca7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58082/0 (socket says 172.21.15.79:58082) 2023-10-19T08:39:06.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.015+0000 7f25a2ffd700 1 -- 172.21.15.79:0/255238968 learned_addr learned my addr 172.21.15.79:0/255238968 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:06.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.015+0000 7f25a27fc700 1 --2- 172.21.15.79:0/255238968 >> v2:172.21.15.89:3300/0 conn(0x7f25a40c5320 0x7f25a406a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:06.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.015+0000 7f25a1ffb700 1 -- 172.21.15.79:0/255238968 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911067619 0 0) 0x7f25a40caef0 con 0x7f25a4157830 2023-10-19T08:39:06.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.015+0000 7f25a1ffb700 1 -- 172.21.15.79:0/255238968 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f258c0035b0 con 0x7f25a4157830 2023-10-19T08:39:06.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.015+0000 7f25a27fc700 1 -- 172.21.15.79:0/255238968 >> v1:172.21.15.89:6789/0 conn(0x7f25a40c3840 legacy=0x7f25a415a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:06.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.015+0000 7f25a27fc700 1 -- 172.21.15.79:0/255238968 >> v1:172.21.15.79:6789/0 conn(0x7f25a4157830 legacy=0x7f25a40ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:06.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.015+0000 7f25a27fc700 1 -- 172.21.15.79:0/255238968 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a40adab0 con 0x7f25a40c5320 2023-10-19T08:39:06.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.015+0000 7f25a27fc700 1 --2- 172.21.15.79:0/255238968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25a40c5320 0x7f25a406a220 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2594009840 tx=0x7f2594009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22004e287c15f762 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:06.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.015+0000 7f25a1ffb700 1 -- 172.21.15.79:0/255238968 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2594011830 con 0x7f25a40c5320 2023-10-19T08:39:06.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.015+0000 7f25a1ffb700 1 -- 172.21.15.79:0/255238968 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2594011990 con 0x7f25a40c5320 2023-10-19T08:39:06.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.015+0000 7f25a1ffb700 1 -- 172.21.15.79:0/255238968 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2594011d20 con 0x7f25a40c5320 2023-10-19T08:39:06.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.016+0000 7f25a96d2700 1 -- 172.21.15.79:0/255238968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25a40c5320 msgr2=0x7f25a406a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:06.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.016+0000 7f25a96d2700 1 --2- 172.21.15.79:0/255238968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25a40c5320 0x7f25a406a220 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2594009840 tx=0x7f2594009b50 comp rx=0 tx=0).stop 2023-10-19T08:39:06.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.016+0000 7f25a96d2700 1 -- 172.21.15.79:0/255238968 shutdown_connections 2023-10-19T08:39:06.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.016+0000 7f25a96d2700 1 --2- 172.21.15.79:0/255238968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25a40c5320 0x7f25a406a220 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.016+0000 7f25a96d2700 1 -- 172.21.15.79:0/255238968 >> 172.21.15.79:0/255238968 conn(0x7f25a40ce960 msgr2=0x7f25a40ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:06.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.016+0000 7f25a96d2700 1 -- 172.21.15.79:0/255238968 shutdown_connections 2023-10-19T08:39:06.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.016+0000 7f25a96d2700 1 -- 172.21.15.79:0/255238968 wait complete. 2023-10-19T08:39:06.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.017+0000 7f25a96d2700 1 Processor -- start 2023-10-19T08:39:06.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.017+0000 7f25a96d2700 1 -- start start 2023-10-19T08:39:06.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.018+0000 7f25a96d2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25a40c3840 0x7f25a4148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:06.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.018+0000 7f25a96d2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25a40c5320 0x7f25a41568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:06.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.018+0000 7f25a96d2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25a4157830 0x7f25a41f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:06.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.018+0000 7f25a96d2700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a4155f60 con 0x7f25a4157830 2023-10-19T08:39:06.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.018+0000 7f25a96d2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a40cb380 con 0x7f25a40c5320 2023-10-19T08:39:06.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.018+0000 7f25a96d2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a40cb620 con 0x7f25a40c3840 2023-10-19T08:39:06.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.018+0000 7f25a37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25a4157830 0x7f25a41f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:06.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.018+0000 7f25a37fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25a4157830 0x7f25a41f4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48018/0 (socket says 172.21.15.79:48018) 2023-10-19T08:39:06.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.018+0000 7f25a37fe700 1 -- 172.21.15.79:0/2169546488 learned_addr learned my addr 172.21.15.79:0/2169546488 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:06.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.018+0000 7f25a2ffd700 1 --2- 172.21.15.79:0/2169546488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25a40c3840 0x7f25a4148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:06.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.018+0000 7f25a27fc700 1 --2- 172.21.15.79:0/2169546488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25a40c5320 0x7f25a41568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:06.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.018+0000 7f25a37fe700 1 -- 172.21.15.79:0/2169546488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25a40c3840 msgr2=0x7f25a4148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:06.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.018+0000 7f25a37fe700 1 --2- 172.21.15.79:0/2169546488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25a40c3840 0x7f25a4148a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.018+0000 7f25a37fe700 1 -- 172.21.15.79:0/2169546488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25a40c5320 msgr2=0x7f25a41568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:06.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.018+0000 7f25a37fe700 1 --2- 172.21.15.79:0/2169546488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25a40c5320 0x7f25a41568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.018+0000 7f25a37fe700 1 -- 172.21.15.79:0/2169546488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25940094a0 con 0x7f25a4157830 2023-10-19T08:39:06.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.019+0000 7f25a27fc700 1 --2- 172.21.15.79:0/2169546488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25a40c5320 0x7f25a41568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:06.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.019+0000 7f25a37fe700 1 --2- 172.21.15.79:0/2169546488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25a4157830 0x7f25a41f4a80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f259c00cc50 tx=0x7f259c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:06.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.019+0000 7f258b7fe700 1 -- 172.21.15.79:0/2169546488 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c00ad80 con 0x7f25a4157830 2023-10-19T08:39:06.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.019+0000 7f258b7fe700 1 -- 172.21.15.79:0/2169546488 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259c00ce50 con 0x7f25a4157830 2023-10-19T08:39:06.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.019+0000 7f25a96d2700 1 -- 172.21.15.79:0/2169546488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a40cb900 con 0x7f25a4157830 2023-10-19T08:39:06.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.019+0000 7f258b7fe700 1 -- 172.21.15.79:0/2169546488 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259c003c40 con 0x7f25a4157830 2023-10-19T08:39:06.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.019+0000 7f25a96d2700 1 -- 172.21.15.79:0/2169546488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a415a360 con 0x7f25a4157830 2023-10-19T08:39:06.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.020+0000 7f25a96d2700 1 -- 172.21.15.79:0/2169546488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a40cbaf0 con 0x7f25a4157830 2023-10-19T08:39:06.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.020+0000 7f258b7fe700 1 -- 172.21.15.79:0/2169546488 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f259c0050d0 con 0x7f25a4157830 2023-10-19T08:39:06.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.020+0000 7f258b7fe700 1 --2- 172.21.15.79:0/2169546488 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f259006a0e0 0x7f259006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:06.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.021+0000 7f258b7fe700 1 -- 172.21.15.79:0/2169546488 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f259c088a50 con 0x7f25a4157830 2023-10-19T08:39:06.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.021+0000 7f25a2ffd700 1 --2- 172.21.15.79:0/2169546488 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f259006a0e0 0x7f259006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:06.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.021+0000 7f25a2ffd700 1 --2- 172.21.15.79:0/2169546488 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f259006a0e0 0x7f259006c5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f25980011e0 tx=0x7f2598009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:06.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.025+0000 7f258b7fe700 1 -- 172.21.15.79:0/2169546488 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f259c053d80 con 0x7f25a4157830 2023-10-19T08:39:06.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.212+0000 7f25a96d2700 1 -- 172.21.15.79:0/2169546488 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f25a404ee70 con 0x7f25a4157830 2023-10-19T08:39:06.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.213+0000 7f258b7fe700 1 -- 172.21.15.79:0/2169546488 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f259c0573a0 con 0x7f25a4157830 2023-10-19T08:39:06.217 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-19T08:39:06.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.215+0000 7f25a96d2700 1 -- 172.21.15.79:0/2169546488 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f259006a0e0 msgr2=0x7f259006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:06.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.215+0000 7f25a96d2700 1 --2- 172.21.15.79:0/2169546488 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f259006a0e0 0x7f259006c5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f25980011e0 tx=0x7f2598009040 comp rx=0 tx=0).stop 2023-10-19T08:39:06.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.215+0000 7f25a96d2700 1 -- 172.21.15.79:0/2169546488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25a4157830 msgr2=0x7f25a41f4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:06.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.215+0000 7f25a96d2700 1 --2- 172.21.15.79:0/2169546488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25a4157830 0x7f25a41f4a80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f259c00cc50 tx=0x7f259c00a340 comp rx=0 tx=0).stop 2023-10-19T08:39:06.219 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.215+0000 7f25a96d2700 1 -- 172.21.15.79:0/2169546488 shutdown_connections 2023-10-19T08:39:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.215+0000 7f25a96d2700 1 --2- 172.21.15.79:0/2169546488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25a4157830 0x7f25a41f4a80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.215+0000 7f25a96d2700 1 --2- 172.21.15.79:0/2169546488 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f259006a0e0 0x7f259006c5a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.215+0000 7f25a96d2700 1 --2- 172.21.15.79:0/2169546488 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25a40c3840 0x7f25a4148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.215+0000 7f25a96d2700 1 --2- 172.21.15.79:0/2169546488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25a40c5320 0x7f25a41568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.215+0000 7f25a96d2700 1 -- 172.21.15.79:0/2169546488 >> 172.21.15.79:0/2169546488 conn(0x7f25a40ce960 msgr2=0x7f25a406cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.215+0000 7f25a96d2700 1 -- 172.21.15.79:0/2169546488 shutdown_connections 2023-10-19T08:39:06.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.215+0000 7f25a96d2700 1 -- 172.21.15.79:0/2169546488 wait complete. 2023-10-19T08:39:06.231 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T08:39:06.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.350+0000 7fa28382f700 1 Processor -- start 2023-10-19T08:39:06.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.350+0000 7fa28382f700 1 -- start start 2023-10-19T08:39:06.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.351+0000 7fa28382f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa27c159ee0 0x7fa27c0b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:06.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.351+0000 7fa28382f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa27c06dff0 0x7fa27c0cae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:06.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.351+0000 7fa28382f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa27c0cecc0 0x7fa27c0cb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:06.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.351+0000 7fa28382f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa27c0663c0 con 0x7fa27c06dff0 2023-10-19T08:39:06.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.351+0000 7fa28382f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa27c0cb8c0 con 0x7fa27c159ee0 2023-10-19T08:39:06.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.351+0000 7fa28382f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c15a2c0 con 0x7fa27c0cecc0 2023-10-19T08:39:06.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.351+0000 7fa280dca700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa27c06dff0 0x7fa27c0cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:06.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.351+0000 7fa280dca700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa27c06dff0 0x7fa27c0cae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48024/0 (socket says 172.21.15.79:48024) 2023-10-19T08:39:06.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.351+0000 7fa280dca700 1 -- 172.21.15.79:0/2356134308 learned_addr learned my addr 172.21.15.79:0/2356134308 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:06.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.351+0000 7fa281dcc700 1 --2- 172.21.15.79:0/2356134308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa27c0cecc0 0x7fa27c0cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:06.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.351+0000 7fa2815cb700 1 --2- 172.21.15.79:0/2356134308 >> v2:172.21.15.89:3300/0 conn(0x7fa27c159ee0 0x7fa27c0b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:06.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.351+0000 7fa280dca700 1 -- 172.21.15.79:0/2356134308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa27c0cecc0 msgr2=0x7fa27c0cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:06.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.351+0000 7fa280dca700 1 --2- 172.21.15.79:0/2356134308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa27c0cecc0 0x7fa27c0cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.351+0000 7fa280dca700 1 -- 172.21.15.79:0/2356134308 >> v2:172.21.15.89:3300/0 conn(0x7fa27c159ee0 msgr2=0x7fa27c0b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:06.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.351+0000 7fa280dca700 1 --2- 172.21.15.79:0/2356134308 >> v2:172.21.15.89:3300/0 conn(0x7fa27c159ee0 0x7fa27c0b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.351+0000 7fa280dca700 1 -- 172.21.15.79:0/2356134308 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c0b5030 con 0x7fa27c06dff0 2023-10-19T08:39:06.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.351+0000 7fa2815cb700 1 --2- 172.21.15.79:0/2356134308 >> v2:172.21.15.89:3300/0 conn(0x7fa27c159ee0 0x7fa27c0b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:06.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.351+0000 7fa281dcc700 1 --2- 172.21.15.79:0/2356134308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa27c0cecc0 0x7fa27c0cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:06.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.352+0000 7fa280dca700 1 --2- 172.21.15.79:0/2356134308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa27c06dff0 0x7fa27c0cae40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0b5310 tx=0x7fa27800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b48b60a78565a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:06.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.352+0000 7fa273fff700 1 -- 172.21.15.79:0/2356134308 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27800dd30 con 0x7fa27c06dff0 2023-10-19T08:39:06.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.352+0000 7fa273fff700 1 -- 172.21.15.79:0/2356134308 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27800de90 con 0x7fa27c06dff0 2023-10-19T08:39:06.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.352+0000 7fa273fff700 1 -- 172.21.15.79:0/2356134308 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa278010690 con 0x7fa27c06dff0 2023-10-19T08:39:06.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.352+0000 7fa28382f700 1 -- 172.21.15.79:0/2356134308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa27c06dff0 msgr2=0x7fa27c0cae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:06.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.352+0000 7fa28382f700 1 --2- 172.21.15.79:0/2356134308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa27c06dff0 0x7fa27c0cae40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa27c0b5310 tx=0x7fa27800be70 comp rx=0 tx=0).stop 2023-10-19T08:39:06.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.352+0000 7fa28382f700 1 -- 172.21.15.79:0/2356134308 shutdown_connections 2023-10-19T08:39:06.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.352+0000 7fa28382f700 1 --2- 172.21.15.79:0/2356134308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa27c0cecc0 0x7fa27c0cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.352+0000 7fa28382f700 1 --2- 172.21.15.79:0/2356134308 >> v2:172.21.15.89:3300/0 conn(0x7fa27c159ee0 0x7fa27c0b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.362 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.352+0000 7fa28382f700 1 --2- 172.21.15.79:0/2356134308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa27c06dff0 0x7fa27c0cae40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.352+0000 7fa28382f700 1 -- 172.21.15.79:0/2356134308 >> 172.21.15.79:0/2356134308 conn(0x7fa27c06d000 msgr2=0x7fa27c06d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:06.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.352+0000 7fa28382f700 1 -- 172.21.15.79:0/2356134308 shutdown_connections 2023-10-19T08:39:06.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.353+0000 7fa28382f700 1 -- 172.21.15.79:0/2356134308 wait complete. 2023-10-19T08:39:06.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.354+0000 7fa28382f700 1 Processor -- start 2023-10-19T08:39:06.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.354+0000 7fa28382f700 1 -- start start 2023-10-19T08:39:06.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.354+0000 7fa28382f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa27c06dff0 0x7fa27c0c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:06.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.354+0000 7fa28382f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa27c0cecc0 0x7fa27c0c3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:06.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.354+0000 7fa28382f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa27c159ee0 0x7fa27c0ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:06.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.354+0000 7fa28382f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0c36c0 con 0x7fa27c06dff0 2023-10-19T08:39:06.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.354+0000 7fa28382f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0abe20 con 0x7fa27c159ee0 2023-10-19T08:39:06.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.354+0000 7fa28382f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0ac080 con 0x7fa27c0cecc0 2023-10-19T08:39:06.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.354+0000 7fa2815cb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa27c06dff0 0x7fa27c0c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:06.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.355+0000 7fa2815cb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa27c06dff0 0x7fa27c0c8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48032/0 (socket says 172.21.15.79:48032) 2023-10-19T08:39:06.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.355+0000 7fa2815cb700 1 -- 172.21.15.79:0/3049214205 learned_addr learned my addr 172.21.15.79:0/3049214205 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:06.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.355+0000 7fa281dcc700 1 --2- 172.21.15.79:0/3049214205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa27c159ee0 0x7fa27c0ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:06.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.355+0000 7fa280dca700 1 --2- 172.21.15.79:0/3049214205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa27c0cecc0 0x7fa27c0c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:06.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.355+0000 7fa2815cb700 1 -- 172.21.15.79:0/3049214205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa27c0cecc0 msgr2=0x7fa27c0c3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:06.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.355+0000 7fa2815cb700 1 --2- 172.21.15.79:0/3049214205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa27c0cecc0 0x7fa27c0c3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.355+0000 7fa2815cb700 1 -- 172.21.15.79:0/3049214205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa27c159ee0 msgr2=0x7fa27c0ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:06.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.355+0000 7fa2815cb700 1 --2- 172.21.15.79:0/3049214205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa27c159ee0 0x7fa27c0ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.355+0000 7fa2815cb700 1 -- 172.21.15.79:0/3049214205 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27800b7f0 con 0x7fa27c06dff0 2023-10-19T08:39:06.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.355+0000 7fa280dca700 1 --2- 172.21.15.79:0/3049214205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa27c0cecc0 0x7fa27c0c3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:06.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.355+0000 7fa2815cb700 1 --2- 172.21.15.79:0/3049214205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa27c06dff0 0x7fa27c0c8c80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa26c00e810 tx=0x7fa26c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:06.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.355+0000 7fa271ffb700 1 -- 172.21.15.79:0/3049214205 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c00c020 con 0x7fa27c06dff0 2023-10-19T08:39:06.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.355+0000 7fa271ffb700 1 -- 172.21.15.79:0/3049214205 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26c004250 con 0x7fa27c06dff0 2023-10-19T08:39:06.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.355+0000 7fa271ffb700 1 -- 172.21.15.79:0/3049214205 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c0036a0 con 0x7fa27c06dff0 2023-10-19T08:39:06.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.355+0000 7fa28382f700 1 -- 172.21.15.79:0/3049214205 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa27c0ac360 con 0x7fa27c06dff0 2023-10-19T08:39:06.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.355+0000 7fa28382f700 1 -- 172.21.15.79:0/3049214205 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27c0ac920 con 0x7fa27c06dff0 2023-10-19T08:39:06.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.356+0000 7fa28382f700 1 -- 172.21.15.79:0/3049214205 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa27c0acf70 con 0x7fa27c06dff0 2023-10-19T08:39:06.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.356+0000 7fa271ffb700 1 -- 172.21.15.79:0/3049214205 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa26c003800 con 0x7fa27c06dff0 2023-10-19T08:39:06.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.357+0000 7fa271ffb700 1 --2- 172.21.15.79:0/3049214205 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa26006a0e0 0x7fa26006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:06.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.357+0000 7fa271ffb700 1 -- 172.21.15.79:0/3049214205 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa26c088200 con 0x7fa27c06dff0 2023-10-19T08:39:06.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.357+0000 7fa280dca700 1 --2- 172.21.15.79:0/3049214205 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa26006a0e0 0x7fa26006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:06.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.357+0000 7fa280dca700 1 --2- 172.21.15.79:0/3049214205 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa26006a0e0 0x7fa26006c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa27c06e410 tx=0x7fa278012000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:06.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.361+0000 7fa271ffb700 1 -- 172.21.15.79:0/3049214205 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa26c053650 con 0x7fa27c06dff0 2023-10-19T08:39:06.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.548+0000 7fa28382f700 1 -- 172.21.15.79:0/3049214205 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa27c04ee70 con 0x7fa27c06dff0 2023-10-19T08:39:06.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.549+0000 7fa271ffb700 1 -- 172.21.15.79:0/3049214205 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa26c056c70 con 0x7fa27c06dff0 2023-10-19T08:39:06.553 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:39:06.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.551+0000 7fa28382f700 1 -- 172.21.15.79:0/3049214205 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa26006a0e0 msgr2=0x7fa26006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:06.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.551+0000 7fa28382f700 1 --2- 172.21.15.79:0/3049214205 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa26006a0e0 0x7fa26006c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa27c06e410 tx=0x7fa278012000 comp rx=0 tx=0).stop 2023-10-19T08:39:06.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.551+0000 7fa28382f700 1 -- 172.21.15.79:0/3049214205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa27c06dff0 msgr2=0x7fa27c0c8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:06.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.551+0000 7fa28382f700 1 --2- 172.21.15.79:0/3049214205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa27c06dff0 0x7fa27c0c8c80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa26c00e810 tx=0x7fa26c00eb20 comp rx=0 tx=0).stop 2023-10-19T08:39:06.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.551+0000 7fa28382f700 1 -- 172.21.15.79:0/3049214205 shutdown_connections 2023-10-19T08:39:06.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.551+0000 7fa28382f700 1 --2- 172.21.15.79:0/3049214205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa27c159ee0 0x7fa27c0ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.551+0000 7fa28382f700 1 --2- 172.21.15.79:0/3049214205 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa27c06dff0 0x7fa27c0c8c80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.551+0000 7fa28382f700 1 --2- 172.21.15.79:0/3049214205 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa26006a0e0 0x7fa26006c5a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.551+0000 7fa28382f700 1 --2- 172.21.15.79:0/3049214205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa27c0cecc0 0x7fa27c0c3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.551+0000 7fa28382f700 1 -- 172.21.15.79:0/3049214205 >> 172.21.15.79:0/3049214205 conn(0x7fa27c06d000 msgr2=0x7fa27c0af660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:06.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.551+0000 7fa28382f700 1 -- 172.21.15.79:0/3049214205 shutdown_connections 2023-10-19T08:39:06.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.551+0000 7fa28382f700 1 -- 172.21.15.79:0/3049214205 wait complete. 2023-10-19T08:39:06.567 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-19T08:39:06.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.685+0000 7f81d1699700 1 Processor -- start 2023-10-19T08:39:06.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.685+0000 7f81d1699700 1 -- start start 2023-10-19T08:39:06.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.686+0000 7f81d1699700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81cc0aed60 0x7f81cc161900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:06.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.686+0000 7f81d1699700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f81cc0af140 0x7f81cc0b1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:06.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.686+0000 7f81d1699700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81cc15e3e0 con 0x7f81cc0b1aa0 2023-10-19T08:39:06.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.686+0000 7f81d1699700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81cc0b1f50 con 0x7f81cc0af140 2023-10-19T08:39:06.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.686+0000 7f81d1699700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc15e6c0 con 0x7f81cc0aed60 2023-10-19T08:39:06.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.687+0000 7f81caffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81cc0aed60 0x7f81cc161900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:06.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.687+0000 7f81ca7fc700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f81cc0af140 0x7f81cc0b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:06.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.687+0000 7f81caffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81cc0aed60 0x7f81cc161900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:50664/0 (socket says 172.21.15.79:50664) 2023-10-19T08:39:06.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.687+0000 7f81caffd700 1 -- 172.21.15.79:0/940104864 learned_addr learned my addr 172.21.15.79:0/940104864 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:06.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.687+0000 7f81caffd700 1 -- 172.21.15.79:0/940104864 >> v2:172.21.15.89:3300/0 conn(0x7f81cc0af140 msgr2=0x7f81cc0b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:06.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.687+0000 7f81caffd700 1 --2- 172.21.15.79:0/940104864 >> v2:172.21.15.89:3300/0 conn(0x7f81cc0af140 0x7f81cc0b1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.687+0000 7f81caffd700 1 -- 172.21.15.79:0/940104864 >> v1:172.21.15.89:6789/0 conn(0x7f81cc0b1aa0 legacy=0x7f81cc15d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.687+0000 7f81caffd700 1 -- 172.21.15.79:0/940104864 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc160e20 con 0x7f81cc0aed60 2023-10-19T08:39:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.687+0000 7f81ca7fc700 1 --2- 172.21.15.79:0/940104864 >> v2:172.21.15.89:3300/0 conn(0x7f81cc0af140 0x7f81cc0b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:39:06.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.687+0000 7f81caffd700 1 --2- 172.21.15.79:0/940104864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81cc0aed60 0x7f81cc161900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f81c00098f0 tx=0x7f81c0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0491dccdf664cde server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:06.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.687+0000 7f81c9ffb700 1 -- 172.21.15.79:0/940104864 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0011830 con 0x7f81cc0aed60 2023-10-19T08:39:06.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.687+0000 7f81c9ffb700 1 -- 172.21.15.79:0/940104864 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c0011990 con 0x7f81cc0aed60 2023-10-19T08:39:06.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.687+0000 7f81c9ffb700 1 -- 172.21.15.79:0/940104864 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0011d20 con 0x7f81cc0aed60 2023-10-19T08:39:06.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.688+0000 7f81d1699700 1 -- 172.21.15.79:0/940104864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81cc0aed60 msgr2=0x7f81cc161900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:06.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.688+0000 7f81d1699700 1 --2- 172.21.15.79:0/940104864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81cc0aed60 0x7f81cc161900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f81c00098f0 tx=0x7f81c0009c00 comp rx=0 tx=0).stop 2023-10-19T08:39:06.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.688+0000 7f81d1699700 1 -- 172.21.15.79:0/940104864 shutdown_connections 2023-10-19T08:39:06.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.688+0000 7f81d1699700 1 --2- 172.21.15.79:0/940104864 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81cc0aed60 0x7f81cc161900 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.688+0000 7f81d1699700 1 --2- 172.21.15.79:0/940104864 >> v2:172.21.15.89:3300/0 conn(0x7f81cc0af140 0x7f81cc0b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.688+0000 7f81d1699700 1 -- 172.21.15.79:0/940104864 >> 172.21.15.79:0/940104864 conn(0x7f81cc0cc560 msgr2=0x7f81cc0cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:06.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.688+0000 7f81d1699700 1 -- 172.21.15.79:0/940104864 shutdown_connections 2023-10-19T08:39:06.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.688+0000 7f81d1699700 1 -- 172.21.15.79:0/940104864 wait complete. 2023-10-19T08:39:06.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.689+0000 7f81d1699700 1 Processor -- start 2023-10-19T08:39:06.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.689+0000 7f81d1699700 1 -- start start 2023-10-19T08:39:06.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.690+0000 7f81d1699700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81cc0aed60 0x7f81cc0c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:06.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.690+0000 7f81d1699700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81cc0af140 0x7f81cc0ad590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:06.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.690+0000 7f81d1699700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81cc0b1aa0 0x7f81cc0adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:06.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.690+0000 7f81d1699700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc1f3c30 con 0x7f81cc0b1aa0 2023-10-19T08:39:06.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.690+0000 7f81d1699700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc1f3f10 con 0x7f81cc0aed60 2023-10-19T08:39:06.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.690+0000 7f81d1699700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81cc1f41f0 con 0x7f81cc0af140 2023-10-19T08:39:06.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.690+0000 7f81cb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81cc0b1aa0 0x7f81cc0adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:06.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.690+0000 7f81cb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81cc0b1aa0 0x7f81cc0adad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48048/0 (socket says 172.21.15.79:48048) 2023-10-19T08:39:06.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.690+0000 7f81cb7fe700 1 -- 172.21.15.79:0/2418508889 learned_addr learned my addr 172.21.15.79:0/2418508889 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:06.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.690+0000 7f81ca7fc700 1 --2- 172.21.15.79:0/2418508889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81cc0af140 0x7f81cc0ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:06.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.690+0000 7f81caffd700 1 --2- 172.21.15.79:0/2418508889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81cc0aed60 0x7f81cc0c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:06.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.690+0000 7f81cb7fe700 1 -- 172.21.15.79:0/2418508889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81cc0af140 msgr2=0x7f81cc0ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:06.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.690+0000 7f81cb7fe700 1 --2- 172.21.15.79:0/2418508889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81cc0af140 0x7f81cc0ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.690+0000 7f81cb7fe700 1 -- 172.21.15.79:0/2418508889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81cc0aed60 msgr2=0x7f81cc0c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:06.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.690+0000 7f81cb7fe700 1 --2- 172.21.15.79:0/2418508889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81cc0aed60 0x7f81cc0c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.690+0000 7f81cb7fe700 1 -- 172.21.15.79:0/2418508889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81bc0094a0 con 0x7f81cc0b1aa0 2023-10-19T08:39:06.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.691+0000 7f81cb7fe700 1 --2- 172.21.15.79:0/2418508889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81cc0b1aa0 0x7f81cc0adad0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f81c400cb50 tx=0x7f81c400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:06.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.691+0000 7f81b37fe700 1 -- 172.21.15.79:0/2418508889 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4003c00 con 0x7f81cc0b1aa0 2023-10-19T08:39:06.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.691+0000 7f81b37fe700 1 -- 172.21.15.79:0/2418508889 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c4003d60 con 0x7f81cc0b1aa0 2023-10-19T08:39:06.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.691+0000 7f81d1699700 1 -- 172.21.15.79:0/2418508889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c0009550 con 0x7f81cc0b1aa0 2023-10-19T08:39:06.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.691+0000 7f81b37fe700 1 -- 172.21.15.79:0/2418508889 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c400aa20 con 0x7f81cc0b1aa0 2023-10-19T08:39:06.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.691+0000 7f81d1699700 1 -- 172.21.15.79:0/2418508889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81cc1f47b0 con 0x7f81cc0b1aa0 2023-10-19T08:39:06.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.692+0000 7f81d1699700 1 -- 172.21.15.79:0/2418508889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81cc1f49d0 con 0x7f81cc0b1aa0 2023-10-19T08:39:06.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.692+0000 7f81b37fe700 1 -- 172.21.15.79:0/2418508889 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f81c400ab80 con 0x7f81cc0b1aa0 2023-10-19T08:39:06.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.692+0000 7f81b37fe700 1 --2- 172.21.15.79:0/2418508889 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f81b806a0e0 0x7f81b806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:06.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.693+0000 7f81b37fe700 1 -- 172.21.15.79:0/2418508889 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f81c4088810 con 0x7f81cc0b1aa0 2023-10-19T08:39:06.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.693+0000 7f81caffd700 1 --2- 172.21.15.79:0/2418508889 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f81b806a0e0 0x7f81b806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:06.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.693+0000 7f81caffd700 1 --2- 172.21.15.79:0/2418508889 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f81b806a0e0 0x7f81b806c5a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009c40 tx=0x7f81c0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:06.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.697+0000 7f81b37fe700 1 -- 172.21.15.79:0/2418508889 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f81c4053c60 con 0x7f81cc0b1aa0 2023-10-19T08:39:06.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.899+0000 7f81d1699700 1 -- 172.21.15.79:0/2418508889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f81cc04ee70 con 0x7f81cc0b1aa0 2023-10-19T08:39:06.902 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.899+0000 7f81b37fe700 1 -- 172.21.15.79:0/2418508889 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f81c4057280 con 0x7f81cc0b1aa0 2023-10-19T08:39:06.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.901+0000 7f81d1699700 1 -- 172.21.15.79:0/2418508889 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f81b806a0e0 msgr2=0x7f81b806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:06.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.901+0000 7f81d1699700 1 --2- 172.21.15.79:0/2418508889 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f81b806a0e0 0x7f81b806c5a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009c40 tx=0x7f81c0008030 comp rx=0 tx=0).stop 2023-10-19T08:39:06.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.901+0000 7f81d1699700 1 -- 172.21.15.79:0/2418508889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81cc0b1aa0 msgr2=0x7f81cc0adad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:06.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.901+0000 7f81d1699700 1 --2- 172.21.15.79:0/2418508889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81cc0b1aa0 0x7f81cc0adad0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f81c400cb50 tx=0x7f81c400ce60 comp rx=0 tx=0).stop 2023-10-19T08:39:06.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.901+0000 7f81d1699700 1 -- 172.21.15.79:0/2418508889 shutdown_connections 2023-10-19T08:39:06.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.901+0000 7f81d1699700 1 --2- 172.21.15.79:0/2418508889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81cc0b1aa0 0x7f81cc0adad0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.901+0000 7f81d1699700 1 --2- 172.21.15.79:0/2418508889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81cc0aed60 0x7f81cc0c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.901+0000 7f81d1699700 1 --2- 172.21.15.79:0/2418508889 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f81b806a0e0 0x7f81b806c5a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.901+0000 7f81d1699700 1 --2- 172.21.15.79:0/2418508889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81cc0af140 0x7f81cc0ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:06.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.901+0000 7f81d1699700 1 -- 172.21.15.79:0/2418508889 >> 172.21.15.79:0/2418508889 conn(0x7f81cc0cc560 msgr2=0x7f81cc0719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:06.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.901+0000 7f81d1699700 1 -- 172.21.15.79:0/2418508889 shutdown_connections 2023-10-19T08:39:06.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:06.901+0000 7f81d1699700 1 -- 172.21.15.79:0/2418508889 wait complete. 2023-10-19T08:39:06.908 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2023-10-19T08:39:06.917 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi089.front.sepia.ceph.com... 2023-10-19T08:39:06.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:06.918 DEBUG:teuthology.orchestra.run.smithi089:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-19T08:39:06.970 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:39:06.971 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-10-19T08:39:06.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:06.972 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-19T08:39:06.997 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:39:06.998 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T08:39:07.015 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:39:07.016 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T08:39:07.072 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:39:07.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.229+0000 7fc61815f700 1 Processor -- start 2023-10-19T08:39:07.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.229+0000 7fc61815f700 1 -- start start 2023-10-19T08:39:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.230+0000 7fc61815f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc610159f40 0x7fc61015e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.230+0000 7fc61815f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6100cf710 0x7fc6100cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:07.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.230+0000 7fc61815f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61015e870 con 0x7fc6100b5610 2023-10-19T08:39:07.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.230+0000 7fc61815f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6100b5aa0 con 0x7fc610159f40 2023-10-19T08:39:07.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.230+0000 7fc61815f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100cd800 con 0x7fc6100cf710 2023-10-19T08:39:07.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.230+0000 7fc615efb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc610159f40 0x7fc61015e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:07.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.230+0000 7fc615efb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc610159f40 0x7fc61015e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48052/0 (socket says 172.21.15.79:48052) 2023-10-19T08:39:07.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.230+0000 7fc615efb700 1 -- 172.21.15.79:0/3726573241 learned_addr learned my addr 172.21.15.79:0/3726573241 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:07.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.230+0000 7fc615efb700 1 -- 172.21.15.79:0/3726573241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6100cf710 msgr2=0x7fc6100cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:07.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.230+0000 7fc615efb700 1 --2- 172.21.15.79:0/3726573241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6100cf710 0x7fc6100cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.230+0000 7fc615efb700 1 -- 172.21.15.79:0/3726573241 >> v1:172.21.15.89:6789/0 conn(0x7fc6100b5610 legacy=0x7fc6100cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:07.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.230+0000 7fc615efb700 1 -- 172.21.15.79:0/3726573241 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6100cdae0 con 0x7fc610159f40 2023-10-19T08:39:07.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.231+0000 7fc615efb700 1 --2- 172.21.15.79:0/3726573241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc610159f40 0x7fc61015e330 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc6000098f0 tx=0x7fc600009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90c66c1b62e799e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:07.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.231+0000 7fc614ef9700 1 -- 172.21.15.79:0/3726573241 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600004230 con 0x7fc610159f40 2023-10-19T08:39:07.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.231+0000 7fc614ef9700 1 -- 172.21.15.79:0/3726573241 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc600004390 con 0x7fc610159f40 2023-10-19T08:39:07.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.231+0000 7fc614ef9700 1 -- 172.21.15.79:0/3726573241 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6000036a0 con 0x7fc610159f40 2023-10-19T08:39:07.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.231+0000 7fc61815f700 1 -- 172.21.15.79:0/3726573241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc610159f40 msgr2=0x7fc61015e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:07.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.231+0000 7fc61815f700 1 --2- 172.21.15.79:0/3726573241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc610159f40 0x7fc61015e330 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc6000098f0 tx=0x7fc600009c00 comp rx=0 tx=0).stop 2023-10-19T08:39:07.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.231+0000 7fc61815f700 1 -- 172.21.15.79:0/3726573241 shutdown_connections 2023-10-19T08:39:07.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.231+0000 7fc61815f700 1 --2- 172.21.15.79:0/3726573241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6100cf710 0x7fc6100cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.231+0000 7fc61815f700 1 --2- 172.21.15.79:0/3726573241 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc610159f40 0x7fc61015e330 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.231+0000 7fc61815f700 1 -- 172.21.15.79:0/3726573241 >> 172.21.15.79:0/3726573241 conn(0x7fc61006dcc0 msgr2=0x7fc61006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:07.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.231+0000 7fc61815f700 1 -- 172.21.15.79:0/3726573241 shutdown_connections 2023-10-19T08:39:07.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.231+0000 7fc61815f700 1 -- 172.21.15.79:0/3726573241 wait complete. 2023-10-19T08:39:07.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.233+0000 7fc61815f700 1 Processor -- start 2023-10-19T08:39:07.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.233+0000 7fc61815f700 1 -- start start 2023-10-19T08:39:07.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.233+0000 7fc61815f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6100cf710 0x7fc6100b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:07.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.233+0000 7fc61815f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc610159f40 0x7fc610157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:07.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.233+0000 7fc61815f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6101f1a00 0x7fc6101f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:07.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.233+0000 7fc61815f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100c58c0 con 0x7fc6101f1a00 2023-10-19T08:39:07.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.233+0000 7fc61815f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100c49d0 con 0x7fc610159f40 2023-10-19T08:39:07.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.233+0000 7fc61815f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100c4cb0 con 0x7fc6100cf710 2023-10-19T08:39:07.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.233+0000 7fc6166fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6101f1a00 0x7fc6101f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:07.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.233+0000 7fc6166fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6101f1a00 0x7fc6101f1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48062/0 (socket says 172.21.15.79:48062) 2023-10-19T08:39:07.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.233+0000 7fc6166fc700 1 -- 172.21.15.79:0/916487873 learned_addr learned my addr 172.21.15.79:0/916487873 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:07.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.234+0000 7fc615efb700 1 --2- 172.21.15.79:0/916487873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6100cf710 0x7fc6100b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:07.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.234+0000 7fc6156fa700 1 --2- 172.21.15.79:0/916487873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc610159f40 0x7fc610157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:07.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.234+0000 7fc6166fc700 1 -- 172.21.15.79:0/916487873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6100cf710 msgr2=0x7fc6100b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:07.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.234+0000 7fc6166fc700 1 --2- 172.21.15.79:0/916487873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6100cf710 0x7fc6100b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.234+0000 7fc6166fc700 1 -- 172.21.15.79:0/916487873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc610159f40 msgr2=0x7fc610157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:07.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.234+0000 7fc6166fc700 1 --2- 172.21.15.79:0/916487873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc610159f40 0x7fc610157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.234+0000 7fc6166fc700 1 -- 172.21.15.79:0/916487873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc600009550 con 0x7fc6101f1a00 2023-10-19T08:39:07.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.234+0000 7fc6156fa700 1 --2- 172.21.15.79:0/916487873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc610159f40 0x7fc610157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:07.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.234+0000 7fc6166fc700 1 --2- 172.21.15.79:0/916487873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6101f1a00 0x7fc6101f1e60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc60800b9e0 tx=0x7fc60800bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:07.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.234+0000 7fc6067fc700 1 -- 172.21.15.79:0/916487873 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60800d8e0 con 0x7fc6101f1a00 2023-10-19T08:39:07.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.234+0000 7fc6067fc700 1 -- 172.21.15.79:0/916487873 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60800da40 con 0x7fc6101f1a00 2023-10-19T08:39:07.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.234+0000 7fc61815f700 1 -- 172.21.15.79:0/916487873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6100c4f90 con 0x7fc6101f1a00 2023-10-19T08:39:07.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.234+0000 7fc6067fc700 1 -- 172.21.15.79:0/916487873 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60800ddf0 con 0x7fc6101f1a00 2023-10-19T08:39:07.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.234+0000 7fc61815f700 1 -- 172.21.15.79:0/916487873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6100c5550 con 0x7fc6101f1a00 2023-10-19T08:39:07.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.235+0000 7fc61815f700 1 -- 172.21.15.79:0/916487873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61004ee70 con 0x7fc6101f1a00 2023-10-19T08:39:07.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.235+0000 7fc6067fc700 1 -- 172.21.15.79:0/916487873 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc608015420 con 0x7fc6101f1a00 2023-10-19T08:39:07.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.236+0000 7fc6067fc700 1 --2- 172.21.15.79:0/916487873 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc5f406a0e0 0x7fc5f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:07.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.236+0000 7fc6067fc700 1 -- 172.21.15.79:0/916487873 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc608011070 con 0x7fc6101f1a00 2023-10-19T08:39:07.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.236+0000 7fc615efb700 1 --2- 172.21.15.79:0/916487873 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc5f406a0e0 0x7fc5f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:07.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.236+0000 7fc615efb700 1 --2- 172.21.15.79:0/916487873 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc5f406a0e0 0x7fc5f406c5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc600000c00 tx=0x7fc600008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:07.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.240+0000 7fc6067fc700 1 -- 172.21.15.79:0/916487873 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc60804e940 con 0x7fc6101f1a00 2023-10-19T08:39:07.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.429+0000 7fc61815f700 1 -- 172.21.15.79:0/916487873 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6100668a0 con 0x7fc6101f1a00 2023-10-19T08:39:07.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.430+0000 7fc6067fc700 1 -- 172.21.15.79:0/916487873 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20155 (secure 0 0 0) 0x7fc608053ac0 con 0x7fc6101f1a00 2023-10-19T08:39:07.434 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:07.434 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:44.473795+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:39:07.436 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.433+0000 7fc61815f700 1 -- 172.21.15.79:0/916487873 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc5f406a0e0 msgr2=0x7fc5f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:07.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.433+0000 7fc61815f700 1 --2- 172.21.15.79:0/916487873 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc5f406a0e0 0x7fc5f406c5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc600000c00 tx=0x7fc600008030 comp rx=0 tx=0).stop 2023-10-19T08:39:07.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.433+0000 7fc61815f700 1 -- 172.21.15.79:0/916487873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6101f1a00 msgr2=0x7fc6101f1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:07.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.433+0000 7fc61815f700 1 --2- 172.21.15.79:0/916487873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6101f1a00 0x7fc6101f1e60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc60800b9e0 tx=0x7fc60800bcf0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.433+0000 7fc61815f700 1 -- 172.21.15.79:0/916487873 shutdown_connections 2023-10-19T08:39:07.437 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.433+0000 7fc61815f700 1 --2- 172.21.15.79:0/916487873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6101f1a00 0x7fc6101f1e60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.433+0000 7fc61815f700 1 --2- 172.21.15.79:0/916487873 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc5f406a0e0 0x7fc5f406c5a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.433+0000 7fc61815f700 1 --2- 172.21.15.79:0/916487873 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6100cf710 0x7fc6100b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.433+0000 7fc61815f700 1 --2- 172.21.15.79:0/916487873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc610159f40 0x7fc610157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.433+0000 7fc61815f700 1 -- 172.21.15.79:0/916487873 >> 172.21.15.79:0/916487873 conn(0x7fc61006dcc0 msgr2=0x7fc6100cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:07.438 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.433+0000 7fc61815f700 1 -- 172.21.15.79:0/916487873 shutdown_connections 2023-10-19T08:39:07.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.433+0000 7fc61815f700 1 -- 172.21.15.79:0/916487873 wait complete. 2023-10-19T08:39:07.448 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T08:37:54.318159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T08:37:55.629862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T08:37:59.333062+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T08:39:07.449 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:39:07.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.570+0000 7f6c618ad700 1 Processor -- start 2023-10-19T08:39:07.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.570+0000 7f6c618ad700 1 -- start start 2023-10-19T08:39:07.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.570+0000 7f6c618ad700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c5c0cd270 0x7f6c5c06a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:07.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.570+0000 7f6c618ad700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c5c0703b0 0x7f6c5c06a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:07.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.570+0000 7f6c618ad700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c5c0b1fe0 con 0x7f6c5c06f910 2023-10-19T08:39:07.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.570+0000 7f6c618ad700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c5c160a80 con 0x7f6c5c0703b0 2023-10-19T08:39:07.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.570+0000 7f6c618ad700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c0ce2b0 con 0x7f6c5c0cd270 2023-10-19T08:39:07.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.571+0000 7f6c5a7fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c5c0703b0 0x7f6c5c06a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:07.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.571+0000 7f6c5b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6c5c06f910 0x7f6c5c160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58142/0 (socket says 172.21.15.79:58142) 2023-10-19T08:39:07.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.571+0000 7f6c5b7fe700 1 -- 172.21.15.79:0/2203968662 learned_addr learned my addr 172.21.15.79:0/2203968662 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:07.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.571+0000 7f6c5affd700 1 --2- 172.21.15.79:0/2203968662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c5c0cd270 0x7f6c5c06a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:07.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.571+0000 7f6c5a7fc700 1 -- 172.21.15.79:0/2203968662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c5c0cd270 msgr2=0x7f6c5c06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:07.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.571+0000 7f6c5a7fc700 1 --2- 172.21.15.79:0/2203968662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c5c0cd270 0x7f6c5c06a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.571+0000 7f6c5a7fc700 1 -- 172.21.15.79:0/2203968662 >> v1:172.21.15.79:6789/0 conn(0x7f6c5c06f910 legacy=0x7f6c5c160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:07.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.571+0000 7f6c5a7fc700 1 -- 172.21.15.79:0/2203968662 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5c0ce550 con 0x7f6c5c0703b0 2023-10-19T08:39:07.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.571+0000 7f6c59ffb700 1 -- 172.21.15.79:0/2203968662 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576081345 0 0) 0x7f6c5c0b1fe0 con 0x7f6c5c06f910 2023-10-19T08:39:07.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.571+0000 7f6c5a7fc700 1 --2- 172.21.15.79:0/2203968662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c5c0703b0 0x7f6c5c06a760 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6c50009840 tx=0x7f6c50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5adb0e08db820d65 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:07.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.571+0000 7f6c59ffb700 1 -- 172.21.15.79:0/2203968662 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c50011830 con 0x7f6c5c0703b0 2023-10-19T08:39:07.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.571+0000 7f6c59ffb700 1 -- 172.21.15.79:0/2203968662 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c50011990 con 0x7f6c5c0703b0 2023-10-19T08:39:07.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.571+0000 7f6c59ffb700 1 -- 172.21.15.79:0/2203968662 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c50011d20 con 0x7f6c5c0703b0 2023-10-19T08:39:07.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.572+0000 7f6c618ad700 1 -- 172.21.15.79:0/2203968662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c5c0703b0 msgr2=0x7f6c5c06a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:07.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.572+0000 7f6c618ad700 1 --2- 172.21.15.79:0/2203968662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c5c0703b0 0x7f6c5c06a760 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6c50009840 tx=0x7f6c50009b50 comp rx=0 tx=0).stop 2023-10-19T08:39:07.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.572+0000 7f6c618ad700 1 -- 172.21.15.79:0/2203968662 shutdown_connections 2023-10-19T08:39:07.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.572+0000 7f6c618ad700 1 --2- 172.21.15.79:0/2203968662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c5c0cd270 0x7f6c5c06a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.572+0000 7f6c618ad700 1 --2- 172.21.15.79:0/2203968662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c5c0703b0 0x7f6c5c06a760 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.572+0000 7f6c618ad700 1 -- 172.21.15.79:0/2203968662 >> 172.21.15.79:0/2203968662 conn(0x7f6c5c06dcc0 msgr2=0x7f6c5c06e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:07.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.572+0000 7f6c618ad700 1 -- 172.21.15.79:0/2203968662 shutdown_connections 2023-10-19T08:39:07.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.572+0000 7f6c618ad700 1 -- 172.21.15.79:0/2203968662 wait complete. 2023-10-19T08:39:07.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.573+0000 7f6c618ad700 1 Processor -- start 2023-10-19T08:39:07.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.574+0000 7f6c618ad700 1 -- start start 2023-10-19T08:39:07.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.574+0000 7f6c618ad700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c5c06f910 0x7f6c5c155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:07.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.574+0000 7f6c618ad700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c5c0703b0 0x7f6c5c0c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:07.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.574+0000 7f6c618ad700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c5c0cd270 0x7f6c5c156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:07.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.574+0000 7f6c618ad700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c158b00 con 0x7f6c5c0703b0 2023-10-19T08:39:07.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.574+0000 7f6c618ad700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c156ed0 con 0x7f6c5c0cd270 2023-10-19T08:39:07.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.574+0000 7f6c618ad700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5c0c6da0 con 0x7f6c5c06f910 2023-10-19T08:39:07.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.575+0000 7f6c5a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c5c0703b0 0x7f6c5c0c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:07.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.575+0000 7f6c5a7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c5c0703b0 0x7f6c5c0c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48074/0 (socket says 172.21.15.79:48074) 2023-10-19T08:39:07.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.575+0000 7f6c5a7fc700 1 -- 172.21.15.79:0/3299169105 learned_addr learned my addr 172.21.15.79:0/3299169105 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:07.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.575+0000 7f6c5affd700 1 --2- 172.21.15.79:0/3299169105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c5c06f910 0x7f6c5c155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:07.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.575+0000 7f6c5b7fe700 1 --2- 172.21.15.79:0/3299169105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c5c0cd270 0x7f6c5c156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:07.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.575+0000 7f6c5a7fc700 1 -- 172.21.15.79:0/3299169105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c5c06f910 msgr2=0x7f6c5c155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:07.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.575+0000 7f6c5a7fc700 1 --2- 172.21.15.79:0/3299169105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c5c06f910 0x7f6c5c155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.575+0000 7f6c5a7fc700 1 -- 172.21.15.79:0/3299169105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c5c0cd270 msgr2=0x7f6c5c156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:07.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.575+0000 7f6c5a7fc700 1 --2- 172.21.15.79:0/3299169105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c5c0cd270 0x7f6c5c156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.575+0000 7f6c5a7fc700 1 -- 172.21.15.79:0/3299169105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c500094a0 con 0x7f6c5c0703b0 2023-10-19T08:39:07.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.575+0000 7f6c5affd700 1 --2- 172.21.15.79:0/3299169105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c5c06f910 0x7f6c5c155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:07.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.575+0000 7f6c5a7fc700 1 --2- 172.21.15.79:0/3299169105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c5c0703b0 0x7f6c5c0c7880 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6c500090b0 tx=0x7f6c50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:07.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.575+0000 7f6c43fff700 1 -- 172.21.15.79:0/3299169105 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c500038a0 con 0x7f6c5c0703b0 2023-10-19T08:39:07.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.575+0000 7f6c43fff700 1 -- 172.21.15.79:0/3299169105 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5001f070 con 0x7f6c5c0703b0 2023-10-19T08:39:07.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.575+0000 7f6c618ad700 1 -- 172.21.15.79:0/3299169105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c5c0c7080 con 0x7f6c5c0703b0 2023-10-19T08:39:07.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.575+0000 7f6c43fff700 1 -- 172.21.15.79:0/3299169105 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c50003c20 con 0x7f6c5c0703b0 2023-10-19T08:39:07.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.575+0000 7f6c618ad700 1 -- 172.21.15.79:0/3299169105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c5c1571b0 con 0x7f6c5c0703b0 2023-10-19T08:39:07.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.576+0000 7f6c618ad700 1 -- 172.21.15.79:0/3299169105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c5c0c75a0 con 0x7f6c5c0703b0 2023-10-19T08:39:07.588 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.577+0000 7f6c43fff700 1 -- 172.21.15.79:0/3299169105 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6c5001a430 con 0x7f6c5c0703b0 2023-10-19T08:39:07.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.577+0000 7f6c43fff700 1 --2- 172.21.15.79:0/3299169105 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6c4806a0e0 0x7f6c4806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:07.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.577+0000 7f6c43fff700 1 -- 172.21.15.79:0/3299169105 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6c50021070 con 0x7f6c5c0703b0 2023-10-19T08:39:07.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.577+0000 7f6c5affd700 1 --2- 172.21.15.79:0/3299169105 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6c4806a0e0 0x7f6c4806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:07.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.577+0000 7f6c5affd700 1 --2- 172.21.15.79:0/3299169105 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6c4806a0e0 0x7f6c4806c5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0099f0 tx=0x7f6c4c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:07.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.581+0000 7f6c43fff700 1 -- 172.21.15.79:0/3299169105 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f6c5c0c75a0 con 0x7f6c5c0703b0 2023-10-19T08:39:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.769+0000 7f6c618ad700 1 -- 172.21.15.79:0/3299169105 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c5c0c75a0 con 0x7f6c5c0703b0 2023-10-19T08:39:07.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.770+0000 7f6c43fff700 1 -- 172.21.15.79:0/3299169105 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c5c0c75a0 con 0x7f6c5c0703b0 2023-10-19T08:39:07.774 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:39:07.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.772+0000 7f6c618ad700 1 -- 172.21.15.79:0/3299169105 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6c4806a0e0 msgr2=0x7f6c4806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:07.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.772+0000 7f6c618ad700 1 --2- 172.21.15.79:0/3299169105 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6c4806a0e0 0x7f6c4806c5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c0099f0 tx=0x7f6c4c008040 comp rx=0 tx=0).stop 2023-10-19T08:39:07.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.772+0000 7f6c618ad700 1 -- 172.21.15.79:0/3299169105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c5c0703b0 msgr2=0x7f6c5c0c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:07.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.772+0000 7f6c618ad700 1 --2- 172.21.15.79:0/3299169105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c5c0703b0 0x7f6c5c0c7880 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6c500090b0 tx=0x7f6c50004750 comp rx=0 tx=0).stop 2023-10-19T08:39:07.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.772+0000 7f6c618ad700 1 -- 172.21.15.79:0/3299169105 shutdown_connections 2023-10-19T08:39:07.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.772+0000 7f6c618ad700 1 --2- 172.21.15.79:0/3299169105 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c5c0cd270 0x7f6c5c156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.772+0000 7f6c618ad700 1 --2- 172.21.15.79:0/3299169105 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f6c4806a0e0 0x7f6c4806c5a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.772+0000 7f6c618ad700 1 --2- 172.21.15.79:0/3299169105 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6c5c06f910 0x7f6c5c155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.772+0000 7f6c618ad700 1 --2- 172.21.15.79:0/3299169105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c5c0703b0 0x7f6c5c0c7880 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.772+0000 7f6c618ad700 1 -- 172.21.15.79:0/3299169105 >> 172.21.15.79:0/3299169105 conn(0x7f6c5c06dcc0 msgr2=0x7f6c5c15ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.772+0000 7f6c618ad700 1 -- 172.21.15.79:0/3299169105 shutdown_connections 2023-10-19T08:39:07.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.772+0000 7f6c618ad700 1 -- 172.21.15.79:0/3299169105 wait complete. 2023-10-19T08:39:07.788 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:39:07.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.907+0000 7faeefce1700 1 Processor -- start 2023-10-19T08:39:07.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.908+0000 7faeefce1700 1 -- start start 2023-10-19T08:39:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.909+0000 7faeefce1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faee8159db0 0x7faee80cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.909+0000 7faeefce1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee806fdc0 0x7faee80ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.909+0000 7faeefce1700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee815d760 con 0x7faee80cc640 2023-10-19T08:39:07.914 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.909+0000 7faeefce1700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee815da40 con 0x7faee8159db0 2023-10-19T08:39:07.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.909+0000 7faeefce1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee815dd20 con 0x7faee806fdc0 2023-10-19T08:39:07.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.909+0000 7faeed27c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7faee8159db0 0x7faee80cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:07.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.909+0000 7faeeda7d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7faee80cc640 0x7faee80cca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58152/0 (socket says 172.21.15.79:58152) 2023-10-19T08:39:07.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.909+0000 7faeeda7d700 1 -- 172.21.15.79:0/2300367810 learned_addr learned my addr 172.21.15.79:0/2300367810 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:07.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.909+0000 7faeee27e700 1 --2- 172.21.15.79:0/2300367810 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee806fdc0 0x7faee80ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.909+0000 7faeed27c700 1 -- 172.21.15.79:0/2300367810 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee806fdc0 msgr2=0x7faee80ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.909+0000 7faeed27c700 1 --2- 172.21.15.79:0/2300367810 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee806fdc0 0x7faee80ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.909+0000 7faeed27c700 1 -- 172.21.15.79:0/2300367810 >> v1:172.21.15.79:6789/0 conn(0x7faee80cc640 legacy=0x7faee80cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.909+0000 7faeed27c700 1 -- 172.21.15.79:0/2300367810 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee815e000 con 0x7faee8159db0 2023-10-19T08:39:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.909+0000 7faeeca7b700 1 -- 172.21.15.79:0/2300367810 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649727397 0 0) 0x7faee815d760 con 0x7faee80cc640 2023-10-19T08:39:07.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.909+0000 7faeed27c700 1 --2- 172.21.15.79:0/2300367810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee8159db0 0x7faee80cdae0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7faee4009840 tx=0x7faee4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f45bfa39b53410 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:07.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.909+0000 7faeeca7b700 1 -- 172.21.15.79:0/2300367810 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4011830 con 0x7faee8159db0 2023-10-19T08:39:07.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.909+0000 7faeeca7b700 1 -- 172.21.15.79:0/2300367810 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee4011990 con 0x7faee8159db0 2023-10-19T08:39:07.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.909+0000 7faeeca7b700 1 -- 172.21.15.79:0/2300367810 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4011d20 con 0x7faee8159db0 2023-10-19T08:39:07.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.910+0000 7faeefce1700 1 -- 172.21.15.79:0/2300367810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee8159db0 msgr2=0x7faee80cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:07.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.910+0000 7faeefce1700 1 --2- 172.21.15.79:0/2300367810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee8159db0 0x7faee80cdae0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7faee4009840 tx=0x7faee4009b50 comp rx=0 tx=0).stop 2023-10-19T08:39:07.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.910+0000 7faeefce1700 1 -- 172.21.15.79:0/2300367810 shutdown_connections 2023-10-19T08:39:07.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.910+0000 7faeefce1700 1 --2- 172.21.15.79:0/2300367810 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee806fdc0 0x7faee80ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.910+0000 7faeefce1700 1 --2- 172.21.15.79:0/2300367810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee8159db0 0x7faee80cdae0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.910+0000 7faeefce1700 1 -- 172.21.15.79:0/2300367810 >> 172.21.15.79:0/2300367810 conn(0x7faee806dcc0 msgr2=0x7faee806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:07.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.910+0000 7faeefce1700 1 -- 172.21.15.79:0/2300367810 shutdown_connections 2023-10-19T08:39:07.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.910+0000 7faeefce1700 1 -- 172.21.15.79:0/2300367810 wait complete. 2023-10-19T08:39:07.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.911+0000 7faeefce1700 1 Processor -- start 2023-10-19T08:39:07.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.911+0000 7faeefce1700 1 -- start start 2023-10-19T08:39:07.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.912+0000 7faeefce1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faee806fdc0 0x7faee81e3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:07.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.912+0000 7faeefce1700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee80cc640 0x7faee813e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:07.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.912+0000 7faeefce1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee8159db0 0x7faee81f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:07.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.912+0000 7faeefce1700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee813fad0 con 0x7faee80cc640 2023-10-19T08:39:07.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.912+0000 7faeefce1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee813ec40 con 0x7faee806fdc0 2023-10-19T08:39:07.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.912+0000 7faeefce1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee813eec0 con 0x7faee8159db0 2023-10-19T08:39:07.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.912+0000 7faeed27c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee80cc640 0x7faee813e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:07.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.912+0000 7faeed27c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee80cc640 0x7faee813e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48088/0 (socket says 172.21.15.79:48088) 2023-10-19T08:39:07.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.912+0000 7faeed27c700 1 -- 172.21.15.79:0/214849948 learned_addr learned my addr 172.21.15.79:0/214849948 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:07.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.912+0000 7faeee27e700 1 --2- 172.21.15.79:0/214849948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee8159db0 0x7faee81f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:07.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.912+0000 7faeeda7d700 1 --2- 172.21.15.79:0/214849948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faee806fdc0 0x7faee81e3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:07.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.912+0000 7faeed27c700 1 -- 172.21.15.79:0/214849948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee8159db0 msgr2=0x7faee81f4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:07.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.912+0000 7faeed27c700 1 --2- 172.21.15.79:0/214849948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee8159db0 0x7faee81f4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.912+0000 7faeed27c700 1 -- 172.21.15.79:0/214849948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faee806fdc0 msgr2=0x7faee81e3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:07.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.912+0000 7faeed27c700 1 --2- 172.21.15.79:0/214849948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faee806fdc0 0x7faee81e3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:07.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.912+0000 7faeed27c700 1 -- 172.21.15.79:0/214849948 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee40094a0 con 0x7faee80cc640 2023-10-19T08:39:07.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.912+0000 7faeeda7d700 1 --2- 172.21.15.79:0/214849948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faee806fdc0 0x7faee81e3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:07.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.912+0000 7faeed27c700 1 --2- 172.21.15.79:0/214849948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee80cc640 0x7faee813e700 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7faee40090b0 tx=0x7faee4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:07.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.913+0000 7faede7fc700 1 -- 172.21.15.79:0/214849948 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee40036a0 con 0x7faee80cc640 2023-10-19T08:39:07.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.913+0000 7faede7fc700 1 -- 172.21.15.79:0/214849948 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee4003800 con 0x7faee80cc640 2023-10-19T08:39:07.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.913+0000 7faeefce1700 1 -- 172.21.15.79:0/214849948 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee813f1a0 con 0x7faee80cc640 2023-10-19T08:39:07.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.913+0000 7faede7fc700 1 -- 172.21.15.79:0/214849948 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4003b70 con 0x7faee80cc640 2023-10-19T08:39:07.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.913+0000 7faeefce1700 1 -- 172.21.15.79:0/214849948 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee813f760 con 0x7faee80cc640 2023-10-19T08:39:07.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.914+0000 7faeefce1700 1 -- 172.21.15.79:0/214849948 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee813fc40 con 0x7faee80cc640 2023-10-19T08:39:07.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.914+0000 7faede7fc700 1 -- 172.21.15.79:0/214849948 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faee4003cd0 con 0x7faee80cc640 2023-10-19T08:39:07.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.914+0000 7faede7fc700 1 --2- 172.21.15.79:0/214849948 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faecc06a0e0 0x7faecc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:07.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.914+0000 7faede7fc700 1 -- 172.21.15.79:0/214849948 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faee4089d10 con 0x7faee80cc640 2023-10-19T08:39:07.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.914+0000 7faeeda7d700 1 --2- 172.21.15.79:0/214849948 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faecc06a0e0 0x7faecc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:07.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.915+0000 7faeeda7d700 1 --2- 172.21.15.79:0/214849948 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faecc06a0e0 0x7faecc06c5a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faed8000f60 tx=0x7faed8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:07.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:07.919+0000 7faede7fc700 1 -- 172.21.15.79:0/214849948 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7faee4055160 con 0x7faee80cc640 2023-10-19T08:39:08.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.108+0000 7faeefce1700 1 -- 172.21.15.79:0/214849948 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faee804ee70 con 0x7faee80cc640 2023-10-19T08:39:08.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.108+0000 7faede7fc700 1 -- 172.21.15.79:0/214849948 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7faee4058780 con 0x7faee80cc640 2023-10-19T08:39:08.112 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:39:08.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.110+0000 7faeefce1700 1 -- 172.21.15.79:0/214849948 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faecc06a0e0 msgr2=0x7faecc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:08.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.110+0000 7faeefce1700 1 --2- 172.21.15.79:0/214849948 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faecc06a0e0 0x7faecc06c5a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7faed8000f60 tx=0x7faed8009040 comp rx=0 tx=0).stop 2023-10-19T08:39:08.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.110+0000 7faeefce1700 1 -- 172.21.15.79:0/214849948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee80cc640 msgr2=0x7faee813e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:08.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.110+0000 7faeefce1700 1 --2- 172.21.15.79:0/214849948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee80cc640 0x7faee813e700 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7faee40090b0 tx=0x7faee4004750 comp rx=0 tx=0).stop 2023-10-19T08:39:08.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.110+0000 7faeefce1700 1 -- 172.21.15.79:0/214849948 shutdown_connections 2023-10-19T08:39:08.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.110+0000 7faeefce1700 1 --2- 172.21.15.79:0/214849948 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faecc06a0e0 0x7faecc06c5a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.110+0000 7faeefce1700 1 --2- 172.21.15.79:0/214849948 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faee8159db0 0x7faee81f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.110+0000 7faeefce1700 1 --2- 172.21.15.79:0/214849948 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faee806fdc0 0x7faee81e3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.110+0000 7faeefce1700 1 --2- 172.21.15.79:0/214849948 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee80cc640 0x7faee813e700 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.110+0000 7faeefce1700 1 -- 172.21.15.79:0/214849948 >> 172.21.15.79:0/214849948 conn(0x7faee806dcc0 msgr2=0x7faee80cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:08.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.110+0000 7faeefce1700 1 -- 172.21.15.79:0/214849948 shutdown_connections 2023-10-19T08:39:08.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.110+0000 7faeefce1700 1 -- 172.21.15.79:0/214849948 wait complete. 2023-10-19T08:39:08.127 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T08:39:08.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.248+0000 7f38ce957700 1 Processor -- start 2023-10-19T08:39:08.252 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.248+0000 7f38ce957700 1 -- start start 2023-10-19T08:39:08.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.249+0000 7f38ce957700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38c806a930 0x7f38c80cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:08.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.249+0000 7f38ce957700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38c80703b0 0x7f38c80cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:08.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.249+0000 7f38ce957700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c80b1fe0 con 0x7f38c80cd270 2023-10-19T08:39:08.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.249+0000 7f38ce957700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c8160a80 con 0x7f38c80703b0 2023-10-19T08:39:08.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.249+0000 7f38ce957700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c80ce2b0 con 0x7f38c806a930 2023-10-19T08:39:08.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.249+0000 7f38ccef4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38c80703b0 0x7f38c80cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:08.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.249+0000 7f38ccef4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f38c80703b0 0x7f38c80cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48098/0 (socket says 172.21.15.79:48098) 2023-10-19T08:39:08.255 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.249+0000 7f38ccef4700 1 -- 172.21.15.79:0/3614068809 learned_addr learned my addr 172.21.15.79:0/3614068809 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:08.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.249+0000 7f38c77fe700 1 --2- 172.21.15.79:0/3614068809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38c806a930 0x7f38c80cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:08.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.249+0000 7f38ccef4700 1 -- 172.21.15.79:0/3614068809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38c806a930 msgr2=0x7f38c80cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:08.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.249+0000 7f38ccef4700 1 --2- 172.21.15.79:0/3614068809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38c806a930 0x7f38c80cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.249+0000 7f38ccef4700 1 -- 172.21.15.79:0/3614068809 >> v1:172.21.15.89:6789/0 conn(0x7f38c80cd270 legacy=0x7f38c806a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:08.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.249+0000 7f38ccef4700 1 -- 172.21.15.79:0/3614068809 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c80ce550 con 0x7f38c80703b0 2023-10-19T08:39:08.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.249+0000 7f38ccef4700 1 --2- 172.21.15.79:0/3614068809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38c80703b0 0x7f38c80cb7d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009e50 tx=0x7f38c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79e731e68b94ffa server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:08.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.249+0000 7f38c6ffd700 1 -- 172.21.15.79:0/3614068809 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c000e070 con 0x7f38c80703b0 2023-10-19T08:39:08.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.249+0000 7f38c6ffd700 1 -- 172.21.15.79:0/3614068809 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c000b910 con 0x7f38c80703b0 2023-10-19T08:39:08.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.249+0000 7f38c6ffd700 1 -- 172.21.15.79:0/3614068809 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c000bcc0 con 0x7f38c80703b0 2023-10-19T08:39:08.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.250+0000 7f38ce957700 1 -- 172.21.15.79:0/3614068809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38c80703b0 msgr2=0x7f38c80cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:08.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.250+0000 7f38ce957700 1 --2- 172.21.15.79:0/3614068809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38c80703b0 0x7f38c80cb7d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009e50 tx=0x7f38c000b330 comp rx=0 tx=0).stop 2023-10-19T08:39:08.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.250+0000 7f38ce957700 1 -- 172.21.15.79:0/3614068809 shutdown_connections 2023-10-19T08:39:08.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.250+0000 7f38ce957700 1 --2- 172.21.15.79:0/3614068809 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38c80703b0 0x7f38c80cb7d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.250+0000 7f38ce957700 1 --2- 172.21.15.79:0/3614068809 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38c806a930 0x7f38c80cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.250+0000 7f38ce957700 1 -- 172.21.15.79:0/3614068809 >> 172.21.15.79:0/3614068809 conn(0x7f38c806dcc0 msgr2=0x7f38c806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:08.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.250+0000 7f38ce957700 1 -- 172.21.15.79:0/3614068809 shutdown_connections 2023-10-19T08:39:08.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.250+0000 7f38ce957700 1 -- 172.21.15.79:0/3614068809 wait complete. 2023-10-19T08:39:08.261 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.252+0000 7f38ce957700 1 Processor -- start 2023-10-19T08:39:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.252+0000 7f38ce957700 1 -- start start 2023-10-19T08:39:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38ce957700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38c806a930 0x7f38c8151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38ce957700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38c80703b0 0x7f38c80c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38ce957700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38c80cd270 0x7f38c80b2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:08.262 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38ce957700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c80c8840 con 0x7f38c80703b0 2023-10-19T08:39:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38ce957700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c80c7c30 con 0x7f38c806a930 2023-10-19T08:39:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38ce957700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c80c7f10 con 0x7f38c80cd270 2023-10-19T08:39:08.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38c77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38c80703b0 0x7f38c80c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:08.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38c77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38c80703b0 0x7f38c80c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48102/0 (socket says 172.21.15.79:48102) 2023-10-19T08:39:08.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38c77fe700 1 -- 172.21.15.79:0/3945021346 learned_addr learned my addr 172.21.15.79:0/3945021346 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:08.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38c7fff700 1 --2- 172.21.15.79:0/3945021346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38c806a930 0x7f38c8151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:08.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38ccef4700 1 --2- 172.21.15.79:0/3945021346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38c80cd270 0x7f38c80b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:08.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38c77fe700 1 -- 172.21.15.79:0/3945021346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38c80cd270 msgr2=0x7f38c80b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:08.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38c77fe700 1 --2- 172.21.15.79:0/3945021346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38c80cd270 0x7f38c80b2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38c77fe700 1 -- 172.21.15.79:0/3945021346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38c806a930 msgr2=0x7f38c8151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:08.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38c77fe700 1 --2- 172.21.15.79:0/3945021346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38c806a930 0x7f38c8151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38c77fe700 1 -- 172.21.15.79:0/3945021346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c0009b30 con 0x7f38c80703b0 2023-10-19T08:39:08.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38c77fe700 1 --2- 172.21.15.79:0/3945021346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38c80703b0 0x7f38c80c8cd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f38b000e870 tx=0x7f38b000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:08.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38c4ff9700 1 -- 172.21.15.79:0/3945021346 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b0009590 con 0x7f38c80703b0 2023-10-19T08:39:08.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38c4ff9700 1 -- 172.21.15.79:0/3945021346 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b000ee70 con 0x7f38c80703b0 2023-10-19T08:39:08.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38c4ff9700 1 -- 172.21.15.79:0/3945021346 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b000ca50 con 0x7f38c80703b0 2023-10-19T08:39:08.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38ce957700 1 -- 172.21.15.79:0/3945021346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c80c81f0 con 0x7f38c80703b0 2023-10-19T08:39:08.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.253+0000 7f38ce957700 1 -- 172.21.15.79:0/3945021346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c8151590 con 0x7f38c80703b0 2023-10-19T08:39:08.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.254+0000 7f38ce957700 1 -- 172.21.15.79:0/3945021346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c80c89b0 con 0x7f38c80703b0 2023-10-19T08:39:08.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.255+0000 7f38c4ff9700 1 -- 172.21.15.79:0/3945021346 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f38b000cbb0 con 0x7f38c80703b0 2023-10-19T08:39:08.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.255+0000 7f38c4ff9700 1 --2- 172.21.15.79:0/3945021346 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f38a806a0e0 0x7f38a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:08.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.255+0000 7f38c4ff9700 1 -- 172.21.15.79:0/3945021346 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f38b0088880 con 0x7f38c80703b0 2023-10-19T08:39:08.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.255+0000 7f38c7fff700 1 --2- 172.21.15.79:0/3945021346 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f38a806a0e0 0x7f38a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:08.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.256+0000 7f38c7fff700 1 --2- 172.21.15.79:0/3945021346 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f38a806a0e0 0x7f38a806c5a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f38b8000f60 tx=0x7f38b8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:08.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.259+0000 7f38c4ff9700 1 -- 172.21.15.79:0/3945021346 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f38b00576d0 con 0x7f38c80703b0 2023-10-19T08:39:08.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.451+0000 7f38ce957700 1 -- 172.21.15.79:0/3945021346 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f38c804ee70 con 0x7f38c80703b0 2023-10-19T08:39:08.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.451+0000 7f38c4ff9700 1 -- 172.21.15.79:0/3945021346 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f38b000ce60 con 0x7f38c80703b0 2023-10-19T08:39:08.455 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:39:08.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.453+0000 7f38ce957700 1 -- 172.21.15.79:0/3945021346 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f38a806a0e0 msgr2=0x7f38a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:08.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.453+0000 7f38ce957700 1 --2- 172.21.15.79:0/3945021346 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f38a806a0e0 0x7f38a806c5a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f38b8000f60 tx=0x7f38b8009040 comp rx=0 tx=0).stop 2023-10-19T08:39:08.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.453+0000 7f38ce957700 1 -- 172.21.15.79:0/3945021346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38c80703b0 msgr2=0x7f38c80c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:08.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.453+0000 7f38ce957700 1 --2- 172.21.15.79:0/3945021346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38c80703b0 0x7f38c80c8cd0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f38b000e870 tx=0x7f38b000ec30 comp rx=0 tx=0).stop 2023-10-19T08:39:08.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.453+0000 7f38ce957700 1 -- 172.21.15.79:0/3945021346 shutdown_connections 2023-10-19T08:39:08.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.453+0000 7f38ce957700 1 --2- 172.21.15.79:0/3945021346 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f38a806a0e0 0x7f38a806c5a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.453+0000 7f38ce957700 1 --2- 172.21.15.79:0/3945021346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38c80cd270 0x7f38c80b2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.453+0000 7f38ce957700 1 --2- 172.21.15.79:0/3945021346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38c806a930 0x7f38c8151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.453+0000 7f38ce957700 1 --2- 172.21.15.79:0/3945021346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38c80703b0 0x7f38c80c8cd0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.453+0000 7f38ce957700 1 -- 172.21.15.79:0/3945021346 >> 172.21.15.79:0/3945021346 conn(0x7f38c806dcc0 msgr2=0x7f38c815dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:08.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.454+0000 7f38ce957700 1 -- 172.21.15.79:0/3945021346 shutdown_connections 2023-10-19T08:39:08.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.454+0000 7f38ce957700 1 -- 172.21.15.79:0/3945021346 wait complete. 2023-10-19T08:39:08.469 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T08:39:08.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.590+0000 7f44d7d56700 1 Processor -- start 2023-10-19T08:39:08.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.590+0000 7f44d7d56700 1 -- start start 2023-10-19T08:39:08.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.591+0000 7f44d7d56700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f44d00cc640 0x7f44d00cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:08.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.591+0000 7f44d7d56700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44d00ceaf0 0x7f44d00b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:08.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.591+0000 7f44d7d56700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d00ccf60 con 0x7f44d0159db0 2023-10-19T08:39:08.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.591+0000 7f44d7d56700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d015d760 con 0x7f44d00cc640 2023-10-19T08:39:08.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.591+0000 7f44d7d56700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d015da40 con 0x7f44d00ceaf0 2023-10-19T08:39:08.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.591+0000 7f44d5af2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f44d00cc640 0x7f44d00cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:08.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.591+0000 7f44d5af2700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f44d00cc640 0x7f44d00cca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48108/0 (socket says 172.21.15.79:48108) 2023-10-19T08:39:08.598 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.591+0000 7f44d5af2700 1 -- 172.21.15.79:0/1462614513 learned_addr learned my addr 172.21.15.79:0/1462614513 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:08.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.592+0000 7f44d62f3700 1 --2- 172.21.15.79:0/1462614513 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44d00ceaf0 0x7f44d00b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:08.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.592+0000 7f44d5af2700 1 -- 172.21.15.79:0/1462614513 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44d00ceaf0 msgr2=0x7f44d00b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:08.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.592+0000 7f44d5af2700 1 --2- 172.21.15.79:0/1462614513 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44d00ceaf0 0x7f44d00b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.592+0000 7f44d5af2700 1 -- 172.21.15.79:0/1462614513 >> v1:172.21.15.89:6789/0 conn(0x7f44d0159db0 legacy=0x7f44d00b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:08.599 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.592+0000 7f44d5af2700 1 -- 172.21.15.79:0/1462614513 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d015dd20 con 0x7f44d00cc640 2023-10-19T08:39:08.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.592+0000 7f44d62f3700 1 --2- 172.21.15.79:0/1462614513 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44d00ceaf0 0x7f44d00b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:08.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.592+0000 7f44d5af2700 1 --2- 172.21.15.79:0/1462614513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44d00cc640 0x7f44d00cca20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f44c000bb90 tx=0x7f44c000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cd1c265ab3939b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:08.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.592+0000 7f44d4af0700 1 -- 172.21.15.79:0/1462614513 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c000dd50 con 0x7f44d00cc640 2023-10-19T08:39:08.600 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.592+0000 7f44d4af0700 1 -- 172.21.15.79:0/1462614513 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c0010470 con 0x7f44d00cc640 2023-10-19T08:39:08.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.592+0000 7f44d4af0700 1 -- 172.21.15.79:0/1462614513 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0010800 con 0x7f44d00cc640 2023-10-19T08:39:08.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.593+0000 7f44d7d56700 1 -- 172.21.15.79:0/1462614513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44d00cc640 msgr2=0x7f44d00cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:08.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.593+0000 7f44d7d56700 1 --2- 172.21.15.79:0/1462614513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44d00cc640 0x7f44d00cca20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f44c000bb90 tx=0x7f44c000bea0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.593+0000 7f44d7d56700 1 -- 172.21.15.79:0/1462614513 shutdown_connections 2023-10-19T08:39:08.601 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.593+0000 7f44d7d56700 1 --2- 172.21.15.79:0/1462614513 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44d00ceaf0 0x7f44d00b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.593+0000 7f44d7d56700 1 --2- 172.21.15.79:0/1462614513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44d00cc640 0x7f44d00cca20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.593+0000 7f44d7d56700 1 -- 172.21.15.79:0/1462614513 >> 172.21.15.79:0/1462614513 conn(0x7f44d006dcc0 msgr2=0x7f44d006e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:08.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.593+0000 7f44d7d56700 1 -- 172.21.15.79:0/1462614513 shutdown_connections 2023-10-19T08:39:08.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.593+0000 7f44d7d56700 1 -- 172.21.15.79:0/1462614513 wait complete. 2023-10-19T08:39:08.602 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.594+0000 7f44d7d56700 1 Processor -- start 2023-10-19T08:39:08.603 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.594+0000 7f44d7d56700 1 -- start start 2023-10-19T08:39:08.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d7d56700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44d00cc640 0x7f44d014fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:08.605 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d7d56700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44d00ceaf0 0x7f44d00c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:08.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d7d56700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44d0159db0 0x7f44d0156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:08.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d7d56700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d00c7f40 con 0x7f44d00cc640 2023-10-19T08:39:08.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d7d56700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d0150010 con 0x7f44d00ceaf0 2023-10-19T08:39:08.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d7d56700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d00c6ea0 con 0x7f44d0159db0 2023-10-19T08:39:08.606 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d5af2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44d00cc640 0x7f44d014fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:08.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d5af2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44d00cc640 0x7f44d014fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48114/0 (socket says 172.21.15.79:48114) 2023-10-19T08:39:08.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d5af2700 1 -- 172.21.15.79:0/3884507334 learned_addr learned my addr 172.21.15.79:0/3884507334 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:08.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d5af2700 1 -- 172.21.15.79:0/3884507334 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44d0159db0 msgr2=0x7f44d0156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:08.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d52f1700 1 --2- 172.21.15.79:0/3884507334 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44d00ceaf0 0x7f44d00c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:08.607 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d62f3700 1 --2- 172.21.15.79:0/3884507334 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44d0159db0 0x7f44d0156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:08.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d5af2700 1 --2- 172.21.15.79:0/3884507334 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44d0159db0 0x7f44d0156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d5af2700 1 -- 172.21.15.79:0/3884507334 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44d00ceaf0 msgr2=0x7f44d00c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:08.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d5af2700 1 --2- 172.21.15.79:0/3884507334 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44d00ceaf0 0x7f44d00c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d5af2700 1 -- 172.21.15.79:0/3884507334 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c000b7f0 con 0x7f44d00cc640 2023-10-19T08:39:08.608 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d52f1700 1 --2- 172.21.15.79:0/3884507334 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44d00ceaf0 0x7f44d00c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:08.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d62f3700 1 --2- 172.21.15.79:0/3884507334 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44d0159db0 0x7f44d0156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:08.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d5af2700 1 --2- 172.21.15.79:0/3884507334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44d00cc640 0x7f44d014fad0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f44c000bee0 tx=0x7f44c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:08.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44c67fc700 1 -- 172.21.15.79:0/3884507334 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c001f070 con 0x7f44d00cc640 2023-10-19T08:39:08.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44c67fc700 1 -- 172.21.15.79:0/3884507334 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c00039b0 con 0x7f44d00cc640 2023-10-19T08:39:08.609 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d7d56700 1 -- 172.21.15.79:0/3884507334 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d00c7180 con 0x7f44d00cc640 2023-10-19T08:39:08.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44c67fc700 1 -- 172.21.15.79:0/3884507334 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0003d60 con 0x7f44d00cc640 2023-10-19T08:39:08.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.595+0000 7f44d7d56700 1 -- 172.21.15.79:0/3884507334 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d00c7740 con 0x7f44d00cc640 2023-10-19T08:39:08.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.596+0000 7f44d7d56700 1 -- 172.21.15.79:0/3884507334 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d004ee70 con 0x7f44d00cc640 2023-10-19T08:39:08.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.597+0000 7f44c67fc700 1 -- 172.21.15.79:0/3884507334 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f44c0019400 con 0x7f44d00cc640 2023-10-19T08:39:08.610 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.597+0000 7f44c67fc700 1 --2- 172.21.15.79:0/3884507334 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f44b406a0e0 0x7f44b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:08.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.597+0000 7f44c67fc700 1 -- 172.21.15.79:0/3884507334 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f44c008c580 con 0x7f44d00cc640 2023-10-19T08:39:08.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.597+0000 7f44d52f1700 1 --2- 172.21.15.79:0/3884507334 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f44b406a0e0 0x7f44b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:08.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.597+0000 7f44d52f1700 1 --2- 172.21.15.79:0/3884507334 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f44b406a0e0 0x7f44b406c5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f44d0157d70 tx=0x7f44cc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:08.611 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.601+0000 7f44c67fc700 1 -- 172.21.15.79:0/3884507334 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f44c00579d0 con 0x7f44d00cc640 2023-10-19T08:39:08.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.790+0000 7f44d7d56700 1 -- 172.21.15.79:0/3884507334 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f44d00ca280 con 0x7f44d00cc640 2023-10-19T08:39:08.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.790+0000 7f44c67fc700 1 -- 172.21.15.79:0/3884507334 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44c005aff0 con 0x7f44d00cc640 2023-10-19T08:39:08.794 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-19T08:39:08.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.792+0000 7f44d7d56700 1 -- 172.21.15.79:0/3884507334 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f44b406a0e0 msgr2=0x7f44b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:08.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.792+0000 7f44d7d56700 1 --2- 172.21.15.79:0/3884507334 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f44b406a0e0 0x7f44b406c5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f44d0157d70 tx=0x7f44cc009040 comp rx=0 tx=0).stop 2023-10-19T08:39:08.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.792+0000 7f44d7d56700 1 -- 172.21.15.79:0/3884507334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44d00cc640 msgr2=0x7f44d014fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:08.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.792+0000 7f44d7d56700 1 --2- 172.21.15.79:0/3884507334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44d00cc640 0x7f44d014fad0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f44c000bee0 tx=0x7f44c0004750 comp rx=0 tx=0).stop 2023-10-19T08:39:08.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.792+0000 7f44d7d56700 1 -- 172.21.15.79:0/3884507334 shutdown_connections 2023-10-19T08:39:08.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.792+0000 7f44d7d56700 1 --2- 172.21.15.79:0/3884507334 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f44b406a0e0 0x7f44b406c5a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.792+0000 7f44d7d56700 1 --2- 172.21.15.79:0/3884507334 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f44d0159db0 0x7f44d0156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.792+0000 7f44d7d56700 1 --2- 172.21.15.79:0/3884507334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f44d00cc640 0x7f44d014fad0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.792+0000 7f44d7d56700 1 --2- 172.21.15.79:0/3884507334 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f44d00ceaf0 0x7f44d00c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.792+0000 7f44d7d56700 1 -- 172.21.15.79:0/3884507334 >> 172.21.15.79:0/3884507334 conn(0x7f44d006dcc0 msgr2=0x7f44d00cb780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:08.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.792+0000 7f44d7d56700 1 -- 172.21.15.79:0/3884507334 shutdown_connections 2023-10-19T08:39:08.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.793+0000 7f44d7d56700 1 -- 172.21.15.79:0/3884507334 wait complete. 2023-10-19T08:39:08.808 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T08:39:08.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.928+0000 7f550bcd6700 1 Processor -- start 2023-10-19T08:39:08.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.928+0000 7f550bcd6700 1 -- start start 2023-10-19T08:39:08.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.929+0000 7f550bcd6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f55040cc640 0x7f55040cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:08.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.929+0000 7f550bcd6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f55040ceaf0 0x7f55040b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:08.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.929+0000 7f550bcd6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55040ccf60 con 0x7f5504159db0 2023-10-19T08:39:08.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.929+0000 7f550bcd6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550415d760 con 0x7f55040cc640 2023-10-19T08:39:08.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.929+0000 7f550bcd6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550415da40 con 0x7f55040ceaf0 2023-10-19T08:39:08.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.929+0000 7f5509a72700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f55040cc640 0x7f55040cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:08.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.929+0000 7f5509a72700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f55040cc640 0x7f55040cca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48122/0 (socket says 172.21.15.79:48122) 2023-10-19T08:39:08.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.929+0000 7f5509a72700 1 -- 172.21.15.79:0/3372062291 learned_addr learned my addr 172.21.15.79:0/3372062291 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:08.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.929+0000 7f5509271700 1 --1- 172.21.15.79:0/3372062291 >> v1:172.21.15.79:6789/0 conn(0x7f5504159db0 0x7f55040b16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58194/0 (socket says 172.21.15.79:58194) 2023-10-19T08:39:08.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.929+0000 7f550a273700 1 --2- 172.21.15.79:0/3372062291 >> v2:172.21.15.89:3300/0 conn(0x7f55040ceaf0 0x7f55040b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:08.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.929+0000 7f5509a72700 1 -- 172.21.15.79:0/3372062291 >> v2:172.21.15.89:3300/0 conn(0x7f55040ceaf0 msgr2=0x7f55040b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:08.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.929+0000 7f5509a72700 1 --2- 172.21.15.79:0/3372062291 >> v2:172.21.15.89:3300/0 conn(0x7f55040ceaf0 0x7f55040b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.929+0000 7f5509a72700 1 -- 172.21.15.79:0/3372062291 >> v1:172.21.15.79:6789/0 conn(0x7f5504159db0 legacy=0x7f55040b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:08.936 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.929+0000 7f5509a72700 1 -- 172.21.15.79:0/3372062291 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550415dd20 con 0x7f55040cc640 2023-10-19T08:39:08.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.929+0000 7f5508a70700 1 -- 172.21.15.79:0/3372062291 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130948112 0 0) 0x7f55040ccf60 con 0x7f5504159db0 2023-10-19T08:39:08.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.929+0000 7f5509a72700 1 --2- 172.21.15.79:0/3372062291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55040cc640 0x7f55040cca20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f550406ed80 tx=0x7f5500009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b4fe9ef89f5e1e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:08.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.929+0000 7f5508a70700 1 -- 172.21.15.79:0/3372062291 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550000b870 con 0x7f55040cc640 2023-10-19T08:39:08.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.929+0000 7f5508a70700 1 -- 172.21.15.79:0/3372062291 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550000b9d0 con 0x7f55040cc640 2023-10-19T08:39:08.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.929+0000 7f5508a70700 1 -- 172.21.15.79:0/3372062291 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550000bd60 con 0x7f55040cc640 2023-10-19T08:39:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.930+0000 7f550bcd6700 1 -- 172.21.15.79:0/3372062291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55040cc640 msgr2=0x7f55040cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.930+0000 7f550bcd6700 1 --2- 172.21.15.79:0/3372062291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55040cc640 0x7f55040cca20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f550406ed80 tx=0x7f5500009bd0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.930+0000 7f550bcd6700 1 -- 172.21.15.79:0/3372062291 shutdown_connections 2023-10-19T08:39:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.930+0000 7f550bcd6700 1 --2- 172.21.15.79:0/3372062291 >> v2:172.21.15.89:3300/0 conn(0x7f55040ceaf0 0x7f55040b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.930+0000 7f550bcd6700 1 --2- 172.21.15.79:0/3372062291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55040cc640 0x7f55040cca20 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.930+0000 7f550bcd6700 1 -- 172.21.15.79:0/3372062291 >> 172.21.15.79:0/3372062291 conn(0x7f550406dcc0 msgr2=0x7f550406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:08.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.930+0000 7f550bcd6700 1 -- 172.21.15.79:0/3372062291 shutdown_connections 2023-10-19T08:39:08.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.930+0000 7f550bcd6700 1 -- 172.21.15.79:0/3372062291 wait complete. 2023-10-19T08:39:08.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.931+0000 7f550bcd6700 1 Processor -- start 2023-10-19T08:39:08.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.932+0000 7f550bcd6700 1 -- start start 2023-10-19T08:39:08.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.932+0000 7f550bcd6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55040cc640 0x7f5504154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:08.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.932+0000 7f550bcd6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55040ceaf0 0x7f550415cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:08.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.932+0000 7f550bcd6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5504159db0 0x7f5504153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:08.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.932+0000 7f550bcd6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550415a940 con 0x7f5504159db0 2023-10-19T08:39:08.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.932+0000 7f550bcd6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550415d240 con 0x7f55040cc640 2023-10-19T08:39:08.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.932+0000 7f550bcd6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5504154f70 con 0x7f55040ceaf0 2023-10-19T08:39:08.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.933+0000 7f550a273700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5504159db0 0x7f5504153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:08.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.933+0000 7f550a273700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5504159db0 0x7f5504153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48132/0 (socket says 172.21.15.79:48132) 2023-10-19T08:39:08.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.933+0000 7f550a273700 1 -- 172.21.15.79:0/3930658730 learned_addr learned my addr 172.21.15.79:0/3930658730 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:08.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.933+0000 7f5509a72700 1 --2- 172.21.15.79:0/3930658730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55040cc640 0x7f5504154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:08.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.933+0000 7f5509271700 1 --2- 172.21.15.79:0/3930658730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55040ceaf0 0x7f550415cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:08.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.933+0000 7f550a273700 1 -- 172.21.15.79:0/3930658730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55040ceaf0 msgr2=0x7f550415cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:08.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.933+0000 7f550a273700 1 --2- 172.21.15.79:0/3930658730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55040ceaf0 0x7f550415cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.933+0000 7f550a273700 1 -- 172.21.15.79:0/3930658730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55040cc640 msgr2=0x7f5504154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:08.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.933+0000 7f550a273700 1 --2- 172.21.15.79:0/3930658730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55040cc640 0x7f5504154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:08.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.933+0000 7f550a273700 1 -- 172.21.15.79:0/3930658730 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5500009550 con 0x7f5504159db0 2023-10-19T08:39:08.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.933+0000 7f5509271700 1 --2- 172.21.15.79:0/3930658730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55040ceaf0 0x7f550415cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:08.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.933+0000 7f550a273700 1 --2- 172.21.15.79:0/3930658730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5504159db0 0x7f5504153f40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f54fc007e40 tx=0x7f54fc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:08.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.933+0000 7f54fa7fc700 1 -- 172.21.15.79:0/3930658730 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc00eea0 con 0x7f5504159db0 2023-10-19T08:39:08.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.933+0000 7f54fa7fc700 1 -- 172.21.15.79:0/3930658730 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54fc014420 con 0x7f5504159db0 2023-10-19T08:39:08.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.933+0000 7f550bcd6700 1 -- 172.21.15.79:0/3930658730 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550415a380 con 0x7f5504159db0 2023-10-19T08:39:08.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.933+0000 7f54fa7fc700 1 -- 172.21.15.79:0/3930658730 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc0147b0 con 0x7f5504159db0 2023-10-19T08:39:08.946 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.933+0000 7f550bcd6700 1 -- 172.21.15.79:0/3930658730 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55040c4ac0 con 0x7f5504159db0 2023-10-19T08:39:08.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.934+0000 7f550bcd6700 1 -- 172.21.15.79:0/3930658730 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55040c4920 con 0x7f5504159db0 2023-10-19T08:39:08.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.935+0000 7f54fa7fc700 1 -- 172.21.15.79:0/3930658730 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f54fc014910 con 0x7f5504159db0 2023-10-19T08:39:08.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.935+0000 7f54fa7fc700 1 --2- 172.21.15.79:0/3930658730 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f54e806a0b0 0x7f54e806c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:08.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.935+0000 7f54fa7fc700 1 -- 172.21.15.79:0/3930658730 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f54fc088fd0 con 0x7f5504159db0 2023-10-19T08:39:08.947 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.935+0000 7f5509a72700 1 --2- 172.21.15.79:0/3930658730 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f54e806a0b0 0x7f54e806c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:08.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.935+0000 7f5509a72700 1 --2- 172.21.15.79:0/3930658730 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f54e806a0b0 0x7f54e806c570 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5500014040 tx=0x7f5500008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:08.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:08.939+0000 7f54fa7fc700 1 -- 172.21.15.79:0/3930658730 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f55040c4920 con 0x7f5504159db0 2023-10-19T08:39:09.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.131+0000 7f550bcd6700 1 -- 172.21.15.79:0/3930658730 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f55040c4920 con 0x7f5504159db0 2023-10-19T08:39:09.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.132+0000 7f54fa7fc700 1 -- 172.21.15.79:0/3930658730 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f55040c4920 con 0x7f5504159db0 2023-10-19T08:39:09.136 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:39:09.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.134+0000 7f550bcd6700 1 -- 172.21.15.79:0/3930658730 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f54e806a0b0 msgr2=0x7f54e806c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:09.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.134+0000 7f550bcd6700 1 --2- 172.21.15.79:0/3930658730 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f54e806a0b0 0x7f54e806c570 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5500014040 tx=0x7f5500008030 comp rx=0 tx=0).stop 2023-10-19T08:39:09.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.134+0000 7f550bcd6700 1 -- 172.21.15.79:0/3930658730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5504159db0 msgr2=0x7f5504153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:09.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.134+0000 7f550bcd6700 1 --2- 172.21.15.79:0/3930658730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5504159db0 0x7f5504153f40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f54fc007e40 tx=0x7f54fc00e3c0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.134+0000 7f550bcd6700 1 -- 172.21.15.79:0/3930658730 shutdown_connections 2023-10-19T08:39:09.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.134+0000 7f550bcd6700 1 --2- 172.21.15.79:0/3930658730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5504159db0 0x7f5504153f40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.134+0000 7f550bcd6700 1 --2- 172.21.15.79:0/3930658730 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55040cc640 0x7f5504154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.134+0000 7f550bcd6700 1 --2- 172.21.15.79:0/3930658730 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f54e806a0b0 0x7f54e806c570 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.139 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.134+0000 7f550bcd6700 1 --2- 172.21.15.79:0/3930658730 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f55040ceaf0 0x7f550415cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.134+0000 7f550bcd6700 1 -- 172.21.15.79:0/3930658730 >> 172.21.15.79:0/3930658730 conn(0x7f550406dcc0 msgr2=0x7f5504157fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:09.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.134+0000 7f550bcd6700 1 -- 172.21.15.79:0/3930658730 shutdown_connections 2023-10-19T08:39:09.140 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.134+0000 7f550bcd6700 1 -- 172.21.15.79:0/3930658730 wait complete. 2023-10-19T08:39:09.150 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-19T08:39:09.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.267+0000 7f56a8eef700 1 Processor -- start 2023-10-19T08:39:09.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.267+0000 7f56a8eef700 1 -- start start 2023-10-19T08:39:09.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.268+0000 7f56a8eef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f56a40b0710 0x7f56a40b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:09.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.268+0000 7f56a8eef700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f56a40b1d50 0x7f56a40b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:09.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.268+0000 7f56a8eef700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a406c5a0 con 0x7f56a40d14f0 2023-10-19T08:39:09.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.268+0000 7f56a8eef700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a4160cb0 con 0x7f56a40b0710 2023-10-19T08:39:09.274 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.268+0000 7f56a8eef700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a406bd40 con 0x7f56a40b1d50 2023-10-19T08:39:09.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.268+0000 7f56a259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f56a40b0710 0x7f56a40b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:09.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.268+0000 7f56a1d9b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f56a40d14f0 0x7f56a40ad9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58208/0 (socket says 172.21.15.79:58208) 2023-10-19T08:39:09.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.269+0000 7f56a259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f56a40b0710 0x7f56a40b0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48140/0 (socket says 172.21.15.79:48140) 2023-10-19T08:39:09.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.269+0000 7f56a1d9b700 1 -- 172.21.15.79:0/706878389 learned_addr learned my addr 172.21.15.79:0/706878389 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:09.275 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.269+0000 7f56a259c700 1 -- 172.21.15.79:0/706878389 >> v2:172.21.15.89:3300/0 conn(0x7f56a40b1d50 msgr2=0x7f56a40b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:09.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.269+0000 7f56a259c700 1 --2- 172.21.15.79:0/706878389 >> v2:172.21.15.89:3300/0 conn(0x7f56a40b1d50 0x7f56a40b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.269+0000 7f56a259c700 1 -- 172.21.15.79:0/706878389 >> v1:172.21.15.79:6789/0 conn(0x7f56a40d14f0 legacy=0x7f56a40ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:09.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.269+0000 7f56a259c700 1 -- 172.21.15.79:0/706878389 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a40b1030 con 0x7f56a40b0710 2023-10-19T08:39:09.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.269+0000 7f56a159a700 1 -- 172.21.15.79:0/706878389 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 330292870 0 0) 0x7f56a406c5a0 con 0x7f56a40d14f0 2023-10-19T08:39:09.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.269+0000 7f56a259c700 1 --2- 172.21.15.79:0/706878389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56a40b0710 0x7f56a40b0af0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f56a406d4f0 tx=0x7f5698009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fde057732fbd883 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:09.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.269+0000 7f56a159a700 1 -- 172.21.15.79:0/706878389 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698011830 con 0x7f56a40b0710 2023-10-19T08:39:09.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.269+0000 7f56a159a700 1 -- 172.21.15.79:0/706878389 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5698011990 con 0x7f56a40b0710 2023-10-19T08:39:09.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.269+0000 7f56a159a700 1 -- 172.21.15.79:0/706878389 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698011d20 con 0x7f56a40b0710 2023-10-19T08:39:09.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.270+0000 7f56a8eef700 1 -- 172.21.15.79:0/706878389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56a40b0710 msgr2=0x7f56a40b0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:09.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.270+0000 7f56a8eef700 1 --2- 172.21.15.79:0/706878389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56a40b0710 0x7f56a40b0af0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f56a406d4f0 tx=0x7f5698009b20 comp rx=0 tx=0).stop 2023-10-19T08:39:09.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.270+0000 7f56a8eef700 1 -- 172.21.15.79:0/706878389 shutdown_connections 2023-10-19T08:39:09.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.270+0000 7f56a8eef700 1 --2- 172.21.15.79:0/706878389 >> v2:172.21.15.89:3300/0 conn(0x7f56a40b1d50 0x7f56a40b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.270+0000 7f56a8eef700 1 --2- 172.21.15.79:0/706878389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56a40b0710 0x7f56a40b0af0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.270+0000 7f56a8eef700 1 -- 172.21.15.79:0/706878389 >> 172.21.15.79:0/706878389 conn(0x7f56a409a0b0 msgr2=0x7f56a40d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:09.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.270+0000 7f56a8eef700 1 -- 172.21.15.79:0/706878389 shutdown_connections 2023-10-19T08:39:09.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.270+0000 7f56a8eef700 1 -- 172.21.15.79:0/706878389 wait complete. 2023-10-19T08:39:09.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.271+0000 7f56a8eef700 1 Processor -- start 2023-10-19T08:39:09.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.271+0000 7f56a8eef700 1 -- start start 2023-10-19T08:39:09.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f56a8eef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56a40b0710 0x7f56a4157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:09.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f56a8eef700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56a40b1d50 0x7f56a409b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:09.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f56a8eef700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56a40d14f0 0x7f56a409b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:09.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f56a8eef700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a415c300 con 0x7f56a40b0710 2023-10-19T08:39:09.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f56a8eef700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a415b3a0 con 0x7f56a40d14f0 2023-10-19T08:39:09.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f56a8eef700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a415b680 con 0x7f56a40b1d50 2023-10-19T08:39:09.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f56a259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56a40b0710 0x7f56a4157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:09.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f56a259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56a40b0710 0x7f56a4157670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48142/0 (socket says 172.21.15.79:48142) 2023-10-19T08:39:09.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f56a259c700 1 -- 172.21.15.79:0/2924529972 learned_addr learned my addr 172.21.15.79:0/2924529972 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:09.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f56a259c700 1 -- 172.21.15.79:0/2924529972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56a40b1d50 msgr2=0x7f56a409b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:09.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f56a259c700 1 --2- 172.21.15.79:0/2924529972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56a40b1d50 0x7f56a409b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f56a259c700 1 -- 172.21.15.79:0/2924529972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56a40d14f0 msgr2=0x7f56a409b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:09.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f56a259c700 1 --2- 172.21.15.79:0/2924529972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56a40d14f0 0x7f56a409b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f56a259c700 1 -- 172.21.15.79:0/2924529972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56980094a0 con 0x7f56a40b0710 2023-10-19T08:39:09.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f56a259c700 1 --2- 172.21.15.79:0/2924529972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56a40b0710 0x7f56a4157670 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f56980090b0 tx=0x7f5698004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:09.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f5692ffd700 1 -- 172.21.15.79:0/2924529972 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56980038a0 con 0x7f56a40b0710 2023-10-19T08:39:09.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f5692ffd700 1 -- 172.21.15.79:0/2924529972 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569801f070 con 0x7f56a40b0710 2023-10-19T08:39:09.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f56a8eef700 1 -- 172.21.15.79:0/2924529972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a415b960 con 0x7f56a40b0710 2023-10-19T08:39:09.285 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f5692ffd700 1 -- 172.21.15.79:0/2924529972 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5698003c60 con 0x7f56a40b0710 2023-10-19T08:39:09.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.272+0000 7f56a8eef700 1 -- 172.21.15.79:0/2924529972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a415bf20 con 0x7f56a40b0710 2023-10-19T08:39:09.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.274+0000 7f56a8eef700 1 -- 172.21.15.79:0/2924529972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a404ee70 con 0x7f56a40b0710 2023-10-19T08:39:09.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.274+0000 7f5692ffd700 1 -- 172.21.15.79:0/2924529972 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f569801a430 con 0x7f56a40b0710 2023-10-19T08:39:09.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.274+0000 7f5692ffd700 1 --2- 172.21.15.79:0/2924529972 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f568406a0e0 0x7f568406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:09.286 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.274+0000 7f56a1d9b700 1 --2- 172.21.15.79:0/2924529972 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f568406a0e0 0x7f568406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:09.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.274+0000 7f5692ffd700 1 -- 172.21.15.79:0/2924529972 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5698021070 con 0x7f56a40b0710 2023-10-19T08:39:09.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.275+0000 7f56a1d9b700 1 --2- 172.21.15.79:0/2924529972 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f568406a0e0 0x7f568406c5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f56a40cd700 tx=0x7f56940079f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:09.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.279+0000 7f5692ffd700 1 -- 172.21.15.79:0/2924529972 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f5698055750 con 0x7f56a40b0710 2023-10-19T08:39:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.487+0000 7f56a8eef700 1 -- 172.21.15.79:0/2924529972 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f56a415c0e0 con 0x7f56a40b0710 2023-10-19T08:39:09.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.488+0000 7f5692ffd700 1 -- 172.21.15.79:0/2924529972 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5698058d70 con 0x7f56a40b0710 2023-10-19T08:39:09.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.490+0000 7f56a8eef700 1 -- 172.21.15.79:0/2924529972 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f568406a0e0 msgr2=0x7f568406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:09.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.490+0000 7f56a8eef700 1 --2- 172.21.15.79:0/2924529972 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f568406a0e0 0x7f568406c5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f56a40cd700 tx=0x7f56940079f0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.490+0000 7f56a8eef700 1 -- 172.21.15.79:0/2924529972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56a40b0710 msgr2=0x7f56a4157670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:09.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.490+0000 7f56a8eef700 1 --2- 172.21.15.79:0/2924529972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56a40b0710 0x7f56a4157670 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f56980090b0 tx=0x7f5698004750 comp rx=0 tx=0).stop 2023-10-19T08:39:09.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.490+0000 7f56a8eef700 1 -- 172.21.15.79:0/2924529972 shutdown_connections 2023-10-19T08:39:09.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.490+0000 7f56a8eef700 1 --2- 172.21.15.79:0/2924529972 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56a40d14f0 0x7f56a409b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.490+0000 7f56a8eef700 1 --2- 172.21.15.79:0/2924529972 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56a40b0710 0x7f56a4157670 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.490+0000 7f56a8eef700 1 --2- 172.21.15.79:0/2924529972 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f568406a0e0 0x7f568406c5a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.490+0000 7f56a8eef700 1 --2- 172.21.15.79:0/2924529972 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56a40b1d50 0x7f56a409b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.495 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.490+0000 7f56a8eef700 1 -- 172.21.15.79:0/2924529972 >> 172.21.15.79:0/2924529972 conn(0x7f56a409a0b0 msgr2=0x7f56a406ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:09.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.490+0000 7f56a8eef700 1 -- 172.21.15.79:0/2924529972 shutdown_connections 2023-10-19T08:39:09.496 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.490+0000 7f56a8eef700 1 -- 172.21.15.79:0/2924529972 wait complete. 2023-10-19T08:39:09.496 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2023-10-19T08:39:09.505 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:39:09.506 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T08:39:09.523 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:39:09.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.680+0000 7f1be1bfd700 1 Processor -- start 2023-10-19T08:39:09.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.680+0000 7f1be1bfd700 1 -- start start 2023-10-19T08:39:09.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.681+0000 7f1be1bfd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1bdc15d580 0x7f1bdc0b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:09.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.681+0000 7f1be1bfd700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bdc161490 con 0x7f1bdc0ce270 2023-10-19T08:39:09.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.681+0000 7f1be1bfd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bdc161770 con 0x7f1bdc160f30 2023-10-19T08:39:09.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.681+0000 7f1be1bfd700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bdc161a50 con 0x7f1bdc15d580 2023-10-19T08:39:09.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.681+0000 7f1bdaffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1bdc15d580 0x7f1bdc0b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:09.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.681+0000 7f1bdb7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1bdc0ce270 0x7f1bdc15ce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58222/0 (socket says 172.21.15.79:58222) 2023-10-19T08:39:09.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.681+0000 7f1bdb7fe700 1 -- 172.21.15.79:0/34187635 learned_addr learned my addr 172.21.15.79:0/34187635 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:09.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.682+0000 7f1bdaffd700 1 -- 172.21.15.79:0/34187635 >> v1:172.21.15.89:6789/0 conn(0x7f1bdc160f30 legacy=0x7f1bdc06a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:09.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.682+0000 7f1bdaffd700 1 -- 172.21.15.79:0/34187635 >> v1:172.21.15.79:6789/0 conn(0x7f1bdc0ce270 legacy=0x7f1bdc15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:09.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.682+0000 7f1bda7fc700 1 -- 172.21.15.79:0/34187635 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370847093 0 0) 0x7f1bdc161490 con 0x7f1bdc0ce270 2023-10-19T08:39:09.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.682+0000 7f1bdaffd700 1 -- 172.21.15.79:0/34187635 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc161d30 con 0x7f1bdc15d580 2023-10-19T08:39:09.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.682+0000 7f1bdaffd700 1 --2- 172.21.15.79:0/34187635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bdc15d580 0x7f1bdc0b1f70 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009840 tx=0x7f1bcc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efb5318102bf004 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:09.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.682+0000 7f1bda7fc700 1 -- 172.21.15.79:0/34187635 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc004230 con 0x7f1bdc15d580 2023-10-19T08:39:09.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.682+0000 7f1bda7fc700 1 -- 172.21.15.79:0/34187635 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bcc004390 con 0x7f1bdc15d580 2023-10-19T08:39:09.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.682+0000 7f1bda7fc700 1 -- 172.21.15.79:0/34187635 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc0036a0 con 0x7f1bdc15d580 2023-10-19T08:39:09.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.682+0000 7f1be1bfd700 1 -- 172.21.15.79:0/34187635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bdc15d580 msgr2=0x7f1bdc0b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:09.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.682+0000 7f1be1bfd700 1 --2- 172.21.15.79:0/34187635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bdc15d580 0x7f1bdc0b1f70 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009840 tx=0x7f1bcc009b50 comp rx=0 tx=0).stop 2023-10-19T08:39:09.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.683+0000 7f1be1bfd700 1 -- 172.21.15.79:0/34187635 shutdown_connections 2023-10-19T08:39:09.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.683+0000 7f1be1bfd700 1 --2- 172.21.15.79:0/34187635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bdc15d580 0x7f1bdc0b1f70 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.683+0000 7f1be1bfd700 1 -- 172.21.15.79:0/34187635 >> 172.21.15.79:0/34187635 conn(0x7f1bdc0cc560 msgr2=0x7f1bdc0cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:09.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.683+0000 7f1be1bfd700 1 -- 172.21.15.79:0/34187635 shutdown_connections 2023-10-19T08:39:09.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.683+0000 7f1be1bfd700 1 -- 172.21.15.79:0/34187635 wait complete. 2023-10-19T08:39:09.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.684+0000 7f1be1bfd700 1 Processor -- start 2023-10-19T08:39:09.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.684+0000 7f1be1bfd700 1 -- start start 2023-10-19T08:39:09.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1be1bfd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bdc0ce270 0x7f1bdc1f2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:09.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1be1bfd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1bdc15d580 0x7f1bdc0c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:09.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1be1bfd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bdc160f30 0x7f1bdc15e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:09.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1be1bfd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc0ab8e0 con 0x7f1bdc0ce270 2023-10-19T08:39:09.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1be1bfd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc0c8f50 con 0x7f1bdc160f30 2023-10-19T08:39:09.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1be1bfd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc0c9230 con 0x7f1bdc15d580 2023-10-19T08:39:09.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1bdb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bdc0ce270 0x7f1bdc1f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:09.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1bdb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bdc0ce270 0x7f1bdc1f2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48154/0 (socket says 172.21.15.79:48154) 2023-10-19T08:39:09.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1bdb7fe700 1 -- 172.21.15.79:0/341048955 learned_addr learned my addr 172.21.15.79:0/341048955 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:09.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1bdbfff700 1 --2- 172.21.15.79:0/341048955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bdc160f30 0x7f1bdc15e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:09.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1bdb7fe700 1 -- 172.21.15.79:0/341048955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1bdc15d580 msgr2=0x7f1bdc0c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:09.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1bdaffd700 1 --2- 172.21.15.79:0/341048955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1bdc15d580 0x7f1bdc0c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:09.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1bdb7fe700 1 --2- 172.21.15.79:0/341048955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1bdc15d580 0x7f1bdc0c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1bdb7fe700 1 -- 172.21.15.79:0/341048955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bdc160f30 msgr2=0x7f1bdc15e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:09.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1bdb7fe700 1 --2- 172.21.15.79:0/341048955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bdc160f30 0x7f1bdc15e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1bdb7fe700 1 -- 172.21.15.79:0/341048955 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc0094a0 con 0x7f1bdc0ce270 2023-10-19T08:39:09.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1bdbfff700 1 --2- 172.21.15.79:0/341048955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bdc160f30 0x7f1bdc15e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:09.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1bdb7fe700 1 --2- 172.21.15.79:0/341048955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bdc0ce270 0x7f1bdc1f2430 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40011e0 tx=0x7f1bc400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1bd3fff700 1 -- 172.21.15.79:0/341048955 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4004c80 con 0x7f1bdc0ce270 2023-10-19T08:39:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1bd3fff700 1 -- 172.21.15.79:0/341048955 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc4004e00 con 0x7f1bdc0ce270 2023-10-19T08:39:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1be1bfd700 1 -- 172.21.15.79:0/341048955 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bdc0c9510 con 0x7f1bdc0ce270 2023-10-19T08:39:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1bd3fff700 1 -- 172.21.15.79:0/341048955 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4007310 con 0x7f1bdc0ce270 2023-10-19T08:39:09.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.685+0000 7f1be1bfd700 1 -- 172.21.15.79:0/341048955 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bdc1f2970 con 0x7f1bdc0ce270 2023-10-19T08:39:09.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.686+0000 7f1be1bfd700 1 -- 172.21.15.79:0/341048955 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bdc04ee70 con 0x7f1bdc0ce270 2023-10-19T08:39:09.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.687+0000 7f1bd3fff700 1 -- 172.21.15.79:0/341048955 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1bc4007470 con 0x7f1bdc0ce270 2023-10-19T08:39:09.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.687+0000 7f1bd3fff700 1 --2- 172.21.15.79:0/341048955 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1bbc06a0e0 0x7f1bbc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:09.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.687+0000 7f1bd3fff700 1 -- 172.21.15.79:0/341048955 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1bc4088590 con 0x7f1bdc0ce270 2023-10-19T08:39:09.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.687+0000 7f1bdaffd700 1 --2- 172.21.15.79:0/341048955 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1bbc06a0e0 0x7f1bbc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:09.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.688+0000 7f1bdaffd700 1 --2- 172.21.15.79:0/341048955 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1bbc06a0e0 0x7f1bbc06c5a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc06c060 tx=0x7f1bcc008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:09.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.691+0000 7f1bd3fff700 1 -- 172.21.15.79:0/341048955 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f1bc40539e0 con 0x7f1bdc0ce270 2023-10-19T08:39:09.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.880+0000 7f1be1bfd700 1 -- 172.21.15.79:0/341048955 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bdc15ce50 con 0x7f1bdc0ce270 2023-10-19T08:39:09.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.881+0000 7f1bd3fff700 1 -- 172.21.15.79:0/341048955 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20155 (secure 0 0 0) 0x7f1bc4057000 con 0x7f1bdc0ce270 2023-10-19T08:39:09.885 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:09.886 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:44.473795+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:39:09.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.883+0000 7f1be1bfd700 1 -- 172.21.15.79:0/341048955 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1bbc06a0e0 msgr2=0x7f1bbc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:09.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.883+0000 7f1be1bfd700 1 --2- 172.21.15.79:0/341048955 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1bbc06a0e0 0x7f1bbc06c5a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1bdc06c060 tx=0x7f1bcc008030 comp rx=0 tx=0).stop 2023-10-19T08:39:09.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.883+0000 7f1be1bfd700 1 -- 172.21.15.79:0/341048955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bdc0ce270 msgr2=0x7f1bdc1f2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:09.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.883+0000 7f1be1bfd700 1 --2- 172.21.15.79:0/341048955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bdc0ce270 0x7f1bdc1f2430 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40011e0 tx=0x7f1bc400cae0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.883+0000 7f1be1bfd700 1 -- 172.21.15.79:0/341048955 shutdown_connections 2023-10-19T08:39:09.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.883+0000 7f1be1bfd700 1 --2- 172.21.15.79:0/341048955 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bdc160f30 0x7f1bdc15e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.883+0000 7f1be1bfd700 1 --2- 172.21.15.79:0/341048955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1bdc0ce270 0x7f1bdc1f2430 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.883+0000 7f1be1bfd700 1 --2- 172.21.15.79:0/341048955 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1bbc06a0e0 0x7f1bbc06c5a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.883+0000 7f1be1bfd700 1 --2- 172.21.15.79:0/341048955 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1bdc15d580 0x7f1bdc0c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:09.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.884+0000 7f1be1bfd700 1 -- 172.21.15.79:0/341048955 >> 172.21.15.79:0/341048955 conn(0x7f1bdc0cc560 msgr2=0x7f1bdc0cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:09.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.884+0000 7f1be1bfd700 1 -- 172.21.15.79:0/341048955 shutdown_connections 2023-10-19T08:39:09.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:09.884+0000 7f1be1bfd700 1 -- 172.21.15.79:0/341048955 wait complete. 2023-10-19T08:39:09.899 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T08:37:54.318159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T08:37:55.629862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T08:37:59.333062+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T08:39:09.900 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:39:10.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.019+0000 7f49a594a700 1 Processor -- start 2023-10-19T08:39:10.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.019+0000 7f49a594a700 1 -- start start 2023-10-19T08:39:10.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.020+0000 7f49a594a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49a00cd270 0x7f49a006a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:10.025 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.020+0000 7f49a594a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49a00703b0 0x7f49a006a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:10.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.020+0000 7f49a594a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49a00b1fe0 con 0x7f49a006f910 2023-10-19T08:39:10.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.020+0000 7f49a594a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49a0160a80 con 0x7f49a00cd270 2023-10-19T08:39:10.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.020+0000 7f49a594a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a00ce2b0 con 0x7f49a00703b0 2023-10-19T08:39:10.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.020+0000 7f499e7fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49a00703b0 0x7f49a006a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:10.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.020+0000 7f499effd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49a00cd270 0x7f49a006a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:10.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.020+0000 7f499e7fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49a00703b0 0x7f49a006a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:50786/0 (socket says 172.21.15.79:50786) 2023-10-19T08:39:10.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.020+0000 7f499effd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f49a00cd270 0x7f49a006a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:34408/0 (socket says 172.21.15.79:34408) 2023-10-19T08:39:10.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.020+0000 7f499e7fc700 1 -- 172.21.15.79:0/2093862452 learned_addr learned my addr 172.21.15.79:0/2093862452 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:10.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.021+0000 7f499effd700 1 -- 172.21.15.79:0/2093862452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49a00703b0 msgr2=0x7f49a006a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:10.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.021+0000 7f499effd700 1 --2- 172.21.15.79:0/2093862452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49a00703b0 0x7f49a006a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.021+0000 7f499effd700 1 -- 172.21.15.79:0/2093862452 >> v1:172.21.15.89:6789/0 conn(0x7f49a006f910 legacy=0x7f49a0160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:10.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.021+0000 7f499effd700 1 -- 172.21.15.79:0/2093862452 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a00ce550 con 0x7f49a00cd270 2023-10-19T08:39:10.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.021+0000 7f499e7fc700 1 --2- 172.21.15.79:0/2093862452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49a00703b0 0x7f49a006a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:39:10.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.021+0000 7f499effd700 1 --2- 172.21.15.79:0/2093862452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a00cd270 0x7f49a006a220 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4994009840 tx=0x7f4994009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39285266a7d344b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:10.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.021+0000 7f499dffb700 1 -- 172.21.15.79:0/2093862452 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994011830 con 0x7f49a00cd270 2023-10-19T08:39:10.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.021+0000 7f499dffb700 1 -- 172.21.15.79:0/2093862452 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4994011990 con 0x7f49a00cd270 2023-10-19T08:39:10.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.021+0000 7f499dffb700 1 -- 172.21.15.79:0/2093862452 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4994011d20 con 0x7f49a00cd270 2023-10-19T08:39:10.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.022+0000 7f49a594a700 1 -- 172.21.15.79:0/2093862452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a00cd270 msgr2=0x7f49a006a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:10.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.022+0000 7f49a594a700 1 --2- 172.21.15.79:0/2093862452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a00cd270 0x7f49a006a220 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4994009840 tx=0x7f4994009b50 comp rx=0 tx=0).stop 2023-10-19T08:39:10.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.022+0000 7f49a594a700 1 -- 172.21.15.79:0/2093862452 shutdown_connections 2023-10-19T08:39:10.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.022+0000 7f49a594a700 1 --2- 172.21.15.79:0/2093862452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a00cd270 0x7f49a006a220 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.022+0000 7f49a594a700 1 --2- 172.21.15.79:0/2093862452 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49a00703b0 0x7f49a006a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.022+0000 7f49a594a700 1 -- 172.21.15.79:0/2093862452 >> 172.21.15.79:0/2093862452 conn(0x7f49a006dcc0 msgr2=0x7f49a006e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:10.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.022+0000 7f49a594a700 1 -- 172.21.15.79:0/2093862452 shutdown_connections 2023-10-19T08:39:10.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.022+0000 7f49a594a700 1 -- 172.21.15.79:0/2093862452 wait complete. 2023-10-19T08:39:10.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.023+0000 7f49a594a700 1 Processor -- start 2023-10-19T08:39:10.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.023+0000 7f49a594a700 1 -- start start 2023-10-19T08:39:10.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.024+0000 7f49a594a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a006f910 0x7f49a00c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:10.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.024+0000 7f49a594a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49a00703b0 0x7f49a00ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:10.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.024+0000 7f49a594a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49a00cd270 0x7f49a0158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:10.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.024+0000 7f49a594a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a00add30 con 0x7f49a00703b0 2023-10-19T08:39:10.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.024+0000 7f49a594a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a00c7400 con 0x7f49a006f910 2023-10-19T08:39:10.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.024+0000 7f49a594a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49a00c76e0 con 0x7f49a00cd270 2023-10-19T08:39:10.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.024+0000 7f499e7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49a00703b0 0x7f49a00ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:10.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.024+0000 7f499e7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49a00703b0 0x7f49a00ad7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48170/0 (socket says 172.21.15.79:48170) 2023-10-19T08:39:10.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.024+0000 7f499e7fc700 1 -- 172.21.15.79:0/2355935130 learned_addr learned my addr 172.21.15.79:0/2355935130 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:10.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.024+0000 7f499effd700 1 --2- 172.21.15.79:0/2355935130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a006f910 0x7f49a00c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:10.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.024+0000 7f499f7fe700 1 --2- 172.21.15.79:0/2355935130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49a00cd270 0x7f49a0158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:10.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.024+0000 7f499e7fc700 1 -- 172.21.15.79:0/2355935130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49a00cd270 msgr2=0x7f49a0158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:10.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.024+0000 7f499e7fc700 1 --2- 172.21.15.79:0/2355935130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49a00cd270 0x7f49a0158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.024+0000 7f499e7fc700 1 -- 172.21.15.79:0/2355935130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a006f910 msgr2=0x7f49a00c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:10.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.024+0000 7f499e7fc700 1 --2- 172.21.15.79:0/2355935130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a006f910 0x7f49a00c6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.024+0000 7f499e7fc700 1 -- 172.21.15.79:0/2355935130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4990009550 con 0x7f49a00703b0 2023-10-19T08:39:10.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.024+0000 7f499e7fc700 1 --2- 172.21.15.79:0/2355935130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49a00703b0 0x7f49a00ad7f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f499000e9b0 tx=0x7f499000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:10.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.024+0000 7f4987fff700 1 -- 172.21.15.79:0/2355935130 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499000c850 con 0x7f49a00703b0 2023-10-19T08:39:10.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.025+0000 7f4987fff700 1 -- 172.21.15.79:0/2355935130 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499000c9b0 con 0x7f49a00703b0 2023-10-19T08:39:10.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.025+0000 7f49a594a700 1 -- 172.21.15.79:0/2355935130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49940094a0 con 0x7f49a00703b0 2023-10-19T08:39:10.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.025+0000 7f4987fff700 1 -- 172.21.15.79:0/2355935130 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499000cd20 con 0x7f49a00703b0 2023-10-19T08:39:10.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.025+0000 7f49a594a700 1 -- 172.21.15.79:0/2355935130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a00c7ca0 con 0x7f49a00703b0 2023-10-19T08:39:10.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.025+0000 7f49a594a700 1 -- 172.21.15.79:0/2355935130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a00c82f0 con 0x7f49a00703b0 2023-10-19T08:39:10.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.026+0000 7f4987fff700 1 -- 172.21.15.79:0/2355935130 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4990013470 con 0x7f49a00703b0 2023-10-19T08:39:10.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.026+0000 7f4987fff700 1 --2- 172.21.15.79:0/2355935130 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f498c06a0e0 0x7f498c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:10.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.026+0000 7f4987fff700 1 -- 172.21.15.79:0/2355935130 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4990088ab0 con 0x7f49a00703b0 2023-10-19T08:39:10.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.026+0000 7f499effd700 1 --2- 172.21.15.79:0/2355935130 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f498c06a0e0 0x7f498c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:10.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.027+0000 7f499effd700 1 --2- 172.21.15.79:0/2355935130 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f498c06a0e0 0x7f498c06c5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4994000c00 tx=0x7f4994008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:10.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.031+0000 7f4987fff700 1 -- 172.21.15.79:0/2355935130 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4990053d50 con 0x7f49a00703b0 2023-10-19T08:39:10.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.219+0000 7f49a594a700 1 -- 172.21.15.79:0/2355935130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f49a004ee70 con 0x7f49a00703b0 2023-10-19T08:39:10.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.220+0000 7f4987fff700 1 -- 172.21.15.79:0/2355935130 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4990057370 con 0x7f49a00703b0 2023-10-19T08:39:10.224 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:39:10.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.222+0000 7f49a594a700 1 -- 172.21.15.79:0/2355935130 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f498c06a0e0 msgr2=0x7f498c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:10.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.222+0000 7f49a594a700 1 --2- 172.21.15.79:0/2355935130 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f498c06a0e0 0x7f498c06c5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4994000c00 tx=0x7f4994008030 comp rx=0 tx=0).stop 2023-10-19T08:39:10.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.222+0000 7f49a594a700 1 -- 172.21.15.79:0/2355935130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49a00703b0 msgr2=0x7f49a00ad7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:10.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.222+0000 7f49a594a700 1 --2- 172.21.15.79:0/2355935130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49a00703b0 0x7f49a00ad7f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f499000e9b0 tx=0x7f499000ed70 comp rx=0 tx=0).stop 2023-10-19T08:39:10.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.222+0000 7f49a594a700 1 -- 172.21.15.79:0/2355935130 shutdown_connections 2023-10-19T08:39:10.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.222+0000 7f49a594a700 1 --2- 172.21.15.79:0/2355935130 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f498c06a0e0 0x7f498c06c5a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.222+0000 7f49a594a700 1 --2- 172.21.15.79:0/2355935130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49a00cd270 0x7f49a0158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.222+0000 7f49a594a700 1 --2- 172.21.15.79:0/2355935130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a006f910 0x7f49a00c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.227 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.222+0000 7f49a594a700 1 --2- 172.21.15.79:0/2355935130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49a00703b0 0x7f49a00ad7f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.222+0000 7f49a594a700 1 -- 172.21.15.79:0/2355935130 >> 172.21.15.79:0/2355935130 conn(0x7f49a006dcc0 msgr2=0x7f49a015eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:10.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.222+0000 7f49a594a700 1 -- 172.21.15.79:0/2355935130 shutdown_connections 2023-10-19T08:39:10.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.222+0000 7f49a594a700 1 -- 172.21.15.79:0/2355935130 wait complete. 2023-10-19T08:39:10.238 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:39:10.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.357+0000 7fdd3fa6a700 1 Processor -- start 2023-10-19T08:39:10.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.357+0000 7fdd3fa6a700 1 -- start start 2023-10-19T08:39:10.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.358+0000 7fdd3fa6a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdd38160380 0x7fdd380cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:10.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.358+0000 7fdd3fa6a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdd380d1080 0x7fdd380d1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:10.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.358+0000 7fdd3fa6a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3806be30 con 0x7fdd380cf7a0 2023-10-19T08:39:10.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.358+0000 7fdd3fa6a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3806c3f0 con 0x7fdd38160380 2023-10-19T08:39:10.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.358+0000 7fdd3fa6a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd380d1a50 con 0x7fdd380d1080 2023-10-19T08:39:10.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.358+0000 7fdd3d806700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdd38160380 0x7fdd380cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:10.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.358+0000 7fdd3d806700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdd38160380 0x7fdd380cf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48176/0 (socket says 172.21.15.79:48176) 2023-10-19T08:39:10.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.358+0000 7fdd3d806700 1 -- 172.21.15.79:0/2235641468 learned_addr learned my addr 172.21.15.79:0/2235641468 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:10.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.358+0000 7fdd3e007700 1 --2- 172.21.15.79:0/2235641468 >> v2:172.21.15.89:3300/0 conn(0x7fdd380d1080 0x7fdd380d1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:10.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.358+0000 7fdd3d806700 1 -- 172.21.15.79:0/2235641468 >> v2:172.21.15.89:3300/0 conn(0x7fdd380d1080 msgr2=0x7fdd380d1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:10.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.358+0000 7fdd3d806700 1 --2- 172.21.15.79:0/2235641468 >> v2:172.21.15.89:3300/0 conn(0x7fdd380d1080 0x7fdd380d1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.358+0000 7fdd3d806700 1 -- 172.21.15.79:0/2235641468 >> v1:172.21.15.89:6789/0 conn(0x7fdd380cf7a0 legacy=0x7fdd3806b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:10.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.358+0000 7fdd3d806700 1 -- 172.21.15.79:0/2235641468 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3806c110 con 0x7fdd38160380 2023-10-19T08:39:10.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.358+0000 7fdd3e007700 1 --2- 172.21.15.79:0/2235641468 >> v2:172.21.15.89:3300/0 conn(0x7fdd380d1080 0x7fdd380d1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:10.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.358+0000 7fdd3d806700 1 --2- 172.21.15.79:0/2235641468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd38160380 0x7fdd380cf260 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdd340098f0 tx=0x7fdd34009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66279f00cdd2e8ac server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:10.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.358+0000 7fdd3c804700 1 -- 172.21.15.79:0/2235641468 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34004230 con 0x7fdd38160380 2023-10-19T08:39:10.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.359+0000 7fdd3c804700 1 -- 172.21.15.79:0/2235641468 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd34004390 con 0x7fdd38160380 2023-10-19T08:39:10.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.359+0000 7fdd3c804700 1 -- 172.21.15.79:0/2235641468 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd340036a0 con 0x7fdd38160380 2023-10-19T08:39:10.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.359+0000 7fdd3fa6a700 1 -- 172.21.15.79:0/2235641468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd38160380 msgr2=0x7fdd380cf260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:10.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.359+0000 7fdd3fa6a700 1 --2- 172.21.15.79:0/2235641468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd38160380 0x7fdd380cf260 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdd340098f0 tx=0x7fdd34009c00 comp rx=0 tx=0).stop 2023-10-19T08:39:10.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.359+0000 7fdd3fa6a700 1 -- 172.21.15.79:0/2235641468 shutdown_connections 2023-10-19T08:39:10.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.359+0000 7fdd3fa6a700 1 --2- 172.21.15.79:0/2235641468 >> v2:172.21.15.89:3300/0 conn(0x7fdd380d1080 0x7fdd380d1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.359+0000 7fdd3fa6a700 1 --2- 172.21.15.79:0/2235641468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd38160380 0x7fdd380cf260 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.359+0000 7fdd3fa6a700 1 -- 172.21.15.79:0/2235641468 >> 172.21.15.79:0/2235641468 conn(0x7fdd3806a400 msgr2=0x7fdd3806a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:10.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.359+0000 7fdd3fa6a700 1 -- 172.21.15.79:0/2235641468 shutdown_connections 2023-10-19T08:39:10.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.359+0000 7fdd3fa6a700 1 -- 172.21.15.79:0/2235641468 wait complete. 2023-10-19T08:39:10.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.360+0000 7fdd3fa6a700 1 Processor -- start 2023-10-19T08:39:10.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.360+0000 7fdd3fa6a700 1 -- start start 2023-10-19T08:39:10.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.361+0000 7fdd3fa6a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd380d1080 0x7fdd38151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:10.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.361+0000 7fdd3fa6a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd38160380 0x7fdd381523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:10.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.361+0000 7fdd3fa6a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd38152900 0x7fdd3815f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:10.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.361+0000 7fdd3fa6a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd38152db0 con 0x7fdd380d1080 2023-10-19T08:39:10.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.361+0000 7fdd3fa6a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd38151760 con 0x7fdd38160380 2023-10-19T08:39:10.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.361+0000 7fdd3fa6a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd380b4800 con 0x7fdd38152900 2023-10-19T08:39:10.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.361+0000 7fdd3d806700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd380d1080 0x7fdd38151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:10.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.361+0000 7fdd3d806700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd380d1080 0x7fdd38151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48182/0 (socket says 172.21.15.79:48182) 2023-10-19T08:39:10.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.361+0000 7fdd3d806700 1 -- 172.21.15.79:0/3117029170 learned_addr learned my addr 172.21.15.79:0/3117029170 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:10.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.361+0000 7fdd3d005700 1 --2- 172.21.15.79:0/3117029170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd38160380 0x7fdd381523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:10.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.361+0000 7fdd3e007700 1 --2- 172.21.15.79:0/3117029170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd38152900 0x7fdd3815f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:10.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.362+0000 7fdd3d806700 1 -- 172.21.15.79:0/3117029170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd38152900 msgr2=0x7fdd3815f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:10.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.362+0000 7fdd3d806700 1 --2- 172.21.15.79:0/3117029170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd38152900 0x7fdd3815f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.362+0000 7fdd3d806700 1 -- 172.21.15.79:0/3117029170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd38160380 msgr2=0x7fdd381523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:10.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.362+0000 7fdd3d806700 1 --2- 172.21.15.79:0/3117029170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd38160380 0x7fdd381523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.362+0000 7fdd3d806700 1 -- 172.21.15.79:0/3117029170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd34009550 con 0x7fdd380d1080 2023-10-19T08:39:10.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.362+0000 7fdd3d806700 1 --2- 172.21.15.79:0/3117029170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd380d1080 0x7fdd38151220 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fdd380d1df0 tx=0x7fdd34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:10.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.362+0000 7fdd2e7fc700 1 -- 172.21.15.79:0/3117029170 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd34003ea0 con 0x7fdd380d1080 2023-10-19T08:39:10.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.362+0000 7fdd2e7fc700 1 -- 172.21.15.79:0/3117029170 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd34011630 con 0x7fdd380d1080 2023-10-19T08:39:10.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.362+0000 7fdd2e7fc700 1 -- 172.21.15.79:0/3117029170 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd340119a0 con 0x7fdd380d1080 2023-10-19T08:39:10.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.362+0000 7fdd3fa6a700 1 -- 172.21.15.79:0/3117029170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd380b39a0 con 0x7fdd380d1080 2023-10-19T08:39:10.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.362+0000 7fdd3fa6a700 1 -- 172.21.15.79:0/3117029170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd380b3ed0 con 0x7fdd380d1080 2023-10-19T08:39:10.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.363+0000 7fdd3fa6a700 1 -- 172.21.15.79:0/3117029170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3806d1a0 con 0x7fdd380d1080 2023-10-19T08:39:10.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.363+0000 7fdd2e7fc700 1 -- 172.21.15.79:0/3117029170 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdd34011b00 con 0x7fdd380d1080 2023-10-19T08:39:10.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.364+0000 7fdd2e7fc700 1 --2- 172.21.15.79:0/3117029170 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdd1c06a0e0 0x7fdd1c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:10.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.364+0000 7fdd3d005700 1 --2- 172.21.15.79:0/3117029170 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdd1c06a0e0 0x7fdd1c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:10.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.364+0000 7fdd2e7fc700 1 -- 172.21.15.79:0/3117029170 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdd34089ae0 con 0x7fdd380d1080 2023-10-19T08:39:10.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.364+0000 7fdd3d005700 1 --2- 172.21.15.79:0/3117029170 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdd1c06a0e0 0x7fdd1c06c5a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdd3806bcc0 tx=0x7fdd28009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:10.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.368+0000 7fdd2e7fc700 1 -- 172.21.15.79:0/3117029170 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fdd3806d1a0 con 0x7fdd380d1080 2023-10-19T08:39:10.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.557+0000 7fdd3fa6a700 1 -- 172.21.15.79:0/3117029170 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdd3806d1a0 con 0x7fdd380d1080 2023-10-19T08:39:10.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.558+0000 7fdd2e7fc700 1 -- 172.21.15.79:0/3117029170 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdd3806d1a0 con 0x7fdd380d1080 2023-10-19T08:39:10.561 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:39:10.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.560+0000 7fdd3fa6a700 1 -- 172.21.15.79:0/3117029170 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdd1c06a0e0 msgr2=0x7fdd1c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:10.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.560+0000 7fdd3fa6a700 1 --2- 172.21.15.79:0/3117029170 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdd1c06a0e0 0x7fdd1c06c5a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdd3806bcc0 tx=0x7fdd28009040 comp rx=0 tx=0).stop 2023-10-19T08:39:10.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.560+0000 7fdd3fa6a700 1 -- 172.21.15.79:0/3117029170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd380d1080 msgr2=0x7fdd38151220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:10.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.560+0000 7fdd3fa6a700 1 --2- 172.21.15.79:0/3117029170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd380d1080 0x7fdd38151220 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fdd380d1df0 tx=0x7fdd34004750 comp rx=0 tx=0).stop 2023-10-19T08:39:10.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.560+0000 7fdd3fa6a700 1 -- 172.21.15.79:0/3117029170 shutdown_connections 2023-10-19T08:39:10.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.560+0000 7fdd3fa6a700 1 --2- 172.21.15.79:0/3117029170 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdd1c06a0e0 0x7fdd1c06c5a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.560+0000 7fdd3fa6a700 1 --2- 172.21.15.79:0/3117029170 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdd38152900 0x7fdd3815f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.560+0000 7fdd3fa6a700 1 --2- 172.21.15.79:0/3117029170 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdd380d1080 0x7fdd38151220 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.560+0000 7fdd3fa6a700 1 --2- 172.21.15.79:0/3117029170 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd38160380 0x7fdd381523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.560+0000 7fdd3fa6a700 1 -- 172.21.15.79:0/3117029170 >> 172.21.15.79:0/3117029170 conn(0x7fdd3806a400 msgr2=0x7fdd380cc510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:10.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.560+0000 7fdd3fa6a700 1 -- 172.21.15.79:0/3117029170 shutdown_connections 2023-10-19T08:39:10.565 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.560+0000 7fdd3fa6a700 1 -- 172.21.15.79:0/3117029170 wait complete. 2023-10-19T08:39:10.575 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T08:39:10.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.694+0000 7fadaa53b700 1 Processor -- start 2023-10-19T08:39:10.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.694+0000 7fadaa53b700 1 -- start start 2023-10-19T08:39:10.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.695+0000 7fadaa53b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fada40cc640 0x7fada40cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:10.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.695+0000 7fadaa53b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fada40ceaf0 0x7fada40b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:10.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.695+0000 7fadaa53b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada40ccf60 con 0x7fada4159db0 2023-10-19T08:39:10.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.695+0000 7fadaa53b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada415d760 con 0x7fada40cc640 2023-10-19T08:39:10.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.695+0000 7fadaa53b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada415da40 con 0x7fada40ceaf0 2023-10-19T08:39:10.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.695+0000 7fada3fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fada40cc640 0x7fada40cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:10.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.695+0000 7fada37fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fada4159db0 0x7fada40b16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58262/0 (socket says 172.21.15.79:58262) 2023-10-19T08:39:10.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.695+0000 7fada37fe700 1 -- 172.21.15.79:0/2077660934 learned_addr learned my addr 172.21.15.79:0/2077660934 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:10.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.695+0000 7fada8ad8700 1 --2- 172.21.15.79:0/2077660934 >> v2:172.21.15.89:3300/0 conn(0x7fada40ceaf0 0x7fada40b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:10.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.695+0000 7fada3fff700 1 -- 172.21.15.79:0/2077660934 >> v2:172.21.15.89:3300/0 conn(0x7fada40ceaf0 msgr2=0x7fada40b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:10.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.695+0000 7fada3fff700 1 --2- 172.21.15.79:0/2077660934 >> v2:172.21.15.89:3300/0 conn(0x7fada40ceaf0 0x7fada40b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.695+0000 7fada3fff700 1 -- 172.21.15.79:0/2077660934 >> v1:172.21.15.79:6789/0 conn(0x7fada4159db0 legacy=0x7fada40b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:10.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.695+0000 7fada3fff700 1 -- 172.21.15.79:0/2077660934 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada415dd20 con 0x7fada40cc640 2023-10-19T08:39:10.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.695+0000 7fada2ffd700 1 -- 172.21.15.79:0/2077660934 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058138959 0 0) 0x7fada40ccf60 con 0x7fada4159db0 2023-10-19T08:39:10.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.695+0000 7fada3fff700 1 --2- 172.21.15.79:0/2077660934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada40cc640 0x7fada40cca20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fada406ed80 tx=0x7fad98009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a014ef6cff0e16 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:10.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.696+0000 7fada2ffd700 1 -- 172.21.15.79:0/2077660934 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad98011830 con 0x7fada40cc640 2023-10-19T08:39:10.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.696+0000 7fada2ffd700 1 -- 172.21.15.79:0/2077660934 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad98011990 con 0x7fada40cc640 2023-10-19T08:39:10.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.696+0000 7fada2ffd700 1 -- 172.21.15.79:0/2077660934 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad98011d20 con 0x7fada40cc640 2023-10-19T08:39:10.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.696+0000 7fadaa53b700 1 -- 172.21.15.79:0/2077660934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada40cc640 msgr2=0x7fada40cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:10.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.696+0000 7fadaa53b700 1 --2- 172.21.15.79:0/2077660934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada40cc640 0x7fada40cca20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fada406ed80 tx=0x7fad98009b20 comp rx=0 tx=0).stop 2023-10-19T08:39:10.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.696+0000 7fadaa53b700 1 -- 172.21.15.79:0/2077660934 shutdown_connections 2023-10-19T08:39:10.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.696+0000 7fadaa53b700 1 --2- 172.21.15.79:0/2077660934 >> v2:172.21.15.89:3300/0 conn(0x7fada40ceaf0 0x7fada40b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.696+0000 7fadaa53b700 1 --2- 172.21.15.79:0/2077660934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada40cc640 0x7fada40cca20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.696+0000 7fadaa53b700 1 -- 172.21.15.79:0/2077660934 >> 172.21.15.79:0/2077660934 conn(0x7fada406dcc0 msgr2=0x7fada406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:10.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.696+0000 7fadaa53b700 1 -- 172.21.15.79:0/2077660934 shutdown_connections 2023-10-19T08:39:10.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.696+0000 7fadaa53b700 1 -- 172.21.15.79:0/2077660934 wait complete. 2023-10-19T08:39:10.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.697+0000 7fadaa53b700 1 Processor -- start 2023-10-19T08:39:10.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.698+0000 7fadaa53b700 1 -- start start 2023-10-19T08:39:10.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.698+0000 7fadaa53b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada40cc640 0x7fada4148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:10.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.698+0000 7fadaa53b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada40ceaf0 0x7fada414b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:10.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.698+0000 7fadaa53b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada4159db0 0x7fada41f30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:10.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.698+0000 7fadaa53b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada414bda0 con 0x7fada4159db0 2023-10-19T08:39:10.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.698+0000 7fadaa53b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada4149360 con 0x7fada40cc640 2023-10-19T08:39:10.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.698+0000 7fadaa53b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada4149640 con 0x7fada40ceaf0 2023-10-19T08:39:10.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.698+0000 7fada8ad8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada4159db0 0x7fada41f30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:10.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.698+0000 7fada8ad8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada4159db0 0x7fada41f30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48198/0 (socket says 172.21.15.79:48198) 2023-10-19T08:39:10.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.698+0000 7fada8ad8700 1 -- 172.21.15.79:0/339015546 learned_addr learned my addr 172.21.15.79:0/339015546 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:10.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.699+0000 7fada37fe700 1 --2- 172.21.15.79:0/339015546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada40ceaf0 0x7fada414b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:10.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.699+0000 7fada3fff700 1 --2- 172.21.15.79:0/339015546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada40cc640 0x7fada4148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:10.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.699+0000 7fada8ad8700 1 -- 172.21.15.79:0/339015546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada40ceaf0 msgr2=0x7fada414b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:10.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.699+0000 7fada8ad8700 1 --2- 172.21.15.79:0/339015546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada40ceaf0 0x7fada414b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.699+0000 7fada8ad8700 1 -- 172.21.15.79:0/339015546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada40cc640 msgr2=0x7fada4148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:10.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.699+0000 7fada8ad8700 1 --2- 172.21.15.79:0/339015546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada40cc640 0x7fada4148cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.699+0000 7fada8ad8700 1 -- 172.21.15.79:0/339015546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad980094a0 con 0x7fada4159db0 2023-10-19T08:39:10.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.699+0000 7fada37fe700 1 --2- 172.21.15.79:0/339015546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada40ceaf0 0x7fada414b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:10.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.699+0000 7fada8ad8700 1 --2- 172.21.15.79:0/339015546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada4159db0 0x7fada41f30e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fad9c007e40 tx=0x7fad9c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:10.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.699+0000 7fada0ff9700 1 -- 172.21.15.79:0/339015546 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c00eea0 con 0x7fada4159db0 2023-10-19T08:39:10.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.699+0000 7fada0ff9700 1 -- 172.21.15.79:0/339015546 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9c014420 con 0x7fada4159db0 2023-10-19T08:39:10.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.699+0000 7fadaa53b700 1 -- 172.21.15.79:0/339015546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada4149920 con 0x7fada4159db0 2023-10-19T08:39:10.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.699+0000 7fada0ff9700 1 -- 172.21.15.79:0/339015546 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c0147b0 con 0x7fada4159db0 2023-10-19T08:39:10.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.699+0000 7fadaa53b700 1 -- 172.21.15.79:0/339015546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada4149ee0 con 0x7fada4159db0 2023-10-19T08:39:10.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.700+0000 7fadaa53b700 1 -- 172.21.15.79:0/339015546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada404ee70 con 0x7fada4159db0 2023-10-19T08:39:10.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.700+0000 7fada0ff9700 1 -- 172.21.15.79:0/339015546 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fad9c014910 con 0x7fada4159db0 2023-10-19T08:39:10.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.701+0000 7fada0ff9700 1 --2- 172.21.15.79:0/339015546 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fad9006a0e0 0x7fad9006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:10.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.701+0000 7fada0ff9700 1 -- 172.21.15.79:0/339015546 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fad9c088ff0 con 0x7fada4159db0 2023-10-19T08:39:10.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.701+0000 7fada3fff700 1 --2- 172.21.15.79:0/339015546 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fad9006a0e0 0x7fad9006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:10.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.701+0000 7fada3fff700 1 --2- 172.21.15.79:0/339015546 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fad9006a0e0 0x7fad9006c5a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fad980090b0 tx=0x7fad9801c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:10.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.705+0000 7fada0ff9700 1 -- 172.21.15.79:0/339015546 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fad9c054440 con 0x7fada4159db0 2023-10-19T08:39:10.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.891+0000 7fadaa53b700 1 -- 172.21.15.79:0/339015546 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fada40ca280 con 0x7fada4159db0 2023-10-19T08:39:10.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.892+0000 7fada0ff9700 1 -- 172.21.15.79:0/339015546 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fad9c057a60 con 0x7fada4159db0 2023-10-19T08:39:10.896 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:39:10.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.894+0000 7fadaa53b700 1 -- 172.21.15.79:0/339015546 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fad9006a0e0 msgr2=0x7fad9006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:10.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.894+0000 7fadaa53b700 1 --2- 172.21.15.79:0/339015546 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fad9006a0e0 0x7fad9006c5a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fad980090b0 tx=0x7fad9801c040 comp rx=0 tx=0).stop 2023-10-19T08:39:10.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.894+0000 7fadaa53b700 1 -- 172.21.15.79:0/339015546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada4159db0 msgr2=0x7fada41f30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:10.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.894+0000 7fadaa53b700 1 --2- 172.21.15.79:0/339015546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada4159db0 0x7fada41f30e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fad9c007e40 tx=0x7fad9c00e3c0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.894+0000 7fadaa53b700 1 -- 172.21.15.79:0/339015546 shutdown_connections 2023-10-19T08:39:10.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.894+0000 7fadaa53b700 1 --2- 172.21.15.79:0/339015546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada4159db0 0x7fada41f30e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.894+0000 7fadaa53b700 1 --2- 172.21.15.79:0/339015546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fada40cc640 0x7fada4148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.894+0000 7fadaa53b700 1 --2- 172.21.15.79:0/339015546 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fad9006a0e0 0x7fad9006c5a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.894+0000 7fadaa53b700 1 --2- 172.21.15.79:0/339015546 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fada40ceaf0 0x7fada414b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:10.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.894+0000 7fadaa53b700 1 -- 172.21.15.79:0/339015546 >> 172.21.15.79:0/339015546 conn(0x7fada406dcc0 msgr2=0x7fada4157e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:10.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.894+0000 7fadaa53b700 1 -- 172.21.15.79:0/339015546 shutdown_connections 2023-10-19T08:39:10.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:10.894+0000 7fadaa53b700 1 -- 172.21.15.79:0/339015546 wait complete. 2023-10-19T08:39:10.909 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T08:39:11.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.028+0000 7fbad8eea700 1 Processor -- start 2023-10-19T08:39:11.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.028+0000 7fbad8eea700 1 -- start start 2023-10-19T08:39:11.034 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.029+0000 7fbad8eea700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbad40b0710 0x7fbad40b0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:11.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.029+0000 7fbad8eea700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbad40d14f0 0x7fbad40ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:11.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.029+0000 7fbad8eea700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad406c5a0 con 0x7fbad40adee0 2023-10-19T08:39:11.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.029+0000 7fbad8eea700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad4160cb0 con 0x7fbad40b0710 2023-10-19T08:39:11.035 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.029+0000 7fbad8eea700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad406bd40 con 0x7fbad40d14f0 2023-10-19T08:39:11.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.030+0000 7fbad259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbad40b0710 0x7fbad40b0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:11.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.030+0000 7fbad259c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbad40b0710 0x7fbad40b0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48202/0 (socket says 172.21.15.79:48202) 2023-10-19T08:39:11.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.030+0000 7fbad259c700 1 -- 172.21.15.79:0/1358018778 learned_addr learned my addr 172.21.15.79:0/1358018778 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:11.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.030+0000 7fbad1d9b700 1 --2- 172.21.15.79:0/1358018778 >> v2:172.21.15.89:3300/0 conn(0x7fbad40d14f0 0x7fbad40ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:11.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.030+0000 7fbad259c700 1 -- 172.21.15.79:0/1358018778 >> v2:172.21.15.89:3300/0 conn(0x7fbad40d14f0 msgr2=0x7fbad40ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:11.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.030+0000 7fbad259c700 1 --2- 172.21.15.79:0/1358018778 >> v2:172.21.15.89:3300/0 conn(0x7fbad40d14f0 0x7fbad40ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.030+0000 7fbad259c700 1 -- 172.21.15.79:0/1358018778 >> v1:172.21.15.89:6789/0 conn(0x7fbad40adee0 legacy=0x7fbad40b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:11.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.030+0000 7fbad259c700 1 -- 172.21.15.79:0/1358018778 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad40b1030 con 0x7fbad40b0710 2023-10-19T08:39:11.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.030+0000 7fbad259c700 1 --2- 172.21.15.79:0/1358018778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40b0710 0x7fbad40b0af0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbad40726d0 tx=0x7fbac8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c746d04d5712fa27 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:11.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.030+0000 7fbad159a700 1 -- 172.21.15.79:0/1358018778 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac8004230 con 0x7fbad40b0710 2023-10-19T08:39:11.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.030+0000 7fbad159a700 1 -- 172.21.15.79:0/1358018778 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac8004390 con 0x7fbad40b0710 2023-10-19T08:39:11.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.030+0000 7fbad159a700 1 -- 172.21.15.79:0/1358018778 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac80036a0 con 0x7fbad40b0710 2023-10-19T08:39:11.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.031+0000 7fbad8eea700 1 -- 172.21.15.79:0/1358018778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40b0710 msgr2=0x7fbad40b0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:11.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.031+0000 7fbad8eea700 1 --2- 172.21.15.79:0/1358018778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40b0710 0x7fbad40b0af0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbad40726d0 tx=0x7fbac8009bd0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.031+0000 7fbad8eea700 1 -- 172.21.15.79:0/1358018778 shutdown_connections 2023-10-19T08:39:11.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.031+0000 7fbad8eea700 1 --2- 172.21.15.79:0/1358018778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40b0710 0x7fbad40b0af0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.031+0000 7fbad8eea700 1 --2- 172.21.15.79:0/1358018778 >> v2:172.21.15.89:3300/0 conn(0x7fbad40d14f0 0x7fbad40ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.031+0000 7fbad8eea700 1 -- 172.21.15.79:0/1358018778 >> 172.21.15.79:0/1358018778 conn(0x7fbad409a0b0 msgr2=0x7fbad40d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:11.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.031+0000 7fbad8eea700 1 -- 172.21.15.79:0/1358018778 shutdown_connections 2023-10-19T08:39:11.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.031+0000 7fbad8eea700 1 -- 172.21.15.79:0/1358018778 wait complete. 2023-10-19T08:39:11.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.032+0000 7fbad8eea700 1 Processor -- start 2023-10-19T08:39:11.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.032+0000 7fbad8eea700 1 -- start start 2023-10-19T08:39:11.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.033+0000 7fbad8eea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40adee0 0x7fbad415ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:11.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.033+0000 7fbad8eea700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbad40b0710 0x7fbad40c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:11.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.033+0000 7fbad8eea700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbad40d14f0 0x7fbad41f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:11.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.033+0000 7fbad8eea700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad40c5960 con 0x7fbad40adee0 2023-10-19T08:39:11.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.033+0000 7fbad8eea700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad415f220 con 0x7fbad40b0710 2023-10-19T08:39:11.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.033+0000 7fbad8eea700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad41f3370 con 0x7fbad40d14f0 2023-10-19T08:39:11.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.033+0000 7fbad259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40adee0 0x7fbad415ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:11.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.033+0000 7fbad259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40adee0 0x7fbad415ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48208/0 (socket says 172.21.15.79:48208) 2023-10-19T08:39:11.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.033+0000 7fbad259c700 1 -- 172.21.15.79:0/2966185061 learned_addr learned my addr 172.21.15.79:0/2966185061 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:11.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.033+0000 7fbad1d9b700 1 --2- 172.21.15.79:0/2966185061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbad40b0710 0x7fbad40c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:11.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.033+0000 7fbad2d9d700 1 --2- 172.21.15.79:0/2966185061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbad40d14f0 0x7fbad41f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:11.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.033+0000 7fbad259c700 1 -- 172.21.15.79:0/2966185061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbad40d14f0 msgr2=0x7fbad41f2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:11.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.033+0000 7fbad259c700 1 --2- 172.21.15.79:0/2966185061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbad40d14f0 0x7fbad41f2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.033+0000 7fbad259c700 1 -- 172.21.15.79:0/2966185061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbad40b0710 msgr2=0x7fbad40c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:11.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.033+0000 7fbad259c700 1 --2- 172.21.15.79:0/2966185061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbad40b0710 0x7fbad40c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.033+0000 7fbad259c700 1 -- 172.21.15.79:0/2966185061 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac8009550 con 0x7fbad40adee0 2023-10-19T08:39:11.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.033+0000 7fbad1d9b700 1 --2- 172.21.15.79:0/2966185061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbad40b0710 0x7fbad40c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:11.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.033+0000 7fbad259c700 1 --2- 172.21.15.79:0/2966185061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40adee0 0x7fbad415ece0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbac8009130 tx=0x7fbac8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:11.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.033+0000 7fbac2ffd700 1 -- 172.21.15.79:0/2966185061 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac8003d40 con 0x7fbad40adee0 2023-10-19T08:39:11.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.034+0000 7fbac2ffd700 1 -- 172.21.15.79:0/2966185061 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac801f070 con 0x7fbad40adee0 2023-10-19T08:39:11.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.034+0000 7fbac2ffd700 1 -- 172.21.15.79:0/2966185061 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac8011870 con 0x7fbad40adee0 2023-10-19T08:39:11.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.034+0000 7fbad8eea700 1 -- 172.21.15.79:0/2966185061 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad41f3650 con 0x7fbad40adee0 2023-10-19T08:39:11.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.034+0000 7fbad8eea700 1 -- 172.21.15.79:0/2966185061 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad40c5e50 con 0x7fbad40adee0 2023-10-19T08:39:11.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.035+0000 7fbad8eea700 1 -- 172.21.15.79:0/2966185061 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad404ee70 con 0x7fbad40adee0 2023-10-19T08:39:11.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.035+0000 7fbac2ffd700 1 -- 172.21.15.79:0/2966185061 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbac8021030 con 0x7fbad40adee0 2023-10-19T08:39:11.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.035+0000 7fbac2ffd700 1 --2- 172.21.15.79:0/2966185061 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbab406a110 0x7fbab406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:11.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.035+0000 7fbac2ffd700 1 -- 172.21.15.79:0/2966185061 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbac8089d10 con 0x7fbad40adee0 2023-10-19T08:39:11.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.035+0000 7fbad1d9b700 1 --2- 172.21.15.79:0/2966185061 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbab406a110 0x7fbab406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:11.048 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.036+0000 7fbad1d9b700 1 --2- 172.21.15.79:0/2966185061 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbab406a110 0x7fbab406c5d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbad409e970 tx=0x7fbac4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:11.049 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.040+0000 7fbac2ffd700 1 -- 172.21.15.79:0/2966185061 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fbac8055160 con 0x7fbad40adee0 2023-10-19T08:39:11.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.230+0000 7fbad8eea700 1 -- 172.21.15.79:0/2966185061 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbad406bb20 con 0x7fbad40adee0 2023-10-19T08:39:11.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.230+0000 7fbac2ffd700 1 -- 172.21.15.79:0/2966185061 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbac8029020 con 0x7fbad40adee0 2023-10-19T08:39:11.234 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-19T08:39:11.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.232+0000 7fbad8eea700 1 -- 172.21.15.79:0/2966185061 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbab406a110 msgr2=0x7fbab406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:11.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.232+0000 7fbad8eea700 1 --2- 172.21.15.79:0/2966185061 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbab406a110 0x7fbab406c5d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbad409e970 tx=0x7fbac4008040 comp rx=0 tx=0).stop 2023-10-19T08:39:11.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.232+0000 7fbad8eea700 1 -- 172.21.15.79:0/2966185061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40adee0 msgr2=0x7fbad415ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:11.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.232+0000 7fbad8eea700 1 --2- 172.21.15.79:0/2966185061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40adee0 0x7fbad415ece0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbac8009130 tx=0x7fbac8004750 comp rx=0 tx=0).stop 2023-10-19T08:39:11.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.232+0000 7fbad8eea700 1 -- 172.21.15.79:0/2966185061 shutdown_connections 2023-10-19T08:39:11.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.232+0000 7fbad8eea700 1 --2- 172.21.15.79:0/2966185061 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbab406a110 0x7fbab406c5d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.232+0000 7fbad8eea700 1 --2- 172.21.15.79:0/2966185061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbad40d14f0 0x7fbad41f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.232+0000 7fbad8eea700 1 --2- 172.21.15.79:0/2966185061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbad40adee0 0x7fbad415ece0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.232+0000 7fbad8eea700 1 --2- 172.21.15.79:0/2966185061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbad40b0710 0x7fbad40c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.232+0000 7fbad8eea700 1 -- 172.21.15.79:0/2966185061 >> 172.21.15.79:0/2966185061 conn(0x7fbad409a0b0 msgr2=0x7fbad40ae2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:11.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.232+0000 7fbad8eea700 1 -- 172.21.15.79:0/2966185061 shutdown_connections 2023-10-19T08:39:11.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.232+0000 7fbad8eea700 1 -- 172.21.15.79:0/2966185061 wait complete. 2023-10-19T08:39:11.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T08:39:11.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.368+0000 7f2309478700 1 Processor -- start 2023-10-19T08:39:11.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.368+0000 7f2309478700 1 -- start start 2023-10-19T08:39:11.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.369+0000 7f2309478700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23040cfcf0 0x7f23040d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:11.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.369+0000 7f2309478700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23040b2180 0x7f23040d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:11.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.369+0000 7f2309478700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f23040d2eb0 0x7f23040d3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:11.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.369+0000 7f2309478700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23040d0610 con 0x7f23040cfcf0 2023-10-19T08:39:11.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.369+0000 7f2309478700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23040d1120 con 0x7f23040d2eb0 2023-10-19T08:39:11.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.369+0000 7f2309478700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23040d1400 con 0x7f23040b2180 2023-10-19T08:39:11.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.369+0000 7f2302ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23040cfcf0 0x7f23040d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:11.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.369+0000 7f2302ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f23040cfcf0 0x7f23040d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48216/0 (socket says 172.21.15.79:48216) 2023-10-19T08:39:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.369+0000 7f2302ffd700 1 -- 172.21.15.79:0/263042014 learned_addr learned my addr 172.21.15.79:0/263042014 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.369+0000 7f23037fe700 1 --2- 172.21.15.79:0/263042014 >> v2:172.21.15.89:3300/0 conn(0x7f23040d2eb0 0x7f23040d3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:11.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.369+0000 7f23027fc700 1 --2- 172.21.15.79:0/263042014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23040b2180 0x7f23040d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.369+0000 7f2302ffd700 1 -- 172.21.15.79:0/263042014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23040b2180 msgr2=0x7f23040d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.369+0000 7f2302ffd700 1 --2- 172.21.15.79:0/263042014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23040b2180 0x7f23040d2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.369+0000 7f2302ffd700 1 -- 172.21.15.79:0/263042014 >> v2:172.21.15.89:3300/0 conn(0x7f23040d2eb0 msgr2=0x7f23040d3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.369+0000 7f2302ffd700 1 --2- 172.21.15.79:0/263042014 >> v2:172.21.15.89:3300/0 conn(0x7f23040d2eb0 0x7f23040d3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.369+0000 7f2302ffd700 1 -- 172.21.15.79:0/263042014 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23040d16e0 con 0x7f23040cfcf0 2023-10-19T08:39:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.369+0000 7f2302ffd700 1 --2- 172.21.15.79:0/263042014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23040cfcf0 0x7f23040d00d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f23040b8b70 tx=0x7f22f8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b56eaa56144523 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.370+0000 7f2301ffb700 1 -- 172.21.15.79:0/263042014 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f8011830 con 0x7f23040cfcf0 2023-10-19T08:39:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.370+0000 7f2301ffb700 1 -- 172.21.15.79:0/263042014 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f8011990 con 0x7f23040cfcf0 2023-10-19T08:39:11.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.370+0000 7f2301ffb700 1 -- 172.21.15.79:0/263042014 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f8011d20 con 0x7f23040cfcf0 2023-10-19T08:39:11.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.370+0000 7f2309478700 1 -- 172.21.15.79:0/263042014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23040cfcf0 msgr2=0x7f23040d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:11.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.370+0000 7f2309478700 1 --2- 172.21.15.79:0/263042014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23040cfcf0 0x7f23040d00d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f23040b8b70 tx=0x7f22f8009bd0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.370+0000 7f2309478700 1 -- 172.21.15.79:0/263042014 shutdown_connections 2023-10-19T08:39:11.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.370+0000 7f2309478700 1 --2- 172.21.15.79:0/263042014 >> v2:172.21.15.89:3300/0 conn(0x7f23040d2eb0 0x7f23040d3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.370+0000 7f2309478700 1 --2- 172.21.15.79:0/263042014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23040cfcf0 0x7f23040d00d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.370+0000 7f2309478700 1 --2- 172.21.15.79:0/263042014 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23040b2180 0x7f23040d2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.370+0000 7f2309478700 1 -- 172.21.15.79:0/263042014 >> 172.21.15.79:0/263042014 conn(0x7f2304071b30 msgr2=0x7f2304071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:11.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.370+0000 7f2309478700 1 -- 172.21.15.79:0/263042014 shutdown_connections 2023-10-19T08:39:11.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.370+0000 7f2309478700 1 -- 172.21.15.79:0/263042014 wait complete. 2023-10-19T08:39:11.384 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.371+0000 7f2309478700 1 Processor -- start 2023-10-19T08:39:11.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.372+0000 7f2309478700 1 -- start start 2023-10-19T08:39:11.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.372+0000 7f2309478700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23040b2180 0x7f23040b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:11.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.372+0000 7f2309478700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23040cfcf0 0x7f230415fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:11.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.372+0000 7f2309478700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23040d2eb0 0x7f230414ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:11.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.372+0000 7f2309478700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23040cae10 con 0x7f23040d2eb0 2023-10-19T08:39:11.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.372+0000 7f2309478700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2304154730 con 0x7f23040b2180 2023-10-19T08:39:11.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.372+0000 7f2309478700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23040ca190 con 0x7f23040cfcf0 2023-10-19T08:39:11.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.372+0000 7f23037fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23040d2eb0 0x7f230414ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:11.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.372+0000 7f23037fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23040d2eb0 0x7f230414ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48226/0 (socket says 172.21.15.79:48226) 2023-10-19T08:39:11.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.372+0000 7f23037fe700 1 -- 172.21.15.79:0/2637302766 learned_addr learned my addr 172.21.15.79:0/2637302766 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:11.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.372+0000 7f2302ffd700 1 --2- 172.21.15.79:0/2637302766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23040b2180 0x7f23040b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:11.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.372+0000 7f23027fc700 1 --2- 172.21.15.79:0/2637302766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23040cfcf0 0x7f230415fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:11.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.373+0000 7f23037fe700 1 -- 172.21.15.79:0/2637302766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23040cfcf0 msgr2=0x7f230415fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:11.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.373+0000 7f23037fe700 1 --2- 172.21.15.79:0/2637302766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23040cfcf0 0x7f230415fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.373+0000 7f23037fe700 1 -- 172.21.15.79:0/2637302766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23040b2180 msgr2=0x7f23040b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:11.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.373+0000 7f23037fe700 1 --2- 172.21.15.79:0/2637302766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23040b2180 0x7f23040b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.373+0000 7f23037fe700 1 -- 172.21.15.79:0/2637302766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f8009550 con 0x7f23040d2eb0 2023-10-19T08:39:11.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.373+0000 7f23037fe700 1 --2- 172.21.15.79:0/2637302766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23040d2eb0 0x7f230414ad10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f22fc00efc0 tx=0x7f22fc00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:11.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.373+0000 7f22eb7fe700 1 -- 172.21.15.79:0/2637302766 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc00cad0 con 0x7f23040d2eb0 2023-10-19T08:39:11.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.373+0000 7f22eb7fe700 1 -- 172.21.15.79:0/2637302766 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22fc00f040 con 0x7f23040d2eb0 2023-10-19T08:39:11.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.373+0000 7f2309478700 1 -- 172.21.15.79:0/2637302766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23040ca470 con 0x7f23040d2eb0 2023-10-19T08:39:11.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.373+0000 7f22eb7fe700 1 -- 172.21.15.79:0/2637302766 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc00ce70 con 0x7f23040d2eb0 2023-10-19T08:39:11.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.373+0000 7f2309478700 1 -- 172.21.15.79:0/2637302766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23040caa30 con 0x7f23040d2eb0 2023-10-19T08:39:11.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.374+0000 7f2309478700 1 -- 172.21.15.79:0/2637302766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23040caf50 con 0x7f23040d2eb0 2023-10-19T08:39:11.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.374+0000 7f22eb7fe700 1 -- 172.21.15.79:0/2637302766 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f22fc014480 con 0x7f23040d2eb0 2023-10-19T08:39:11.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.375+0000 7f22eb7fe700 1 --2- 172.21.15.79:0/2637302766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f22f006a0e0 0x7f22f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:11.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.375+0000 7f22eb7fe700 1 -- 172.21.15.79:0/2637302766 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f22fc0892b0 con 0x7f23040d2eb0 2023-10-19T08:39:11.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.375+0000 7f2302ffd700 1 --2- 172.21.15.79:0/2637302766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f22f006a0e0 0x7f22f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:11.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.375+0000 7f2302ffd700 1 --2- 172.21.15.79:0/2637302766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f22f006a0e0 0x7f22f006c5a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f22f8009c10 tx=0x7f22f8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:11.391 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.379+0000 7f22eb7fe700 1 -- 172.21.15.79:0/2637302766 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f23040caf50 con 0x7f23040d2eb0 2023-10-19T08:39:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.566+0000 7f2309478700 1 -- 172.21.15.79:0/2637302766 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f23040caf50 con 0x7f23040d2eb0 2023-10-19T08:39:11.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.566+0000 7f22eb7fe700 1 -- 172.21.15.79:0/2637302766 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f23040caf50 con 0x7f23040d2eb0 2023-10-19T08:39:11.570 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:39:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.568+0000 7f2309478700 1 -- 172.21.15.79:0/2637302766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f22f006a0e0 msgr2=0x7f22f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.568+0000 7f2309478700 1 --2- 172.21.15.79:0/2637302766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f22f006a0e0 0x7f22f006c5a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f22f8009c10 tx=0x7f22f8008030 comp rx=0 tx=0).stop 2023-10-19T08:39:11.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.568+0000 7f2309478700 1 -- 172.21.15.79:0/2637302766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23040d2eb0 msgr2=0x7f230414ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:11.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.568+0000 7f2309478700 1 --2- 172.21.15.79:0/2637302766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23040d2eb0 0x7f230414ad10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f22fc00efc0 tx=0x7f22fc00c0c0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.568+0000 7f2309478700 1 -- 172.21.15.79:0/2637302766 shutdown_connections 2023-10-19T08:39:11.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.568+0000 7f2309478700 1 --2- 172.21.15.79:0/2637302766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23040d2eb0 0x7f230414ad10 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.568+0000 7f2309478700 1 --2- 172.21.15.79:0/2637302766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23040b2180 0x7f23040b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.568+0000 7f2309478700 1 --2- 172.21.15.79:0/2637302766 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f22f006a0e0 0x7f22f006c5a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.568+0000 7f2309478700 1 --2- 172.21.15.79:0/2637302766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23040cfcf0 0x7f230415fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.568+0000 7f2309478700 1 -- 172.21.15.79:0/2637302766 >> 172.21.15.79:0/2637302766 conn(0x7f2304071b30 msgr2=0x7f23040b63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:11.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.569+0000 7f2309478700 1 -- 172.21.15.79:0/2637302766 shutdown_connections 2023-10-19T08:39:11.574 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.569+0000 7f2309478700 1 -- 172.21.15.79:0/2637302766 wait complete. 2023-10-19T08:39:11.585 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-19T08:39:11.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.702+0000 7f1628d58700 1 Processor -- start 2023-10-19T08:39:11.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.702+0000 7f1628d58700 1 -- start start 2023-10-19T08:39:11.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.703+0000 7f1628d58700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162406bed0 0x7f16240cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:11.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.703+0000 7f1628d58700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f16240cbd80 0x7f16240cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:11.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.703+0000 7f1628d58700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162415d910 con 0x7f162415d530 2023-10-19T08:39:11.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.703+0000 7f1628d58700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16240b1c70 con 0x7f16240cbd80 2023-10-19T08:39:11.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.703+0000 7f1628d58700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162415db10 con 0x7f162406bed0 2023-10-19T08:39:11.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.703+0000 7f1622d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f16240cbd80 0x7f16240cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:11.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.703+0000 7f162259c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f162415d530 0x7f16240b1560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58302/0 (socket says 172.21.15.79:58302) 2023-10-19T08:39:11.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.703+0000 7f162259c700 1 -- 172.21.15.79:0/153940114 learned_addr learned my addr 172.21.15.79:0/153940114 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:11.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.704+0000 7f1621d9b700 1 --2- 172.21.15.79:0/153940114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162406bed0 0x7f16240cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:11.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.704+0000 7f1622d9d700 1 -- 172.21.15.79:0/153940114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162406bed0 msgr2=0x7f16240cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:11.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.704+0000 7f1622d9d700 1 --2- 172.21.15.79:0/153940114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162406bed0 0x7f16240cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.704+0000 7f1622d9d700 1 -- 172.21.15.79:0/153940114 >> v1:172.21.15.79:6789/0 conn(0x7f162415d530 legacy=0x7f16240b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:11.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.704+0000 7f1622d9d700 1 -- 172.21.15.79:0/153940114 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16240b1eb0 con 0x7f16240cbd80 2023-10-19T08:39:11.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.704+0000 7f162159a700 1 -- 172.21.15.79:0/153940114 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192697030 0 0) 0x7f162415d910 con 0x7f162415d530 2023-10-19T08:39:11.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.704+0000 7f1621d9b700 1 --2- 172.21.15.79:0/153940114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162406bed0 0x7f16240cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:11.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.704+0000 7f1622d9d700 1 --2- 172.21.15.79:0/153940114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16240cbd80 0x7f16240cd620 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f161c009d90 tx=0x7f161c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c427eeb0a2b2aa37 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:11.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.704+0000 7f162159a700 1 -- 172.21.15.79:0/153940114 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c00e070 con 0x7f16240cbd80 2023-10-19T08:39:11.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.704+0000 7f162159a700 1 -- 172.21.15.79:0/153940114 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161c00bbd0 con 0x7f16240cbd80 2023-10-19T08:39:11.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.704+0000 7f162159a700 1 -- 172.21.15.79:0/153940114 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161c012430 con 0x7f16240cbd80 2023-10-19T08:39:11.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.704+0000 7f1628d58700 1 -- 172.21.15.79:0/153940114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16240cbd80 msgr2=0x7f16240cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:11.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.704+0000 7f1628d58700 1 --2- 172.21.15.79:0/153940114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16240cbd80 0x7f16240cd620 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f161c009d90 tx=0x7f161c00b330 comp rx=0 tx=0).stop 2023-10-19T08:39:11.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.705+0000 7f1628d58700 1 -- 172.21.15.79:0/153940114 shutdown_connections 2023-10-19T08:39:11.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.705+0000 7f1628d58700 1 --2- 172.21.15.79:0/153940114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16240cbd80 0x7f16240cd620 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.705+0000 7f1628d58700 1 --2- 172.21.15.79:0/153940114 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162406bed0 0x7f16240cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.705+0000 7f1628d58700 1 -- 172.21.15.79:0/153940114 >> 172.21.15.79:0/153940114 conn(0x7f16240cc560 msgr2=0x7f16240cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:11.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.705+0000 7f1628d58700 1 -- 172.21.15.79:0/153940114 shutdown_connections 2023-10-19T08:39:11.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.705+0000 7f1628d58700 1 -- 172.21.15.79:0/153940114 wait complete. 2023-10-19T08:39:11.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.706+0000 7f1628d58700 1 Processor -- start 2023-10-19T08:39:11.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.706+0000 7f1628d58700 1 -- start start 2023-10-19T08:39:11.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f1628d58700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f162406bed0 0x7f162415b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:11.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f1628d58700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16240cbd80 0x7f162414fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:11.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f1628d58700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162415d530 0x7f16240acd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:11.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f1628d58700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162415c990 con 0x7f162406bed0 2023-10-19T08:39:11.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f1628d58700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162415ba40 con 0x7f16240cbd80 2023-10-19T08:39:11.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f1628d58700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162415bd10 con 0x7f162415d530 2023-10-19T08:39:11.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f162259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f162406bed0 0x7f162415b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:11.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f162259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f162406bed0 0x7f162415b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48236/0 (socket says 172.21.15.79:48236) 2023-10-19T08:39:11.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f162259c700 1 -- 172.21.15.79:0/1941493179 learned_addr learned my addr 172.21.15.79:0/1941493179 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:11.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f162259c700 1 -- 172.21.15.79:0/1941493179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162415d530 msgr2=0x7f16240acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:11.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f162259c700 1 --2- 172.21.15.79:0/1941493179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162415d530 0x7f16240acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f162259c700 1 -- 172.21.15.79:0/1941493179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16240cbd80 msgr2=0x7f162414fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:11.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f162259c700 1 --2- 172.21.15.79:0/1941493179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16240cbd80 0x7f162414fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f162259c700 1 -- 172.21.15.79:0/1941493179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c009a70 con 0x7f162406bed0 2023-10-19T08:39:11.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f162259c700 1 --2- 172.21.15.79:0/1941493179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f162406bed0 0x7f162415b500 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f161800c550 tx=0x7f161800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:11.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f1612ffd700 1 -- 172.21.15.79:0/1941493179 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618004c80 con 0x7f162406bed0 2023-10-19T08:39:11.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f1612ffd700 1 -- 172.21.15.79:0/1941493179 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1618004e00 con 0x7f162406bed0 2023-10-19T08:39:11.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f1612ffd700 1 -- 172.21.15.79:0/1941493179 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618007310 con 0x7f162406bed0 2023-10-19T08:39:11.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f1628d58700 1 -- 172.21.15.79:0/1941493179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162415bff0 con 0x7f162406bed0 2023-10-19T08:39:11.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.707+0000 7f1628d58700 1 -- 172.21.15.79:0/1941493179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f162415c5b0 con 0x7f162406bed0 2023-10-19T08:39:11.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.708+0000 7f1628d58700 1 -- 172.21.15.79:0/1941493179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162404ee70 con 0x7f162406bed0 2023-10-19T08:39:11.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.709+0000 7f1612ffd700 1 -- 172.21.15.79:0/1941493179 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1618007470 con 0x7f162406bed0 2023-10-19T08:39:11.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.709+0000 7f1612ffd700 1 --2- 172.21.15.79:0/1941493179 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f160406a0e0 0x7f160406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:11.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.709+0000 7f1621d9b700 1 --2- 172.21.15.79:0/1941493179 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f160406a0e0 0x7f160406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:11.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.709+0000 7f1612ffd700 1 -- 172.21.15.79:0/1941493179 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1618088570 con 0x7f162406bed0 2023-10-19T08:39:11.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.709+0000 7f1621d9b700 1 --2- 172.21.15.79:0/1941493179 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f160406a0e0 0x7f160406c5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1614006fd0 tx=0x7f1614008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:11.722 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.714+0000 7f1612ffd700 1 -- 172.21.15.79:0/1941493179 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f16180539c0 con 0x7f162406bed0 2023-10-19T08:39:11.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.916+0000 7f1628d58700 1 -- 172.21.15.79:0/1941493179 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f162406b7d0 con 0x7f162406bed0 2023-10-19T08:39:11.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.917+0000 7f1612ffd700 1 -- 172.21.15.79:0/1941493179 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1618056fe0 con 0x7f162406bed0 2023-10-19T08:39:11.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.919+0000 7f1628d58700 1 -- 172.21.15.79:0/1941493179 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f160406a0e0 msgr2=0x7f160406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:11.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.919+0000 7f1628d58700 1 --2- 172.21.15.79:0/1941493179 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f160406a0e0 0x7f160406c5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1614006fd0 tx=0x7f1614008040 comp rx=0 tx=0).stop 2023-10-19T08:39:11.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.919+0000 7f1628d58700 1 -- 172.21.15.79:0/1941493179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f162406bed0 msgr2=0x7f162415b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:11.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.919+0000 7f1628d58700 1 --2- 172.21.15.79:0/1941493179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f162406bed0 0x7f162415b500 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f161800c550 tx=0x7f161800c910 comp rx=0 tx=0).stop 2023-10-19T08:39:11.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.919+0000 7f1628d58700 1 -- 172.21.15.79:0/1941493179 shutdown_connections 2023-10-19T08:39:11.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.919+0000 7f1628d58700 1 --2- 172.21.15.79:0/1941493179 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f160406a0e0 0x7f160406c5a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.919+0000 7f1628d58700 1 --2- 172.21.15.79:0/1941493179 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f162415d530 0x7f16240acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.919+0000 7f1628d58700 1 --2- 172.21.15.79:0/1941493179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f162406bed0 0x7f162415b500 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.919+0000 7f1628d58700 1 --2- 172.21.15.79:0/1941493179 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16240cbd80 0x7f162414fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:11.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.919+0000 7f1628d58700 1 -- 172.21.15.79:0/1941493179 >> 172.21.15.79:0/1941493179 conn(0x7f16240cc560 msgr2=0x7f16240719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:11.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.919+0000 7f1628d58700 1 -- 172.21.15.79:0/1941493179 shutdown_connections 2023-10-19T08:39:11.925 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:11.919+0000 7f1628d58700 1 -- 172.21.15.79:0/1941493179 wait complete. 2023-10-19T08:39:11.925 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2023-10-19T08:39:11.934 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi079.front.sepia.ceph.com... 2023-10-19T08:39:11.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:11.935 DEBUG:teuthology.orchestra.run.smithi079:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-10-19T08:39:11.976 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:39:11.977 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2023-10-19T08:39:11.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:11.978 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-19T08:39:12.033 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:39:12.033 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T08:39:12.054 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:39:12.055 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T08:39:12.115 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:39:12.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.232+0000 7f11dee90700 1 Processor -- start 2023-10-19T08:39:12.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.232+0000 7f11dee90700 1 -- start start 2023-10-19T08:39:12.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.233+0000 7f11dee90700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f11d806b330 0x7f11d806b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:12.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.233+0000 7f11dee90700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d80cf970 con 0x7f11d80d1080 2023-10-19T08:39:12.238 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.233+0000 7f11dee90700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d806be30 con 0x7f11d8160380 2023-10-19T08:39:12.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.233+0000 7f11dee90700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d806c3f0 con 0x7f11d806b330 2023-10-19T08:39:12.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.233+0000 7f11d7fff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f11d806b330 0x7f11d806b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:12.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.233+0000 7f11dd42d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f11d80d1080 0x7f11d80cb4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58320/0 (socket says 172.21.15.79:58320) 2023-10-19T08:39:12.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.233+0000 7f11dd42d700 1 -- 172.21.15.79:0/150361015 learned_addr learned my addr 172.21.15.79:0/150361015 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:12.239 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.233+0000 7f11d7fff700 1 -- 172.21.15.79:0/150361015 >> v1:172.21.15.89:6789/0 conn(0x7f11d8160380 legacy=0x7f11d80cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:12.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.233+0000 7f11d7fff700 1 -- 172.21.15.79:0/150361015 >> v1:172.21.15.79:6789/0 conn(0x7f11d80d1080 legacy=0x7f11d80cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:12.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.233+0000 7f11d7fff700 1 -- 172.21.15.79:0/150361015 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d806c110 con 0x7f11d806b330 2023-10-19T08:39:12.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.233+0000 7f11d77fe700 1 -- 172.21.15.79:0/150361015 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2990347658 0 0) 0x7f11d80cf970 con 0x7f11d80d1080 2023-10-19T08:39:12.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.233+0000 7f11d7fff700 1 --2- 172.21.15.79:0/150361015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11d806b330 0x7f11d806b7e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009840 tx=0x7f11c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e3819397124323 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:12.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.234+0000 7f11d77fe700 1 -- 172.21.15.79:0/150361015 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4004230 con 0x7f11d806b330 2023-10-19T08:39:12.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.234+0000 7f11d77fe700 1 -- 172.21.15.79:0/150361015 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c4004390 con 0x7f11d806b330 2023-10-19T08:39:12.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.234+0000 7f11d77fe700 1 -- 172.21.15.79:0/150361015 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c40036a0 con 0x7f11d806b330 2023-10-19T08:39:12.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.234+0000 7f11dee90700 1 -- 172.21.15.79:0/150361015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11d806b330 msgr2=0x7f11d806b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:12.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.234+0000 7f11dee90700 1 --2- 172.21.15.79:0/150361015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11d806b330 0x7f11d806b7e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009840 tx=0x7f11c4009b50 comp rx=0 tx=0).stop 2023-10-19T08:39:12.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.234+0000 7f11dee90700 1 -- 172.21.15.79:0/150361015 shutdown_connections 2023-10-19T08:39:12.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.234+0000 7f11dee90700 1 --2- 172.21.15.79:0/150361015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11d806b330 0x7f11d806b7e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.234+0000 7f11dee90700 1 -- 172.21.15.79:0/150361015 >> 172.21.15.79:0/150361015 conn(0x7f11d806a400 msgr2=0x7f11d806a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:12.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.234+0000 7f11dee90700 1 -- 172.21.15.79:0/150361015 shutdown_connections 2023-10-19T08:39:12.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.234+0000 7f11dee90700 1 -- 172.21.15.79:0/150361015 wait complete. 2023-10-19T08:39:12.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.235+0000 7f11dee90700 1 Processor -- start 2023-10-19T08:39:12.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.235+0000 7f11dee90700 1 -- start start 2023-10-19T08:39:12.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.236+0000 7f11dee90700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11d806b330 0x7f11d8154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:12.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.236+0000 7f11dee90700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11d80d1080 0x7f11d80b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:12.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.236+0000 7f11dee90700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11d8160380 0x7f11d8158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:12.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.236+0000 7f11dee90700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d80b39a0 con 0x7f11d8160380 2023-10-19T08:39:12.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.236+0000 7f11dee90700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d8154b40 con 0x7f11d80d1080 2023-10-19T08:39:12.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.236+0000 7f11dee90700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d80b6600 con 0x7f11d806b330 2023-10-19T08:39:12.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.236+0000 7f11dd42d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11d8160380 0x7f11d8158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:12.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.236+0000 7f11dd42d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11d8160380 0x7f11d8158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48254/0 (socket says 172.21.15.79:48254) 2023-10-19T08:39:12.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.236+0000 7f11dd42d700 1 -- 172.21.15.79:0/873211132 learned_addr learned my addr 172.21.15.79:0/873211132 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:12.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.237+0000 7f11d7fff700 1 --2- 172.21.15.79:0/873211132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11d80d1080 0x7f11d80b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:12.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.237+0000 7f11dcc2c700 1 --2- 172.21.15.79:0/873211132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11d806b330 0x7f11d8154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:12.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.237+0000 7f11dd42d700 1 -- 172.21.15.79:0/873211132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11d806b330 msgr2=0x7f11d8154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:12.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.237+0000 7f11dd42d700 1 --2- 172.21.15.79:0/873211132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11d806b330 0x7f11d8154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.237+0000 7f11dd42d700 1 -- 172.21.15.79:0/873211132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11d80d1080 msgr2=0x7f11d80b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:12.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.237+0000 7f11dd42d700 1 --2- 172.21.15.79:0/873211132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11d80d1080 0x7f11d80b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.237+0000 7f11dd42d700 1 -- 172.21.15.79:0/873211132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c40094a0 con 0x7f11d8160380 2023-10-19T08:39:12.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.237+0000 7f11dd42d700 1 --2- 172.21.15.79:0/873211132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11d8160380 0x7f11d8158200 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f11d000ccd0 tx=0x7f11d000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:12.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.237+0000 7f11d57fa700 1 -- 172.21.15.79:0/873211132 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d000ada0 con 0x7f11d8160380 2023-10-19T08:39:12.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.237+0000 7f11d57fa700 1 -- 172.21.15.79:0/873211132 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d00070d0 con 0x7f11d8160380 2023-10-19T08:39:12.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.237+0000 7f11d57fa700 1 -- 172.21.15.79:0/873211132 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d0007480 con 0x7f11d8160380 2023-10-19T08:39:12.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.237+0000 7f11dee90700 1 -- 172.21.15.79:0/873211132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d80b3bf0 con 0x7f11d8160380 2023-10-19T08:39:12.249 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.237+0000 7f11dee90700 1 -- 172.21.15.79:0/873211132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d80b41b0 con 0x7f11d8160380 2023-10-19T08:39:12.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.238+0000 7f11dee90700 1 -- 172.21.15.79:0/873211132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d804ee70 con 0x7f11d8160380 2023-10-19T08:39:12.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.238+0000 7f11d57fa700 1 -- 172.21.15.79:0/873211132 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f11d00075e0 con 0x7f11d8160380 2023-10-19T08:39:12.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.239+0000 7f11d57fa700 1 --2- 172.21.15.79:0/873211132 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f11bc06a0e0 0x7f11bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:12.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.239+0000 7f11d57fa700 1 -- 172.21.15.79:0/873211132 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f11d00884d0 con 0x7f11d8160380 2023-10-19T08:39:12.250 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.239+0000 7f11dcc2c700 1 --2- 172.21.15.79:0/873211132 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f11bc06a0e0 0x7f11bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:12.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.239+0000 7f11dcc2c700 1 --2- 172.21.15.79:0/873211132 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f11bc06a0e0 0x7f11bc06c5a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f11d80cd6c0 tx=0x7f11cc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:12.251 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.243+0000 7f11d57fa700 1 -- 172.21.15.79:0/873211132 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f11d0053920 con 0x7f11d8160380 2023-10-19T08:39:12.439 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.436+0000 7f11dee90700 1 -- 172.21.15.79:0/873211132 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11d80b6d00 con 0x7f11d8160380 2023-10-19T08:39:12.440 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.437+0000 7f11d57fa700 1 -- 172.21.15.79:0/873211132 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20155 (secure 0 0 0) 0x7f11d0056f40 con 0x7f11d8160380 2023-10-19T08:39:12.441 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:12.441 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:44.473795+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:39:12.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.439+0000 7f11dee90700 1 -- 172.21.15.79:0/873211132 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f11bc06a0e0 msgr2=0x7f11bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:12.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.439+0000 7f11dee90700 1 --2- 172.21.15.79:0/873211132 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f11bc06a0e0 0x7f11bc06c5a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f11d80cd6c0 tx=0x7f11cc008040 comp rx=0 tx=0).stop 2023-10-19T08:39:12.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.439+0000 7f11dee90700 1 -- 172.21.15.79:0/873211132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11d8160380 msgr2=0x7f11d8158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:12.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.439+0000 7f11dee90700 1 --2- 172.21.15.79:0/873211132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11d8160380 0x7f11d8158200 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f11d000ccd0 tx=0x7f11d000a340 comp rx=0 tx=0).stop 2023-10-19T08:39:12.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.439+0000 7f11dee90700 1 -- 172.21.15.79:0/873211132 shutdown_connections 2023-10-19T08:39:12.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.439+0000 7f11dee90700 1 --2- 172.21.15.79:0/873211132 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11d8160380 0x7f11d8158200 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.439+0000 7f11dee90700 1 --2- 172.21.15.79:0/873211132 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f11bc06a0e0 0x7f11bc06c5a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.439+0000 7f11dee90700 1 --2- 172.21.15.79:0/873211132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11d806b330 0x7f11d8154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.439+0000 7f11dee90700 1 --2- 172.21.15.79:0/873211132 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11d80d1080 0x7f11d80b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.439+0000 7f11dee90700 1 -- 172.21.15.79:0/873211132 >> 172.21.15.79:0/873211132 conn(0x7f11d806a400 msgr2=0x7f11d80cb570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:12.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.439+0000 7f11dee90700 1 -- 172.21.15.79:0/873211132 shutdown_connections 2023-10-19T08:39:12.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.439+0000 7f11dee90700 1 -- 172.21.15.79:0/873211132 wait complete. 2023-10-19T08:39:12.455 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T08:37:54.318159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T08:37:55.629862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T08:37:59.333062+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T08:39:12.456 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:39:12.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.575+0000 7fa0d6beb700 1 Processor -- start 2023-10-19T08:39:12.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.575+0000 7fa0d6beb700 1 -- start start 2023-10-19T08:39:12.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.576+0000 7fa0d6beb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa0d006e650 0x7fa0d006f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:12.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.576+0000 7fa0d6beb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0d00ca200 0x7fa0d006ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:12.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.576+0000 7fa0d6beb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d00b2290 con 0x7fa0d015e9c0 2023-10-19T08:39:12.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.576+0000 7fa0d6beb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d015b340 con 0x7fa0d006e650 2023-10-19T08:39:12.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.576+0000 7fa0d6beb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d00ca680 con 0x7fa0d00ca200 2023-10-19T08:39:12.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.576+0000 7fa0cffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0d00ca200 0x7fa0d006ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:12.582 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.576+0000 7fa0d4987700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa0d006e650 0x7fa0d006f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:12.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.576+0000 7fa0cffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0d00ca200 0x7fa0d006ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:50882/0 (socket says 172.21.15.79:50882) 2023-10-19T08:39:12.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.576+0000 7fa0d4987700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa0d006e650 0x7fa0d006f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:34504/0 (socket says 172.21.15.79:34504) 2023-10-19T08:39:12.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.576+0000 7fa0cffff700 1 -- 172.21.15.79:0/2818849854 learned_addr learned my addr 172.21.15.79:0/2818849854 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:12.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.576+0000 7fa0d5188700 1 --1- 172.21.15.79:0/2818849854 >> v1:172.21.15.89:6789/0 conn(0x7fa0d015e9c0 0x7fa0d015ee50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:43176/0 (socket says 172.21.15.79:43176) 2023-10-19T08:39:12.583 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.577+0000 7fa0cffff700 1 -- 172.21.15.79:0/2818849854 >> v2:172.21.15.89:3300/0 conn(0x7fa0d006e650 msgr2=0x7fa0d006f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:12.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.577+0000 7fa0cffff700 1 --2- 172.21.15.79:0/2818849854 >> v2:172.21.15.89:3300/0 conn(0x7fa0d006e650 0x7fa0d006f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.577+0000 7fa0cffff700 1 -- 172.21.15.79:0/2818849854 >> v1:172.21.15.89:6789/0 conn(0x7fa0d015e9c0 legacy=0x7fa0d015ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:12.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.577+0000 7fa0cf7fe700 1 -- 172.21.15.79:0/2818849854 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958196653 0 0) 0x7fa0d00b2290 con 0x7fa0d015e9c0 2023-10-19T08:39:12.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.577+0000 7fa0cffff700 1 -- 172.21.15.79:0/2818849854 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d006ef70 con 0x7fa0d00ca200 2023-10-19T08:39:12.584 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.577+0000 7fa0d4987700 1 --2- 172.21.15.79:0/2818849854 >> v2:172.21.15.89:3300/0 conn(0x7fa0d006e650 0x7fa0d006f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:39:12.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.577+0000 7fa0cffff700 1 --2- 172.21.15.79:0/2818849854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0d00ca200 0x7fa0d006ea30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc0098f0 tx=0x7fa0bc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f50948cc9508020 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:12.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.577+0000 7fa0cf7fe700 1 -- 172.21.15.79:0/2818849854 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc011830 con 0x7fa0d00ca200 2023-10-19T08:39:12.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.577+0000 7fa0cf7fe700 1 -- 172.21.15.79:0/2818849854 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc011990 con 0x7fa0d00ca200 2023-10-19T08:39:12.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.577+0000 7fa0cf7fe700 1 -- 172.21.15.79:0/2818849854 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc011d20 con 0x7fa0d00ca200 2023-10-19T08:39:12.585 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.577+0000 7fa0d6beb700 1 -- 172.21.15.79:0/2818849854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0d00ca200 msgr2=0x7fa0d006ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:12.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.577+0000 7fa0d6beb700 1 --2- 172.21.15.79:0/2818849854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0d00ca200 0x7fa0d006ea30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc0098f0 tx=0x7fa0bc009c00 comp rx=0 tx=0).stop 2023-10-19T08:39:12.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.578+0000 7fa0d6beb700 1 -- 172.21.15.79:0/2818849854 shutdown_connections 2023-10-19T08:39:12.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.578+0000 7fa0d6beb700 1 --2- 172.21.15.79:0/2818849854 >> v2:172.21.15.89:3300/0 conn(0x7fa0d006e650 0x7fa0d006f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.586 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.578+0000 7fa0d6beb700 1 --2- 172.21.15.79:0/2818849854 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0d00ca200 0x7fa0d006ea30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.578+0000 7fa0d6beb700 1 -- 172.21.15.79:0/2818849854 >> 172.21.15.79:0/2818849854 conn(0x7fa0d006d000 msgr2=0x7fa0d006d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:12.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.578+0000 7fa0d6beb700 1 -- 172.21.15.79:0/2818849854 shutdown_connections 2023-10-19T08:39:12.587 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.578+0000 7fa0d6beb700 1 -- 172.21.15.79:0/2818849854 wait complete. 2023-10-19T08:39:12.589 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.579+0000 7fa0d6beb700 1 Processor -- start 2023-10-19T08:39:12.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.579+0000 7fa0d6beb700 1 -- start start 2023-10-19T08:39:12.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0d6beb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0d006e650 0x7fa0d014a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:12.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0d6beb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0d00ca200 0x7fa0d014b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:12.590 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0d6beb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0d015e9c0 0x7fa0d00c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:12.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0d6beb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d014b900 con 0x7fa0d015e9c0 2023-10-19T08:39:12.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0d6beb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d014bbe0 con 0x7fa0d006e650 2023-10-19T08:39:12.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0d6beb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d014bec0 con 0x7fa0d00ca200 2023-10-19T08:39:12.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0d5188700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0d015e9c0 0x7fa0d00c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:12.591 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0d5188700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0d015e9c0 0x7fa0d00c7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48268/0 (socket says 172.21.15.79:48268) 2023-10-19T08:39:12.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0d5188700 1 -- 172.21.15.79:0/867085148 learned_addr learned my addr 172.21.15.79:0/867085148 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:12.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0d4987700 1 --2- 172.21.15.79:0/867085148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0d006e650 0x7fa0d014a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:12.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0cffff700 1 --2- 172.21.15.79:0/867085148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0d00ca200 0x7fa0d014b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:12.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0d5188700 1 -- 172.21.15.79:0/867085148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0d00ca200 msgr2=0x7fa0d014b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:12.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0d5188700 1 --2- 172.21.15.79:0/867085148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0d00ca200 0x7fa0d014b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.592 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0d5188700 1 -- 172.21.15.79:0/867085148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0d006e650 msgr2=0x7fa0d014a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:12.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0d5188700 1 --2- 172.21.15.79:0/867085148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0d006e650 0x7fa0d014a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0d5188700 1 -- 172.21.15.79:0/867085148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c40094a0 con 0x7fa0d015e9c0 2023-10-19T08:39:12.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0d5188700 1 --2- 172.21.15.79:0/867085148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0d015e9c0 0x7fa0d00c7040 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800cba0 tx=0x7fa0c800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:12.593 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0cd7fa700 1 -- 172.21.15.79:0/867085148 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c800aaa0 con 0x7fa0d015e9c0 2023-10-19T08:39:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0cd7fa700 1 -- 172.21.15.79:0/867085148 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c800ac20 con 0x7fa0d015e9c0 2023-10-19T08:39:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0d6beb700 1 -- 172.21.15.79:0/867085148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0bc009550 con 0x7fa0d015e9c0 2023-10-19T08:39:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0cd7fa700 1 -- 172.21.15.79:0/867085148 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80070d0 con 0x7fa0d015e9c0 2023-10-19T08:39:12.594 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.580+0000 7fa0d6beb700 1 -- 172.21.15.79:0/867085148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d014c480 con 0x7fa0d015e9c0 2023-10-19T08:39:12.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.581+0000 7fa0d6beb700 1 -- 172.21.15.79:0/867085148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d004ee70 con 0x7fa0d015e9c0 2023-10-19T08:39:12.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.582+0000 7fa0cd7fa700 1 -- 172.21.15.79:0/867085148 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa0c8007230 con 0x7fa0d015e9c0 2023-10-19T08:39:12.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.582+0000 7fa0cd7fa700 1 --2- 172.21.15.79:0/867085148 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa0b406a0e0 0x7fa0b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:12.596 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.582+0000 7fa0cd7fa700 1 -- 172.21.15.79:0/867085148 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa0c8088570 con 0x7fa0d015e9c0 2023-10-19T08:39:12.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.582+0000 7fa0d4987700 1 --2- 172.21.15.79:0/867085148 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa0b406a0e0 0x7fa0b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:12.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.583+0000 7fa0d4987700 1 --2- 172.21.15.79:0/867085148 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa0b406a0e0 0x7fa0b406c5a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0157b40 tx=0x7fa0c4009210 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:12.597 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.587+0000 7fa0cd7fa700 1 -- 172.21.15.79:0/867085148 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa0c8053930 con 0x7fa0d015e9c0 2023-10-19T08:39:12.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.775+0000 7fa0d6beb700 1 -- 172.21.15.79:0/867085148 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0d006b380 con 0x7fa0d015e9c0 2023-10-19T08:39:12.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.775+0000 7fa0cd7fa700 1 -- 172.21.15.79:0/867085148 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa0c8056f50 con 0x7fa0d015e9c0 2023-10-19T08:39:12.779 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:39:12.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.777+0000 7fa0d6beb700 1 -- 172.21.15.79:0/867085148 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa0b406a0e0 msgr2=0x7fa0b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:12.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.777+0000 7fa0d6beb700 1 --2- 172.21.15.79:0/867085148 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa0b406a0e0 0x7fa0b406c5a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0157b40 tx=0x7fa0c4009210 comp rx=0 tx=0).stop 2023-10-19T08:39:12.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.777+0000 7fa0d6beb700 1 -- 172.21.15.79:0/867085148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0d015e9c0 msgr2=0x7fa0d00c7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:12.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.777+0000 7fa0d6beb700 1 --2- 172.21.15.79:0/867085148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0d015e9c0 0x7fa0d00c7040 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800cba0 tx=0x7fa0c800ceb0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.778+0000 7fa0d6beb700 1 -- 172.21.15.79:0/867085148 shutdown_connections 2023-10-19T08:39:12.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.778+0000 7fa0d6beb700 1 --2- 172.21.15.79:0/867085148 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0d015e9c0 0x7fa0d00c7040 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.778+0000 7fa0d6beb700 1 --2- 172.21.15.79:0/867085148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0d006e650 0x7fa0d014a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.778+0000 7fa0d6beb700 1 --2- 172.21.15.79:0/867085148 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa0b406a0e0 0x7fa0b406c5a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.778+0000 7fa0d6beb700 1 --2- 172.21.15.79:0/867085148 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0d00ca200 0x7fa0d014b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.778+0000 7fa0d6beb700 1 -- 172.21.15.79:0/867085148 >> 172.21.15.79:0/867085148 conn(0x7fa0d006d000 msgr2=0x7fa0d00b4580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:12.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.778+0000 7fa0d6beb700 1 -- 172.21.15.79:0/867085148 shutdown_connections 2023-10-19T08:39:12.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.778+0000 7fa0d6beb700 1 -- 172.21.15.79:0/867085148 wait complete. 2023-10-19T08:39:12.793 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:39:12.915 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.912+0000 7f62c89fb700 1 Processor -- start 2023-10-19T08:39:12.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.912+0000 7f62c89fb700 1 -- start start 2023-10-19T08:39:12.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.913+0000 7f62c89fb700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f62c406a930 0x7f62c40cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:12.918 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.913+0000 7f62c89fb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c40703b0 0x7f62c40cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:12.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.913+0000 7f62c89fb700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c40b1fe0 con 0x7f62c40cd270 2023-10-19T08:39:12.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.913+0000 7f62c89fb700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c4160a80 con 0x7f62c406a930 2023-10-19T08:39:12.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.913+0000 7f62c89fb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40ce2b0 con 0x7f62c40703b0 2023-10-19T08:39:12.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.913+0000 7f62c1d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f62c406a930 0x7f62c40cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:12.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.913+0000 7f62c1d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f62c406a930 0x7f62c40cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48274/0 (socket says 172.21.15.79:48274) 2023-10-19T08:39:12.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.913+0000 7f62c1d9b700 1 -- 172.21.15.79:0/2400967061 learned_addr learned my addr 172.21.15.79:0/2400967061 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:12.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.913+0000 7f62c259c700 1 --1- 172.21.15.79:0/2400967061 >> v1:172.21.15.79:6789/0 conn(0x7f62c40cd270 0x7f62c406a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58344/0 (socket says 172.21.15.79:58344) 2023-10-19T08:39:12.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.913+0000 7f62c2d9d700 1 --2- 172.21.15.79:0/2400967061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c40703b0 0x7f62c40cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:12.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.913+0000 7f62c1d9b700 1 -- 172.21.15.79:0/2400967061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c40703b0 msgr2=0x7f62c40cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:12.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.914+0000 7f62c1d9b700 1 --2- 172.21.15.79:0/2400967061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c40703b0 0x7f62c40cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.914+0000 7f62c1d9b700 1 -- 172.21.15.79:0/2400967061 >> v1:172.21.15.79:6789/0 conn(0x7f62c40cd270 legacy=0x7f62c406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:12.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.914+0000 7f62c159a700 1 -- 172.21.15.79:0/2400967061 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727453352 0 0) 0x7f62c40b1fe0 con 0x7f62c40cd270 2023-10-19T08:39:12.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.914+0000 7f62c1d9b700 1 -- 172.21.15.79:0/2400967061 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c40ce550 con 0x7f62c406a930 2023-10-19T08:39:12.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.914+0000 7f62c1d9b700 1 --2- 172.21.15.79:0/2400967061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62c406a930 0x7f62c40cb290 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f62b40098f0 tx=0x7f62b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8458f2f8c60db8a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:12.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.914+0000 7f62c159a700 1 -- 172.21.15.79:0/2400967061 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b400b8a0 con 0x7f62c406a930 2023-10-19T08:39:12.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.914+0000 7f62c159a700 1 -- 172.21.15.79:0/2400967061 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b400ba00 con 0x7f62c406a930 2023-10-19T08:39:12.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.914+0000 7f62c159a700 1 -- 172.21.15.79:0/2400967061 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b400bd90 con 0x7f62c406a930 2023-10-19T08:39:12.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.914+0000 7f62c89fb700 1 -- 172.21.15.79:0/2400967061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62c406a930 msgr2=0x7f62c40cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:12.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.914+0000 7f62c89fb700 1 --2- 172.21.15.79:0/2400967061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62c406a930 0x7f62c40cb290 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f62b40098f0 tx=0x7f62b4009c00 comp rx=0 tx=0).stop 2023-10-19T08:39:12.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.914+0000 7f62c89fb700 1 -- 172.21.15.79:0/2400967061 shutdown_connections 2023-10-19T08:39:12.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.914+0000 7f62c89fb700 1 --2- 172.21.15.79:0/2400967061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c40703b0 0x7f62c40cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.923 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.914+0000 7f62c89fb700 1 --2- 172.21.15.79:0/2400967061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62c406a930 0x7f62c40cb290 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.914+0000 7f62c89fb700 1 -- 172.21.15.79:0/2400967061 >> 172.21.15.79:0/2400967061 conn(0x7f62c406dcc0 msgr2=0x7f62c406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:12.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.914+0000 7f62c89fb700 1 -- 172.21.15.79:0/2400967061 shutdown_connections 2023-10-19T08:39:12.924 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.915+0000 7f62c89fb700 1 -- 172.21.15.79:0/2400967061 wait complete. 2023-10-19T08:39:12.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.916+0000 7f62c89fb700 1 Processor -- start 2023-10-19T08:39:12.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.916+0000 7f62c89fb700 1 -- start start 2023-10-19T08:39:12.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c89fb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c406a930 0x7f62c4150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:12.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c89fb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62c40703b0 0x7f62c40b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c89fb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c40cd270 0x7f62c40b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c89fb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c414ed40 con 0x7f62c40703b0 2023-10-19T08:39:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c89fb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c414f020 con 0x7f62c40cd270 2023-10-19T08:39:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c89fb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4151310 con 0x7f62c406a930 2023-10-19T08:39:12.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c1d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62c40703b0 0x7f62c40b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c1d9b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62c40703b0 0x7f62c40b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48280/0 (socket says 172.21.15.79:48280) 2023-10-19T08:39:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c1d9b700 1 -- 172.21.15.79:0/21435657 learned_addr learned my addr 172.21.15.79:0/21435657 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c259c700 1 --2- 172.21.15.79:0/21435657 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c406a930 0x7f62c4150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c2d9d700 1 --2- 172.21.15.79:0/21435657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c40cd270 0x7f62c40b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:12.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c1d9b700 1 -- 172.21.15.79:0/21435657 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c406a930 msgr2=0x7f62c4150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:12.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c1d9b700 1 --2- 172.21.15.79:0/21435657 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c406a930 0x7f62c4150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c1d9b700 1 -- 172.21.15.79:0/21435657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c40cd270 msgr2=0x7f62c40b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:12.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c1d9b700 1 --2- 172.21.15.79:0/21435657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c40cd270 0x7f62c40b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:12.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c1d9b700 1 -- 172.21.15.79:0/21435657 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b4009550 con 0x7f62c40703b0 2023-10-19T08:39:12.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c259c700 1 --2- 172.21.15.79:0/21435657 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c406a930 0x7f62c4150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:12.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c1d9b700 1 --2- 172.21.15.79:0/21435657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62c40703b0 0x7f62c40b2d80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f62b4014040 tx=0x7f62b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:12.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62b2ffd700 1 -- 172.21.15.79:0/21435657 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b40036a0 con 0x7f62c40703b0 2023-10-19T08:39:12.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62b2ffd700 1 -- 172.21.15.79:0/21435657 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b401e070 con 0x7f62c40703b0 2023-10-19T08:39:12.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c89fb700 1 -- 172.21.15.79:0/21435657 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c41515c0 con 0x7f62c40703b0 2023-10-19T08:39:12.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62b2ffd700 1 -- 172.21.15.79:0/21435657 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4003a60 con 0x7f62c40703b0 2023-10-19T08:39:12.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.917+0000 7f62c89fb700 1 -- 172.21.15.79:0/21435657 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c4151b80 con 0x7f62c40703b0 2023-10-19T08:39:12.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.918+0000 7f62c89fb700 1 -- 172.21.15.79:0/21435657 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c404ee70 con 0x7f62c40703b0 2023-10-19T08:39:12.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.919+0000 7f62b2ffd700 1 -- 172.21.15.79:0/21435657 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f62b4003bc0 con 0x7f62c40703b0 2023-10-19T08:39:12.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.919+0000 7f62b2ffd700 1 --2- 172.21.15.79:0/21435657 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f62a406a0e0 0x7f62a406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:12.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.919+0000 7f62b2ffd700 1 -- 172.21.15.79:0/21435657 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f62b4020070 con 0x7f62c40703b0 2023-10-19T08:39:12.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.919+0000 7f62c259c700 1 --2- 172.21.15.79:0/21435657 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f62a406a0e0 0x7f62a406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:12.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.919+0000 7f62c259c700 1 --2- 172.21.15.79:0/21435657 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f62a406a0e0 0x7f62a406c5a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f62b8000f60 tx=0x7f62b8007ca0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:12.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:12.923+0000 7f62b2ffd700 1 -- 172.21.15.79:0/21435657 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f62b4055230 con 0x7f62c40703b0 2023-10-19T08:39:13.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.112+0000 7f62c89fb700 1 -- 172.21.15.79:0/21435657 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f62c414f160 con 0x7f62c40703b0 2023-10-19T08:39:13.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.112+0000 7f62b2ffd700 1 -- 172.21.15.79:0/21435657 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f62b402a020 con 0x7f62c40703b0 2023-10-19T08:39:13.129 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:39:13.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.114+0000 7f62c89fb700 1 -- 172.21.15.79:0/21435657 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f62a406a0e0 msgr2=0x7f62a406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:13.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.114+0000 7f62c89fb700 1 --2- 172.21.15.79:0/21435657 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f62a406a0e0 0x7f62a406c5a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f62b8000f60 tx=0x7f62b8007ca0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.114+0000 7f62c89fb700 1 -- 172.21.15.79:0/21435657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62c40703b0 msgr2=0x7f62c40b2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:13.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.114+0000 7f62c89fb700 1 --2- 172.21.15.79:0/21435657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62c40703b0 0x7f62c40b2d80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f62b4014040 tx=0x7f62b4004750 comp rx=0 tx=0).stop 2023-10-19T08:39:13.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.114+0000 7f62c89fb700 1 -- 172.21.15.79:0/21435657 shutdown_connections 2023-10-19T08:39:13.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.114+0000 7f62c89fb700 1 --2- 172.21.15.79:0/21435657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c40cd270 0x7f62c40b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.114+0000 7f62c89fb700 1 --2- 172.21.15.79:0/21435657 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f62a406a0e0 0x7f62a406c5a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.114+0000 7f62c89fb700 1 --2- 172.21.15.79:0/21435657 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62c406a930 0x7f62c4150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.114+0000 7f62c89fb700 1 --2- 172.21.15.79:0/21435657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62c40703b0 0x7f62c40b2d80 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.114+0000 7f62c89fb700 1 -- 172.21.15.79:0/21435657 >> 172.21.15.79:0/21435657 conn(0x7f62c406dcc0 msgr2=0x7f62c406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:13.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.114+0000 7f62c89fb700 1 -- 172.21.15.79:0/21435657 shutdown_connections 2023-10-19T08:39:13.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.114+0000 7f62c89fb700 1 -- 172.21.15.79:0/21435657 wait complete. 2023-10-19T08:39:13.133 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T08:39:13.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.263+0000 7feb3936a700 1 Processor -- start 2023-10-19T08:39:13.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.263+0000 7feb3936a700 1 -- start start 2023-10-19T08:39:13.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.263+0000 7feb3936a700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feb340cfd40 0x7feb340d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:13.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.263+0000 7feb3936a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb340d0660 con 0x7feb340d0ae0 2023-10-19T08:39:13.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.263+0000 7feb3936a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb340d1050 con 0x7feb3415d070 2023-10-19T08:39:13.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.263+0000 7feb3936a700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb340b6570 con 0x7feb340cfd40 2023-10-19T08:39:13.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.264+0000 7feb32ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7feb340cfd40 0x7feb340d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:13.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.264+0000 7feb337fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7feb340d0ae0 0x7feb340d20f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58362/0 (socket says 172.21.15.79:58362) 2023-10-19T08:39:13.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.264+0000 7feb337fe700 1 -- 172.21.15.79:0/3050789593 learned_addr learned my addr 172.21.15.79:0/3050789593 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:13.270 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.264+0000 7feb32ffd700 1 -- 172.21.15.79:0/3050789593 >> v1:172.21.15.89:6789/0 conn(0x7feb3415d070 legacy=0x7feb340b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:13.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.264+0000 7feb32ffd700 1 -- 172.21.15.79:0/3050789593 >> v1:172.21.15.79:6789/0 conn(0x7feb340d0ae0 legacy=0x7feb340d20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:13.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.264+0000 7feb32ffd700 1 -- 172.21.15.79:0/3050789593 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb340d1330 con 0x7feb340cfd40 2023-10-19T08:39:13.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.264+0000 7feb31ffb700 1 -- 172.21.15.79:0/3050789593 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715179882 0 0) 0x7feb340d0660 con 0x7feb340d0ae0 2023-10-19T08:39:13.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.264+0000 7feb32ffd700 1 --2- 172.21.15.79:0/3050789593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb340cfd40 0x7feb340d0120 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7feb24009820 tx=0x7feb24009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f7959c432263f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:13.271 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.264+0000 7feb31ffb700 1 -- 172.21.15.79:0/3050789593 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb24005e30 con 0x7feb340cfd40 2023-10-19T08:39:13.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.264+0000 7feb31ffb700 1 -- 172.21.15.79:0/3050789593 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb24006030 con 0x7feb340cfd40 2023-10-19T08:39:13.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.264+0000 7feb31ffb700 1 -- 172.21.15.79:0/3050789593 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb240063e0 con 0x7feb340cfd40 2023-10-19T08:39:13.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.265+0000 7feb3936a700 1 -- 172.21.15.79:0/3050789593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb340cfd40 msgr2=0x7feb340d0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:13.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.265+0000 7feb3936a700 1 --2- 172.21.15.79:0/3050789593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb340cfd40 0x7feb340d0120 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7feb24009820 tx=0x7feb24009b30 comp rx=0 tx=0).stop 2023-10-19T08:39:13.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.265+0000 7feb3936a700 1 -- 172.21.15.79:0/3050789593 shutdown_connections 2023-10-19T08:39:13.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.265+0000 7feb3936a700 1 --2- 172.21.15.79:0/3050789593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb340cfd40 0x7feb340d0120 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.265+0000 7feb3936a700 1 -- 172.21.15.79:0/3050789593 >> 172.21.15.79:0/3050789593 conn(0x7feb34071b30 msgr2=0x7feb34071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:13.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.265+0000 7feb3936a700 1 -- 172.21.15.79:0/3050789593 shutdown_connections 2023-10-19T08:39:13.273 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.265+0000 7feb3936a700 1 -- 172.21.15.79:0/3050789593 wait complete. 2023-10-19T08:39:13.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.266+0000 7feb3936a700 1 Processor -- start 2023-10-19T08:39:13.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.266+0000 7feb3936a700 1 -- start start 2023-10-19T08:39:13.276 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb3936a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb340cfd40 0x7feb3415d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:13.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb3936a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb340d0ae0 0x7feb340d2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:13.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb3936a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb3415d070 0x7feb3415f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:13.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb3936a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb341f36a0 con 0x7feb340cfd40 2023-10-19T08:39:13.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb3936a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb341f2b20 con 0x7feb340d0ae0 2023-10-19T08:39:13.277 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb3936a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb341f2e00 con 0x7feb3415d070 2023-10-19T08:39:13.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb32ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb340cfd40 0x7feb3415d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:13.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb32ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb340cfd40 0x7feb3415d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48292/0 (socket says 172.21.15.79:48292) 2023-10-19T08:39:13.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb32ffd700 1 -- 172.21.15.79:0/4284657797 learned_addr learned my addr 172.21.15.79:0/4284657797 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:13.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb327fc700 1 --2- 172.21.15.79:0/4284657797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb340d0ae0 0x7feb340d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:13.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb337fe700 1 --2- 172.21.15.79:0/4284657797 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb3415d070 0x7feb3415f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:13.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb32ffd700 1 -- 172.21.15.79:0/4284657797 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb3415d070 msgr2=0x7feb3415f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:13.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb32ffd700 1 --2- 172.21.15.79:0/4284657797 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb3415d070 0x7feb3415f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb32ffd700 1 -- 172.21.15.79:0/4284657797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb340d0ae0 msgr2=0x7feb340d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:13.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb32ffd700 1 --2- 172.21.15.79:0/4284657797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb340d0ae0 0x7feb340d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb32ffd700 1 -- 172.21.15.79:0/4284657797 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb24009430 con 0x7feb340cfd40 2023-10-19T08:39:13.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb327fc700 1 --2- 172.21.15.79:0/4284657797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb340d0ae0 0x7feb340d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:13.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb337fe700 1 --2- 172.21.15.79:0/4284657797 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb3415d070 0x7feb3415f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:13.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb32ffd700 1 --2- 172.21.15.79:0/4284657797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb340cfd40 0x7feb3415d450 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7feb24012000 tx=0x7feb24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:13.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb1b7fe700 1 -- 172.21.15.79:0/4284657797 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb24004240 con 0x7feb340cfd40 2023-10-19T08:39:13.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb1b7fe700 1 -- 172.21.15.79:0/4284657797 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb240043c0 con 0x7feb340cfd40 2023-10-19T08:39:13.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb3936a700 1 -- 172.21.15.79:0/4284657797 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb341f30e0 con 0x7feb340cfd40 2023-10-19T08:39:13.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.267+0000 7feb1b7fe700 1 -- 172.21.15.79:0/4284657797 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb240036a0 con 0x7feb340cfd40 2023-10-19T08:39:13.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.268+0000 7feb3936a700 1 -- 172.21.15.79:0/4284657797 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3415d990 con 0x7feb340cfd40 2023-10-19T08:39:13.281 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.268+0000 7feb3936a700 1 -- 172.21.15.79:0/4284657797 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb3404ee70 con 0x7feb340cfd40 2023-10-19T08:39:13.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.269+0000 7feb1b7fe700 1 -- 172.21.15.79:0/4284657797 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feb24022070 con 0x7feb340cfd40 2023-10-19T08:39:13.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.269+0000 7feb1b7fe700 1 --2- 172.21.15.79:0/4284657797 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7feb2006a0e0 0x7feb2006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:13.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.269+0000 7feb1b7fe700 1 -- 172.21.15.79:0/4284657797 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feb2408a1c0 con 0x7feb340cfd40 2023-10-19T08:39:13.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.269+0000 7feb327fc700 1 --2- 172.21.15.79:0/4284657797 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7feb2006a0e0 0x7feb2006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:13.282 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.270+0000 7feb327fc700 1 --2- 172.21.15.79:0/4284657797 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7feb2006a0e0 0x7feb2006c5a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7feb340b6350 tx=0x7feb28009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:13.283 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.273+0000 7feb1b7fe700 1 -- 172.21.15.79:0/4284657797 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7feb24055610 con 0x7feb340cfd40 2023-10-19T08:39:13.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.467+0000 7feb3936a700 1 -- 172.21.15.79:0/4284657797 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feb340d15e0 con 0x7feb340cfd40 2023-10-19T08:39:13.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.467+0000 7feb1b7fe700 1 -- 172.21.15.79:0/4284657797 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7feb24058c30 con 0x7feb340cfd40 2023-10-19T08:39:13.471 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:39:13.473 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.470+0000 7feb3936a700 1 -- 172.21.15.79:0/4284657797 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7feb2006a0e0 msgr2=0x7feb2006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:13.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.470+0000 7feb3936a700 1 --2- 172.21.15.79:0/4284657797 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7feb2006a0e0 0x7feb2006c5a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7feb340b6350 tx=0x7feb28009040 comp rx=0 tx=0).stop 2023-10-19T08:39:13.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.470+0000 7feb3936a700 1 -- 172.21.15.79:0/4284657797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb340cfd40 msgr2=0x7feb3415d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:13.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.470+0000 7feb3936a700 1 --2- 172.21.15.79:0/4284657797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb340cfd40 0x7feb3415d450 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7feb24012000 tx=0x7feb24004750 comp rx=0 tx=0).stop 2023-10-19T08:39:13.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.470+0000 7feb3936a700 1 -- 172.21.15.79:0/4284657797 shutdown_connections 2023-10-19T08:39:13.474 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.470+0000 7feb3936a700 1 --2- 172.21.15.79:0/4284657797 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7feb2006a0e0 0x7feb2006c5a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.470+0000 7feb3936a700 1 --2- 172.21.15.79:0/4284657797 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feb3415d070 0x7feb3415f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.470+0000 7feb3936a700 1 --2- 172.21.15.79:0/4284657797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb340cfd40 0x7feb3415d450 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.470+0000 7feb3936a700 1 --2- 172.21.15.79:0/4284657797 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb340d0ae0 0x7feb340d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.470+0000 7feb3936a700 1 -- 172.21.15.79:0/4284657797 >> 172.21.15.79:0/4284657797 conn(0x7feb34071b30 msgr2=0x7feb3415be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:13.475 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.470+0000 7feb3936a700 1 -- 172.21.15.79:0/4284657797 shutdown_connections 2023-10-19T08:39:13.476 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.470+0000 7feb3936a700 1 -- 172.21.15.79:0/4284657797 wait complete. 2023-10-19T08:39:13.485 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T08:39:13.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.609+0000 7f1dfb27f700 1 Processor -- start 2023-10-19T08:39:13.612 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.609+0000 7f1dfb27f700 1 -- start start 2023-10-19T08:39:13.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.610+0000 7f1dfb27f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1df40cc640 0x7f1df40cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:13.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.610+0000 7f1dfb27f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1df4159db0 0x7f1df40b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:13.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.610+0000 7f1dfb27f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df40ccf60 con 0x7f1df406fdc0 2023-10-19T08:39:13.615 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.610+0000 7f1dfb27f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df415d760 con 0x7f1df40cc640 2023-10-19T08:39:13.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.610+0000 7f1dfb27f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df415da40 con 0x7f1df4159db0 2023-10-19T08:39:13.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.610+0000 7f1df981c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1df406fdc0 0x7f1df40b1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58376/0 (socket says 172.21.15.79:58376) 2023-10-19T08:39:13.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.610+0000 7f1df981c700 1 -- 172.21.15.79:0/2587543990 learned_addr learned my addr 172.21.15.79:0/2587543990 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:13.616 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.610+0000 7f1df901b700 1 --2- 172.21.15.79:0/2587543990 >> v2:172.21.15.89:3300/0 conn(0x7f1df40cc640 0x7f1df40cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:13.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.610+0000 7f1df881a700 1 --2- 172.21.15.79:0/2587543990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1df4159db0 0x7f1df40b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:13.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.610+0000 7f1debfff700 1 -- 172.21.15.79:0/2587543990 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127376250 0 0) 0x7f1df40ccf60 con 0x7f1df406fdc0 2023-10-19T08:39:13.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.610+0000 7f1debfff700 1 -- 172.21.15.79:0/2587543990 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1de00035b0 con 0x7f1df406fdc0 2023-10-19T08:39:13.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.610+0000 7f1df901b700 1 -- 172.21.15.79:0/2587543990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1df4159db0 msgr2=0x7f1df40b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:13.617 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.610+0000 7f1df901b700 1 --2- 172.21.15.79:0/2587543990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1df4159db0 0x7f1df40b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.610+0000 7f1df901b700 1 -- 172.21.15.79:0/2587543990 >> v1:172.21.15.79:6789/0 conn(0x7f1df406fdc0 legacy=0x7f1df40b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:13.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.610+0000 7f1df901b700 1 -- 172.21.15.79:0/2587543990 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df415dd20 con 0x7f1df40cc640 2023-10-19T08:39:13.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.610+0000 7f1df901b700 1 --2- 172.21.15.79:0/2587543990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1df40cc640 0x7f1df40cca20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009840 tx=0x7f1de4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=664bb8a5d161c183 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:13.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.611+0000 7f1debfff700 1 -- 172.21.15.79:0/2587543990 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de4011830 con 0x7f1df40cc640 2023-10-19T08:39:13.618 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.611+0000 7f1debfff700 1 -- 172.21.15.79:0/2587543990 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de4011990 con 0x7f1df40cc640 2023-10-19T08:39:13.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.611+0000 7f1debfff700 1 -- 172.21.15.79:0/2587543990 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de4011d20 con 0x7f1df40cc640 2023-10-19T08:39:13.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.611+0000 7f1dfb27f700 1 -- 172.21.15.79:0/2587543990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1df40cc640 msgr2=0x7f1df40cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:13.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.611+0000 7f1dfb27f700 1 --2- 172.21.15.79:0/2587543990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1df40cc640 0x7f1df40cca20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1de4009840 tx=0x7f1de4009b50 comp rx=0 tx=0).stop 2023-10-19T08:39:13.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.611+0000 7f1dfb27f700 1 -- 172.21.15.79:0/2587543990 shutdown_connections 2023-10-19T08:39:13.619 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.611+0000 7f1dfb27f700 1 --2- 172.21.15.79:0/2587543990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1df40cc640 0x7f1df40cca20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.611+0000 7f1dfb27f700 1 --2- 172.21.15.79:0/2587543990 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1df4159db0 0x7f1df40b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.611+0000 7f1dfb27f700 1 -- 172.21.15.79:0/2587543990 >> 172.21.15.79:0/2587543990 conn(0x7f1df406dcc0 msgr2=0x7f1df406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:13.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.611+0000 7f1dfb27f700 1 -- 172.21.15.79:0/2587543990 shutdown_connections 2023-10-19T08:39:13.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.611+0000 7f1dfb27f700 1 -- 172.21.15.79:0/2587543990 wait complete. 2023-10-19T08:39:13.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.612+0000 7f1dfb27f700 1 Processor -- start 2023-10-19T08:39:13.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.612+0000 7f1dfb27f700 1 -- start start 2023-10-19T08:39:13.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.613+0000 7f1dfb27f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1df406fdc0 0x7f1df414f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:13.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.613+0000 7f1dfb27f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1df40cc640 0x7f1df4157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:13.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.613+0000 7f1dfb27f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1df4159db0 0x7f1df415a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:13.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.613+0000 7f1dfb27f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df414f8b0 con 0x7f1df4159db0 2023-10-19T08:39:13.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.613+0000 7f1dfb27f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40c70f0 con 0x7f1df40cc640 2023-10-19T08:39:13.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.613+0000 7f1dfb27f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40c73d0 con 0x7f1df406fdc0 2023-10-19T08:39:13.624 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.613+0000 7f1df981c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1df4159db0 0x7f1df415a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:13.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.613+0000 7f1df981c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1df4159db0 0x7f1df415a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48310/0 (socket says 172.21.15.79:48310) 2023-10-19T08:39:13.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.613+0000 7f1df981c700 1 -- 172.21.15.79:0/4227395834 learned_addr learned my addr 172.21.15.79:0/4227395834 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:13.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.613+0000 7f1df901b700 1 --2- 172.21.15.79:0/4227395834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1df406fdc0 0x7f1df414f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:13.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.613+0000 7f1df881a700 1 --2- 172.21.15.79:0/4227395834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1df40cc640 0x7f1df4157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:13.625 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.614+0000 7f1df981c700 1 -- 172.21.15.79:0/4227395834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1df406fdc0 msgr2=0x7f1df414f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:13.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.614+0000 7f1df981c700 1 --2- 172.21.15.79:0/4227395834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1df406fdc0 0x7f1df414f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.614+0000 7f1df981c700 1 -- 172.21.15.79:0/4227395834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1df40cc640 msgr2=0x7f1df4157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:13.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.614+0000 7f1df981c700 1 --2- 172.21.15.79:0/4227395834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1df40cc640 0x7f1df4157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.614+0000 7f1df981c700 1 -- 172.21.15.79:0/4227395834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de40094a0 con 0x7f1df4159db0 2023-10-19T08:39:13.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.614+0000 7f1df981c700 1 --2- 172.21.15.79:0/4227395834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1df4159db0 0x7f1df415a940 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00caa0 tx=0x7f1dec00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:13.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.614+0000 7f1de9ffb700 1 -- 172.21.15.79:0/4227395834 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec00a9e0 con 0x7f1df4159db0 2023-10-19T08:39:13.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.614+0000 7f1de9ffb700 1 -- 172.21.15.79:0/4227395834 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dec00ab40 con 0x7f1df4159db0 2023-10-19T08:39:13.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.614+0000 7f1dfb27f700 1 -- 172.21.15.79:0/4227395834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df4157e80 con 0x7f1df4159db0 2023-10-19T08:39:13.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.614+0000 7f1de9ffb700 1 -- 172.21.15.79:0/4227395834 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec012400 con 0x7f1df4159db0 2023-10-19T08:39:13.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.614+0000 7f1dfb27f700 1 -- 172.21.15.79:0/4227395834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df4158440 con 0x7f1df4159db0 2023-10-19T08:39:13.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.615+0000 7f1dfb27f700 1 -- 172.21.15.79:0/4227395834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df404ee70 con 0x7f1df4159db0 2023-10-19T08:39:13.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.615+0000 7f1de9ffb700 1 -- 172.21.15.79:0/4227395834 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1dec01b3b0 con 0x7f1df4159db0 2023-10-19T08:39:13.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.616+0000 7f1de9ffb700 1 --2- 172.21.15.79:0/4227395834 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1dd806a110 0x7f1dd806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:13.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.616+0000 7f1de9ffb700 1 -- 172.21.15.79:0/4227395834 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1dec0883f0 con 0x7f1df4159db0 2023-10-19T08:39:13.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.616+0000 7f1df901b700 1 --2- 172.21.15.79:0/4227395834 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1dd806a110 0x7f1dd806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:13.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.616+0000 7f1df901b700 1 --2- 172.21.15.79:0/4227395834 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1dd806a110 0x7f1dd806c5d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1de4000c00 tx=0x7f1de401c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:13.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.620+0000 7f1de9ffb700 1 -- 172.21.15.79:0/4227395834 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f1dec053880 con 0x7f1df4159db0 2023-10-19T08:39:13.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.809+0000 7f1dfb27f700 1 -- 172.21.15.79:0/4227395834 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1df40c7510 con 0x7f1df4159db0 2023-10-19T08:39:13.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.810+0000 7f1de9ffb700 1 -- 172.21.15.79:0/4227395834 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1dec056ea0 con 0x7f1df4159db0 2023-10-19T08:39:13.814 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-19T08:39:13.815 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.812+0000 7f1dfb27f700 1 -- 172.21.15.79:0/4227395834 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1dd806a110 msgr2=0x7f1dd806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:13.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.812+0000 7f1dfb27f700 1 --2- 172.21.15.79:0/4227395834 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1dd806a110 0x7f1dd806c5d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1de4000c00 tx=0x7f1de401c040 comp rx=0 tx=0).stop 2023-10-19T08:39:13.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.812+0000 7f1dfb27f700 1 -- 172.21.15.79:0/4227395834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1df4159db0 msgr2=0x7f1df415a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:13.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.812+0000 7f1dfb27f700 1 --2- 172.21.15.79:0/4227395834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1df4159db0 0x7f1df415a940 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00caa0 tx=0x7f1dec00cdb0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.812+0000 7f1dfb27f700 1 -- 172.21.15.79:0/4227395834 shutdown_connections 2023-10-19T08:39:13.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.812+0000 7f1dfb27f700 1 --2- 172.21.15.79:0/4227395834 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1df4159db0 0x7f1df415a940 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.812+0000 7f1dfb27f700 1 --2- 172.21.15.79:0/4227395834 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1dd806a110 0x7f1dd806c5d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.812+0000 7f1dfb27f700 1 --2- 172.21.15.79:0/4227395834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1df406fdc0 0x7f1df414f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.812+0000 7f1dfb27f700 1 --2- 172.21.15.79:0/4227395834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1df40cc640 0x7f1df4157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.812+0000 7f1dfb27f700 1 -- 172.21.15.79:0/4227395834 >> 172.21.15.79:0/4227395834 conn(0x7f1df406dcc0 msgr2=0x7f1df40cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:13.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.812+0000 7f1dfb27f700 1 -- 172.21.15.79:0/4227395834 shutdown_connections 2023-10-19T08:39:13.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.812+0000 7f1dfb27f700 1 -- 172.21.15.79:0/4227395834 wait complete. 2023-10-19T08:39:13.830 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T08:39:13.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.950+0000 7fdceb5a7700 1 Processor -- start 2023-10-19T08:39:13.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.950+0000 7fdceb5a7700 1 -- start start 2023-10-19T08:39:13.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.951+0000 7fdceb5a7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdce4159ee0 0x7fdce40b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:13.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.951+0000 7fdceb5a7700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdce40cecc0 0x7fdce406b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:13.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.951+0000 7fdceb5a7700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce40663c0 con 0x7fdce406dff0 2023-10-19T08:39:13.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.951+0000 7fdceb5a7700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce415a2c0 con 0x7fdce40cecc0 2023-10-19T08:39:13.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.951+0000 7fdceb5a7700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce40b5030 con 0x7fdce4159ee0 2023-10-19T08:39:13.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.951+0000 7fdce9b44700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdce40cecc0 0x7fdce406b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:13.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.951+0000 7fdce9b44700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdce40cecc0 0x7fdce406b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48318/0 (socket says 172.21.15.79:48318) 2023-10-19T08:39:13.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.951+0000 7fdce9b44700 1 -- 172.21.15.79:0/3389727811 learned_addr learned my addr 172.21.15.79:0/3389727811 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:13.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.952+0000 7fdce9343700 1 --2- 172.21.15.79:0/3389727811 >> v2:172.21.15.89:3300/0 conn(0x7fdce4159ee0 0x7fdce40b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:13.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.952+0000 7fdce9b44700 1 -- 172.21.15.79:0/3389727811 >> v2:172.21.15.89:3300/0 conn(0x7fdce4159ee0 msgr2=0x7fdce40b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:13.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.952+0000 7fdce9b44700 1 --2- 172.21.15.79:0/3389727811 >> v2:172.21.15.89:3300/0 conn(0x7fdce4159ee0 0x7fdce40b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.952+0000 7fdce9b44700 1 -- 172.21.15.79:0/3389727811 >> v1:172.21.15.89:6789/0 conn(0x7fdce406dff0 legacy=0x7fdce40cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:13.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.952+0000 7fdce9b44700 1 -- 172.21.15.79:0/3389727811 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce40b4d50 con 0x7fdce40cecc0 2023-10-19T08:39:13.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.952+0000 7fdce9b44700 1 --2- 172.21.15.79:0/3389727811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce40cecc0 0x7fdce406b080 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdce40b5310 tx=0x7fdcdc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a795fd2c31eb6bcf server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:13.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.952+0000 7fdcdbfff700 1 -- 172.21.15.79:0/3389727811 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc00e070 con 0x7fdce40cecc0 2023-10-19T08:39:13.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.952+0000 7fdcdbfff700 1 -- 172.21.15.79:0/3389727811 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc00b9c0 con 0x7fdce40cecc0 2023-10-19T08:39:13.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.952+0000 7fdcdbfff700 1 -- 172.21.15.79:0/3389727811 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc00bd70 con 0x7fdce40cecc0 2023-10-19T08:39:13.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.952+0000 7fdceb5a7700 1 -- 172.21.15.79:0/3389727811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce40cecc0 msgr2=0x7fdce406b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:13.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.952+0000 7fdceb5a7700 1 --2- 172.21.15.79:0/3389727811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce40cecc0 0x7fdce406b080 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdce40b5310 tx=0x7fdcdc00b330 comp rx=0 tx=0).stop 2023-10-19T08:39:13.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.952+0000 7fdceb5a7700 1 -- 172.21.15.79:0/3389727811 shutdown_connections 2023-10-19T08:39:13.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.952+0000 7fdceb5a7700 1 --2- 172.21.15.79:0/3389727811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce40cecc0 0x7fdce406b080 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.952+0000 7fdceb5a7700 1 --2- 172.21.15.79:0/3389727811 >> v2:172.21.15.89:3300/0 conn(0x7fdce4159ee0 0x7fdce40b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.953+0000 7fdceb5a7700 1 -- 172.21.15.79:0/3389727811 >> 172.21.15.79:0/3389727811 conn(0x7fdce406d000 msgr2=0x7fdce406d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:13.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.953+0000 7fdceb5a7700 1 -- 172.21.15.79:0/3389727811 shutdown_connections 2023-10-19T08:39:13.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.953+0000 7fdceb5a7700 1 -- 172.21.15.79:0/3389727811 wait complete. 2023-10-19T08:39:13.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.954+0000 7fdceb5a7700 1 Processor -- start 2023-10-19T08:39:13.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.954+0000 7fdceb5a7700 1 -- start start 2023-10-19T08:39:13.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.954+0000 7fdceb5a7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce406dff0 0x7fdce40c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:13.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.954+0000 7fdceb5a7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdce40cecc0 0x7fdce41f00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:13.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.954+0000 7fdceb5a7700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce4159ee0 0x7fdce4154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:13.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.955+0000 7fdceb5a7700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce40c9160 con 0x7fdce4159ee0 2023-10-19T08:39:13.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.955+0000 7fdceb5a7700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce41f36b0 con 0x7fdce406dff0 2023-10-19T08:39:13.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.955+0000 7fdceb5a7700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce41f0600 con 0x7fdce40cecc0 2023-10-19T08:39:13.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.955+0000 7fdce9b44700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce4159ee0 0x7fdce4154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.955+0000 7fdce9b44700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce4159ee0 0x7fdce4154620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48324/0 (socket says 172.21.15.79:48324) 2023-10-19T08:39:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.955+0000 7fdce9b44700 1 -- 172.21.15.79:0/2400880939 learned_addr learned my addr 172.21.15.79:0/2400880939 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.955+0000 7fdce9b44700 1 -- 172.21.15.79:0/2400880939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdce40cecc0 msgr2=0x7fdce41f00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.955+0000 7fdce9b44700 1 --2- 172.21.15.79:0/2400880939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdce40cecc0 0x7fdce41f00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.955+0000 7fdce9b44700 1 -- 172.21.15.79:0/2400880939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce406dff0 msgr2=0x7fdce40c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:13.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.955+0000 7fdce9343700 1 --2- 172.21.15.79:0/2400880939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce406dff0 0x7fdce40c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:13.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.955+0000 7fdce9b44700 1 --2- 172.21.15.79:0/2400880939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce406dff0 0x7fdce40c8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:13.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.955+0000 7fdce9b44700 1 -- 172.21.15.79:0/2400880939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc009b30 con 0x7fdce4159ee0 2023-10-19T08:39:13.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.955+0000 7fdce9b44700 1 --2- 172.21.15.79:0/2400880939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce4159ee0 0x7fdce4154620 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00b370 tx=0x7fdcdc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:13.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.955+0000 7fdcd9ffb700 1 -- 172.21.15.79:0/2400880939 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc0092e0 con 0x7fdce4159ee0 2023-10-19T08:39:13.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.955+0000 7fdcd9ffb700 1 -- 172.21.15.79:0/2400880939 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc01c440 con 0x7fdce4159ee0 2023-10-19T08:39:13.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.955+0000 7fdceb5a7700 1 -- 172.21.15.79:0/2400880939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce41f0860 con 0x7fdce4159ee0 2023-10-19T08:39:13.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.955+0000 7fdcd9ffb700 1 -- 172.21.15.79:0/2400880939 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc01c7f0 con 0x7fdce4159ee0 2023-10-19T08:39:13.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.955+0000 7fdceb5a7700 1 -- 172.21.15.79:0/2400880939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce41f0e20 con 0x7fdce4159ee0 2023-10-19T08:39:13.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.956+0000 7fdceb5a7700 1 -- 172.21.15.79:0/2400880939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce41f1040 con 0x7fdce4159ee0 2023-10-19T08:39:13.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.957+0000 7fdcd9ffb700 1 -- 172.21.15.79:0/2400880939 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdcdc01c950 con 0x7fdce4159ee0 2023-10-19T08:39:13.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.957+0000 7fdcd9ffb700 1 --2- 172.21.15.79:0/2400880939 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdcc806a0e0 0x7fdcc806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:13.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.958+0000 7fdcd9ffb700 1 -- 172.21.15.79:0/2400880939 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdcdc08a540 con 0x7fdce4159ee0 2023-10-19T08:39:13.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.958+0000 7fdce9343700 1 --2- 172.21.15.79:0/2400880939 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdcc806a0e0 0x7fdcc806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:13.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.958+0000 7fdce9343700 1 --2- 172.21.15.79:0/2400880939 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdcc806a0e0 0x7fdcc806c5a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdce40c3bd0 tx=0x7fdcd4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:13.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:13.962+0000 7fdcd9ffb700 1 -- 172.21.15.79:0/2400880939 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fdcdc055ab0 con 0x7fdce4159ee0 2023-10-19T08:39:14.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.153+0000 7fdceb5a7700 1 -- 172.21.15.79:0/2400880939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdce404ee70 con 0x7fdce4159ee0 2023-10-19T08:39:14.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.154+0000 7fdcd9ffb700 1 -- 172.21.15.79:0/2400880939 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdcdc0590d0 con 0x7fdce4159ee0 2023-10-19T08:39:14.158 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:39:14.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.156+0000 7fdceb5a7700 1 -- 172.21.15.79:0/2400880939 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdcc806a0e0 msgr2=0x7fdcc806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:14.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.156+0000 7fdceb5a7700 1 --2- 172.21.15.79:0/2400880939 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdcc806a0e0 0x7fdcc806c5a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdce40c3bd0 tx=0x7fdcd4008040 comp rx=0 tx=0).stop 2023-10-19T08:39:14.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.156+0000 7fdceb5a7700 1 -- 172.21.15.79:0/2400880939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce4159ee0 msgr2=0x7fdce4154620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:14.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.156+0000 7fdceb5a7700 1 --2- 172.21.15.79:0/2400880939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce4159ee0 0x7fdce4154620 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc00b370 tx=0x7fdcdc004ad0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.156+0000 7fdceb5a7700 1 -- 172.21.15.79:0/2400880939 shutdown_connections 2023-10-19T08:39:14.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.156+0000 7fdceb5a7700 1 --2- 172.21.15.79:0/2400880939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdce4159ee0 0x7fdce4154620 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.156+0000 7fdceb5a7700 1 --2- 172.21.15.79:0/2400880939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdce406dff0 0x7fdce40c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.156+0000 7fdceb5a7700 1 --2- 172.21.15.79:0/2400880939 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fdcc806a0e0 0x7fdcc806c5a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.156+0000 7fdceb5a7700 1 --2- 172.21.15.79:0/2400880939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdce40cecc0 0x7fdce41f00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.156+0000 7fdceb5a7700 1 -- 172.21.15.79:0/2400880939 >> 172.21.15.79:0/2400880939 conn(0x7fdce406d000 msgr2=0x7fdce406d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:14.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.156+0000 7fdceb5a7700 1 -- 172.21.15.79:0/2400880939 shutdown_connections 2023-10-19T08:39:14.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.156+0000 7fdceb5a7700 1 -- 172.21.15.79:0/2400880939 wait complete. 2023-10-19T08:39:14.172 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-19T08:39:14.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.290+0000 7f8602831700 1 Processor -- start 2023-10-19T08:39:14.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.290+0000 7f8602831700 1 -- start start 2023-10-19T08:39:14.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f8602831700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f85fc0af170 0x7f85fc0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:14.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f8602831700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85fc15de50 con 0x7f85fc0b2270 2023-10-19T08:39:14.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f8602831700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85fc15e130 con 0x7f85fc0b1de0 2023-10-19T08:39:14.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f8602831700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85fc0af550 con 0x7f85fc0af170 2023-10-19T08:39:14.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f8600dce700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f85fc0b2270 0x7f85fc06a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58404/0 (socket says 172.21.15.79:58404) 2023-10-19T08:39:14.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f8600dce700 1 -- 172.21.15.79:0/3049077326 learned_addr learned my addr 172.21.15.79:0/3049077326 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:14.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f85faffd700 1 -- 172.21.15.79:0/3049077326 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607340203 0 0) 0x7f85fc15de50 con 0x7f85fc0b2270 2023-10-19T08:39:14.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f85fbfff700 1 --2- 172.21.15.79:0/3049077326 >> v2:172.21.15.89:3300/0 conn(0x7f85fc0af170 0x7f85fc0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:14.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f85faffd700 1 -- 172.21.15.79:0/3049077326 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85e40035b0 con 0x7f85fc0b2270 2023-10-19T08:39:14.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f85faffd700 1 -- 172.21.15.79:0/3049077326 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1450638668 0 0) 0x7f85e40035b0 con 0x7f85fc0b2270 2023-10-19T08:39:14.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f85faffd700 1 -- 172.21.15.79:0/3049077326 >> v2:172.21.15.89:3300/0 conn(0x7f85fc0af170 msgr2=0x7f85fc0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:14.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f85faffd700 1 --2- 172.21.15.79:0/3049077326 >> v2:172.21.15.89:3300/0 conn(0x7f85fc0af170 0x7f85fc0cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f85faffd700 1 -- 172.21.15.79:0/3049077326 >> v1:172.21.15.89:6789/0 conn(0x7f85fc0b1de0 legacy=0x7f85fc0cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:14.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f85faffd700 1 -- 172.21.15.79:0/3049077326 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85fc15e410 con 0x7f85fc0b2270 2023-10-19T08:39:14.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f85faffd700 1 -- 172.21.15.79:0/3049077326 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f85f40019f0 con 0x7f85fc0b2270 2023-10-19T08:39:14.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f85faffd700 1 -- 172.21.15.79:0/3049077326 >> v1:172.21.15.79:6789/0 conn(0x7f85fc0b2270 legacy=0x7f85fc06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:14.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f85faffd700 1 --2- 172.21.15.79:0/3049077326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85e4003a00 0x7f85e4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:14.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f85faffd700 1 --2- 172.21.15.79:0/3049077326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85e4004850 0x7f85e4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:14.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f85faffd700 1 --2- 172.21.15.79:0/3049077326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85e4005210 0x7f85e400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:14.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f85faffd700 1 -- 172.21.15.79:0/3049077326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc0af550 con 0x7f85e4003a00 2023-10-19T08:39:14.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f85faffd700 1 -- 172.21.15.79:0/3049077326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e400c0b0 con 0x7f85e4005210 2023-10-19T08:39:14.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f85faffd700 1 -- 172.21.15.79:0/3049077326 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e400c270 con 0x7f85e4004850 2023-10-19T08:39:14.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f85fbfff700 1 --2- 172.21.15.79:0/3049077326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85e4003a00 0x7f85e4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:14.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f8600dce700 1 --2- 172.21.15.79:0/3049077326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85e4005210 0x7f85e400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:14.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.291+0000 7f85fb7fe700 1 --2- 172.21.15.79:0/3049077326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85e4004850 0x7f85e4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:14.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.292+0000 7f85fbfff700 1 -- 172.21.15.79:0/3049077326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85e4004850 msgr2=0x7f85e4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:14.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.292+0000 7f85fbfff700 1 --2- 172.21.15.79:0/3049077326 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85e4004850 0x7f85e4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.292+0000 7f85fbfff700 1 -- 172.21.15.79:0/3049077326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85e4005210 msgr2=0x7f85e400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:14.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.292+0000 7f85fbfff700 1 --2- 172.21.15.79:0/3049077326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85e4005210 0x7f85e400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.292+0000 7f85fbfff700 1 -- 172.21.15.79:0/3049077326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e40035b0 con 0x7f85e4003a00 2023-10-19T08:39:14.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.292+0000 7f8600dce700 1 --2- 172.21.15.79:0/3049077326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85e4005210 0x7f85e400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:14.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.292+0000 7f8600dce700 1 -- 172.21.15.79:0/3049077326 reap_dead start 2023-10-19T08:39:14.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.292+0000 7f85fbfff700 1 --2- 172.21.15.79:0/3049077326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85e4003a00 0x7f85e4003e20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f85ec009b60 tx=0x7f85e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ee32b188ce3e7c server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:14.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.292+0000 7f85faffd700 1 -- 172.21.15.79:0/3049077326 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec00e6c0 con 0x7f85e4003a00 2023-10-19T08:39:14.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.292+0000 7f85faffd700 1 -- 172.21.15.79:0/3049077326 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ec00e820 con 0x7f85e4003a00 2023-10-19T08:39:14.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.292+0000 7f85faffd700 1 -- 172.21.15.79:0/3049077326 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec00eb90 con 0x7f85e4003a00 2023-10-19T08:39:14.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.292+0000 7f8602831700 1 -- 172.21.15.79:0/3049077326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85e4003a00 msgr2=0x7f85e4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:14.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.292+0000 7f8602831700 1 --2- 172.21.15.79:0/3049077326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85e4003a00 0x7f85e4003e20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f85ec009b60 tx=0x7f85e4005880 comp rx=0 tx=0).stop 2023-10-19T08:39:14.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.292+0000 7f8602831700 1 -- 172.21.15.79:0/3049077326 shutdown_connections 2023-10-19T08:39:14.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.292+0000 7f8602831700 1 --2- 172.21.15.79:0/3049077326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85e4003a00 0x7f85e4003e20 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.292+0000 7f8602831700 1 -- 172.21.15.79:0/3049077326 >> 172.21.15.79:0/3049077326 conn(0x7f85fc06dcc0 msgr2=0x7f85fc06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:14.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.292+0000 7f8602831700 1 -- 172.21.15.79:0/3049077326 shutdown_connections 2023-10-19T08:39:14.305 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.292+0000 7f8602831700 1 -- 172.21.15.79:0/3049077326 wait complete. 2023-10-19T08:39:14.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.294+0000 7f8602831700 1 Processor -- start 2023-10-19T08:39:14.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.294+0000 7f8602831700 1 -- start start 2023-10-19T08:39:14.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.295+0000 7f8602831700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85e4003a00 0x7f85fc155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:14.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.295+0000 7f8602831700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85fc0c8940 0x7f85fc0c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:14.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.295+0000 7f8602831700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85fc15ee60 0x7f85fc15f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:14.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.295+0000 7f8602831700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc0c9a50 con 0x7f85fc15ee60 2023-10-19T08:39:14.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.295+0000 7f8602831700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc15f830 con 0x7f85fc0c8940 2023-10-19T08:39:14.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.295+0000 7f8602831700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc0c8dd0 con 0x7f85e4003a00 2023-10-19T08:39:14.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.295+0000 7f8600dce700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85fc15ee60 0x7f85fc15f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:14.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.295+0000 7f8600dce700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85fc15ee60 0x7f85fc15f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48344/0 (socket says 172.21.15.79:48344) 2023-10-19T08:39:14.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.295+0000 7f8600dce700 1 -- 172.21.15.79:0/2935537549 learned_addr learned my addr 172.21.15.79:0/2935537549 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:14.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.295+0000 7f85fbfff700 1 --2- 172.21.15.79:0/2935537549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85e4003a00 0x7f85fc155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:14.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.295+0000 7f85fb7fe700 1 --2- 172.21.15.79:0/2935537549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85fc0c8940 0x7f85fc0c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:14.310 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.295+0000 7f8600dce700 1 -- 172.21.15.79:0/2935537549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85e4003a00 msgr2=0x7f85fc155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:14.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.295+0000 7f8600dce700 1 --2- 172.21.15.79:0/2935537549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85e4003a00 0x7f85fc155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.295+0000 7f8600dce700 1 -- 172.21.15.79:0/2935537549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85fc0c8940 msgr2=0x7f85fc0c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:14.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.295+0000 7f8600dce700 1 --2- 172.21.15.79:0/2935537549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85fc0c8940 0x7f85fc0c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.295+0000 7f8600dce700 1 -- 172.21.15.79:0/2935537549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85fc0c90b0 con 0x7f85fc15ee60 2023-10-19T08:39:14.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.296+0000 7f8600dce700 1 --2- 172.21.15.79:0/2935537549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85fc15ee60 0x7f85fc15f2f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f85f4000f80 tx=0x7f85f400e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:14.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.296+0000 7f85f8ff9700 1 -- 172.21.15.79:0/2935537549 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f400ed90 con 0x7f85fc15ee60 2023-10-19T08:39:14.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.296+0000 7f85f8ff9700 1 -- 172.21.15.79:0/2935537549 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f4013420 con 0x7f85fc15ee60 2023-10-19T08:39:14.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.296+0000 7f8602831700 1 -- 172.21.15.79:0/2935537549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85fc0c9390 con 0x7f85fc15ee60 2023-10-19T08:39:14.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.296+0000 7f85f8ff9700 1 -- 172.21.15.79:0/2935537549 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f40137d0 con 0x7f85fc15ee60 2023-10-19T08:39:14.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.296+0000 7f8602831700 1 -- 172.21.15.79:0/2935537549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85fc0c84f0 con 0x7f85fc15ee60 2023-10-19T08:39:14.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.297+0000 7f8602831700 1 -- 172.21.15.79:0/2935537549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85fc0c9b90 con 0x7f85fc15ee60 2023-10-19T08:39:14.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.297+0000 7f85f8ff9700 1 -- 172.21.15.79:0/2935537549 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f85f4013930 con 0x7f85fc15ee60 2023-10-19T08:39:14.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.298+0000 7f85f8ff9700 1 --2- 172.21.15.79:0/2935537549 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f85e806a0e0 0x7f85e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:14.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.298+0000 7f85f8ff9700 1 -- 172.21.15.79:0/2935537549 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f85f4088e40 con 0x7f85fc15ee60 2023-10-19T08:39:14.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.298+0000 7f85fbfff700 1 --2- 172.21.15.79:0/2935537549 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f85e806a0e0 0x7f85e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:14.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.298+0000 7f85fbfff700 1 --2- 172.21.15.79:0/2935537549 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f85e806a0e0 0x7f85e806c5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f85ec0090b0 tx=0x7f85ec008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:14.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.302+0000 7f85f8ff9700 1 -- 172.21.15.79:0/2935537549 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f85fc0c9b90 con 0x7f85fc15ee60 2023-10-19T08:39:14.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.509+0000 7f8602831700 1 -- 172.21.15.79:0/2935537549 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f85fc0c9b90 con 0x7f85fc15ee60 2023-10-19T08:39:14.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.510+0000 7f85f8ff9700 1 -- 172.21.15.79:0/2935537549 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f85fc0c9b90 con 0x7f85fc15ee60 2023-10-19T08:39:14.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.512+0000 7f8602831700 1 -- 172.21.15.79:0/2935537549 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f85e806a0e0 msgr2=0x7f85e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:14.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.512+0000 7f8602831700 1 --2- 172.21.15.79:0/2935537549 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f85e806a0e0 0x7f85e806c5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f85ec0090b0 tx=0x7f85ec008030 comp rx=0 tx=0).stop 2023-10-19T08:39:14.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.512+0000 7f8602831700 1 -- 172.21.15.79:0/2935537549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85fc15ee60 msgr2=0x7f85fc15f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:14.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.512+0000 7f8602831700 1 --2- 172.21.15.79:0/2935537549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85fc15ee60 0x7f85fc15f2f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f85f4000f80 tx=0x7f85f400e440 comp rx=0 tx=0).stop 2023-10-19T08:39:14.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.512+0000 7f8602831700 1 -- 172.21.15.79:0/2935537549 shutdown_connections 2023-10-19T08:39:14.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.512+0000 7f8602831700 1 --2- 172.21.15.79:0/2935537549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85fc15ee60 0x7f85fc15f2f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.512+0000 7f8602831700 1 --2- 172.21.15.79:0/2935537549 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f85e806a0e0 0x7f85e806c5a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.512+0000 7f8602831700 1 --2- 172.21.15.79:0/2935537549 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85e4003a00 0x7f85fc155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.517 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.512+0000 7f8602831700 1 --2- 172.21.15.79:0/2935537549 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85fc0c8940 0x7f85fc0c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.512+0000 7f8602831700 1 -- 172.21.15.79:0/2935537549 >> 172.21.15.79:0/2935537549 conn(0x7f85fc06dcc0 msgr2=0x7f85fc0cdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:14.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.512+0000 7f8602831700 1 -- 172.21.15.79:0/2935537549 shutdown_connections 2023-10-19T08:39:14.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.512+0000 7f8602831700 1 -- 172.21.15.79:0/2935537549 wait complete. 2023-10-19T08:39:14.519 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2023-10-19T08:39:14.527 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:39:14.528 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T08:39:14.549 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:39:14.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.667+0000 7fe2cda7c700 1 Processor -- start 2023-10-19T08:39:14.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.667+0000 7fe2cda7c700 1 -- start start 2023-10-19T08:39:14.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.668+0000 7fe2cda7c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2c80d14f0 0x7fe2c80ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:14.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.668+0000 7fe2cda7c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe2c80adee0 0x7fe2c80b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:14.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.668+0000 7fe2cda7c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c806c5a0 con 0x7fe2c80b0710 2023-10-19T08:39:14.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.668+0000 7fe2cda7c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c8160cb0 con 0x7fe2c80adee0 2023-10-19T08:39:14.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.668+0000 7fe2cda7c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c806bd40 con 0x7fe2c80d14f0 2023-10-19T08:39:14.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.668+0000 7fe2c77fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe2c80b0710 0x7fe2c80b0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58420/0 (socket says 172.21.15.79:58420) 2023-10-19T08:39:14.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.668+0000 7fe2c77fe700 1 -- 172.21.15.79:0/2460469788 learned_addr learned my addr 172.21.15.79:0/2460469788 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:14.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.668+0000 7fe2c6ffd700 1 --2- 172.21.15.79:0/2460469788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2c80d14f0 0x7fe2c80ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:14.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.668+0000 7fe2c7fff700 1 --2- 172.21.15.79:0/2460469788 >> v2:172.21.15.89:3300/0 conn(0x7fe2c80adee0 0x7fe2c80b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:14.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.668+0000 7fe2c67fc700 1 -- 172.21.15.79:0/2460469788 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415465421 0 0) 0x7fe2c806c5a0 con 0x7fe2c80b0710 2023-10-19T08:39:14.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.668+0000 7fe2c67fc700 1 -- 172.21.15.79:0/2460469788 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2b00035b0 con 0x7fe2c80b0710 2023-10-19T08:39:14.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c67fc700 1 -- 172.21.15.79:0/2460469788 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3967973758 0 0) 0x7fe2b00035b0 con 0x7fe2c80b0710 2023-10-19T08:39:14.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c67fc700 1 -- 172.21.15.79:0/2460469788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2c80d14f0 msgr2=0x7fe2c80ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:14.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c67fc700 1 --2- 172.21.15.79:0/2460469788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2c80d14f0 0x7fe2c80ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c67fc700 1 -- 172.21.15.79:0/2460469788 >> v2:172.21.15.89:3300/0 conn(0x7fe2c80adee0 msgr2=0x7fe2c80b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:14.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c67fc700 1 --2- 172.21.15.79:0/2460469788 >> v2:172.21.15.89:3300/0 conn(0x7fe2c80adee0 0x7fe2c80b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c67fc700 1 -- 172.21.15.79:0/2460469788 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c806bfe0 con 0x7fe2c80b0710 2023-10-19T08:39:14.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c67fc700 1 -- 172.21.15.79:0/2460469788 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7fe2bc001670 con 0x7fe2c80b0710 2023-10-19T08:39:14.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c67fc700 1 -- 172.21.15.79:0/2460469788 >> v1:172.21.15.79:6789/0 conn(0x7fe2c80b0710 legacy=0x7fe2c80b0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:14.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c67fc700 1 --2- 172.21.15.79:0/2460469788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2c80d14f0 0x7fe2b0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:14.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c67fc700 1 --2- 172.21.15.79:0/2460469788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b0003fd0 0x7fe2b0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:14.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c67fc700 1 --2- 172.21.15.79:0/2460469788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2b0004d90 0x7fe2b0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:14.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c67fc700 1 -- 172.21.15.79:0/2460469788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c8160cb0 con 0x7fe2b0003fd0 2023-10-19T08:39:14.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c67fc700 1 -- 172.21.15.79:0/2460469788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c806bd40 con 0x7fe2b0004d90 2023-10-19T08:39:14.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c67fc700 1 -- 172.21.15.79:0/2460469788 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b000ba10 con 0x7fe2c80d14f0 2023-10-19T08:39:14.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c6ffd700 1 --2- 172.21.15.79:0/2460469788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b0003fd0 0x7fe2b0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:14.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c77fe700 1 --2- 172.21.15.79:0/2460469788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2c80d14f0 0x7fe2b0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:14.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c7fff700 1 --2- 172.21.15.79:0/2460469788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2b0004d90 0x7fe2b0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:14.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c6ffd700 1 -- 172.21.15.79:0/2460469788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2c80d14f0 msgr2=0x7fe2b0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:14.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c6ffd700 1 --2- 172.21.15.79:0/2460469788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2c80d14f0 0x7fe2b0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c6ffd700 1 -- 172.21.15.79:0/2460469788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2b0004d90 msgr2=0x7fe2b0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:14.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c6ffd700 1 --2- 172.21.15.79:0/2460469788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2b0004d90 0x7fe2b0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c6ffd700 1 -- 172.21.15.79:0/2460469788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b00035b0 con 0x7fe2b0003fd0 2023-10-19T08:39:14.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c6ffd700 1 --2- 172.21.15.79:0/2460469788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b0003fd0 0x7fe2b0004850 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009b90 tx=0x7fe2b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9aabf0d4b3bf56 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:14.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c67fc700 1 -- 172.21.15.79:0/2460469788 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800e6c0 con 0x7fe2b0003fd0 2023-10-19T08:39:14.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c67fc700 1 -- 172.21.15.79:0/2460469788 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b800e820 con 0x7fe2b0003fd0 2023-10-19T08:39:14.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.669+0000 7fe2c67fc700 1 -- 172.21.15.79:0/2460469788 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800eb90 con 0x7fe2b0003fd0 2023-10-19T08:39:14.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.670+0000 7fe2cda7c700 1 -- 172.21.15.79:0/2460469788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b0003fd0 msgr2=0x7fe2b0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:14.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.670+0000 7fe2cda7c700 1 --2- 172.21.15.79:0/2460469788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b0003fd0 0x7fe2b0004850 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009b90 tx=0x7fe2b0005880 comp rx=0 tx=0).stop 2023-10-19T08:39:14.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.670+0000 7fe2c7fff700 1 -- 172.21.15.79:0/2460469788 reap_dead start 2023-10-19T08:39:14.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.670+0000 7fe2cda7c700 1 -- 172.21.15.79:0/2460469788 shutdown_connections 2023-10-19T08:39:14.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.670+0000 7fe2cda7c700 1 -- 172.21.15.79:0/2460469788 >> 172.21.15.79:0/2460469788 conn(0x7fe2c809a0b0 msgr2=0x7fe2c80d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:14.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.670+0000 7fe2cda7c700 1 -- 172.21.15.79:0/2460469788 shutdown_connections 2023-10-19T08:39:14.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.670+0000 7fe2cda7c700 1 -- 172.21.15.79:0/2460469788 wait complete. 2023-10-19T08:39:14.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.671+0000 7fe2cda7c700 1 Processor -- start 2023-10-19T08:39:14.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.671+0000 7fe2cda7c700 1 -- start start 2023-10-19T08:39:14.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.672+0000 7fe2cda7c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b0003fd0 0x7fe2c80cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:14.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.672+0000 7fe2cda7c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2c8070640 0x7fe2c80c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:14.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.672+0000 7fe2cda7c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2c80c6bf0 0x7fe2c80c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:14.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.672+0000 7fe2cda7c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c80cf810 con 0x7fe2b0003fd0 2023-10-19T08:39:14.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.672+0000 7fe2cda7c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c80c7ca0 con 0x7fe2c80c6bf0 2023-10-19T08:39:14.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.672+0000 7fe2cda7c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c80c7120 con 0x7fe2c8070640 2023-10-19T08:39:14.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.672+0000 7fe2c77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b0003fd0 0x7fe2c80cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:14.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.672+0000 7fe2c77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b0003fd0 0x7fe2c80cf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48358/0 (socket says 172.21.15.79:48358) 2023-10-19T08:39:14.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.672+0000 7fe2c77fe700 1 -- 172.21.15.79:0/4059740134 learned_addr learned my addr 172.21.15.79:0/4059740134 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:14.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.672+0000 7fe2c6ffd700 1 --2- 172.21.15.79:0/4059740134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2c8070640 0x7fe2c80c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:14.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.672+0000 7fe2c7fff700 1 --2- 172.21.15.79:0/4059740134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2c80c6bf0 0x7fe2c80c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:14.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.673+0000 7fe2c77fe700 1 -- 172.21.15.79:0/4059740134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2c8070640 msgr2=0x7fe2c80c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:14.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.673+0000 7fe2c77fe700 1 --2- 172.21.15.79:0/4059740134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2c8070640 0x7fe2c80c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.673+0000 7fe2c77fe700 1 -- 172.21.15.79:0/4059740134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2c80c6bf0 msgr2=0x7fe2c80c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:14.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.673+0000 7fe2c77fe700 1 --2- 172.21.15.79:0/4059740134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2c80c6bf0 0x7fe2c80c4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.673+0000 7fe2c77fe700 1 -- 172.21.15.79:0/4059740134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c80c7400 con 0x7fe2b0003fd0 2023-10-19T08:39:14.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.673+0000 7fe2c6ffd700 1 --2- 172.21.15.79:0/4059740134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2c8070640 0x7fe2c80c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:14.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.673+0000 7fe2c7fff700 1 --2- 172.21.15.79:0/4059740134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2c80c6bf0 0x7fe2c80c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:14.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.673+0000 7fe2c77fe700 1 --2- 172.21.15.79:0/4059740134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b0003fd0 0x7fe2c80cf2d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc007310 tx=0x7fe2bc0076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:14.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.673+0000 7fe2affff700 1 -- 172.21.15.79:0/4059740134 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc0077f0 con 0x7fe2b0003fd0 2023-10-19T08:39:14.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.673+0000 7fe2affff700 1 -- 172.21.15.79:0/4059740134 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc00f8d0 con 0x7fe2b0003fd0 2023-10-19T08:39:14.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.673+0000 7fe2cda7c700 1 -- 172.21.15.79:0/4059740134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c80c76e0 con 0x7fe2b0003fd0 2023-10-19T08:39:14.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.673+0000 7fe2affff700 1 -- 172.21.15.79:0/4059740134 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc00fc80 con 0x7fe2b0003fd0 2023-10-19T08:39:14.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.673+0000 7fe2cda7c700 1 -- 172.21.15.79:0/4059740134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c80c4d80 con 0x7fe2b0003fd0 2023-10-19T08:39:14.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.674+0000 7fe2cda7c700 1 -- 172.21.15.79:0/4059740134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c804ee70 con 0x7fe2b0003fd0 2023-10-19T08:39:14.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.674+0000 7fe2affff700 1 -- 172.21.15.79:0/4059740134 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe2bc01d460 con 0x7fe2b0003fd0 2023-10-19T08:39:14.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.675+0000 7fe2affff700 1 --2- 172.21.15.79:0/4059740134 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe2b406a0e0 0x7fe2b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:14.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.675+0000 7fe2affff700 1 -- 172.21.15.79:0/4059740134 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe2bc0889a0 con 0x7fe2b0003fd0 2023-10-19T08:39:14.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.675+0000 7fe2c6ffd700 1 --2- 172.21.15.79:0/4059740134 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe2b406a0e0 0x7fe2b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:14.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.675+0000 7fe2c6ffd700 1 --2- 172.21.15.79:0/4059740134 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe2b406a0e0 0x7fe2b406c5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80090b0 tx=0x7fe2b8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:14.692 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.679+0000 7fe2affff700 1 -- 172.21.15.79:0/4059740134 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fe2bc053d60 con 0x7fe2b0003fd0 2023-10-19T08:39:14.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.870+0000 7fe2cda7c700 1 -- 172.21.15.79:0/4059740134 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2c814a810 con 0x7fe2b0003fd0 2023-10-19T08:39:14.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.871+0000 7fe2affff700 1 -- 172.21.15.79:0/4059740134 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20155 (secure 0 0 0) 0x7fe2bc086e60 con 0x7fe2b0003fd0 2023-10-19T08:39:14.875 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:14.875 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:44.473795+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:39:14.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.873+0000 7fe2cda7c700 1 -- 172.21.15.79:0/4059740134 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe2b406a0e0 msgr2=0x7fe2b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:14.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.873+0000 7fe2cda7c700 1 --2- 172.21.15.79:0/4059740134 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe2b406a0e0 0x7fe2b406c5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80090b0 tx=0x7fe2b8008030 comp rx=0 tx=0).stop 2023-10-19T08:39:14.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.873+0000 7fe2cda7c700 1 -- 172.21.15.79:0/4059740134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b0003fd0 msgr2=0x7fe2c80cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:14.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.873+0000 7fe2cda7c700 1 --2- 172.21.15.79:0/4059740134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b0003fd0 0x7fe2c80cf2d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc007310 tx=0x7fe2bc0076d0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.873+0000 7fe2cda7c700 1 -- 172.21.15.79:0/4059740134 shutdown_connections 2023-10-19T08:39:14.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.873+0000 7fe2cda7c700 1 --2- 172.21.15.79:0/4059740134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2c80c6bf0 0x7fe2c80c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.873+0000 7fe2cda7c700 1 --2- 172.21.15.79:0/4059740134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe2b0003fd0 0x7fe2c80cf2d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.873+0000 7fe2cda7c700 1 --2- 172.21.15.79:0/4059740134 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe2b406a0e0 0x7fe2b406c5a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.873+0000 7fe2cda7c700 1 --2- 172.21.15.79:0/4059740134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe2c8070640 0x7fe2c80c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:14.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.873+0000 7fe2cda7c700 1 -- 172.21.15.79:0/4059740134 >> 172.21.15.79:0/4059740134 conn(0x7fe2c809a0b0 msgr2=0x7fe2c80cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:14.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.873+0000 7fe2cda7c700 1 -- 172.21.15.79:0/4059740134 shutdown_connections 2023-10-19T08:39:14.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:14.873+0000 7fe2cda7c700 1 -- 172.21.15.79:0/4059740134 wait complete. 2023-10-19T08:39:14.889 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T08:37:54.318159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T08:37:55.629862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T08:37:59.333062+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T08:39:14.890 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:39:15.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.009+0000 7f1f0f6d8700 1 Processor -- start 2023-10-19T08:39:15.012 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.009+0000 7f1f0f6d8700 1 -- start start 2023-10-19T08:39:15.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1f0f6d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f080cc640 0x7f1f080cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1f0f6d8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1f080ceaf0 0x7f1f080b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1f0f6d8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f080ccf60 con 0x7f1f08159db0 2023-10-19T08:39:15.016 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1f0f6d8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f0815d760 con 0x7f1f080ceaf0 2023-10-19T08:39:15.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1f0f6d8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0815da40 con 0x7f1f080cc640 2023-10-19T08:39:15.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1f0cc73700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1f08159db0 0x7f1f080b16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58440/0 (socket says 172.21.15.79:58440) 2023-10-19T08:39:15.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1f0cc73700 1 -- 172.21.15.79:0/816326886 learned_addr learned my addr 172.21.15.79:0/816326886 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:15.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1f0dc75700 1 --2- 172.21.15.79:0/816326886 >> v2:172.21.15.89:3300/0 conn(0x7f1f080ceaf0 0x7f1f080b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.017 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1f0d474700 1 --2- 172.21.15.79:0/816326886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f080cc640 0x7f1f080cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1efffff700 1 -- 172.21.15.79:0/816326886 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234465066 0 0) 0x7f1f080ccf60 con 0x7f1f08159db0 2023-10-19T08:39:15.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1efffff700 1 -- 172.21.15.79:0/816326886 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ef40035b0 con 0x7f1f08159db0 2023-10-19T08:39:15.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1efffff700 1 -- 172.21.15.79:0/816326886 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4043016188 0 0) 0x7f1ef40035b0 con 0x7f1f08159db0 2023-10-19T08:39:15.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1efffff700 1 -- 172.21.15.79:0/816326886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f080cc640 msgr2=0x7f1f080cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:15.018 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1efffff700 1 --2- 172.21.15.79:0/816326886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f080cc640 0x7f1f080cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1efffff700 1 -- 172.21.15.79:0/816326886 >> v2:172.21.15.89:3300/0 conn(0x7f1f080ceaf0 msgr2=0x7f1f080b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:15.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1efffff700 1 --2- 172.21.15.79:0/816326886 >> v2:172.21.15.89:3300/0 conn(0x7f1f080ceaf0 0x7f1f080b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1efffff700 1 -- 172.21.15.79:0/816326886 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0815dd20 con 0x7f1f08159db0 2023-10-19T08:39:15.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1efffff700 1 -- 172.21.15.79:0/816326886 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f1ef8001670 con 0x7f1f08159db0 2023-10-19T08:39:15.019 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1efffff700 1 -- 172.21.15.79:0/816326886 >> v1:172.21.15.79:6789/0 conn(0x7f1f08159db0 legacy=0x7f1f080b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:15.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1efffff700 1 --2- 172.21.15.79:0/816326886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ef4003a70 0x7f1ef4003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1efffff700 1 --2- 172.21.15.79:0/816326886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f080cc640 0x7f1ef4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1efffff700 1 --2- 172.21.15.79:0/816326886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ef4004d90 0x7f1ef4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1efffff700 1 -- 172.21.15.79:0/816326886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0815d760 con 0x7f1ef4004d90 2023-10-19T08:39:15.020 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1efffff700 1 -- 172.21.15.79:0/816326886 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0815da40 con 0x7f1ef4003a70 2023-10-19T08:39:15.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.010+0000 7f1efffff700 1 -- 172.21.15.79:0/816326886 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef400ba10 con 0x7f1f080cc640 2023-10-19T08:39:15.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.011+0000 7f1f0dc75700 1 --2- 172.21.15.79:0/816326886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ef4004d90 0x7f1ef4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.011+0000 7f1f0d474700 1 --2- 172.21.15.79:0/816326886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ef4003a70 0x7f1ef4003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.011+0000 7f1f0cc73700 1 --2- 172.21.15.79:0/816326886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f080cc640 0x7f1ef4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.021 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.011+0000 7f1f0dc75700 1 -- 172.21.15.79:0/816326886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f080cc640 msgr2=0x7f1ef4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:15.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.011+0000 7f1f0dc75700 1 --2- 172.21.15.79:0/816326886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f080cc640 0x7f1ef4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.011+0000 7f1f0dc75700 1 -- 172.21.15.79:0/816326886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ef4003a70 msgr2=0x7f1ef4003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:15.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.011+0000 7f1f0dc75700 1 --2- 172.21.15.79:0/816326886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ef4003a70 0x7f1ef4003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.011+0000 7f1f0dc75700 1 -- 172.21.15.79:0/816326886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef40035b0 con 0x7f1ef4004d90 2023-10-19T08:39:15.022 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.011+0000 7f1f0dc75700 1 --2- 172.21.15.79:0/816326886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ef4004d90 0x7f1ef4005210 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009fc0 tx=0x7f1ef4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b1972d0db2787c server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:15.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.011+0000 7f1efffff700 1 -- 172.21.15.79:0/816326886 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0000ec30 con 0x7f1ef4004d90 2023-10-19T08:39:15.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.011+0000 7f1efffff700 1 -- 172.21.15.79:0/816326886 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0000f040 con 0x7f1ef4004d90 2023-10-19T08:39:15.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.011+0000 7f1efffff700 1 -- 172.21.15.79:0/816326886 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f00014480 con 0x7f1ef4004d90 2023-10-19T08:39:15.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.012+0000 7f1f0f6d8700 1 -- 172.21.15.79:0/816326886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ef4004d90 msgr2=0x7f1ef4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:15.023 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.012+0000 7f1f0f6d8700 1 --2- 172.21.15.79:0/816326886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ef4004d90 0x7f1ef4005210 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009fc0 tx=0x7f1ef4005880 comp rx=0 tx=0).stop 2023-10-19T08:39:15.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.012+0000 7f1f0dc75700 1 -- 172.21.15.79:0/816326886 reap_dead start 2023-10-19T08:39:15.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.012+0000 7f1f0f6d8700 1 -- 172.21.15.79:0/816326886 shutdown_connections 2023-10-19T08:39:15.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.012+0000 7f1f0f6d8700 1 -- 172.21.15.79:0/816326886 >> 172.21.15.79:0/816326886 conn(0x7f1f0806dcc0 msgr2=0x7f1f0806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:15.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.012+0000 7f1f0f6d8700 1 -- 172.21.15.79:0/816326886 shutdown_connections 2023-10-19T08:39:15.024 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.012+0000 7f1f0f6d8700 1 -- 172.21.15.79:0/816326886 wait complete. 2023-10-19T08:39:15.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.013+0000 7f1f0f6d8700 1 Processor -- start 2023-10-19T08:39:15.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.013+0000 7f1f0f6d8700 1 -- start start 2023-10-19T08:39:15.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.014+0000 7f1f0f6d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f0814e3b0 0x7f1f080c3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.027 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.014+0000 7f1f0f6d8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f080c3ca0 0x7f1f0806a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.014+0000 7f1f0f6d8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f0806a760 0x7f1f080c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.014+0000 7f1f0f6d8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0806ac10 con 0x7f1f0806a760 2023-10-19T08:39:15.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.014+0000 7f1f0f6d8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0815d1b0 con 0x7f1f080c3ca0 2023-10-19T08:39:15.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.014+0000 7f1f0f6d8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080c5740 con 0x7f1f0814e3b0 2023-10-19T08:39:15.028 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.014+0000 7f1f0dc75700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f0806a760 0x7f1f080c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.014+0000 7f1f0dc75700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f0806a760 0x7f1f080c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48382/0 (socket says 172.21.15.79:48382) 2023-10-19T08:39:15.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.014+0000 7f1f0dc75700 1 -- 172.21.15.79:0/2435297250 learned_addr learned my addr 172.21.15.79:0/2435297250 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:15.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.014+0000 7f1f0dc75700 1 -- 172.21.15.79:0/2435297250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f0814e3b0 msgr2=0x7f1f080c3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:15.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.014+0000 7f1f0dc75700 1 --2- 172.21.15.79:0/2435297250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f0814e3b0 0x7f1f080c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.014+0000 7f1f0dc75700 1 -- 172.21.15.79:0/2435297250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f080c3ca0 msgr2=0x7f1f0806a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:15.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.014+0000 7f1f0dc75700 1 --2- 172.21.15.79:0/2435297250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f080c3ca0 0x7f1f0806a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.014+0000 7f1f0dc75700 1 -- 172.21.15.79:0/2435297250 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f080c5a20 con 0x7f1f0806a760 2023-10-19T08:39:15.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.014+0000 7f1f0dc75700 1 --2- 172.21.15.79:0/2435297250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f0806a760 0x7f1f080c8660 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1f00016000 tx=0x7f1f00009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:15.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.014+0000 7f1efdffb700 1 -- 172.21.15.79:0/2435297250 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f00007000 con 0x7f1f0806a760 2023-10-19T08:39:15.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.014+0000 7f1efdffb700 1 -- 172.21.15.79:0/2435297250 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f00015b30 con 0x7f1f0806a760 2023-10-19T08:39:15.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.014+0000 7f1efdffb700 1 -- 172.21.15.79:0/2435297250 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0001d420 con 0x7f1f0806a760 2023-10-19T08:39:15.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.014+0000 7f1f0f6d8700 1 -- 172.21.15.79:0/2435297250 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f080c5d00 con 0x7f1f0806a760 2023-10-19T08:39:15.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.015+0000 7f1f0f6d8700 1 -- 172.21.15.79:0/2435297250 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f080c62c0 con 0x7f1f0806a760 2023-10-19T08:39:15.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.015+0000 7f1f0f6d8700 1 -- 172.21.15.79:0/2435297250 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f0804ee70 con 0x7f1f0806a760 2023-10-19T08:39:15.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.016+0000 7f1efdffb700 1 -- 172.21.15.79:0/2435297250 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1f0001d580 con 0x7f1f0806a760 2023-10-19T08:39:15.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.016+0000 7f1efdffb700 1 --2- 172.21.15.79:0/2435297250 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1eec06a0e0 0x7f1eec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.016+0000 7f1efdffb700 1 -- 172.21.15.79:0/2435297250 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1f0008a470 con 0x7f1f0806a760 2023-10-19T08:39:15.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.016+0000 7f1f0d474700 1 --2- 172.21.15.79:0/2435297250 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1eec06a0e0 0x7f1eec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.017+0000 7f1f0d474700 1 --2- 172.21.15.79:0/2435297250 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1eec06a0e0 0x7f1eec06c5a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1f04009b50 tx=0x7f1f04009670 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:15.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.020+0000 7f1efdffb700 1 -- 172.21.15.79:0/2435297250 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f1f000559e0 con 0x7f1f0806a760 2023-10-19T08:39:15.213 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.210+0000 7f1f0f6d8700 1 -- 172.21.15.79:0/2435297250 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f080ca280 con 0x7f1f0806a760 2023-10-19T08:39:15.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.210+0000 7f1efdffb700 1 -- 172.21.15.79:0/2435297250 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f00059000 con 0x7f1f0806a760 2023-10-19T08:39:15.214 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:39:15.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.212+0000 7f1f0f6d8700 1 -- 172.21.15.79:0/2435297250 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1eec06a0e0 msgr2=0x7f1eec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:15.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.212+0000 7f1f0f6d8700 1 --2- 172.21.15.79:0/2435297250 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1eec06a0e0 0x7f1eec06c5a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1f04009b50 tx=0x7f1f04009670 comp rx=0 tx=0).stop 2023-10-19T08:39:15.216 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.212+0000 7f1f0f6d8700 1 -- 172.21.15.79:0/2435297250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f0806a760 msgr2=0x7f1f080c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:15.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.212+0000 7f1f0f6d8700 1 --2- 172.21.15.79:0/2435297250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f0806a760 0x7f1f080c8660 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f1f00016000 tx=0x7f1f00009750 comp rx=0 tx=0).stop 2023-10-19T08:39:15.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.212+0000 7f1f0f6d8700 1 -- 172.21.15.79:0/2435297250 shutdown_connections 2023-10-19T08:39:15.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.212+0000 7f1f0f6d8700 1 --2- 172.21.15.79:0/2435297250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f0806a760 0x7f1f080c8660 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.212+0000 7f1f0f6d8700 1 --2- 172.21.15.79:0/2435297250 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1eec06a0e0 0x7f1eec06c5a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.212+0000 7f1f0f6d8700 1 --2- 172.21.15.79:0/2435297250 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f0814e3b0 0x7f1f080c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.212+0000 7f1f0f6d8700 1 --2- 172.21.15.79:0/2435297250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f080c3ca0 0x7f1f0806a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.212+0000 7f1f0f6d8700 1 -- 172.21.15.79:0/2435297250 >> 172.21.15.79:0/2435297250 conn(0x7f1f0806dcc0 msgr2=0x7f1f0806fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:15.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.212+0000 7f1f0f6d8700 1 -- 172.21.15.79:0/2435297250 shutdown_connections 2023-10-19T08:39:15.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.212+0000 7f1f0f6d8700 1 -- 172.21.15.79:0/2435297250 wait complete. 2023-10-19T08:39:15.228 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:39:15.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.348+0000 7fa63712b700 1 Processor -- start 2023-10-19T08:39:15.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.349+0000 7fa63712b700 1 -- start start 2023-10-19T08:39:15.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.349+0000 7fa63712b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa63015aec0 0x7fa630070120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.349+0000 7fa63712b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6300ca280 0x7fa63006a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.349+0000 7fa63712b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa63006a760 0x7fa6300cc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.349+0000 7fa63712b700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63006abf0 con 0x7fa6300ca280 2023-10-19T08:39:15.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.349+0000 7fa63712b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63015b2a0 con 0x7fa63015aec0 2023-10-19T08:39:15.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.349+0000 7fa63712b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6300b31d0 con 0x7fa63006a760 2023-10-19T08:39:15.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.349+0000 7fa62ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6300ca280 0x7fa63006a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.350+0000 7fa62ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa6300ca280 0x7fa63006a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48388/0 (socket says 172.21.15.79:48388) 2023-10-19T08:39:15.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.350+0000 7fa62ffff700 1 -- 172.21.15.79:0/3715358122 learned_addr learned my addr 172.21.15.79:0/3715358122 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:15.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.350+0000 7fa6356c8700 1 --2- 172.21.15.79:0/3715358122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa63006a760 0x7fa6300cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.350+0000 7fa634ec7700 1 --2- 172.21.15.79:0/3715358122 >> v2:172.21.15.89:3300/0 conn(0x7fa63015aec0 0x7fa630070120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.350+0000 7fa62ffff700 1 -- 172.21.15.79:0/3715358122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa63006a760 msgr2=0x7fa6300cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:15.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.350+0000 7fa62ffff700 1 --2- 172.21.15.79:0/3715358122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa63006a760 0x7fa6300cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.350+0000 7fa62ffff700 1 -- 172.21.15.79:0/3715358122 >> v2:172.21.15.89:3300/0 conn(0x7fa63015aec0 msgr2=0x7fa630070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:15.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.350+0000 7fa62ffff700 1 --2- 172.21.15.79:0/3715358122 >> v2:172.21.15.89:3300/0 conn(0x7fa63015aec0 0x7fa630070120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.350+0000 7fa62ffff700 1 -- 172.21.15.79:0/3715358122 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6300b2650 con 0x7fa6300ca280 2023-10-19T08:39:15.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.350+0000 7fa62ffff700 1 --2- 172.21.15.79:0/3715358122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6300ca280 0x7fa63006a220 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa6300cd6c0 tx=0x7fa61c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88c35ff182ce9cb server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:15.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.350+0000 7fa62f7fe700 1 -- 172.21.15.79:0/3715358122 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c011830 con 0x7fa6300ca280 2023-10-19T08:39:15.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.350+0000 7fa62f7fe700 1 -- 172.21.15.79:0/3715358122 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c011990 con 0x7fa6300ca280 2023-10-19T08:39:15.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.350+0000 7fa62f7fe700 1 -- 172.21.15.79:0/3715358122 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c011d20 con 0x7fa6300ca280 2023-10-19T08:39:15.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.351+0000 7fa63712b700 1 -- 172.21.15.79:0/3715358122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6300ca280 msgr2=0x7fa63006a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:15.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.351+0000 7fa63712b700 1 --2- 172.21.15.79:0/3715358122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6300ca280 0x7fa63006a220 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa6300cd6c0 tx=0x7fa61c009bd0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.351+0000 7fa63712b700 1 -- 172.21.15.79:0/3715358122 shutdown_connections 2023-10-19T08:39:15.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.351+0000 7fa63712b700 1 --2- 172.21.15.79:0/3715358122 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa63006a760 0x7fa6300cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.351+0000 7fa63712b700 1 --2- 172.21.15.79:0/3715358122 >> v2:172.21.15.89:3300/0 conn(0x7fa63015aec0 0x7fa630070120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.351+0000 7fa63712b700 1 --2- 172.21.15.79:0/3715358122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6300ca280 0x7fa63006a220 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.351+0000 7fa63712b700 1 -- 172.21.15.79:0/3715358122 >> 172.21.15.79:0/3715358122 conn(0x7fa63006dcc0 msgr2=0x7fa63006e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:15.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.351+0000 7fa63712b700 1 -- 172.21.15.79:0/3715358122 shutdown_connections 2023-10-19T08:39:15.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.351+0000 7fa63712b700 1 -- 172.21.15.79:0/3715358122 wait complete. 2023-10-19T08:39:15.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.352+0000 7fa63712b700 1 Processor -- start 2023-10-19T08:39:15.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.352+0000 7fa63712b700 1 -- start start 2023-10-19T08:39:15.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.353+0000 7fa63712b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa63006a760 0x7fa630150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.363 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.353+0000 7fa63712b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6300ca280 0x7fa630151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.353+0000 7fa63712b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa63015aec0 0x7fa630153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.353+0000 7fa63712b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6300c3990 con 0x7fa63015aec0 2023-10-19T08:39:15.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.353+0000 7fa63712b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6301542d0 con 0x7fa63006a760 2023-10-19T08:39:15.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.353+0000 7fa63712b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6301545b0 con 0x7fa6300ca280 2023-10-19T08:39:15.364 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.353+0000 7fa6356c8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa63015aec0 0x7fa630153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.353+0000 7fa6356c8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa63015aec0 0x7fa630153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48396/0 (socket says 172.21.15.79:48396) 2023-10-19T08:39:15.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.353+0000 7fa6356c8700 1 -- 172.21.15.79:0/3386426240 learned_addr learned my addr 172.21.15.79:0/3386426240 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:15.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.353+0000 7fa634ec7700 1 --2- 172.21.15.79:0/3386426240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa63006a760 0x7fa630150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.353+0000 7fa62ffff700 1 --2- 172.21.15.79:0/3386426240 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6300ca280 0x7fa630151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.353+0000 7fa6356c8700 1 -- 172.21.15.79:0/3386426240 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6300ca280 msgr2=0x7fa630151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:15.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.353+0000 7fa6356c8700 1 --2- 172.21.15.79:0/3386426240 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6300ca280 0x7fa630151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.353+0000 7fa6356c8700 1 -- 172.21.15.79:0/3386426240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa63006a760 msgr2=0x7fa630150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:15.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.353+0000 7fa6356c8700 1 --2- 172.21.15.79:0/3386426240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa63006a760 0x7fa630150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.353+0000 7fa6356c8700 1 -- 172.21.15.79:0/3386426240 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c009550 con 0x7fa63015aec0 2023-10-19T08:39:15.366 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.353+0000 7fa6356c8700 1 --2- 172.21.15.79:0/3386426240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa63015aec0 0x7fa630153620 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa62800eed0 tx=0x7fa62800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:15.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.353+0000 7fa62d7fa700 1 -- 172.21.15.79:0/3386426240 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628010040 con 0x7fa63015aec0 2023-10-19T08:39:15.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.353+0000 7fa62d7fa700 1 -- 172.21.15.79:0/3386426240 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62800bd30 con 0x7fa63015aec0 2023-10-19T08:39:15.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.354+0000 7fa63712b700 1 -- 172.21.15.79:0/3386426240 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa630154890 con 0x7fa63015aec0 2023-10-19T08:39:15.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.354+0000 7fa62d7fa700 1 -- 172.21.15.79:0/3386426240 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628009ea0 con 0x7fa63015aec0 2023-10-19T08:39:15.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.354+0000 7fa63712b700 1 -- 172.21.15.79:0/3386426240 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6301508a0 con 0x7fa63015aec0 2023-10-19T08:39:15.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.354+0000 7fa63712b700 1 -- 172.21.15.79:0/3386426240 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6300c3b00 con 0x7fa63015aec0 2023-10-19T08:39:15.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.355+0000 7fa62d7fa700 1 -- 172.21.15.79:0/3386426240 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa628014640 con 0x7fa63015aec0 2023-10-19T08:39:15.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.355+0000 7fa62d7fa700 1 --2- 172.21.15.79:0/3386426240 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa61406a0e0 0x7fa61406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.355+0000 7fa634ec7700 1 --2- 172.21.15.79:0/3386426240 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa61406a0e0 0x7fa61406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.355+0000 7fa62d7fa700 1 -- 172.21.15.79:0/3386426240 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa628088f20 con 0x7fa63015aec0 2023-10-19T08:39:15.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.356+0000 7fa634ec7700 1 --2- 172.21.15.79:0/3386426240 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa61406a0e0 0x7fa61406c5a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa624009ad0 tx=0x7fa624008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:15.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.360+0000 7fa62d7fa700 1 -- 172.21.15.79:0/3386426240 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa6300c3b00 con 0x7fa63015aec0 2023-10-19T08:39:15.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.548+0000 7fa63712b700 1 -- 172.21.15.79:0/3386426240 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa6300c3ad0 con 0x7fa63015aec0 2023-10-19T08:39:15.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.548+0000 7fa62d7fa700 1 -- 172.21.15.79:0/3386426240 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa6280180a0 con 0x7fa63015aec0 2023-10-19T08:39:15.552 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:39:15.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.550+0000 7fa63712b700 1 -- 172.21.15.79:0/3386426240 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa61406a0e0 msgr2=0x7fa61406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:15.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.550+0000 7fa63712b700 1 --2- 172.21.15.79:0/3386426240 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa61406a0e0 0x7fa61406c5a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa624009ad0 tx=0x7fa624008040 comp rx=0 tx=0).stop 2023-10-19T08:39:15.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.550+0000 7fa63712b700 1 -- 172.21.15.79:0/3386426240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa63015aec0 msgr2=0x7fa630153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:15.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.550+0000 7fa63712b700 1 --2- 172.21.15.79:0/3386426240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa63015aec0 0x7fa630153620 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa62800eed0 tx=0x7fa62800b390 comp rx=0 tx=0).stop 2023-10-19T08:39:15.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.550+0000 7fa63712b700 1 -- 172.21.15.79:0/3386426240 shutdown_connections 2023-10-19T08:39:15.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.550+0000 7fa63712b700 1 --2- 172.21.15.79:0/3386426240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa63015aec0 0x7fa630153620 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.550+0000 7fa63712b700 1 --2- 172.21.15.79:0/3386426240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa63006a760 0x7fa630150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.550+0000 7fa63712b700 1 --2- 172.21.15.79:0/3386426240 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa61406a0e0 0x7fa61406c5a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.550+0000 7fa63712b700 1 --2- 172.21.15.79:0/3386426240 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa6300ca280 0x7fa630151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.550+0000 7fa63712b700 1 -- 172.21.15.79:0/3386426240 >> 172.21.15.79:0/3386426240 conn(0x7fa63006dcc0 msgr2=0x7fa6301583e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:15.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.550+0000 7fa63712b700 1 -- 172.21.15.79:0/3386426240 shutdown_connections 2023-10-19T08:39:15.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.550+0000 7fa63712b700 1 -- 172.21.15.79:0/3386426240 wait complete. 2023-10-19T08:39:15.566 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T08:39:15.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.687+0000 7fe635eb6700 1 Processor -- start 2023-10-19T08:39:15.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.687+0000 7fe635eb6700 1 -- start start 2023-10-19T08:39:15.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.688+0000 7fe635eb6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe63015e570 0x7fe6300d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.688+0000 7fe635eb6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe6300b0c00 0x7fe6300ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.688+0000 7fe635eb6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6300b25f0 con 0x7fe6300cb6f0 2023-10-19T08:39:15.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.688+0000 7fe635eb6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6300afd60 con 0x7fe63015e570 2023-10-19T08:39:15.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.688+0000 7fe635eb6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6300af810 con 0x7fe6300b0c00 2023-10-19T08:39:15.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.688+0000 7fe62f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe63015e570 0x7fe6300d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.688+0000 7fe62f7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe63015e570 0x7fe6300d1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48400/0 (socket says 172.21.15.79:48400) 2023-10-19T08:39:15.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.688+0000 7fe62f7fe700 1 -- 172.21.15.79:0/2671261352 learned_addr learned my addr 172.21.15.79:0/2671261352 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:15.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.688+0000 7fe62ffff700 1 --2- 172.21.15.79:0/2671261352 >> v2:172.21.15.89:3300/0 conn(0x7fe6300b0c00 0x7fe6300ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.689+0000 7fe62f7fe700 1 -- 172.21.15.79:0/2671261352 >> v2:172.21.15.89:3300/0 conn(0x7fe6300b0c00 msgr2=0x7fe6300ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:15.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.689+0000 7fe62f7fe700 1 --2- 172.21.15.79:0/2671261352 >> v2:172.21.15.89:3300/0 conn(0x7fe6300b0c00 0x7fe6300ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.689+0000 7fe62f7fe700 1 -- 172.21.15.79:0/2671261352 >> v1:172.21.15.89:6789/0 conn(0x7fe6300cb6f0 legacy=0x7fe6300b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:15.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.689+0000 7fe62f7fe700 1 -- 172.21.15.79:0/2671261352 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6300aef70 con 0x7fe63015e570 2023-10-19T08:39:15.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.689+0000 7fe62f7fe700 1 --2- 172.21.15.79:0/2671261352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe63015e570 0x7fe6300d1990 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe63008aed0 tx=0x7fe618009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae0e9fa1cbf919b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:15.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.689+0000 7fe62e7fc700 1 -- 172.21.15.79:0/2671261352 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe618004230 con 0x7fe63015e570 2023-10-19T08:39:15.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.689+0000 7fe62e7fc700 1 -- 172.21.15.79:0/2671261352 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe618004390 con 0x7fe63015e570 2023-10-19T08:39:15.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.689+0000 7fe62e7fc700 1 -- 172.21.15.79:0/2671261352 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6180036a0 con 0x7fe63015e570 2023-10-19T08:39:15.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.689+0000 7fe635eb6700 1 -- 172.21.15.79:0/2671261352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe63015e570 msgr2=0x7fe6300d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:15.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.689+0000 7fe635eb6700 1 --2- 172.21.15.79:0/2671261352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe63015e570 0x7fe6300d1990 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe63008aed0 tx=0x7fe618009bd0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.689+0000 7fe635eb6700 1 -- 172.21.15.79:0/2671261352 shutdown_connections 2023-10-19T08:39:15.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.689+0000 7fe635eb6700 1 --2- 172.21.15.79:0/2671261352 >> v2:172.21.15.89:3300/0 conn(0x7fe6300b0c00 0x7fe6300ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.689+0000 7fe635eb6700 1 --2- 172.21.15.79:0/2671261352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe63015e570 0x7fe6300d1990 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.689+0000 7fe635eb6700 1 -- 172.21.15.79:0/2671261352 >> 172.21.15.79:0/2671261352 conn(0x7fe63009a0b0 msgr2=0x7fe6300d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:15.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.689+0000 7fe635eb6700 1 -- 172.21.15.79:0/2671261352 shutdown_connections 2023-10-19T08:39:15.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.689+0000 7fe635eb6700 1 -- 172.21.15.79:0/2671261352 wait complete. 2023-10-19T08:39:15.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.691+0000 7fe635eb6700 1 Processor -- start 2023-10-19T08:39:15.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.691+0000 7fe635eb6700 1 -- start start 2023-10-19T08:39:15.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.691+0000 7fe635eb6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6300b0c00 0x7fe6300d0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.691+0000 7fe635eb6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6300cb6f0 0x7fe6300c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.691+0000 7fe635eb6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe63015e570 0x7fe630152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.691+0000 7fe635eb6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6300c6f50 con 0x7fe6300cb6f0 2023-10-19T08:39:15.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.691+0000 7fe635eb6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6300d1c30 con 0x7fe6300b0c00 2023-10-19T08:39:15.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.691+0000 7fe635eb6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63006d1a0 con 0x7fe63015e570 2023-10-19T08:39:15.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.692+0000 7fe62effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6300cb6f0 0x7fe6300c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.692+0000 7fe62effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6300cb6f0 0x7fe6300c6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48408/0 (socket says 172.21.15.79:48408) 2023-10-19T08:39:15.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.692+0000 7fe62effd700 1 -- 172.21.15.79:0/977996084 learned_addr learned my addr 172.21.15.79:0/977996084 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:15.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.692+0000 7fe62f7fe700 1 --2- 172.21.15.79:0/977996084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6300b0c00 0x7fe6300d0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.692+0000 7fe62ffff700 1 --2- 172.21.15.79:0/977996084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe63015e570 0x7fe630152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.692+0000 7fe62effd700 1 -- 172.21.15.79:0/977996084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe63015e570 msgr2=0x7fe630152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:15.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.692+0000 7fe62effd700 1 --2- 172.21.15.79:0/977996084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe63015e570 0x7fe630152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.692+0000 7fe62effd700 1 -- 172.21.15.79:0/977996084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6300b0c00 msgr2=0x7fe6300d0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:15.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.692+0000 7fe62effd700 1 --2- 172.21.15.79:0/977996084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6300b0c00 0x7fe6300d0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.692+0000 7fe62effd700 1 -- 172.21.15.79:0/977996084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe618009550 con 0x7fe6300cb6f0 2023-10-19T08:39:15.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.692+0000 7fe62effd700 1 --2- 172.21.15.79:0/977996084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6300cb6f0 0x7fe6300c6a10 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe62000c4a0 tx=0x7fe62000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:15.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.692+0000 7fe627fff700 1 -- 172.21.15.79:0/977996084 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620011790 con 0x7fe6300cb6f0 2023-10-19T08:39:15.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.692+0000 7fe627fff700 1 -- 172.21.15.79:0/977996084 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6200118f0 con 0x7fe6300cb6f0 2023-10-19T08:39:15.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.692+0000 7fe635eb6700 1 -- 172.21.15.79:0/977996084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6301597a0 con 0x7fe6300cb6f0 2023-10-19T08:39:15.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.692+0000 7fe627fff700 1 -- 172.21.15.79:0/977996084 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620011ca0 con 0x7fe6300cb6f0 2023-10-19T08:39:15.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.692+0000 7fe635eb6700 1 -- 172.21.15.79:0/977996084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe630159fe0 con 0x7fe6300cb6f0 2023-10-19T08:39:15.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.693+0000 7fe635eb6700 1 -- 172.21.15.79:0/977996084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63004ee70 con 0x7fe6300cb6f0 2023-10-19T08:39:15.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.694+0000 7fe627fff700 1 -- 172.21.15.79:0/977996084 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe62001c460 con 0x7fe6300cb6f0 2023-10-19T08:39:15.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.694+0000 7fe627fff700 1 --2- 172.21.15.79:0/977996084 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe61006a0e0 0x7fe61006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:15.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.694+0000 7fe62f7fe700 1 --2- 172.21.15.79:0/977996084 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe61006a0e0 0x7fe61006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:15.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.694+0000 7fe627fff700 1 -- 172.21.15.79:0/977996084 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe6200885f0 con 0x7fe6300cb6f0 2023-10-19T08:39:15.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.694+0000 7fe62f7fe700 1 --2- 172.21.15.79:0/977996084 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe61006a0e0 0x7fe61006c5a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe618009130 tx=0x7fe618008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:15.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.699+0000 7fe627fff700 1 -- 172.21.15.79:0/977996084 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fe6200539b0 con 0x7fe6300cb6f0 2023-10-19T08:39:15.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.885+0000 7fe635eb6700 1 -- 172.21.15.79:0/977996084 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe6300b1090 con 0x7fe6300cb6f0 2023-10-19T08:39:15.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.885+0000 7fe627fff700 1 -- 172.21.15.79:0/977996084 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe620056fd0 con 0x7fe6300cb6f0 2023-10-19T08:39:15.889 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:39:15.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.887+0000 7fe635eb6700 1 -- 172.21.15.79:0/977996084 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe61006a0e0 msgr2=0x7fe61006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:15.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.887+0000 7fe635eb6700 1 --2- 172.21.15.79:0/977996084 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe61006a0e0 0x7fe61006c5a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe618009130 tx=0x7fe618008030 comp rx=0 tx=0).stop 2023-10-19T08:39:15.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.887+0000 7fe635eb6700 1 -- 172.21.15.79:0/977996084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6300cb6f0 msgr2=0x7fe6300c6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:15.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.887+0000 7fe635eb6700 1 --2- 172.21.15.79:0/977996084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6300cb6f0 0x7fe6300c6a10 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe62000c4a0 tx=0x7fe62000c7b0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.887+0000 7fe635eb6700 1 -- 172.21.15.79:0/977996084 shutdown_connections 2023-10-19T08:39:15.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.887+0000 7fe635eb6700 1 --2- 172.21.15.79:0/977996084 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe61006a0e0 0x7fe61006c5a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.887+0000 7fe635eb6700 1 --2- 172.21.15.79:0/977996084 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe63015e570 0x7fe630152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.887+0000 7fe635eb6700 1 --2- 172.21.15.79:0/977996084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe6300b0c00 0x7fe6300d0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.887+0000 7fe635eb6700 1 --2- 172.21.15.79:0/977996084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe6300cb6f0 0x7fe6300c6a10 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:15.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.887+0000 7fe635eb6700 1 -- 172.21.15.79:0/977996084 >> 172.21.15.79:0/977996084 conn(0x7fe63009a0b0 msgr2=0x7fe6301534e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:15.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.888+0000 7fe635eb6700 1 -- 172.21.15.79:0/977996084 shutdown_connections 2023-10-19T08:39:15.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:15.888+0000 7fe635eb6700 1 -- 172.21.15.79:0/977996084 wait complete. 2023-10-19T08:39:15.903 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T08:39:16.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.022+0000 7f4ee3aee700 1 Processor -- start 2023-10-19T08:39:16.026 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.023+0000 7f4ee3aee700 1 -- start start 2023-10-19T08:39:16.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.023+0000 7f4ee3aee700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4edc0703b0 0x7f4edc0cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:16.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.023+0000 7f4ee3aee700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4edc0b1fe0 con 0x7f4edc0cd270 2023-10-19T08:39:16.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.023+0000 7f4ee3aee700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4edc0ce2b0 con 0x7f4edc06a930 2023-10-19T08:39:16.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.023+0000 7f4ee3aee700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4edc160a80 con 0x7f4edc0703b0 2023-10-19T08:39:16.029 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.024+0000 7f4ee188a700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4edc0cd270 0x7f4edc06a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58486/0 (socket says 172.21.15.79:58486) 2023-10-19T08:39:16.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.024+0000 7f4ee188a700 1 -- 172.21.15.79:0/3822188375 learned_addr learned my addr 172.21.15.79:0/3822188375 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:16.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.024+0000 7f4ee208b700 1 --2- 172.21.15.79:0/3822188375 >> v2:172.21.15.89:3300/0 conn(0x7f4edc0703b0 0x7f4edc0cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:16.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.024+0000 7f4ee0888700 1 -- 172.21.15.79:0/3822188375 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905889813 0 0) 0x7f4edc0b1fe0 con 0x7f4edc0cd270 2023-10-19T08:39:16.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.024+0000 7f4ee0888700 1 -- 172.21.15.79:0/3822188375 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ec80035b0 con 0x7f4edc0cd270 2023-10-19T08:39:16.030 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.024+0000 7f4ee208b700 1 -- 172.21.15.79:0/3822188375 >> v1:172.21.15.89:6789/0 conn(0x7f4edc06a930 legacy=0x7f4edc0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:16.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.024+0000 7f4ee208b700 1 -- 172.21.15.79:0/3822188375 >> v1:172.21.15.79:6789/0 conn(0x7f4edc0cd270 legacy=0x7f4edc06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:16.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.024+0000 7f4ee208b700 1 -- 172.21.15.79:0/3822188375 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc0ce550 con 0x7f4edc0703b0 2023-10-19T08:39:16.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.024+0000 7f4ee208b700 1 --2- 172.21.15.79:0/3822188375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0703b0 0x7f4edc0cb9a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4009d90 tx=0x7f4ed400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9521a48452ebc051 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:16.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.024+0000 7f4ee0888700 1 -- 172.21.15.79:0/3822188375 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed400e070 con 0x7f4edc0703b0 2023-10-19T08:39:16.031 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.024+0000 7f4ee0888700 1 -- 172.21.15.79:0/3822188375 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed400bb20 con 0x7f4edc0703b0 2023-10-19T08:39:16.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.024+0000 7f4ee0888700 1 -- 172.21.15.79:0/3822188375 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed400be90 con 0x7f4edc0703b0 2023-10-19T08:39:16.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.025+0000 7f4ee3aee700 1 -- 172.21.15.79:0/3822188375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0703b0 msgr2=0x7f4edc0cb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:16.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.025+0000 7f4ee3aee700 1 --2- 172.21.15.79:0/3822188375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0703b0 0x7f4edc0cb9a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4009d90 tx=0x7f4ed400b330 comp rx=0 tx=0).stop 2023-10-19T08:39:16.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.025+0000 7f4ee3aee700 1 -- 172.21.15.79:0/3822188375 shutdown_connections 2023-10-19T08:39:16.032 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.025+0000 7f4ee3aee700 1 --2- 172.21.15.79:0/3822188375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0703b0 0x7f4edc0cb9a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.025+0000 7f4ee3aee700 1 -- 172.21.15.79:0/3822188375 >> 172.21.15.79:0/3822188375 conn(0x7f4edc06dcc0 msgr2=0x7f4edc06e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:16.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.025+0000 7f4ee3aee700 1 -- 172.21.15.79:0/3822188375 shutdown_connections 2023-10-19T08:39:16.033 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.025+0000 7f4ee3aee700 1 -- 172.21.15.79:0/3822188375 wait complete. 2023-10-19T08:39:16.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.026+0000 7f4ee3aee700 1 Processor -- start 2023-10-19T08:39:16.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.026+0000 7f4ee3aee700 1 -- start start 2023-10-19T08:39:16.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.027+0000 7f4ee3aee700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4edc06a930 0x7f4edc0aaa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:16.036 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.027+0000 7f4ee3aee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4edc0703b0 0x7f4edc1f76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:16.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.027+0000 7f4ee3aee700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0cd270 0x7f4edc15ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:16.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.027+0000 7f4ee3aee700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc0ab260 con 0x7f4edc06a930 2023-10-19T08:39:16.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.027+0000 7f4ee3aee700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc0ab540 con 0x7f4edc0cd270 2023-10-19T08:39:16.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.027+0000 7f4ee3aee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc0acf50 con 0x7f4edc0703b0 2023-10-19T08:39:16.037 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.027+0000 7f4ee188a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4edc06a930 0x7f4edc0aaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:16.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.027+0000 7f4ee188a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4edc06a930 0x7f4edc0aaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48422/0 (socket says 172.21.15.79:48422) 2023-10-19T08:39:16.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.027+0000 7f4ee188a700 1 -- 172.21.15.79:0/1759554838 learned_addr learned my addr 172.21.15.79:0/1759554838 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:16.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.027+0000 7f4ee208b700 1 --2- 172.21.15.79:0/1759554838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0cd270 0x7f4edc15ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:16.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.027+0000 7f4ee1089700 1 --2- 172.21.15.79:0/1759554838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4edc0703b0 0x7f4edc1f76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:16.038 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.027+0000 7f4ee188a700 1 -- 172.21.15.79:0/1759554838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4edc0703b0 msgr2=0x7f4edc1f76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:16.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.027+0000 7f4ee188a700 1 --2- 172.21.15.79:0/1759554838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4edc0703b0 0x7f4edc1f76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.027+0000 7f4ee188a700 1 -- 172.21.15.79:0/1759554838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0cd270 msgr2=0x7f4edc15ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:16.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.027+0000 7f4ee188a700 1 --2- 172.21.15.79:0/1759554838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0cd270 0x7f4edc15ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.027+0000 7f4ee188a700 1 -- 172.21.15.79:0/1759554838 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed4009a70 con 0x7f4edc06a930 2023-10-19T08:39:16.039 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.027+0000 7f4ee208b700 1 --2- 172.21.15.79:0/1759554838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0cd270 0x7f4edc15ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:16.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.027+0000 7f4ee188a700 1 --2- 172.21.15.79:0/1759554838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4edc06a930 0x7f4edc0aaa10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00c700 tx=0x7f4ecc00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:16.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.028+0000 7f4ed27fc700 1 -- 172.21.15.79:0/1759554838 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc005d70 con 0x7f4edc06a930 2023-10-19T08:39:16.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.028+0000 7f4ed27fc700 1 -- 172.21.15.79:0/1759554838 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc0070d0 con 0x7f4edc06a930 2023-10-19T08:39:16.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.028+0000 7f4ee3aee700 1 -- 172.21.15.79:0/1759554838 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4edc0ad230 con 0x7f4edc06a930 2023-10-19T08:39:16.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.028+0000 7f4ed27fc700 1 -- 172.21.15.79:0/1759554838 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc007460 con 0x7f4edc06a930 2023-10-19T08:39:16.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.028+0000 7f4ee3aee700 1 -- 172.21.15.79:0/1759554838 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4edc1f7c00 con 0x7f4edc06a930 2023-10-19T08:39:16.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.029+0000 7f4ee3aee700 1 -- 172.21.15.79:0/1759554838 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4edc0ad470 con 0x7f4edc06a930 2023-10-19T08:39:16.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.029+0000 7f4ed27fc700 1 -- 172.21.15.79:0/1759554838 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4ecc0075c0 con 0x7f4edc06a930 2023-10-19T08:39:16.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.029+0000 7f4ed27fc700 1 --2- 172.21.15.79:0/1759554838 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4ec006a0e0 0x7f4ec006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:16.041 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.030+0000 7f4ed27fc700 1 -- 172.21.15.79:0/1759554838 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4ecc087e90 con 0x7f4edc06a930 2023-10-19T08:39:16.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.030+0000 7f4ee1089700 1 --2- 172.21.15.79:0/1759554838 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4ec006a0e0 0x7f4ec006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:16.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.030+0000 7f4ee1089700 1 --2- 172.21.15.79:0/1759554838 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4ec006a0e0 0x7f4ec006c5a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4edc070340 tx=0x7f4ed8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:16.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.034+0000 7f4ed27fc700 1 -- 172.21.15.79:0/1759554838 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4edc0ad470 con 0x7f4edc06a930 2023-10-19T08:39:16.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.222+0000 7f4ee3aee700 1 -- 172.21.15.79:0/1759554838 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4edc0ad470 con 0x7f4edc06a930 2023-10-19T08:39:16.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.223+0000 7f4ed27fc700 1 -- 172.21.15.79:0/1759554838 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ecc053260 con 0x7f4edc06a930 2023-10-19T08:39:16.227 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-19T08:39:16.228 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.224+0000 7f4ee3aee700 1 -- 172.21.15.79:0/1759554838 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4ec006a0e0 msgr2=0x7f4ec006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.224+0000 7f4ee3aee700 1 --2- 172.21.15.79:0/1759554838 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4ec006a0e0 0x7f4ec006c5a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4edc070340 tx=0x7f4ed8009040 comp rx=0 tx=0).stop 2023-10-19T08:39:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.224+0000 7f4ee3aee700 1 -- 172.21.15.79:0/1759554838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4edc06a930 msgr2=0x7f4edc0aaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.224+0000 7f4ee3aee700 1 --2- 172.21.15.79:0/1759554838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4edc06a930 0x7f4edc0aaa10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc00c700 tx=0x7f4ecc00cac0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.224+0000 7f4ee3aee700 1 -- 172.21.15.79:0/1759554838 shutdown_connections 2023-10-19T08:39:16.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.224+0000 7f4ee3aee700 1 --2- 172.21.15.79:0/1759554838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4edc0cd270 0x7f4edc15ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.224+0000 7f4ee3aee700 1 --2- 172.21.15.79:0/1759554838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4edc06a930 0x7f4edc0aaa10 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.224+0000 7f4ee3aee700 1 --2- 172.21.15.79:0/1759554838 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4ec006a0e0 0x7f4ec006c5a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.224+0000 7f4ee3aee700 1 --2- 172.21.15.79:0/1759554838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4edc0703b0 0x7f4edc1f76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.224+0000 7f4ee3aee700 1 -- 172.21.15.79:0/1759554838 >> 172.21.15.79:0/1759554838 conn(0x7f4edc06dcc0 msgr2=0x7f4edc0b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:16.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.225+0000 7f4ee3aee700 1 -- 172.21.15.79:0/1759554838 shutdown_connections 2023-10-19T08:39:16.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.225+0000 7f4ee3aee700 1 -- 172.21.15.79:0/1759554838 wait complete. 2023-10-19T08:39:16.240 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T08:39:16.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.361+0000 7fe0e8ebe700 1 Processor -- start 2023-10-19T08:39:16.365 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.361+0000 7fe0e8ebe700 1 -- start start 2023-10-19T08:39:16.367 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.362+0000 7fe0e8ebe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe0e40cd270 0x7fe0e406a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:16.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.362+0000 7fe0e8ebe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe0e40cc2a0 0x7fe0e406a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:16.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.362+0000 7fe0e8ebe700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e40b1fe0 con 0x7fe0e40703b0 2023-10-19T08:39:16.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.362+0000 7fe0e8ebe700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e4160a80 con 0x7fe0e40cc2a0 2023-10-19T08:39:16.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.362+0000 7fe0e8ebe700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e40ce2b0 con 0x7fe0e40cd270 2023-10-19T08:39:16.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.362+0000 7fe0e2d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe0e40cc2a0 0x7fe0e406a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:16.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.362+0000 7fe0e2d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe0e40cc2a0 0x7fe0e406a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48432/0 (socket says 172.21.15.79:48432) 2023-10-19T08:39:16.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.362+0000 7fe0e2d9d700 1 -- 172.21.15.79:0/760932157 learned_addr learned my addr 172.21.15.79:0/760932157 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:16.369 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.362+0000 7fe0e259c700 1 --2- 172.21.15.79:0/760932157 >> v2:172.21.15.89:3300/0 conn(0x7fe0e40cd270 0x7fe0e406a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:16.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.363+0000 7fe0e2d9d700 1 -- 172.21.15.79:0/760932157 >> v2:172.21.15.89:3300/0 conn(0x7fe0e40cd270 msgr2=0x7fe0e406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:16.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.363+0000 7fe0e2d9d700 1 --2- 172.21.15.79:0/760932157 >> v2:172.21.15.89:3300/0 conn(0x7fe0e40cd270 0x7fe0e406a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.363+0000 7fe0e2d9d700 1 -- 172.21.15.79:0/760932157 >> v1:172.21.15.89:6789/0 conn(0x7fe0e40703b0 legacy=0x7fe0e4160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:16.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.363+0000 7fe0e2d9d700 1 -- 172.21.15.79:0/760932157 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e40ce550 con 0x7fe0e40cc2a0 2023-10-19T08:39:16.370 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.363+0000 7fe0e2d9d700 1 --2- 172.21.15.79:0/760932157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e40cc2a0 0x7fe0e406a760 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40717c0 tx=0x7fe0dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbcf52b4a168e6b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:16.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.363+0000 7fe0e159a700 1 -- 172.21.15.79:0/760932157 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc00e070 con 0x7fe0e40cc2a0 2023-10-19T08:39:16.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.363+0000 7fe0e159a700 1 -- 172.21.15.79:0/760932157 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc00b9c0 con 0x7fe0e40cc2a0 2023-10-19T08:39:16.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.363+0000 7fe0e159a700 1 -- 172.21.15.79:0/760932157 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc00bd70 con 0x7fe0e40cc2a0 2023-10-19T08:39:16.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.363+0000 7fe0e8ebe700 1 -- 172.21.15.79:0/760932157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e40cc2a0 msgr2=0x7fe0e406a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:16.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.363+0000 7fe0e8ebe700 1 --2- 172.21.15.79:0/760932157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e40cc2a0 0x7fe0e406a760 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40717c0 tx=0x7fe0dc00b330 comp rx=0 tx=0).stop 2023-10-19T08:39:16.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.363+0000 7fe0e8ebe700 1 -- 172.21.15.79:0/760932157 shutdown_connections 2023-10-19T08:39:16.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.363+0000 7fe0e8ebe700 1 --2- 172.21.15.79:0/760932157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e40cc2a0 0x7fe0e406a760 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.372 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.363+0000 7fe0e8ebe700 1 --2- 172.21.15.79:0/760932157 >> v2:172.21.15.89:3300/0 conn(0x7fe0e40cd270 0x7fe0e406a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.363+0000 7fe0e8ebe700 1 -- 172.21.15.79:0/760932157 >> 172.21.15.79:0/760932157 conn(0x7fe0e406dcc0 msgr2=0x7fe0e406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:16.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.363+0000 7fe0e8ebe700 1 -- 172.21.15.79:0/760932157 shutdown_connections 2023-10-19T08:39:16.373 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.364+0000 7fe0e8ebe700 1 -- 172.21.15.79:0/760932157 wait complete. 2023-10-19T08:39:16.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.365+0000 7fe0e8ebe700 1 Processor -- start 2023-10-19T08:39:16.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.365+0000 7fe0e8ebe700 1 -- start start 2023-10-19T08:39:16.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.365+0000 7fe0e8ebe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e40703b0 0x7fe0e40c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:16.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0e8ebe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0e40cc2a0 0x7fe0e40c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:16.377 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0e8ebe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0e40cd270 0x7fe0e41f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:16.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0e8ebe700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e40c5ac0 con 0x7fe0e40703b0 2023-10-19T08:39:16.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0e8ebe700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e41f6810 con 0x7fe0e40cc2a0 2023-10-19T08:39:16.378 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0e8ebe700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e41f6af0 con 0x7fe0e40cd270 2023-10-19T08:39:16.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0e259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e40703b0 0x7fe0e40c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:16.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0e259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e40703b0 0x7fe0e40c22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48434/0 (socket says 172.21.15.79:48434) 2023-10-19T08:39:16.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0e259c700 1 -- 172.21.15.79:0/2463885223 learned_addr learned my addr 172.21.15.79:0/2463885223 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:16.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0e1d9b700 1 --2- 172.21.15.79:0/2463885223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0e40cc2a0 0x7fe0e40c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:16.379 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0e2d9d700 1 --2- 172.21.15.79:0/2463885223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0e40cd270 0x7fe0e41f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:16.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0e259c700 1 -- 172.21.15.79:0/2463885223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0e40cd270 msgr2=0x7fe0e41f5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:16.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0e259c700 1 --2- 172.21.15.79:0/2463885223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0e40cd270 0x7fe0e41f5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0e259c700 1 -- 172.21.15.79:0/2463885223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0e40cc2a0 msgr2=0x7fe0e40c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:16.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0e259c700 1 --2- 172.21.15.79:0/2463885223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0e40cc2a0 0x7fe0e40c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.380 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0e259c700 1 -- 172.21.15.79:0/2463885223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc009b30 con 0x7fe0e40703b0 2023-10-19T08:39:16.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0e1d9b700 1 --2- 172.21.15.79:0/2463885223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0e40cc2a0 0x7fe0e40c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:16.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0e259c700 1 --2- 172.21.15.79:0/2463885223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e40703b0 0x7fe0e40c22b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800e810 tx=0x7fe0d800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:16.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0d2ffd700 1 -- 172.21.15.79:0/2463885223 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8013610 con 0x7fe0e40703b0 2023-10-19T08:39:16.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0d2ffd700 1 -- 172.21.15.79:0/2463885223 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d8013770 con 0x7fe0e40703b0 2023-10-19T08:39:16.381 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0e8ebe700 1 -- 172.21.15.79:0/2463885223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e40c5400 con 0x7fe0e40703b0 2023-10-19T08:39:16.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0d2ffd700 1 -- 172.21.15.79:0/2463885223 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8013b20 con 0x7fe0e40703b0 2023-10-19T08:39:16.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.366+0000 7fe0e8ebe700 1 -- 172.21.15.79:0/2463885223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e4153260 con 0x7fe0e40703b0 2023-10-19T08:39:16.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.367+0000 7fe0e8ebe700 1 -- 172.21.15.79:0/2463885223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e404ee70 con 0x7fe0e40703b0 2023-10-19T08:39:16.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.368+0000 7fe0d2ffd700 1 -- 172.21.15.79:0/2463885223 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe0d8013c80 con 0x7fe0e40703b0 2023-10-19T08:39:16.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.368+0000 7fe0d2ffd700 1 --2- 172.21.15.79:0/2463885223 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe0c406a0e0 0x7fe0c406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:16.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.368+0000 7fe0d2ffd700 1 -- 172.21.15.79:0/2463885223 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe0d80885c0 con 0x7fe0e40703b0 2023-10-19T08:39:16.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.368+0000 7fe0e1d9b700 1 --2- 172.21.15.79:0/2463885223 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe0c406a0e0 0x7fe0c406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:16.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.368+0000 7fe0e1d9b700 1 --2- 172.21.15.79:0/2463885223 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe0c406a0e0 0x7fe0c406c5a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4000f60 tx=0x7fe0d4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:16.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.372+0000 7fe0d2ffd700 1 -- 172.21.15.79:0/2463885223 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fe0d8053990 con 0x7fe0e40703b0 2023-10-19T08:39:16.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.562+0000 7fe0e8ebe700 1 -- 172.21.15.79:0/2463885223 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe0e40b1820 con 0x7fe0e40703b0 2023-10-19T08:39:16.566 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.563+0000 7fe0d2ffd700 1 -- 172.21.15.79:0/2463885223 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe0d8056fb0 con 0x7fe0e40703b0 2023-10-19T08:39:16.567 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:39:16.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.565+0000 7fe0e8ebe700 1 -- 172.21.15.79:0/2463885223 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe0c406a0e0 msgr2=0x7fe0c406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:16.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.565+0000 7fe0e8ebe700 1 --2- 172.21.15.79:0/2463885223 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe0c406a0e0 0x7fe0c406c5a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4000f60 tx=0x7fe0d4009040 comp rx=0 tx=0).stop 2023-10-19T08:39:16.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.565+0000 7fe0e8ebe700 1 -- 172.21.15.79:0/2463885223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e40703b0 msgr2=0x7fe0e40c22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:16.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.565+0000 7fe0e8ebe700 1 --2- 172.21.15.79:0/2463885223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e40703b0 0x7fe0e40c22b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe0d800e810 tx=0x7fe0d800ebd0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.565+0000 7fe0e8ebe700 1 -- 172.21.15.79:0/2463885223 shutdown_connections 2023-10-19T08:39:16.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.565+0000 7fe0e8ebe700 1 --2- 172.21.15.79:0/2463885223 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe0c406a0e0 0x7fe0c406c5a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.565+0000 7fe0e8ebe700 1 --2- 172.21.15.79:0/2463885223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0e40cd270 0x7fe0e41f5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.565+0000 7fe0e8ebe700 1 --2- 172.21.15.79:0/2463885223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe0e40703b0 0x7fe0e40c22b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.565+0000 7fe0e8ebe700 1 --2- 172.21.15.79:0/2463885223 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0e40cc2a0 0x7fe0e40c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.565+0000 7fe0e8ebe700 1 -- 172.21.15.79:0/2463885223 >> 172.21.15.79:0/2463885223 conn(0x7fe0e406dcc0 msgr2=0x7fe0e40b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:16.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.565+0000 7fe0e8ebe700 1 -- 172.21.15.79:0/2463885223 shutdown_connections 2023-10-19T08:39:16.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.565+0000 7fe0e8ebe700 1 -- 172.21.15.79:0/2463885223 wait complete. 2023-10-19T08:39:16.581 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-19T08:39:16.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.699+0000 7f9eb0364700 1 Processor -- start 2023-10-19T08:39:16.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.699+0000 7f9eb0364700 1 -- start start 2023-10-19T08:39:16.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.700+0000 7f9eb0364700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9ea8159f40 0x7f9ea815e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:16.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.700+0000 7f9eb0364700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea815e870 con 0x7f9ea80cf710 2023-10-19T08:39:16.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.700+0000 7f9eb0364700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea80b5aa0 con 0x7f9ea80b5610 2023-10-19T08:39:16.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.700+0000 7f9eb0364700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea80cd800 con 0x7f9ea8159f40 2023-10-19T08:39:16.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.701+0000 7f9eae100700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9ea8159f40 0x7f9ea815e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:16.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.701+0000 7f9eae100700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9ea8159f40 0x7f9ea815e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48442/0 (socket says 172.21.15.79:48442) 2023-10-19T08:39:16.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.701+0000 7f9eae901700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9ea80cf710 0x7f9ea80cb860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58518/0 (socket says 172.21.15.79:58518) 2023-10-19T08:39:16.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.701+0000 7f9eae100700 1 -- 172.21.15.79:0/2950676395 learned_addr learned my addr 172.21.15.79:0/2950676395 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:16.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.701+0000 7f9eae100700 1 -- 172.21.15.79:0/2950676395 >> v1:172.21.15.89:6789/0 conn(0x7f9ea80b5610 legacy=0x7f9ea80cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:16.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.701+0000 7f9eae100700 1 -- 172.21.15.79:0/2950676395 >> v1:172.21.15.79:6789/0 conn(0x7f9ea80cf710 legacy=0x7f9ea80cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:16.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.701+0000 7f9ead0fe700 1 -- 172.21.15.79:0/2950676395 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354686398 0 0) 0x7f9ea815e870 con 0x7f9ea80cf710 2023-10-19T08:39:16.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.701+0000 7f9eae100700 1 -- 172.21.15.79:0/2950676395 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea80cdae0 con 0x7f9ea8159f40 2023-10-19T08:39:16.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.701+0000 7f9eae100700 1 --2- 172.21.15.79:0/2950676395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea8159f40 0x7f9ea815e330 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9e980098f0 tx=0x7f9e98009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd76b1e281592281 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:16.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.701+0000 7f9ead0fe700 1 -- 172.21.15.79:0/2950676395 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e98004230 con 0x7f9ea8159f40 2023-10-19T08:39:16.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.701+0000 7f9ead0fe700 1 -- 172.21.15.79:0/2950676395 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e98004390 con 0x7f9ea8159f40 2023-10-19T08:39:16.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.701+0000 7f9ead0fe700 1 -- 172.21.15.79:0/2950676395 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e980036a0 con 0x7f9ea8159f40 2023-10-19T08:39:16.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.702+0000 7f9eb0364700 1 -- 172.21.15.79:0/2950676395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea8159f40 msgr2=0x7f9ea815e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:16.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.702+0000 7f9eb0364700 1 --2- 172.21.15.79:0/2950676395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea8159f40 0x7f9ea815e330 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9e980098f0 tx=0x7f9e98009c00 comp rx=0 tx=0).stop 2023-10-19T08:39:16.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.702+0000 7f9eb0364700 1 -- 172.21.15.79:0/2950676395 shutdown_connections 2023-10-19T08:39:16.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.702+0000 7f9eb0364700 1 --2- 172.21.15.79:0/2950676395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea8159f40 0x7f9ea815e330 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.702+0000 7f9eb0364700 1 -- 172.21.15.79:0/2950676395 >> 172.21.15.79:0/2950676395 conn(0x7f9ea806dcc0 msgr2=0x7f9ea806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:16.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.702+0000 7f9eb0364700 1 -- 172.21.15.79:0/2950676395 shutdown_connections 2023-10-19T08:39:16.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.702+0000 7f9eb0364700 1 -- 172.21.15.79:0/2950676395 wait complete. 2023-10-19T08:39:16.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.703+0000 7f9eb0364700 1 Processor -- start 2023-10-19T08:39:16.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.703+0000 7f9eb0364700 1 -- start start 2023-10-19T08:39:16.713 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9eb0364700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ea80cf710 0x7f9ea81550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:16.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9eb0364700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea8159f40 0x7f9ea81e35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:16.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9eb0364700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ea81545e0 0x7f9ea8154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:16.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9eb0364700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea81f5d90 con 0x7f9ea8159f40 2023-10-19T08:39:16.714 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9eb0364700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea81e5270 con 0x7f9ea80cf710 2023-10-19T08:39:16.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9eb0364700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea81e5550 con 0x7f9ea81545e0 2023-10-19T08:39:16.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9ead8ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea8159f40 0x7f9ea81e35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:16.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9ead8ff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea8159f40 0x7f9ea81e35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48450/0 (socket says 172.21.15.79:48450) 2023-10-19T08:39:16.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9ead8ff700 1 -- 172.21.15.79:0/3920436669 learned_addr learned my addr 172.21.15.79:0/3920436669 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:16.715 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9eae100700 1 --2- 172.21.15.79:0/3920436669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ea80cf710 0x7f9ea81550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:16.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9ead8ff700 1 -- 172.21.15.79:0/3920436669 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ea81545e0 msgr2=0x7f9ea8154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:16.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9ead8ff700 1 --2- 172.21.15.79:0/3920436669 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ea81545e0 0x7f9ea8154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9ead8ff700 1 -- 172.21.15.79:0/3920436669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ea80cf710 msgr2=0x7f9ea81550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:16.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9ead8ff700 1 --2- 172.21.15.79:0/3920436669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ea80cf710 0x7f9ea81550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9ead8ff700 1 -- 172.21.15.79:0/3920436669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e98009550 con 0x7f9ea8159f40 2023-10-19T08:39:16.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9ead8ff700 1 --2- 172.21.15.79:0/3920436669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea8159f40 0x7f9ea81e35e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400c4d0 tx=0x7f9ea400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:16.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9e9effd700 1 -- 172.21.15.79:0/3920436669 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4011790 con 0x7f9ea8159f40 2023-10-19T08:39:16.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9e9effd700 1 -- 172.21.15.79:0/3920436669 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea40118f0 con 0x7f9ea8159f40 2023-10-19T08:39:16.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9eb0364700 1 -- 172.21.15.79:0/3920436669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea81e5830 con 0x7f9ea8159f40 2023-10-19T08:39:16.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9e9effd700 1 -- 172.21.15.79:0/3920436669 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4011ca0 con 0x7f9ea8159f40 2023-10-19T08:39:16.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.704+0000 7f9eb0364700 1 -- 172.21.15.79:0/3920436669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea8157160 con 0x7f9ea8159f40 2023-10-19T08:39:16.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.705+0000 7f9eb0364700 1 -- 172.21.15.79:0/3920436669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea81f5f00 con 0x7f9ea8159f40 2023-10-19T08:39:16.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.706+0000 7f9e9effd700 1 -- 172.21.15.79:0/3920436669 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9ea401c460 con 0x7f9ea8159f40 2023-10-19T08:39:16.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.706+0000 7f9e9effd700 1 --2- 172.21.15.79:0/3920436669 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9e8c06a0e0 0x7f9e8c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:16.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.706+0000 7f9e9effd700 1 -- 172.21.15.79:0/3920436669 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9ea40886d0 con 0x7f9ea8159f40 2023-10-19T08:39:16.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.706+0000 7f9eae100700 1 --2- 172.21.15.79:0/3920436669 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9e8c06a0e0 0x7f9e8c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:16.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.706+0000 7f9eae100700 1 --2- 172.21.15.79:0/3920436669 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9e8c06a0e0 0x7f9e8c06c5a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009c40 tx=0x7f9e98008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:16.719 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.710+0000 7f9e9effd700 1 -- 172.21.15.79:0/3920436669 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f9ea81f5f00 con 0x7f9ea8159f40 2023-10-19T08:39:16.916 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.913+0000 7f9eb0364700 1 -- 172.21.15.79:0/3920436669 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9ea81f5f00 con 0x7f9ea8159f40 2023-10-19T08:39:16.917 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.913+0000 7f9e9effd700 1 -- 172.21.15.79:0/3920436669 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9ea81f5f00 con 0x7f9ea8159f40 2023-10-19T08:39:16.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.915+0000 7f9eb0364700 1 -- 172.21.15.79:0/3920436669 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9e8c06a0e0 msgr2=0x7f9e8c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:16.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.915+0000 7f9eb0364700 1 --2- 172.21.15.79:0/3920436669 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9e8c06a0e0 0x7f9e8c06c5a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9e98009c40 tx=0x7f9e98008030 comp rx=0 tx=0).stop 2023-10-19T08:39:16.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.915+0000 7f9eb0364700 1 -- 172.21.15.79:0/3920436669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea8159f40 msgr2=0x7f9ea81e35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:16.919 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.915+0000 7f9eb0364700 1 --2- 172.21.15.79:0/3920436669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea8159f40 0x7f9ea81e35e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400c4d0 tx=0x7f9ea400c890 comp rx=0 tx=0).stop 2023-10-19T08:39:16.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.915+0000 7f9eb0364700 1 -- 172.21.15.79:0/3920436669 shutdown_connections 2023-10-19T08:39:16.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.915+0000 7f9eb0364700 1 --2- 172.21.15.79:0/3920436669 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9e8c06a0e0 0x7f9e8c06c5a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.915+0000 7f9eb0364700 1 --2- 172.21.15.79:0/3920436669 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ea81545e0 0x7f9ea8154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.920 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.915+0000 7f9eb0364700 1 --2- 172.21.15.79:0/3920436669 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ea80cf710 0x7f9ea81550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.915+0000 7f9eb0364700 1 --2- 172.21.15.79:0/3920436669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ea8159f40 0x7f9ea81e35e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:16.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.915+0000 7f9eb0364700 1 -- 172.21.15.79:0/3920436669 >> 172.21.15.79:0/3920436669 conn(0x7f9ea806dcc0 msgr2=0x7f9ea80af690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:16.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.915+0000 7f9eb0364700 1 -- 172.21.15.79:0/3920436669 shutdown_connections 2023-10-19T08:39:16.921 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:16.915+0000 7f9eb0364700 1 -- 172.21.15.79:0/3920436669 wait complete. 2023-10-19T08:39:16.922 INFO:teuthology.orchestra.run.smithi079.stderr:listed 0 entries 2023-10-19T08:39:16.930 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi089.front.sepia.ceph.com... 2023-10-19T08:39:16.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:16.931 DEBUG:teuthology.orchestra.run.smithi089:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-10-19T08:39:16.974 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:39:16.975 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-10-19T08:39:16.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:16.976 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-19T08:39:17.034 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-19T08:39:17.034 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T08:39:17.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.151+0000 7f407e660700 1 Processor -- start 2023-10-19T08:39:17.155 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.152+0000 7f407e660700 1 -- start start 2023-10-19T08:39:17.157 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.152+0000 7f407e660700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f40780b2180 0x7f40780d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.152+0000 7f407e660700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40780b5f20 0x7f40780b6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.152+0000 7f407e660700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40780d1120 con 0x7f40780cfcf0 2023-10-19T08:39:17.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.152+0000 7f407e660700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40780d1400 con 0x7f40780b5f20 2023-10-19T08:39:17.158 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.152+0000 7f407e660700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40780d16e0 con 0x7f40780b2180 2023-10-19T08:39:17.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.152+0000 7f407cbfd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40780b5f20 0x7f40780b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.152+0000 7f407cbfd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40780b5f20 0x7f40780b6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48460/0 (socket says 172.21.15.79:48460) 2023-10-19T08:39:17.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.152+0000 7f407cbfd700 1 -- 172.21.15.79:0/938216839 learned_addr learned my addr 172.21.15.79:0/938216839 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:17.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.153+0000 7f40777fe700 1 --2- 172.21.15.79:0/938216839 >> v2:172.21.15.89:3300/0 conn(0x7f40780b2180 0x7f40780d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.159 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.153+0000 7f407cbfd700 1 -- 172.21.15.79:0/938216839 >> v2:172.21.15.89:3300/0 conn(0x7f40780b2180 msgr2=0x7f40780d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:17.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.153+0000 7f407cbfd700 1 --2- 172.21.15.79:0/938216839 >> v2:172.21.15.89:3300/0 conn(0x7f40780b2180 0x7f40780d2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.153+0000 7f407cbfd700 1 -- 172.21.15.79:0/938216839 >> v1:172.21.15.89:6789/0 conn(0x7f40780cfcf0 legacy=0x7f40780d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:17.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.153+0000 7f407cbfd700 1 -- 172.21.15.79:0/938216839 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40780d19c0 con 0x7f40780b5f20 2023-10-19T08:39:17.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.153+0000 7f407cbfd700 1 --2- 172.21.15.79:0/938216839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40780b5f20 0x7f40780b6360 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f40780b8b70 tx=0x7f407000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7535f2167c7b3e7a server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:17.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.153+0000 7f4076ffd700 1 -- 172.21.15.79:0/938216839 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407000e070 con 0x7f40780b5f20 2023-10-19T08:39:17.160 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.153+0000 7f4076ffd700 1 -- 172.21.15.79:0/938216839 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407000b9c0 con 0x7f40780b5f20 2023-10-19T08:39:17.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.153+0000 7f4076ffd700 1 -- 172.21.15.79:0/938216839 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407000bd70 con 0x7f40780b5f20 2023-10-19T08:39:17.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.154+0000 7f407e660700 1 -- 172.21.15.79:0/938216839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40780b5f20 msgr2=0x7f40780b6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:17.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.154+0000 7f407e660700 1 --2- 172.21.15.79:0/938216839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40780b5f20 0x7f40780b6360 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f40780b8b70 tx=0x7f407000b330 comp rx=0 tx=0).stop 2023-10-19T08:39:17.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.154+0000 7f407e660700 1 -- 172.21.15.79:0/938216839 shutdown_connections 2023-10-19T08:39:17.161 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.154+0000 7f407e660700 1 --2- 172.21.15.79:0/938216839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40780b5f20 0x7f40780b6360 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.154+0000 7f407e660700 1 --2- 172.21.15.79:0/938216839 >> v2:172.21.15.89:3300/0 conn(0x7f40780b2180 0x7f40780d2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.154+0000 7f407e660700 1 -- 172.21.15.79:0/938216839 >> 172.21.15.79:0/938216839 conn(0x7f4078071b30 msgr2=0x7f4078071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:17.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.154+0000 7f407e660700 1 -- 172.21.15.79:0/938216839 shutdown_connections 2023-10-19T08:39:17.162 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.154+0000 7f407e660700 1 -- 172.21.15.79:0/938216839 wait complete. 2023-10-19T08:39:17.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.155+0000 7f407e660700 1 Processor -- start 2023-10-19T08:39:17.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.155+0000 7f407e660700 1 -- start start 2023-10-19T08:39:17.165 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.156+0000 7f407e660700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40780b2180 0x7f4078157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.156+0000 7f407e660700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40780b5f20 0x7f407815f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.156+0000 7f407e660700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40780cfcf0 0x7f4078157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.156+0000 7f407e660700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407815efd0 con 0x7f40780b5f20 2023-10-19T08:39:17.166 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.156+0000 7f407e660700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4078157ad0 con 0x7f40780cfcf0 2023-10-19T08:39:17.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.156+0000 7f407e660700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407815e3c0 con 0x7f40780b2180 2023-10-19T08:39:17.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.156+0000 7f40777fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40780b5f20 0x7f407815f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.156+0000 7f40777fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40780b5f20 0x7f407815f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48464/0 (socket says 172.21.15.79:48464) 2023-10-19T08:39:17.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.156+0000 7f40777fe700 1 -- 172.21.15.79:0/3505044130 learned_addr learned my addr 172.21.15.79:0/3505044130 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:17.167 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.156+0000 7f407cbfd700 1 --2- 172.21.15.79:0/3505044130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40780cfcf0 0x7f4078157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.156+0000 7f4077fff700 1 --2- 172.21.15.79:0/3505044130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40780b2180 0x7f4078157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.157+0000 7f40777fe700 1 -- 172.21.15.79:0/3505044130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40780b2180 msgr2=0x7f4078157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:17.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.157+0000 7f40777fe700 1 --2- 172.21.15.79:0/3505044130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40780b2180 0x7f4078157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.157+0000 7f40777fe700 1 -- 172.21.15.79:0/3505044130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40780cfcf0 msgr2=0x7f4078157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:17.168 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.157+0000 7f40777fe700 1 --2- 172.21.15.79:0/3505044130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40780cfcf0 0x7f4078157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.157+0000 7f40777fe700 1 -- 172.21.15.79:0/3505044130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4070009b30 con 0x7f40780b5f20 2023-10-19T08:39:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.157+0000 7f40777fe700 1 --2- 172.21.15.79:0/3505044130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40780b5f20 0x7f407815f790 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f406c00e810 tx=0x7f406c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.157+0000 7f4074ff9700 1 -- 172.21.15.79:0/3505044130 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c00c070 con 0x7f40780b5f20 2023-10-19T08:39:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.157+0000 7f4074ff9700 1 -- 172.21.15.79:0/3505044130 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406c013610 con 0x7f40780b5f20 2023-10-19T08:39:17.169 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.157+0000 7f4074ff9700 1 -- 172.21.15.79:0/3505044130 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c0139c0 con 0x7f40780b5f20 2023-10-19T08:39:17.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.157+0000 7f407e660700 1 -- 172.21.15.79:0/3505044130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407815e6a0 con 0x7f40780b5f20 2023-10-19T08:39:17.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.157+0000 7f407e660700 1 -- 172.21.15.79:0/3505044130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407815ec60 con 0x7f40780b5f20 2023-10-19T08:39:17.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.158+0000 7f407e660700 1 -- 172.21.15.79:0/3505044130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407804ee70 con 0x7f40780b5f20 2023-10-19T08:39:17.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.159+0000 7f4074ff9700 1 -- 172.21.15.79:0/3505044130 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f406c013b20 con 0x7f40780b5f20 2023-10-19T08:39:17.170 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.159+0000 7f4074ff9700 1 --2- 172.21.15.79:0/3505044130 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f406406a0e0 0x7f406406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.159+0000 7f4074ff9700 1 -- 172.21.15.79:0/3505044130 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f406c088390 con 0x7f40780b5f20 2023-10-19T08:39:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.159+0000 7f4077fff700 1 --2- 172.21.15.79:0/3505044130 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f406406a0e0 0x7f406406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.171 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.159+0000 7f4077fff700 1 --2- 172.21.15.79:0/3505044130 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f406406a0e0 0x7f406406c5a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4068007fd0 tx=0x7f4068009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:17.172 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.163+0000 7f4074ff9700 1 -- 172.21.15.79:0/3505044130 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f406c0571d0 con 0x7f40780b5f20 2023-10-19T08:39:17.402 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.399+0000 7f407e660700 1 -- 172.21.15.79:0/3505044130 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f407815f110 con 0x7f40780b5f20 2023-10-19T08:39:17.403 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.399+0000 7f4074ff9700 1 -- 172.21.15.79:0/3505044130 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4865 (secure 0 0 0) 0x7f407815f110 con 0x7f40780b5f20 2023-10-19T08:39:17.403 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:17.403 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3710906518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3710906518},{"type":"v1","addr":"172.21.15.89:6835","nonce":3710906518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3037310614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3037310614},{"type":"v1","addr":"172.21.15.79:6835","nonce":3037310614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/79656061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":79656061},{"type":"v1","addr":"172.21.15.79:6837","nonce":79656061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-19T08:37:56.667105+0000","modified":"2023-10-19T08:38:20.379674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6833/3076620199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3076620199},{"type":"v1","addr":"172.21.15.89:6833","nonce":3076620199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-19T08:39:17.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.401+0000 7f407e660700 1 -- 172.21.15.79:0/3505044130 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f406406a0e0 msgr2=0x7f406406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:17.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.401+0000 7f407e660700 1 --2- 172.21.15.79:0/3505044130 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f406406a0e0 0x7f406406c5a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4068007fd0 tx=0x7f4068009040 comp rx=0 tx=0).stop 2023-10-19T08:39:17.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.401+0000 7f407e660700 1 -- 172.21.15.79:0/3505044130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40780b5f20 msgr2=0x7f407815f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:17.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.401+0000 7f407e660700 1 --2- 172.21.15.79:0/3505044130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40780b5f20 0x7f407815f790 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f406c00e810 tx=0x7f406c00eb20 comp rx=0 tx=0).stop 2023-10-19T08:39:17.405 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.401+0000 7f407e660700 1 -- 172.21.15.79:0/3505044130 shutdown_connections 2023-10-19T08:39:17.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.401+0000 7f407e660700 1 --2- 172.21.15.79:0/3505044130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40780cfcf0 0x7f4078157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.401+0000 7f407e660700 1 --2- 172.21.15.79:0/3505044130 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f406406a0e0 0x7f406406c5a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.401+0000 7f407e660700 1 --2- 172.21.15.79:0/3505044130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40780b2180 0x7f4078157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.406 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.401+0000 7f407e660700 1 --2- 172.21.15.79:0/3505044130 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40780b5f20 0x7f407815f790 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.401+0000 7f407e660700 1 -- 172.21.15.79:0/3505044130 >> 172.21.15.79:0/3505044130 conn(0x7f4078071b30 msgr2=0x7f4078071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:17.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.401+0000 7f407e660700 1 -- 172.21.15.79:0/3505044130 shutdown_connections 2023-10-19T08:39:17.407 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.401+0000 7f407e660700 1 -- 172.21.15.79:0/3505044130 wait complete. 2023-10-19T08:39:17.408 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 9 2023-10-19T08:39:17.417 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:39:17.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.534+0000 7f20fd99b700 1 Processor -- start 2023-10-19T08:39:17.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.534+0000 7f20fd99b700 1 -- start start 2023-10-19T08:39:17.542 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.535+0000 7f20fd99b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20f80cd0c0 0x7f20f80cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20fd99b700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f80cd520 con 0x7f20f80cdd40 2023-10-19T08:39:17.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20fd99b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f815de50 con 0x7f20f80af170 2023-10-19T08:39:17.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20fd99b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f80af550 con 0x7f20f80cd0c0 2023-10-19T08:39:17.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f77fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f20f80cdd40 0x7f20f806a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58546/0 (socket says 172.21.15.79:58546) 2023-10-19T08:39:17.543 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f77fe700 1 -- 172.21.15.79:0/3830836595 learned_addr learned my addr 172.21.15.79:0/3830836595 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:17.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f67fc700 1 --2- 172.21.15.79:0/3830836595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20f80cd0c0 0x7f20f80cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f5ffb700 1 -- 172.21.15.79:0/3830836595 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896437491 0 0) 0x7f20f80cd520 con 0x7f20f80cdd40 2023-10-19T08:39:17.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f5ffb700 1 -- 172.21.15.79:0/3830836595 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20e00035b0 con 0x7f20f80cdd40 2023-10-19T08:39:17.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f5ffb700 1 -- 172.21.15.79:0/3830836595 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473758119 0 0) 0x7f20f815de50 con 0x7f20f80af170 2023-10-19T08:39:17.544 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f5ffb700 1 -- 172.21.15.79:0/3830836595 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20f80cd520 con 0x7f20f80af170 2023-10-19T08:39:17.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f5ffb700 1 -- 172.21.15.79:0/3830836595 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 569975379 0 0) 0x7f20e00035b0 con 0x7f20f80cdd40 2023-10-19T08:39:17.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f5ffb700 1 -- 172.21.15.79:0/3830836595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20f80cd0c0 msgr2=0x7f20f80cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:17.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f5ffb700 1 --2- 172.21.15.79:0/3830836595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20f80cd0c0 0x7f20f80cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f5ffb700 1 -- 172.21.15.79:0/3830836595 >> v1:172.21.15.89:6789/0 conn(0x7f20f80af170 legacy=0x7f20f80b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:17.545 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f5ffb700 1 -- 172.21.15.79:0/3830836595 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f815e130 con 0x7f20f80cdd40 2023-10-19T08:39:17.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f5ffb700 1 -- 172.21.15.79:0/3830836595 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f20f00019f0 con 0x7f20f80cdd40 2023-10-19T08:39:17.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f5ffb700 1 -- 172.21.15.79:0/3830836595 >> v1:172.21.15.79:6789/0 conn(0x7f20f80cdd40 legacy=0x7f20f806a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:17.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f5ffb700 1 --2- 172.21.15.79:0/3830836595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20f80cd0c0 0x7f20e0003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f5ffb700 1 --2- 172.21.15.79:0/3830836595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20e0004120 0x7f20e0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f5ffb700 1 --2- 172.21.15.79:0/3830836595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e0004d90 0x7f20e0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f5ffb700 1 -- 172.21.15.79:0/3830836595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f80af550 con 0x7f20e0004120 2023-10-19T08:39:17.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f5ffb700 1 -- 172.21.15.79:0/3830836595 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e000baf0 con 0x7f20e0004d90 2023-10-19T08:39:17.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f5ffb700 1 -- 172.21.15.79:0/3830836595 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e000bcb0 con 0x7f20f80cd0c0 2023-10-19T08:39:17.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f67fc700 1 --2- 172.21.15.79:0/3830836595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20e0004120 0x7f20e0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f6ffd700 1 --2- 172.21.15.79:0/3830836595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20f80cd0c0 0x7f20e0003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.536+0000 7f20f77fe700 1 --2- 172.21.15.79:0/3830836595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e0004d90 0x7f20e0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.537+0000 7f20f67fc700 1 -- 172.21.15.79:0/3830836595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20f80cd0c0 msgr2=0x7f20e0003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:17.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.537+0000 7f20f67fc700 1 --2- 172.21.15.79:0/3830836595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20f80cd0c0 0x7f20e0003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.537+0000 7f20f67fc700 1 -- 172.21.15.79:0/3830836595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e0004d90 msgr2=0x7f20e0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:17.548 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.537+0000 7f20f67fc700 1 --2- 172.21.15.79:0/3830836595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e0004d90 0x7f20e0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.537+0000 7f20f67fc700 1 -- 172.21.15.79:0/3830836595 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e00035b0 con 0x7f20e0004120 2023-10-19T08:39:17.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.537+0000 7f20f77fe700 1 --2- 172.21.15.79:0/3830836595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20e0004d90 0x7f20e0005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:17.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.537+0000 7f20f67fc700 1 --2- 172.21.15.79:0/3830836595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20e0004120 0x7f20e0004850 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009b60 tx=0x7f20e0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f64dfa3519a03ad server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:17.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.537+0000 7f20f5ffb700 1 -- 172.21.15.79:0/3830836595 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e800e6c0 con 0x7f20e0004120 2023-10-19T08:39:17.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.537+0000 7f20f5ffb700 1 -- 172.21.15.79:0/3830836595 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e800e820 con 0x7f20e0004120 2023-10-19T08:39:17.549 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.537+0000 7f20f5ffb700 1 -- 172.21.15.79:0/3830836595 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e800eb90 con 0x7f20e0004120 2023-10-19T08:39:17.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.537+0000 7f20fd99b700 1 -- 172.21.15.79:0/3830836595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20e0004120 msgr2=0x7f20e0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:17.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.537+0000 7f20fd99b700 1 --2- 172.21.15.79:0/3830836595 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20e0004120 0x7f20e0004850 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f20e8009b60 tx=0x7f20e0005880 comp rx=0 tx=0).stop 2023-10-19T08:39:17.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.537+0000 7f20f77fe700 1 -- 172.21.15.79:0/3830836595 reap_dead start 2023-10-19T08:39:17.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.537+0000 7f20fd99b700 1 -- 172.21.15.79:0/3830836595 shutdown_connections 2023-10-19T08:39:17.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.537+0000 7f20fd99b700 1 -- 172.21.15.79:0/3830836595 >> 172.21.15.79:0/3830836595 conn(0x7f20f806dcc0 msgr2=0x7f20f806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:17.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.537+0000 7f20fd99b700 1 -- 172.21.15.79:0/3830836595 shutdown_connections 2023-10-19T08:39:17.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.537+0000 7f20fd99b700 1 -- 172.21.15.79:0/3830836595 wait complete. 2023-10-19T08:39:17.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.539+0000 7f20fd99b700 1 Processor -- start 2023-10-19T08:39:17.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.539+0000 7f20fd99b700 1 -- start start 2023-10-19T08:39:17.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.539+0000 7f20fd99b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20e0004120 0x7f20f80c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.539+0000 7f20fd99b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20f81554d0 0x7f20f80c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.554 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.539+0000 7f20fd99b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20f80c95d0 0x7f20f80c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.539+0000 7f20fd99b700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f80afb00 con 0x7f20e0004120 2023-10-19T08:39:17.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.539+0000 7f20fd99b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f80afde0 con 0x7f20f81554d0 2023-10-19T08:39:17.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.540+0000 7f20fd99b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f80b00c0 con 0x7f20f80c95d0 2023-10-19T08:39:17.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.540+0000 7f20f6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20e0004120 0x7f20f80c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.555 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.540+0000 7f20f6ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20e0004120 0x7f20f80c7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48482/0 (socket says 172.21.15.79:48482) 2023-10-19T08:39:17.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.540+0000 7f20f6ffd700 1 -- 172.21.15.79:0/2686609363 learned_addr learned my addr 172.21.15.79:0/2686609363 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:17.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.540+0000 7f20f77fe700 1 --2- 172.21.15.79:0/2686609363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20f80c95d0 0x7f20f80c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.540+0000 7f20f6ffd700 1 -- 172.21.15.79:0/2686609363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20f80c95d0 msgr2=0x7f20f80c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:17.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.540+0000 7f20f6ffd700 1 --2- 172.21.15.79:0/2686609363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20f80c95d0 0x7f20f80c5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.540+0000 7f20f6ffd700 1 -- 172.21.15.79:0/2686609363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20f81554d0 msgr2=0x7f20f80c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:17.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.540+0000 7f20f67fc700 1 --2- 172.21.15.79:0/2686609363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20f81554d0 0x7f20f80c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.540+0000 7f20f6ffd700 1 --2- 172.21.15.79:0/2686609363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20f81554d0 0x7f20f80c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.540+0000 7f20f6ffd700 1 -- 172.21.15.79:0/2686609363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f80c8290 con 0x7f20e0004120 2023-10-19T08:39:17.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.540+0000 7f20f6ffd700 1 --2- 172.21.15.79:0/2686609363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20e0004120 0x7f20f80c7d50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00f7e0 tx=0x7f20ec00fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:17.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.540+0000 7f20dffff700 1 -- 172.21.15.79:0/2686609363 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec001520 con 0x7f20e0004120 2023-10-19T08:39:17.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.540+0000 7f20dffff700 1 -- 172.21.15.79:0/2686609363 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ec0052e0 con 0x7f20e0004120 2023-10-19T08:39:17.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.540+0000 7f20dffff700 1 -- 172.21.15.79:0/2686609363 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec003680 con 0x7f20e0004120 2023-10-19T08:39:17.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.540+0000 7f20fd99b700 1 -- 172.21.15.79:0/2686609363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f80c9a70 con 0x7f20e0004120 2023-10-19T08:39:17.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.540+0000 7f20fd99b700 1 -- 172.21.15.79:0/2686609363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f80b2b50 con 0x7f20e0004120 2023-10-19T08:39:17.558 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.541+0000 7f20fd99b700 1 -- 172.21.15.79:0/2686609363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f80afc40 con 0x7f20e0004120 2023-10-19T08:39:17.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.542+0000 7f20dffff700 1 -- 172.21.15.79:0/2686609363 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f20ec003800 con 0x7f20e0004120 2023-10-19T08:39:17.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.542+0000 7f20dffff700 1 --2- 172.21.15.79:0/2686609363 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f20e406a0e0 0x7f20e406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.542+0000 7f20dffff700 1 -- 172.21.15.79:0/2686609363 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f20ec088830 con 0x7f20e0004120 2023-10-19T08:39:17.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.542+0000 7f20f67fc700 1 --2- 172.21.15.79:0/2686609363 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f20e406a0e0 0x7f20e406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.542+0000 7f20f67fc700 1 --2- 172.21.15.79:0/2686609363 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f20e406a0e0 0x7f20e406c5a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f20f80b5aa0 tx=0x7f20e8008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:17.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.546+0000 7f20dffff700 1 -- 172.21.15.79:0/2686609363 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f20f80afc40 con 0x7f20e0004120 2023-10-19T08:39:17.740 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.736+0000 7f20fd99b700 1 -- 172.21.15.79:0/2686609363 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20f80afc40 con 0x7f20e0004120 2023-10-19T08:39:17.741 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.737+0000 7f20dffff700 1 -- 172.21.15.79:0/2686609363 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20155 (secure 0 0 0) 0x7f20f80afc40 con 0x7f20e0004120 2023-10-19T08:39:17.741 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:17.742 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:44.473795+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:39:17.743 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.739+0000 7f20fd99b700 1 -- 172.21.15.79:0/2686609363 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f20e406a0e0 msgr2=0x7f20e406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:17.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.739+0000 7f20fd99b700 1 --2- 172.21.15.79:0/2686609363 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f20e406a0e0 0x7f20e406c5a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f20f80b5aa0 tx=0x7f20e8008030 comp rx=0 tx=0).stop 2023-10-19T08:39:17.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.739+0000 7f20fd99b700 1 -- 172.21.15.79:0/2686609363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20e0004120 msgr2=0x7f20f80c7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:17.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.739+0000 7f20fd99b700 1 --2- 172.21.15.79:0/2686609363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20e0004120 0x7f20f80c7d50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f20ec00f7e0 tx=0x7f20ec00fba0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.740+0000 7f20fd99b700 1 -- 172.21.15.79:0/2686609363 shutdown_connections 2023-10-19T08:39:17.744 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.740+0000 7f20fd99b700 1 --2- 172.21.15.79:0/2686609363 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f20e406a0e0 0x7f20e406c5a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.740+0000 7f20fd99b700 1 --2- 172.21.15.79:0/2686609363 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f20f80c95d0 0x7f20f80c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.740+0000 7f20fd99b700 1 --2- 172.21.15.79:0/2686609363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f20e0004120 0x7f20f80c7d50 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.740+0000 7f20fd99b700 1 --2- 172.21.15.79:0/2686609363 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f20f81554d0 0x7f20f80c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.740+0000 7f20fd99b700 1 -- 172.21.15.79:0/2686609363 >> 172.21.15.79:0/2686609363 conn(0x7f20f806dcc0 msgr2=0x7f20f80b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:17.745 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.740+0000 7f20fd99b700 1 -- 172.21.15.79:0/2686609363 shutdown_connections 2023-10-19T08:39:17.746 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.740+0000 7f20fd99b700 1 -- 172.21.15.79:0/2686609363 wait complete. 2023-10-19T08:39:17.755 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-19T08:37:54.318159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-19T08:37:55.629862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-19T08:37:59.333062+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-19T08:39:17.756 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:39:17.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.875+0000 7fd5a7bce700 1 Processor -- start 2023-10-19T08:39:17.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.876+0000 7fd5a7bce700 1 -- start start 2023-10-19T08:39:17.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.876+0000 7fd5a7bce700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5a006a930 0x7fd5a00cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.876+0000 7fd5a7bce700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd5a00703b0 0x7fd5a00cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.876+0000 7fd5a7bce700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a00b1fe0 con 0x7fd5a00cd270 2023-10-19T08:39:17.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.876+0000 7fd5a7bce700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a0160a80 con 0x7fd5a00703b0 2023-10-19T08:39:17.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.876+0000 7fd5a7bce700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a00ce2b0 con 0x7fd5a006a930 2023-10-19T08:39:17.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.877+0000 7fd5a5169700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5a006a930 0x7fd5a00cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.877+0000 7fd5a616b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd5a00703b0 0x7fd5a00cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.877+0000 7fd5a616b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd5a00703b0 0x7fd5a00cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:34740/0 (socket says 172.21.15.79:34740) 2023-10-19T08:39:17.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.877+0000 7fd5a5169700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5a006a930 0x7fd5a00cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:51116/0 (socket says 172.21.15.79:51116) 2023-10-19T08:39:17.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.877+0000 7fd5a616b700 1 -- 172.21.15.79:0/966087900 learned_addr learned my addr 172.21.15.79:0/966087900 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:17.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.877+0000 7fd5a4968700 1 -- 172.21.15.79:0/966087900 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289786481 0 0) 0x7fd5a00b1fe0 con 0x7fd5a00cd270 2023-10-19T08:39:17.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.877+0000 7fd5a4968700 1 -- 172.21.15.79:0/966087900 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd58c0035b0 con 0x7fd5a00cd270 2023-10-19T08:39:17.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.877+0000 7fd5a616b700 1 -- 172.21.15.79:0/966087900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5a006a930 msgr2=0x7fd5a00cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:17.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.877+0000 7fd5a616b700 1 --2- 172.21.15.79:0/966087900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5a006a930 0x7fd5a00cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.877+0000 7fd5a616b700 1 -- 172.21.15.79:0/966087900 >> v1:172.21.15.89:6789/0 conn(0x7fd5a00cd270 legacy=0x7fd5a006a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:17.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.877+0000 7fd5a616b700 1 -- 172.21.15.79:0/966087900 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a00ce550 con 0x7fd5a00703b0 2023-10-19T08:39:17.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.877+0000 7fd5a5169700 1 --2- 172.21.15.79:0/966087900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5a006a930 0x7fd5a00cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:39:17.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.877+0000 7fd5a616b700 1 --2- 172.21.15.79:0/966087900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5a00703b0 0x7fd5a00cb7d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd598009e50 tx=0x7fd59800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2274b948b08e4f19 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:17.885 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.878+0000 7fd5a4968700 1 -- 172.21.15.79:0/966087900 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59800e070 con 0x7fd5a00703b0 2023-10-19T08:39:17.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.878+0000 7fd5a4968700 1 -- 172.21.15.79:0/966087900 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59800b910 con 0x7fd5a00703b0 2023-10-19T08:39:17.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.878+0000 7fd5a4968700 1 -- 172.21.15.79:0/966087900 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59800bc80 con 0x7fd5a00703b0 2023-10-19T08:39:17.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.878+0000 7fd5a7bce700 1 -- 172.21.15.79:0/966087900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5a00703b0 msgr2=0x7fd5a00cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:17.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.878+0000 7fd5a7bce700 1 --2- 172.21.15.79:0/966087900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5a00703b0 0x7fd5a00cb7d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd598009e50 tx=0x7fd59800b330 comp rx=0 tx=0).stop 2023-10-19T08:39:17.886 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.878+0000 7fd5a7bce700 1 -- 172.21.15.79:0/966087900 shutdown_connections 2023-10-19T08:39:17.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.878+0000 7fd5a7bce700 1 --2- 172.21.15.79:0/966087900 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5a00703b0 0x7fd5a00cb7d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.878+0000 7fd5a7bce700 1 --2- 172.21.15.79:0/966087900 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5a006a930 0x7fd5a00cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.878+0000 7fd5a7bce700 1 -- 172.21.15.79:0/966087900 >> 172.21.15.79:0/966087900 conn(0x7fd5a006dcc0 msgr2=0x7fd5a006e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:17.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.878+0000 7fd5a7bce700 1 -- 172.21.15.79:0/966087900 shutdown_connections 2023-10-19T08:39:17.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.878+0000 7fd5a7bce700 1 -- 172.21.15.79:0/966087900 wait complete. 2023-10-19T08:39:17.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.879+0000 7fd5a7bce700 1 Processor -- start 2023-10-19T08:39:17.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.879+0000 7fd5a7bce700 1 -- start start 2023-10-19T08:39:17.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.880+0000 7fd5a7bce700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5a006a930 0x7fd5a00b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.880+0000 7fd5a7bce700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5a00703b0 0x7fd5a014d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.880+0000 7fd5a7bce700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5a00cd270 0x7fd5a014f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.880+0000 7fd5a7bce700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a014de00 con 0x7fd5a00703b0 2023-10-19T08:39:17.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.880+0000 7fd5a7bce700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a014e080 con 0x7fd5a006a930 2023-10-19T08:39:17.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.880+0000 7fd5a7bce700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a014e360 con 0x7fd5a00cd270 2023-10-19T08:39:17.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.880+0000 7fd5a5169700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5a00703b0 0x7fd5a014d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.880+0000 7fd5a5169700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5a00703b0 0x7fd5a014d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48498/0 (socket says 172.21.15.79:48498) 2023-10-19T08:39:17.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.880+0000 7fd5a5169700 1 -- 172.21.15.79:0/3249022500 learned_addr learned my addr 172.21.15.79:0/3249022500 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:17.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.880+0000 7fd5a596a700 1 --2- 172.21.15.79:0/3249022500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5a006a930 0x7fd5a00b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.880+0000 7fd5a616b700 1 --2- 172.21.15.79:0/3249022500 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5a00cd270 0x7fd5a014f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.881+0000 7fd5a5169700 1 -- 172.21.15.79:0/3249022500 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5a00cd270 msgr2=0x7fd5a014f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:17.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.881+0000 7fd5a5169700 1 --2- 172.21.15.79:0/3249022500 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5a00cd270 0x7fd5a014f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.881+0000 7fd5a5169700 1 -- 172.21.15.79:0/3249022500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5a006a930 msgr2=0x7fd5a00b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:17.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.881+0000 7fd5a5169700 1 --2- 172.21.15.79:0/3249022500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5a006a930 0x7fd5a00b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:17.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.881+0000 7fd5a5169700 1 -- 172.21.15.79:0/3249022500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c0094a0 con 0x7fd5a00703b0 2023-10-19T08:39:17.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.881+0000 7fd5a5169700 1 --2- 172.21.15.79:0/3249022500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5a00703b0 0x7fd5a014d8c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00ebe0 tx=0x7fd59c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:17.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.881+0000 7fd5967fc700 1 -- 172.21.15.79:0/3249022500 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c009760 con 0x7fd5a00703b0 2023-10-19T08:39:17.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.881+0000 7fd5967fc700 1 -- 172.21.15.79:0/3249022500 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c00c850 con 0x7fd5a00703b0 2023-10-19T08:39:17.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.881+0000 7fd5a7bce700 1 -- 172.21.15.79:0/3249022500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd598009b30 con 0x7fd5a00703b0 2023-10-19T08:39:17.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.881+0000 7fd5967fc700 1 -- 172.21.15.79:0/3249022500 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c00cbe0 con 0x7fd5a00703b0 2023-10-19T08:39:17.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.881+0000 7fd5a7bce700 1 -- 172.21.15.79:0/3249022500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a014e920 con 0x7fd5a00703b0 2023-10-19T08:39:17.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.882+0000 7fd5a7bce700 1 -- 172.21.15.79:0/3249022500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a004ee70 con 0x7fd5a00703b0 2023-10-19T08:39:17.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.882+0000 7fd5967fc700 1 -- 172.21.15.79:0/3249022500 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd59c00cd40 con 0x7fd5a00703b0 2023-10-19T08:39:17.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.883+0000 7fd5967fc700 1 --2- 172.21.15.79:0/3249022500 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd58406a0e0 0x7fd58406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:17.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.883+0000 7fd5967fc700 1 -- 172.21.15.79:0/3249022500 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd59c088bd0 con 0x7fd5a00703b0 2023-10-19T08:39:17.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.883+0000 7fd5a596a700 1 --2- 172.21.15.79:0/3249022500 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd58406a0e0 0x7fd58406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:17.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.883+0000 7fd5a596a700 1 --2- 172.21.15.79:0/3249022500 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd58406a0e0 0x7fd58406c5a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd590001790 tx=0x7fd590009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:17.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:17.887+0000 7fd5967fc700 1 -- 172.21.15.79:0/3249022500 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd59c053f90 con 0x7fd5a00703b0 2023-10-19T08:39:18.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.076+0000 7fd5a7bce700 1 -- 172.21.15.79:0/3249022500 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5a00c9ff0 con 0x7fd5a00703b0 2023-10-19T08:39:18.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.076+0000 7fd5967fc700 1 -- 172.21.15.79:0/3249022500 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd59c0575b0 con 0x7fd5a00703b0 2023-10-19T08:39:18.080 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:39:18.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.078+0000 7fd5a7bce700 1 -- 172.21.15.79:0/3249022500 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd58406a0e0 msgr2=0x7fd58406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:18.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.078+0000 7fd5a7bce700 1 --2- 172.21.15.79:0/3249022500 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd58406a0e0 0x7fd58406c5a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd590001790 tx=0x7fd590009040 comp rx=0 tx=0).stop 2023-10-19T08:39:18.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.078+0000 7fd5a7bce700 1 -- 172.21.15.79:0/3249022500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5a00703b0 msgr2=0x7fd5a014d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:18.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.078+0000 7fd5a7bce700 1 --2- 172.21.15.79:0/3249022500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5a00703b0 0x7fd5a014d8c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00ebe0 tx=0x7fd59c00eef0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.078+0000 7fd5a7bce700 1 -- 172.21.15.79:0/3249022500 shutdown_connections 2023-10-19T08:39:18.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.078+0000 7fd5a7bce700 1 --2- 172.21.15.79:0/3249022500 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd58406a0e0 0x7fd58406c5a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.078+0000 7fd5a7bce700 1 --2- 172.21.15.79:0/3249022500 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5a00cd270 0x7fd5a014f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.078+0000 7fd5a7bce700 1 --2- 172.21.15.79:0/3249022500 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5a006a930 0x7fd5a00b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.078+0000 7fd5a7bce700 1 --2- 172.21.15.79:0/3249022500 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5a00703b0 0x7fd5a014d8c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.078+0000 7fd5a7bce700 1 -- 172.21.15.79:0/3249022500 >> 172.21.15.79:0/3249022500 conn(0x7fd5a006dcc0 msgr2=0x7fd5a006e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:18.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.079+0000 7fd5a7bce700 1 -- 172.21.15.79:0/3249022500 shutdown_connections 2023-10-19T08:39:18.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.079+0000 7fd5a7bce700 1 -- 172.21.15.79:0/3249022500 wait complete. 2023-10-19T08:39:18.094 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:39:18.217 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.214+0000 7f4aa5d74700 1 Processor -- start 2023-10-19T08:39:18.218 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.214+0000 7f4aa5d74700 1 -- start start 2023-10-19T08:39:18.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.215+0000 7f4aa5d74700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa015e570 0x7f4aa00d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:18.220 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.215+0000 7f4aa5d74700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4aa00b0c00 0x7f4aa00ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:18.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.215+0000 7f4aa5d74700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa00b25f0 con 0x7f4aa00cb6f0 2023-10-19T08:39:18.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.215+0000 7f4aa5d74700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa00afd60 con 0x7f4aa00b0c00 2023-10-19T08:39:18.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.215+0000 7f4aa5d74700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa00af810 con 0x7f4aa015e570 2023-10-19T08:39:18.221 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.215+0000 7f4a9effd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f4aa00cb6f0 0x7f4aa00b04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58576/0 (socket says 172.21.15.79:58576) 2023-10-19T08:39:18.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.215+0000 7f4a9effd700 1 -- 172.21.15.79:0/3859948211 learned_addr learned my addr 172.21.15.79:0/3859948211 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:18.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.215+0000 7f4a9ffff700 1 --2- 172.21.15.79:0/3859948211 >> v2:172.21.15.89:3300/0 conn(0x7f4aa00b0c00 0x7f4aa00ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:18.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.215+0000 7f4a9f7fe700 1 --2- 172.21.15.79:0/3859948211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa015e570 0x7f4aa00d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:18.222 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.215+0000 7f4a9e7fc700 1 -- 172.21.15.79:0/3859948211 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269301710 0 0) 0x7f4aa00b25f0 con 0x7f4aa00cb6f0 2023-10-19T08:39:18.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.215+0000 7f4a9e7fc700 1 -- 172.21.15.79:0/3859948211 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a880035b0 con 0x7f4aa00cb6f0 2023-10-19T08:39:18.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.215+0000 7f4a9f7fe700 1 -- 172.21.15.79:0/3859948211 >> v2:172.21.15.89:3300/0 conn(0x7f4aa00b0c00 msgr2=0x7f4aa00ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:18.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.215+0000 7f4a9f7fe700 1 --2- 172.21.15.79:0/3859948211 >> v2:172.21.15.89:3300/0 conn(0x7f4aa00b0c00 0x7f4aa00ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.223 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.215+0000 7f4a9f7fe700 1 -- 172.21.15.79:0/3859948211 >> v1:172.21.15.79:6789/0 conn(0x7f4aa00cb6f0 legacy=0x7f4aa00b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:18.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.215+0000 7f4a9f7fe700 1 -- 172.21.15.79:0/3859948211 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa00aef70 con 0x7f4aa015e570 2023-10-19T08:39:18.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.216+0000 7f4a9f7fe700 1 --2- 172.21.15.79:0/3859948211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa015e570 0x7f4aa00d1990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4a90009840 tx=0x7f4a90009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6406676e30c8dea4 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:18.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.216+0000 7f4a9e7fc700 1 -- 172.21.15.79:0/3859948211 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a90011830 con 0x7f4aa015e570 2023-10-19T08:39:18.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.216+0000 7f4a9e7fc700 1 -- 172.21.15.79:0/3859948211 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a90011990 con 0x7f4aa015e570 2023-10-19T08:39:18.224 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.216+0000 7f4a9e7fc700 1 -- 172.21.15.79:0/3859948211 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a90011d20 con 0x7f4aa015e570 2023-10-19T08:39:18.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.216+0000 7f4aa5d74700 1 -- 172.21.15.79:0/3859948211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa015e570 msgr2=0x7f4aa00d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:18.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.216+0000 7f4aa5d74700 1 --2- 172.21.15.79:0/3859948211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa015e570 0x7f4aa00d1990 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4a90009840 tx=0x7f4a90009b50 comp rx=0 tx=0).stop 2023-10-19T08:39:18.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.216+0000 7f4aa5d74700 1 -- 172.21.15.79:0/3859948211 shutdown_connections 2023-10-19T08:39:18.225 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.216+0000 7f4aa5d74700 1 --2- 172.21.15.79:0/3859948211 >> v2:172.21.15.89:3300/0 conn(0x7f4aa00b0c00 0x7f4aa00ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.216+0000 7f4aa5d74700 1 --2- 172.21.15.79:0/3859948211 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa015e570 0x7f4aa00d1990 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.216+0000 7f4aa5d74700 1 -- 172.21.15.79:0/3859948211 >> 172.21.15.79:0/3859948211 conn(0x7f4aa009a0b0 msgr2=0x7f4aa00d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:18.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.216+0000 7f4aa5d74700 1 -- 172.21.15.79:0/3859948211 shutdown_connections 2023-10-19T08:39:18.226 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.216+0000 7f4aa5d74700 1 -- 172.21.15.79:0/3859948211 wait complete. 2023-10-19T08:39:18.229 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.218+0000 7f4aa5d74700 1 Processor -- start 2023-10-19T08:39:18.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.218+0000 7f4aa5d74700 1 -- start start 2023-10-19T08:39:18.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.219+0000 7f4aa5d74700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa00b0c00 0x7f4aa00c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:18.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.219+0000 7f4aa5d74700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa00cb6f0 0x7f4aa00cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:18.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.219+0000 7f4aa5d74700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa015e570 0x7f4aa00ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:18.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.219+0000 7f4aa5d74700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa0158c90 con 0x7f4aa00cb6f0 2023-10-19T08:39:18.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.219+0000 7f4aa5d74700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa01f17a0 con 0x7f4aa015e570 2023-10-19T08:39:18.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.219+0000 7f4aa5d74700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa0155b00 con 0x7f4aa00b0c00 2023-10-19T08:39:18.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.219+0000 7f4a9effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa00cb6f0 0x7f4aa00cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:18.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.219+0000 7f4a9effd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa00cb6f0 0x7f4aa00cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48512/0 (socket says 172.21.15.79:48512) 2023-10-19T08:39:18.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.219+0000 7f4a9effd700 1 -- 172.21.15.79:0/2303699935 learned_addr learned my addr 172.21.15.79:0/2303699935 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:18.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.219+0000 7f4a9ffff700 1 --2- 172.21.15.79:0/2303699935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa015e570 0x7f4aa00ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:18.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.219+0000 7f4a9f7fe700 1 --2- 172.21.15.79:0/2303699935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa00b0c00 0x7f4aa00c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:18.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.219+0000 7f4a9effd700 1 -- 172.21.15.79:0/2303699935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa00b0c00 msgr2=0x7f4aa00c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:18.232 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.219+0000 7f4a9effd700 1 --2- 172.21.15.79:0/2303699935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa00b0c00 0x7f4aa00c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.219+0000 7f4a9effd700 1 -- 172.21.15.79:0/2303699935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa015e570 msgr2=0x7f4aa00ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:18.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.219+0000 7f4a9effd700 1 --2- 172.21.15.79:0/2303699935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa015e570 0x7f4aa00ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.219+0000 7f4a9effd700 1 -- 172.21.15.79:0/2303699935 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a900094a0 con 0x7f4aa00cb6f0 2023-10-19T08:39:18.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.219+0000 7f4a9ffff700 1 --2- 172.21.15.79:0/2303699935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa015e570 0x7f4aa00ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:18.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.219+0000 7f4a9f7fe700 1 --2- 172.21.15.79:0/2303699935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa00b0c00 0x7f4aa00c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:18.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.220+0000 7f4a9effd700 1 --2- 172.21.15.79:0/2303699935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa00cb6f0 0x7f4aa00cc680 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4a9400c700 tx=0x7f4a9400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:18.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.220+0000 7f4a87fff700 1 -- 172.21.15.79:0/2303699935 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a94005d70 con 0x7f4aa00cb6f0 2023-10-19T08:39:18.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.220+0000 7f4a87fff700 1 -- 172.21.15.79:0/2303699935 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a940070d0 con 0x7f4aa00cb6f0 2023-10-19T08:39:18.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.220+0000 7f4aa5d74700 1 -- 172.21.15.79:0/2303699935 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa0158360 con 0x7f4aa00cb6f0 2023-10-19T08:39:18.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.220+0000 7f4a87fff700 1 -- 172.21.15.79:0/2303699935 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a94007460 con 0x7f4aa00cb6f0 2023-10-19T08:39:18.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.220+0000 7f4aa5d74700 1 -- 172.21.15.79:0/2303699935 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa0158920 con 0x7f4aa00cb6f0 2023-10-19T08:39:18.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.221+0000 7f4aa5d74700 1 -- 172.21.15.79:0/2303699935 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa0158e40 con 0x7f4aa00cb6f0 2023-10-19T08:39:18.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.221+0000 7f4a87fff700 1 -- 172.21.15.79:0/2303699935 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4a940075c0 con 0x7f4aa00cb6f0 2023-10-19T08:39:18.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.221+0000 7f4a87fff700 1 --2- 172.21.15.79:0/2303699935 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4a8c06a0e0 0x7f4a8c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:18.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.222+0000 7f4a87fff700 1 -- 172.21.15.79:0/2303699935 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4a94087eb0 con 0x7f4aa00cb6f0 2023-10-19T08:39:18.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.222+0000 7f4a9f7fe700 1 --2- 172.21.15.79:0/2303699935 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4a8c06a0e0 0x7f4a8c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:18.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.222+0000 7f4a9f7fe700 1 --2- 172.21.15.79:0/2303699935 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4a8c06a0e0 0x7f4a8c06c5a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4a90000c00 tx=0x7f4a9001c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:18.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.226+0000 7f4a87fff700 1 -- 172.21.15.79:0/2303699935 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4aa0158e40 con 0x7f4aa00cb6f0 2023-10-19T08:39:18.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.416+0000 7f4aa5d74700 1 -- 172.21.15.79:0/2303699935 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4aa0158e40 con 0x7f4aa00cb6f0 2023-10-19T08:39:18.420 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.416+0000 7f4a87fff700 1 -- 172.21.15.79:0/2303699935 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4aa0158e40 con 0x7f4aa00cb6f0 2023-10-19T08:39:18.420 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:39:18.422 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.419+0000 7f4aa5d74700 1 -- 172.21.15.79:0/2303699935 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4a8c06a0e0 msgr2=0x7f4a8c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:18.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.419+0000 7f4aa5d74700 1 --2- 172.21.15.79:0/2303699935 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4a8c06a0e0 0x7f4a8c06c5a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4a90000c00 tx=0x7f4a9001c040 comp rx=0 tx=0).stop 2023-10-19T08:39:18.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.419+0000 7f4aa5d74700 1 -- 172.21.15.79:0/2303699935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa00cb6f0 msgr2=0x7f4aa00cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:18.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.419+0000 7f4aa5d74700 1 --2- 172.21.15.79:0/2303699935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa00cb6f0 0x7f4aa00cc680 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4a9400c700 tx=0x7f4a9400cac0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.419+0000 7f4aa5d74700 1 -- 172.21.15.79:0/2303699935 shutdown_connections 2023-10-19T08:39:18.423 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.419+0000 7f4aa5d74700 1 --2- 172.21.15.79:0/2303699935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4aa015e570 0x7f4aa00ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.419+0000 7f4aa5d74700 1 --2- 172.21.15.79:0/2303699935 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f4a8c06a0e0 0x7f4a8c06c5a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.419+0000 7f4aa5d74700 1 --2- 172.21.15.79:0/2303699935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4aa00b0c00 0x7f4aa00c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.419+0000 7f4aa5d74700 1 --2- 172.21.15.79:0/2303699935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4aa00cb6f0 0x7f4aa00cc680 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.419+0000 7f4aa5d74700 1 -- 172.21.15.79:0/2303699935 >> 172.21.15.79:0/2303699935 conn(0x7f4aa009a0b0 msgr2=0x7f4aa006f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:18.424 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.419+0000 7f4aa5d74700 1 -- 172.21.15.79:0/2303699935 shutdown_connections 2023-10-19T08:39:18.425 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.419+0000 7f4aa5d74700 1 -- 172.21.15.79:0/2303699935 wait complete. 2023-10-19T08:39:18.434 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-19T08:39:18.556 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.553+0000 7f61d6033700 1 Processor -- start 2023-10-19T08:39:18.557 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.553+0000 7f61d6033700 1 -- start start 2023-10-19T08:39:18.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.554+0000 7f61d6033700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f61d00b0c00 0x7f61d00d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:18.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.554+0000 7f61d6033700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f61d00cb6f0 0x7f61d00ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:18.559 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.554+0000 7f61d6033700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d00b25f0 con 0x7f61d015e570 2023-10-19T08:39:18.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.554+0000 7f61d6033700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d00afd60 con 0x7f61d00b0c00 2023-10-19T08:39:18.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.554+0000 7f61d6033700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d00af810 con 0x7f61d00cb6f0 2023-10-19T08:39:18.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.554+0000 7f61ceffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f61d00b0c00 0x7f61d00d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:18.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.554+0000 7f61cf7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f61d015e570 0x7f61d00b04f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58590/0 (socket says 172.21.15.79:58590) 2023-10-19T08:39:18.560 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.554+0000 7f61cf7fe700 1 -- 172.21.15.79:0/3566646982 learned_addr learned my addr 172.21.15.79:0/3566646982 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:18.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.554+0000 7f61cffff700 1 --2- 172.21.15.79:0/3566646982 >> v2:172.21.15.89:3300/0 conn(0x7f61d00cb6f0 0x7f61d00ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:18.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.554+0000 7f61ceffd700 1 -- 172.21.15.79:0/3566646982 >> v2:172.21.15.89:3300/0 conn(0x7f61d00cb6f0 msgr2=0x7f61d00ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:18.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.554+0000 7f61ceffd700 1 --2- 172.21.15.79:0/3566646982 >> v2:172.21.15.89:3300/0 conn(0x7f61d00cb6f0 0x7f61d00ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.554+0000 7f61ceffd700 1 -- 172.21.15.79:0/3566646982 >> v1:172.21.15.79:6789/0 conn(0x7f61d015e570 legacy=0x7f61d00b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:18.561 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.554+0000 7f61ceffd700 1 -- 172.21.15.79:0/3566646982 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d00aef70 con 0x7f61d00b0c00 2023-10-19T08:39:18.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.554+0000 7f61ce7fc700 1 -- 172.21.15.79:0/3566646982 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795353133 0 0) 0x7f61d00b25f0 con 0x7f61d015e570 2023-10-19T08:39:18.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.554+0000 7f61ceffd700 1 --2- 172.21.15.79:0/3566646982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d00b0c00 0x7f61d00d1990 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f61d008aed0 tx=0x7f61c0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c635d3d8d6fcb0c server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:18.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.554+0000 7f61ce7fc700 1 -- 172.21.15.79:0/3566646982 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c0011830 con 0x7f61d00b0c00 2023-10-19T08:39:18.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.555+0000 7f61ce7fc700 1 -- 172.21.15.79:0/3566646982 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c0011990 con 0x7f61d00b0c00 2023-10-19T08:39:18.562 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.555+0000 7f61ce7fc700 1 -- 172.21.15.79:0/3566646982 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c0011d20 con 0x7f61d00b0c00 2023-10-19T08:39:18.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.555+0000 7f61d6033700 1 -- 172.21.15.79:0/3566646982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d00b0c00 msgr2=0x7f61d00d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:18.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.555+0000 7f61d6033700 1 --2- 172.21.15.79:0/3566646982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d00b0c00 0x7f61d00d1990 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f61d008aed0 tx=0x7f61c0009b20 comp rx=0 tx=0).stop 2023-10-19T08:39:18.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.555+0000 7f61d6033700 1 -- 172.21.15.79:0/3566646982 shutdown_connections 2023-10-19T08:39:18.563 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.555+0000 7f61d6033700 1 --2- 172.21.15.79:0/3566646982 >> v2:172.21.15.89:3300/0 conn(0x7f61d00cb6f0 0x7f61d00ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.555+0000 7f61d6033700 1 --2- 172.21.15.79:0/3566646982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d00b0c00 0x7f61d00d1990 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.555+0000 7f61d6033700 1 -- 172.21.15.79:0/3566646982 >> 172.21.15.79:0/3566646982 conn(0x7f61d009a0b0 msgr2=0x7f61d00d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:18.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.555+0000 7f61d6033700 1 -- 172.21.15.79:0/3566646982 shutdown_connections 2023-10-19T08:39:18.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.555+0000 7f61d6033700 1 -- 172.21.15.79:0/3566646982 wait complete. 2023-10-19T08:39:18.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.556+0000 7f61d6033700 1 Processor -- start 2023-10-19T08:39:18.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.557+0000 7f61d6033700 1 -- start start 2023-10-19T08:39:18.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.557+0000 7f61d6033700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61d00b0c00 0x7f61d00c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:18.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.557+0000 7f61d6033700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d00cb6f0 0x7f61d014dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:18.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.557+0000 7f61d6033700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61d015e570 0x7f61d014e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:18.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.557+0000 7f61d6033700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00c5a90 con 0x7f61d00cb6f0 2023-10-19T08:39:18.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.557+0000 7f61d6033700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00c6610 con 0x7f61d015e570 2023-10-19T08:39:18.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.557+0000 7f61d6033700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d015a3f0 con 0x7f61d00b0c00 2023-10-19T08:39:18.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.557+0000 7f61ceffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d00cb6f0 0x7f61d014dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:18.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.557+0000 7f61ceffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d00cb6f0 0x7f61d014dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48526/0 (socket says 172.21.15.79:48526) 2023-10-19T08:39:18.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.557+0000 7f61ceffd700 1 -- 172.21.15.79:0/980156515 learned_addr learned my addr 172.21.15.79:0/980156515 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:18.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.557+0000 7f61cf7fe700 1 --2- 172.21.15.79:0/980156515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61d00b0c00 0x7f61d00c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:18.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.557+0000 7f61cffff700 1 --2- 172.21.15.79:0/980156515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61d015e570 0x7f61d014e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:18.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.558+0000 7f61ceffd700 1 -- 172.21.15.79:0/980156515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61d00b0c00 msgr2=0x7f61d00c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:18.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.558+0000 7f61ceffd700 1 --2- 172.21.15.79:0/980156515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61d00b0c00 0x7f61d00c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.558+0000 7f61ceffd700 1 -- 172.21.15.79:0/980156515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61d015e570 msgr2=0x7f61d014e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:18.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.558+0000 7f61ceffd700 1 --2- 172.21.15.79:0/980156515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61d015e570 0x7f61d014e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.558+0000 7f61ceffd700 1 -- 172.21.15.79:0/980156515 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c00094a0 con 0x7f61d00cb6f0 2023-10-19T08:39:18.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.558+0000 7f61ceffd700 1 --2- 172.21.15.79:0/980156515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d00cb6f0 0x7f61d014dd00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f61d00727f0 tx=0x7f61c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:18.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.558+0000 7f61b7fff700 1 -- 172.21.15.79:0/980156515 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c00036a0 con 0x7f61d00cb6f0 2023-10-19T08:39:18.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.558+0000 7f61b7fff700 1 -- 172.21.15.79:0/980156515 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c001f070 con 0x7f61d00cb6f0 2023-10-19T08:39:18.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.558+0000 7f61d6033700 1 -- 172.21.15.79:0/980156515 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d00c5ce0 con 0x7f61d00cb6f0 2023-10-19T08:39:18.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.558+0000 7f61b7fff700 1 -- 172.21.15.79:0/980156515 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c0003a60 con 0x7f61d00cb6f0 2023-10-19T08:39:18.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.558+0000 7f61d6033700 1 -- 172.21.15.79:0/980156515 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d00c62a0 con 0x7f61d00cb6f0 2023-10-19T08:39:18.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.559+0000 7f61d6033700 1 -- 172.21.15.79:0/980156515 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d004ee70 con 0x7f61d00cb6f0 2023-10-19T08:39:18.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.559+0000 7f61b7fff700 1 -- 172.21.15.79:0/980156515 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f61c0003bc0 con 0x7f61d00cb6f0 2023-10-19T08:39:18.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.560+0000 7f61b7fff700 1 --2- 172.21.15.79:0/980156515 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f61bc06a0e0 0x7f61bc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:18.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.560+0000 7f61b7fff700 1 -- 172.21.15.79:0/980156515 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f61c0021070 con 0x7f61d00cb6f0 2023-10-19T08:39:18.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.560+0000 7f61cf7fe700 1 --2- 172.21.15.79:0/980156515 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f61bc06a0e0 0x7f61bc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:18.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.560+0000 7f61cf7fe700 1 --2- 172.21.15.79:0/980156515 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f61bc06a0e0 0x7f61bc06c5a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f61c4000f60 tx=0x7f61c4007e70 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:18.573 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.564+0000 7f61b7fff700 1 -- 172.21.15.79:0/980156515 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f61c0055480 con 0x7f61d00cb6f0 2023-10-19T08:39:18.755 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.752+0000 7f61d6033700 1 -- 172.21.15.79:0/980156515 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61d00b26d0 con 0x7f61d00cb6f0 2023-10-19T08:39:18.756 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.752+0000 7f61b7fff700 1 -- 172.21.15.79:0/980156515 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f61c0058aa0 con 0x7f61d00cb6f0 2023-10-19T08:39:18.756 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:39:18.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.754+0000 7f61d6033700 1 -- 172.21.15.79:0/980156515 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f61bc06a0e0 msgr2=0x7f61bc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:18.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.754+0000 7f61d6033700 1 --2- 172.21.15.79:0/980156515 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f61bc06a0e0 0x7f61bc06c5a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f61c4000f60 tx=0x7f61c4007e70 comp rx=0 tx=0).stop 2023-10-19T08:39:18.758 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.754+0000 7f61d6033700 1 -- 172.21.15.79:0/980156515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d00cb6f0 msgr2=0x7f61d014dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:18.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.754+0000 7f61d6033700 1 --2- 172.21.15.79:0/980156515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d00cb6f0 0x7f61d014dd00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f61d00727f0 tx=0x7f61c0004750 comp rx=0 tx=0).stop 2023-10-19T08:39:18.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.754+0000 7f61d6033700 1 -- 172.21.15.79:0/980156515 shutdown_connections 2023-10-19T08:39:18.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.754+0000 7f61d6033700 1 --2- 172.21.15.79:0/980156515 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61d015e570 0x7f61d014e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.754+0000 7f61d6033700 1 --2- 172.21.15.79:0/980156515 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f61bc06a0e0 0x7f61bc06c5a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.754+0000 7f61d6033700 1 --2- 172.21.15.79:0/980156515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f61d00b0c00 0x7f61d00c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.754+0000 7f61d6033700 1 --2- 172.21.15.79:0/980156515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61d00cb6f0 0x7f61d014dd00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.754+0000 7f61d6033700 1 -- 172.21.15.79:0/980156515 >> 172.21.15.79:0/980156515 conn(0x7f61d009a0b0 msgr2=0x7f61d00b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:18.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.754+0000 7f61d6033700 1 -- 172.21.15.79:0/980156515 shutdown_connections 2023-10-19T08:39:18.760 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.755+0000 7f61d6033700 1 -- 172.21.15.79:0/980156515 wait complete. 2023-10-19T08:39:18.770 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-19T08:39:18.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.890+0000 7eff6a573700 1 Processor -- start 2023-10-19T08:39:18.894 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.890+0000 7eff6a573700 1 -- start start 2023-10-19T08:39:18.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.890+0000 7eff6a573700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7eff640cd270 0x7eff6406a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:18.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.890+0000 7eff6a573700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7eff640cc2a0 0x7eff6406a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:18.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.891+0000 7eff6a573700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff640b1fe0 con 0x7eff640703b0 2023-10-19T08:39:18.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.891+0000 7eff6a573700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff64160a80 con 0x7eff640cc2a0 2023-10-19T08:39:18.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.891+0000 7eff6a573700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff640ce2b0 con 0x7eff640cd270 2023-10-19T08:39:18.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.891+0000 7eff68b10700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7eff640cc2a0 0x7eff6406a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:18.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.891+0000 7eff68b10700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7eff640cc2a0 0x7eff6406a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48536/0 (socket says 172.21.15.79:48536) 2023-10-19T08:39:18.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.891+0000 7eff68b10700 1 -- 172.21.15.79:0/3111273752 learned_addr learned my addr 172.21.15.79:0/3111273752 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:18.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.891+0000 7eff63fff700 1 --2- 172.21.15.79:0/3111273752 >> v2:172.21.15.89:3300/0 conn(0x7eff640cd270 0x7eff6406a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:18.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.891+0000 7eff68b10700 1 -- 172.21.15.79:0/3111273752 >> v2:172.21.15.89:3300/0 conn(0x7eff640cd270 msgr2=0x7eff6406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:18.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.891+0000 7eff68b10700 1 --2- 172.21.15.79:0/3111273752 >> v2:172.21.15.89:3300/0 conn(0x7eff640cd270 0x7eff6406a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.891+0000 7eff68b10700 1 -- 172.21.15.79:0/3111273752 >> v1:172.21.15.89:6789/0 conn(0x7eff640703b0 legacy=0x7eff64160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:18.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.891+0000 7eff68b10700 1 -- 172.21.15.79:0/3111273752 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff640ce550 con 0x7eff640cc2a0 2023-10-19T08:39:18.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.891+0000 7eff68b10700 1 --2- 172.21.15.79:0/3111273752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff640cc2a0 0x7eff6406a760 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7eff640717c0 tx=0x7eff5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d77da9d798b688 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:18.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.891+0000 7eff62ffd700 1 -- 172.21.15.79:0/3111273752 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c00e070 con 0x7eff640cc2a0 2023-10-19T08:39:18.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.891+0000 7eff62ffd700 1 -- 172.21.15.79:0/3111273752 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c003a20 con 0x7eff640cc2a0 2023-10-19T08:39:18.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.891+0000 7eff62ffd700 1 -- 172.21.15.79:0/3111273752 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c003dd0 con 0x7eff640cc2a0 2023-10-19T08:39:18.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.892+0000 7eff6a573700 1 -- 172.21.15.79:0/3111273752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff640cc2a0 msgr2=0x7eff6406a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:18.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.892+0000 7eff6a573700 1 --2- 172.21.15.79:0/3111273752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff640cc2a0 0x7eff6406a760 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7eff640717c0 tx=0x7eff5c00b330 comp rx=0 tx=0).stop 2023-10-19T08:39:18.899 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.892+0000 7eff6a573700 1 -- 172.21.15.79:0/3111273752 shutdown_connections 2023-10-19T08:39:18.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.892+0000 7eff6a573700 1 --2- 172.21.15.79:0/3111273752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff640cc2a0 0x7eff6406a760 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.892+0000 7eff6a573700 1 --2- 172.21.15.79:0/3111273752 >> v2:172.21.15.89:3300/0 conn(0x7eff640cd270 0x7eff6406a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.892+0000 7eff6a573700 1 -- 172.21.15.79:0/3111273752 >> 172.21.15.79:0/3111273752 conn(0x7eff6406dcc0 msgr2=0x7eff6406e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:18.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.892+0000 7eff6a573700 1 -- 172.21.15.79:0/3111273752 shutdown_connections 2023-10-19T08:39:18.900 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.892+0000 7eff6a573700 1 -- 172.21.15.79:0/3111273752 wait complete. 2023-10-19T08:39:18.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.893+0000 7eff6a573700 1 Processor -- start 2023-10-19T08:39:18.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.893+0000 7eff6a573700 1 -- start start 2023-10-19T08:39:18.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.894+0000 7eff6a573700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff640703b0 0x7eff640c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:18.903 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.894+0000 7eff6a573700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff640cc2a0 0x7eff640ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:18.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.894+0000 7eff6a573700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff640cd270 0x7eff640c2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:18.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.894+0000 7eff6a573700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff640c7c80 con 0x7eff640cd270 2023-10-19T08:39:18.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.894+0000 7eff6a573700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff640c7f60 con 0x7eff640703b0 2023-10-19T08:39:18.904 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.894+0000 7eff6a573700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff640c8240 con 0x7eff640cc2a0 2023-10-19T08:39:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.894+0000 7eff68b10700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff640cd270 0x7eff640c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.894+0000 7eff68b10700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff640cd270 0x7eff640c2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48542/0 (socket says 172.21.15.79:48542) 2023-10-19T08:39:18.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.894+0000 7eff68b10700 1 -- 172.21.15.79:0/656484176 learned_addr learned my addr 172.21.15.79:0/656484176 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.894+0000 7eff63fff700 1 --2- 172.21.15.79:0/656484176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff640703b0 0x7eff640c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.894+0000 7eff68b10700 1 -- 172.21.15.79:0/656484176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff640cc2a0 msgr2=0x7eff640ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.894+0000 7eff68b10700 1 --2- 172.21.15.79:0/656484176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff640cc2a0 0x7eff640ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.894+0000 7eff68b10700 1 -- 172.21.15.79:0/656484176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff640703b0 msgr2=0x7eff640c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:18.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.894+0000 7eff68b10700 1 --2- 172.21.15.79:0/656484176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff640703b0 0x7eff640c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:18.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.894+0000 7eff68b10700 1 -- 172.21.15.79:0/656484176 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c009b30 con 0x7eff640cd270 2023-10-19T08:39:18.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.894+0000 7eff68b10700 1 --2- 172.21.15.79:0/656484176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff640cd270 0x7eff640c2770 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00b370 tx=0x7eff5c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:18.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.895+0000 7eff60ff9700 1 -- 172.21.15.79:0/656484176 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c004440 con 0x7eff640cd270 2023-10-19T08:39:18.907 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.895+0000 7eff60ff9700 1 -- 172.21.15.79:0/656484176 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c0045a0 con 0x7eff640cd270 2023-10-19T08:39:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.895+0000 7eff6a573700 1 -- 172.21.15.79:0/656484176 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff640c8520 con 0x7eff640cd270 2023-10-19T08:39:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.895+0000 7eff60ff9700 1 -- 172.21.15.79:0/656484176 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c004950 con 0x7eff640cd270 2023-10-19T08:39:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.895+0000 7eff6a573700 1 -- 172.21.15.79:0/656484176 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff640c96c0 con 0x7eff640cd270 2023-10-19T08:39:18.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.896+0000 7eff6a573700 1 -- 172.21.15.79:0/656484176 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6404ee70 con 0x7eff640cd270 2023-10-19T08:39:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.896+0000 7eff60ff9700 1 -- 172.21.15.79:0/656484176 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7eff5c012430 con 0x7eff640cd270 2023-10-19T08:39:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.897+0000 7eff60ff9700 1 --2- 172.21.15.79:0/656484176 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7eff5006a0e0 0x7eff5006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.897+0000 7eff63fff700 1 --2- 172.21.15.79:0/656484176 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7eff5006a0e0 0x7eff5006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.897+0000 7eff60ff9700 1 -- 172.21.15.79:0/656484176 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7eff5c089c80 con 0x7eff640cd270 2023-10-19T08:39:18.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.897+0000 7eff63fff700 1 --2- 172.21.15.79:0/656484176 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7eff5006a0e0 0x7eff5006c5a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff54009950 tx=0x7eff54008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:18.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:18.901+0000 7eff60ff9700 1 -- 172.21.15.79:0/656484176 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7eff5c0550d0 con 0x7eff640cd270 2023-10-19T08:39:19.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.089+0000 7eff6a573700 1 -- 172.21.15.79:0/656484176 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff6406b110 con 0x7eff640cd270 2023-10-19T08:39:19.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.090+0000 7eff60ff9700 1 -- 172.21.15.79:0/656484176 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff5c017020 con 0x7eff640cd270 2023-10-19T08:39:19.093 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 64 2023-10-19T08:39:19.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.092+0000 7eff6a573700 1 -- 172.21.15.79:0/656484176 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7eff5006a0e0 msgr2=0x7eff5006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:19.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.092+0000 7eff6a573700 1 --2- 172.21.15.79:0/656484176 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7eff5006a0e0 0x7eff5006c5a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff54009950 tx=0x7eff54008040 comp rx=0 tx=0).stop 2023-10-19T08:39:19.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.092+0000 7eff6a573700 1 -- 172.21.15.79:0/656484176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff640cd270 msgr2=0x7eff640c2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:19.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.092+0000 7eff6a573700 1 --2- 172.21.15.79:0/656484176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff640cd270 0x7eff640c2770 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00b370 tx=0x7eff5c004ad0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.092+0000 7eff6a573700 1 -- 172.21.15.79:0/656484176 shutdown_connections 2023-10-19T08:39:19.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.092+0000 7eff6a573700 1 --2- 172.21.15.79:0/656484176 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff640cd270 0x7eff640c2770 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.092+0000 7eff6a573700 1 --2- 172.21.15.79:0/656484176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff640703b0 0x7eff640c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.092+0000 7eff6a573700 1 --2- 172.21.15.79:0/656484176 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7eff5006a0e0 0x7eff5006c5a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.092+0000 7eff6a573700 1 --2- 172.21.15.79:0/656484176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7eff640cc2a0 0x7eff640ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.092+0000 7eff6a573700 1 -- 172.21.15.79:0/656484176 >> 172.21.15.79:0/656484176 conn(0x7eff6406dcc0 msgr2=0x7eff6415ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:19.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.092+0000 7eff6a573700 1 -- 172.21.15.79:0/656484176 shutdown_connections 2023-10-19T08:39:19.098 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.092+0000 7eff6a573700 1 -- 172.21.15.79:0/656484176 wait complete. 2023-10-19T08:39:19.107 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-19T08:39:19.230 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.227+0000 7fec474ea700 1 Processor -- start 2023-10-19T08:39:19.231 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.227+0000 7fec474ea700 1 -- start start 2023-10-19T08:39:19.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.228+0000 7fec474ea700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fec4006fdc0 0x7fec400ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:19.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.228+0000 7fec474ea700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec4015d760 con 0x7fec400cc640 2023-10-19T08:39:19.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.228+0000 7fec474ea700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec4015da40 con 0x7fec40159db0 2023-10-19T08:39:19.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.228+0000 7fec474ea700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec4015dd20 con 0x7fec4006fdc0 2023-10-19T08:39:19.233 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.228+0000 7fec45a87700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fec4006fdc0 0x7fec400ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:19.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.228+0000 7fec45286700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fec400cc640 0x7fec400cca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58618/0 (socket says 172.21.15.79:58618) 2023-10-19T08:39:19.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.228+0000 7fec45a87700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fec4006fdc0 0x7fec400ce1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48550/0 (socket says 172.21.15.79:48550) 2023-10-19T08:39:19.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.228+0000 7fec45286700 1 -- 172.21.15.79:0/1693738736 learned_addr learned my addr 172.21.15.79:0/1693738736 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:19.234 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.228+0000 7fec45a87700 1 -- 172.21.15.79:0/1693738736 >> v1:172.21.15.89:6789/0 conn(0x7fec40159db0 legacy=0x7fec400cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:19.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.228+0000 7fec45a87700 1 -- 172.21.15.79:0/1693738736 >> v1:172.21.15.79:6789/0 conn(0x7fec400cc640 legacy=0x7fec400cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:19.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.228+0000 7fec45a87700 1 -- 172.21.15.79:0/1693738736 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4015e000 con 0x7fec4006fdc0 2023-10-19T08:39:19.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.229+0000 7fec45a87700 1 --2- 172.21.15.79:0/1693738736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec4006fdc0 0x7fec400ce1f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fec38009d90 tx=0x7fec3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85a7b2877300d16 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:19.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.229+0000 7fec37fff700 1 -- 172.21.15.79:0/1693738736 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3800e070 con 0x7fec4006fdc0 2023-10-19T08:39:19.235 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.229+0000 7fec37fff700 1 -- 172.21.15.79:0/1693738736 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3800bad0 con 0x7fec4006fdc0 2023-10-19T08:39:19.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.229+0000 7fec37fff700 1 -- 172.21.15.79:0/1693738736 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3800be80 con 0x7fec4006fdc0 2023-10-19T08:39:19.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.229+0000 7fec474ea700 1 -- 172.21.15.79:0/1693738736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec4006fdc0 msgr2=0x7fec400ce1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:19.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.229+0000 7fec474ea700 1 --2- 172.21.15.79:0/1693738736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec4006fdc0 0x7fec400ce1f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fec38009d90 tx=0x7fec3800b330 comp rx=0 tx=0).stop 2023-10-19T08:39:19.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.229+0000 7fec474ea700 1 -- 172.21.15.79:0/1693738736 shutdown_connections 2023-10-19T08:39:19.236 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.229+0000 7fec474ea700 1 --2- 172.21.15.79:0/1693738736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec4006fdc0 0x7fec400ce1f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.229+0000 7fec474ea700 1 -- 172.21.15.79:0/1693738736 >> 172.21.15.79:0/1693738736 conn(0x7fec4006dcc0 msgr2=0x7fec4006e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:19.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.229+0000 7fec474ea700 1 -- 172.21.15.79:0/1693738736 shutdown_connections 2023-10-19T08:39:19.237 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.229+0000 7fec474ea700 1 -- 172.21.15.79:0/1693738736 wait complete. 2023-10-19T08:39:19.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.230+0000 7fec474ea700 1 Processor -- start 2023-10-19T08:39:19.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.231+0000 7fec474ea700 1 -- start start 2023-10-19T08:39:19.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.231+0000 7fec474ea700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec4006fdc0 0x7fec40154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:19.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.231+0000 7fec474ea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec400cc640 0x7fec400c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:19.240 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.231+0000 7fec474ea700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec40159db0 0x7fec40150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:19.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.231+0000 7fec474ea700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec40155900 con 0x7fec400cc640 2023-10-19T08:39:19.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.231+0000 7fec474ea700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec40154cf0 con 0x7fec40159db0 2023-10-19T08:39:19.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.231+0000 7fec474ea700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec40154fd0 con 0x7fec4006fdc0 2023-10-19T08:39:19.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.231+0000 7fec44a85700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec400cc640 0x7fec400c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:19.241 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.231+0000 7fec44a85700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec400cc640 0x7fec400c5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48552/0 (socket says 172.21.15.79:48552) 2023-10-19T08:39:19.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.231+0000 7fec44a85700 1 -- 172.21.15.79:0/612442690 learned_addr learned my addr 172.21.15.79:0/612442690 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:19.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.232+0000 7fec45a87700 1 --2- 172.21.15.79:0/612442690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec40159db0 0x7fec40150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:19.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.232+0000 7fec45286700 1 --2- 172.21.15.79:0/612442690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec4006fdc0 0x7fec40154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:19.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.232+0000 7fec44a85700 1 -- 172.21.15.79:0/612442690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec4006fdc0 msgr2=0x7fec40154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:19.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.232+0000 7fec44a85700 1 --2- 172.21.15.79:0/612442690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec4006fdc0 0x7fec40154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.232+0000 7fec44a85700 1 -- 172.21.15.79:0/612442690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec40159db0 msgr2=0x7fec40150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:19.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.232+0000 7fec44a85700 1 --2- 172.21.15.79:0/612442690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec40159db0 0x7fec40150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.232+0000 7fec44a85700 1 -- 172.21.15.79:0/612442690 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec38009a70 con 0x7fec400cc640 2023-10-19T08:39:19.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.232+0000 7fec45286700 1 --2- 172.21.15.79:0/612442690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec4006fdc0 0x7fec40154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:19.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.232+0000 7fec44a85700 1 --2- 172.21.15.79:0/612442690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec400cc640 0x7fec400c5bc0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00c430 tx=0x7fec3c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:19.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.232+0000 7fec35ffb700 1 -- 172.21.15.79:0/612442690 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c0052d0 con 0x7fec400cc640 2023-10-19T08:39:19.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.232+0000 7fec35ffb700 1 -- 172.21.15.79:0/612442690 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3c005450 con 0x7fec400cc640 2023-10-19T08:39:19.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.232+0000 7fec474ea700 1 -- 172.21.15.79:0/612442690 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec401552b0 con 0x7fec400cc640 2023-10-19T08:39:19.244 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.232+0000 7fec35ffb700 1 -- 172.21.15.79:0/612442690 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c006aa0 con 0x7fec400cc640 2023-10-19T08:39:19.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.232+0000 7fec474ea700 1 -- 172.21.15.79:0/612442690 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec401433a0 con 0x7fec400cc640 2023-10-19T08:39:19.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.233+0000 7fec474ea700 1 -- 172.21.15.79:0/612442690 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec40155a70 con 0x7fec400cc640 2023-10-19T08:39:19.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.233+0000 7fec35ffb700 1 -- 172.21.15.79:0/612442690 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fec3c003680 con 0x7fec400cc640 2023-10-19T08:39:19.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.233+0000 7fec35ffb700 1 --2- 172.21.15.79:0/612442690 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fec2406a0e0 0x7fec2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:19.245 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.234+0000 7fec35ffb700 1 -- 172.21.15.79:0/612442690 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fec3c087a40 con 0x7fec400cc640 2023-10-19T08:39:19.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.234+0000 7fec45286700 1 --2- 172.21.15.79:0/612442690 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fec2406a0e0 0x7fec2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:19.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.234+0000 7fec45286700 1 --2- 172.21.15.79:0/612442690 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fec2406a0e0 0x7fec2406c5a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fec30000f60 tx=0x7fec30009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:19.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.238+0000 7fec35ffb700 1 -- 172.21.15.79:0/612442690 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fec3c089e60 con 0x7fec400cc640 2023-10-19T08:39:19.429 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.426+0000 7fec474ea700 1 -- 172.21.15.79:0/612442690 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fec4004ee70 con 0x7fec400cc640 2023-10-19T08:39:19.430 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.426+0000 7fec35ffb700 1 -- 172.21.15.79:0/612442690 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fec3c052e90 con 0x7fec400cc640 2023-10-19T08:39:19.430 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 32 2023-10-19T08:39:19.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.428+0000 7fec474ea700 1 -- 172.21.15.79:0/612442690 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fec2406a0e0 msgr2=0x7fec2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:19.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.428+0000 7fec474ea700 1 --2- 172.21.15.79:0/612442690 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fec2406a0e0 0x7fec2406c5a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fec30000f60 tx=0x7fec30009040 comp rx=0 tx=0).stop 2023-10-19T08:39:19.432 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.428+0000 7fec474ea700 1 -- 172.21.15.79:0/612442690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec400cc640 msgr2=0x7fec400c5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:19.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.428+0000 7fec474ea700 1 --2- 172.21.15.79:0/612442690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec400cc640 0x7fec400c5bc0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00c430 tx=0x7fec3c00c7f0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.428+0000 7fec474ea700 1 -- 172.21.15.79:0/612442690 shutdown_connections 2023-10-19T08:39:19.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.428+0000 7fec474ea700 1 --2- 172.21.15.79:0/612442690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec40159db0 0x7fec40150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.428+0000 7fec474ea700 1 --2- 172.21.15.79:0/612442690 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fec2406a0e0 0x7fec2406c5a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.433 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.428+0000 7fec474ea700 1 --2- 172.21.15.79:0/612442690 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec4006fdc0 0x7fec40154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.428+0000 7fec474ea700 1 --2- 172.21.15.79:0/612442690 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fec400cc640 0x7fec400c5bc0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.428+0000 7fec474ea700 1 -- 172.21.15.79:0/612442690 >> 172.21.15.79:0/612442690 conn(0x7fec4006dcc0 msgr2=0x7fec400c8220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:19.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.428+0000 7fec474ea700 1 -- 172.21.15.79:0/612442690 shutdown_connections 2023-10-19T08:39:19.434 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.428+0000 7fec474ea700 1 -- 172.21.15.79:0/612442690 wait complete. 2023-10-19T08:39:19.444 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T08:39:19.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.560+0000 7fa612338700 1 Processor -- start 2023-10-19T08:39:19.564 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.560+0000 7fa612338700 1 -- start start 2023-10-19T08:39:19.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.561+0000 7fa612338700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa60c0ce270 0x7fa60c0b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:19.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.561+0000 7fa612338700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa60c160f30 0x7fa60c0ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:19.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.561+0000 7fa612338700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60c161490 con 0x7fa60c0ce650 2023-10-19T08:39:19.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.561+0000 7fa612338700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c161770 con 0x7fa60c160f30 2023-10-19T08:39:19.567 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.561+0000 7fa612338700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c161a50 con 0x7fa60c0ce270 2023-10-19T08:39:19.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.561+0000 7fa60b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa60c160f30 0x7fa60c0ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:19.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.561+0000 7fa60b7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa60c160f30 0x7fa60c0ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48560/0 (socket says 172.21.15.79:48560) 2023-10-19T08:39:19.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.561+0000 7fa60b7fe700 1 -- 172.21.15.79:0/290471893 learned_addr learned my addr 172.21.15.79:0/290471893 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:19.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.562+0000 7fa60b7fe700 1 -- 172.21.15.79:0/290471893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa60c0ce270 msgr2=0x7fa60c0b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:19.568 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.562+0000 7fa60bfff700 1 --2- 172.21.15.79:0/290471893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa60c0ce270 0x7fa60c0b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:19.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.562+0000 7fa60b7fe700 1 --2- 172.21.15.79:0/290471893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa60c0ce270 0x7fa60c0b1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.562+0000 7fa60b7fe700 1 -- 172.21.15.79:0/290471893 >> v1:172.21.15.89:6789/0 conn(0x7fa60c0ce650 legacy=0x7fa60c15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:19.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.562+0000 7fa60b7fe700 1 -- 172.21.15.79:0/290471893 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c161d30 con 0x7fa60c160f30 2023-10-19T08:39:19.569 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.562+0000 7fa60bfff700 1 --2- 172.21.15.79:0/290471893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa60c0ce270 0x7fa60c0b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:19.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.562+0000 7fa60b7fe700 1 --2- 172.21.15.79:0/290471893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c160f30 0x7fa60c0ca7d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa6000098f0 tx=0x7fa600009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8620a82b7bb8150 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:19.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.562+0000 7fa60affd700 1 -- 172.21.15.79:0/290471893 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600004230 con 0x7fa60c160f30 2023-10-19T08:39:19.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.562+0000 7fa60affd700 1 -- 172.21.15.79:0/290471893 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa600004390 con 0x7fa60c160f30 2023-10-19T08:39:19.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.562+0000 7fa60affd700 1 -- 172.21.15.79:0/290471893 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6000036a0 con 0x7fa60c160f30 2023-10-19T08:39:19.570 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.563+0000 7fa612338700 1 -- 172.21.15.79:0/290471893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c160f30 msgr2=0x7fa60c0ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:19.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.563+0000 7fa612338700 1 --2- 172.21.15.79:0/290471893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c160f30 0x7fa60c0ca7d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa6000098f0 tx=0x7fa600009c00 comp rx=0 tx=0).stop 2023-10-19T08:39:19.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.563+0000 7fa612338700 1 -- 172.21.15.79:0/290471893 shutdown_connections 2023-10-19T08:39:19.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.563+0000 7fa612338700 1 --2- 172.21.15.79:0/290471893 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa60c0ce270 0x7fa60c0b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.563+0000 7fa612338700 1 --2- 172.21.15.79:0/290471893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c160f30 0x7fa60c0ca7d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.571 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.563+0000 7fa612338700 1 -- 172.21.15.79:0/290471893 >> 172.21.15.79:0/290471893 conn(0x7fa60c0cc560 msgr2=0x7fa60c0cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:19.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.563+0000 7fa612338700 1 -- 172.21.15.79:0/290471893 shutdown_connections 2023-10-19T08:39:19.572 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.563+0000 7fa612338700 1 -- 172.21.15.79:0/290471893 wait complete. 2023-10-19T08:39:19.575 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.564+0000 7fa612338700 1 Processor -- start 2023-10-19T08:39:19.575 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.564+0000 7fa612338700 1 -- start start 2023-10-19T08:39:19.575 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa612338700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa60c0ce270 0x7fa60c1577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:19.575 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa612338700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c0ce650 0x7fa60c0ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:19.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa612338700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa60c160f30 0x7fa60c0c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:19.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa612338700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0ac830 con 0x7fa60c0ce650 2023-10-19T08:39:19.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa612338700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0aca60 con 0x7fa60c160f30 2023-10-19T08:39:19.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa612338700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0acd40 con 0x7fa60c0ce270 2023-10-19T08:39:19.576 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa60b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c0ce650 0x7fa60c0ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:19.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa60b7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c0ce650 0x7fa60c0ac2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48568/0 (socket says 172.21.15.79:48568) 2023-10-19T08:39:19.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa60b7fe700 1 -- 172.21.15.79:0/114931466 learned_addr learned my addr 172.21.15.79:0/114931466 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:19.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa60bfff700 1 --2- 172.21.15.79:0/114931466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa60c0ce270 0x7fa60c1577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:19.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa6108d5700 1 --2- 172.21.15.79:0/114931466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa60c160f30 0x7fa60c0c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:19.577 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa60b7fe700 1 -- 172.21.15.79:0/114931466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa60c0ce270 msgr2=0x7fa60c1577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:19.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa60b7fe700 1 --2- 172.21.15.79:0/114931466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa60c0ce270 0x7fa60c1577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa60b7fe700 1 -- 172.21.15.79:0/114931466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa60c160f30 msgr2=0x7fa60c0c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:19.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa60b7fe700 1 --2- 172.21.15.79:0/114931466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa60c160f30 0x7fa60c0c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.578 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa60b7fe700 1 -- 172.21.15.79:0/114931466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa600009550 con 0x7fa60c0ce650 2023-10-19T08:39:19.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa6108d5700 1 --2- 172.21.15.79:0/114931466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa60c160f30 0x7fa60c0c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:19.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa60b7fe700 1 --2- 172.21.15.79:0/114931466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c0ce650 0x7fa60c0ac2f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa600000c00 tx=0x7fa600004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:19.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa608ff9700 1 -- 172.21.15.79:0/114931466 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60000b860 con 0x7fa60c0ce650 2023-10-19T08:39:19.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa608ff9700 1 -- 172.21.15.79:0/114931466 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60000b9c0 con 0x7fa60c0ce650 2023-10-19T08:39:19.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa612338700 1 -- 172.21.15.79:0/114931466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60c0ad020 con 0x7fa60c0ce650 2023-10-19T08:39:19.579 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa608ff9700 1 -- 172.21.15.79:0/114931466 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60000bd70 con 0x7fa60c0ce650 2023-10-19T08:39:19.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.565+0000 7fa612338700 1 -- 172.21.15.79:0/114931466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60c0ad5e0 con 0x7fa60c0ce650 2023-10-19T08:39:19.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.566+0000 7fa612338700 1 -- 172.21.15.79:0/114931466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60c04ee70 con 0x7fa60c0ce650 2023-10-19T08:39:19.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.567+0000 7fa608ff9700 1 -- 172.21.15.79:0/114931466 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa60001b440 con 0x7fa60c0ce650 2023-10-19T08:39:19.580 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.567+0000 7fa608ff9700 1 --2- 172.21.15.79:0/114931466 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa5f806a0e0 0x7fa5f806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:19.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.567+0000 7fa608ff9700 1 -- 172.21.15.79:0/114931466 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa60008a050 con 0x7fa60c0ce650 2023-10-19T08:39:19.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.567+0000 7fa60bfff700 1 --2- 172.21.15.79:0/114931466 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa5f806a0e0 0x7fa5f806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:19.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.568+0000 7fa60bfff700 1 --2- 172.21.15.79:0/114931466 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa5f806a0e0 0x7fa5f806c5a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc006fd0 tx=0x7fa5fc008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:19.581 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.572+0000 7fa608ff9700 1 -- 172.21.15.79:0/114931466 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fa600055400 con 0x7fa60c0ce650 2023-10-19T08:39:19.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.805+0000 7fa612338700 1 -- 172.21.15.79:0/114931466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa60c0b5a60 con 0x7fa60c0ce650 2023-10-19T08:39:19.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.806+0000 7fa608ff9700 1 -- 172.21.15.79:0/114931466 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4865 (secure 0 0 0) 0x7fa600028090 con 0x7fa60c0ce650 2023-10-19T08:39:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:19.810 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3710906518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3710906518},{"type":"v1","addr":"172.21.15.89:6835","nonce":3710906518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3037310614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3037310614},{"type":"v1","addr":"172.21.15.79:6835","nonce":3037310614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/79656061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":79656061},{"type":"v1","addr":"172.21.15.79:6837","nonce":79656061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-19T08:37:56.667105+0000","modified":"2023-10-19T08:38:20.379674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6833/3076620199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3076620199},{"type":"v1","addr":"172.21.15.89:6833","nonce":3076620199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-19T08:39:19.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.808+0000 7fa612338700 1 -- 172.21.15.79:0/114931466 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa5f806a0e0 msgr2=0x7fa5f806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.808+0000 7fa612338700 1 --2- 172.21.15.79:0/114931466 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa5f806a0e0 0x7fa5f806c5a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc006fd0 tx=0x7fa5fc008040 comp rx=0 tx=0).stop 2023-10-19T08:39:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.808+0000 7fa612338700 1 -- 172.21.15.79:0/114931466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c0ce650 msgr2=0x7fa60c0ac2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.808+0000 7fa612338700 1 --2- 172.21.15.79:0/114931466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c0ce650 0x7fa60c0ac2f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa600000c00 tx=0x7fa600004750 comp rx=0 tx=0).stop 2023-10-19T08:39:19.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.808+0000 7fa612338700 1 -- 172.21.15.79:0/114931466 shutdown_connections 2023-10-19T08:39:19.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.808+0000 7fa612338700 1 --2- 172.21.15.79:0/114931466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa60c160f30 0x7fa60c0c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.808+0000 7fa612338700 1 --2- 172.21.15.79:0/114931466 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fa5f806a0e0 0x7fa5f806c5a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.808+0000 7fa612338700 1 --2- 172.21.15.79:0/114931466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa60c0ce270 0x7fa60c1577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.808+0000 7fa612338700 1 --2- 172.21.15.79:0/114931466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa60c0ce650 0x7fa60c0ac2f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.808+0000 7fa612338700 1 -- 172.21.15.79:0/114931466 >> 172.21.15.79:0/114931466 conn(0x7fa60c0cc560 msgr2=0x7fa60c0af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:19.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.808+0000 7fa612338700 1 -- 172.21.15.79:0/114931466 shutdown_connections 2023-10-19T08:39:19.814 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.808+0000 7fa612338700 1 -- 172.21.15.79:0/114931466 wait complete. 2023-10-19T08:39:19.814 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 9 2023-10-19T08:39:19.823 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:39:19.944 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.941+0000 7f11124a8700 1 Processor -- start 2023-10-19T08:39:19.945 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.941+0000 7f11124a8700 1 -- start start 2023-10-19T08:39:19.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.941+0000 7f11124a8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f110c15af30 0x7f110c06a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:19.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.941+0000 7f11124a8700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110c0b2d90 con 0x7f110c15b310 2023-10-19T08:39:19.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.941+0000 7f11124a8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110c0cd350 con 0x7f110c06e7e0 2023-10-19T08:39:19.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.941+0000 7f11124a8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0ca630 con 0x7f110c15af30 2023-10-19T08:39:19.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f110c15b310 0x7f110c0cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58646/0 (socket says 172.21.15.79:58646) 2023-10-19T08:39:19.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110b7fe700 1 -- 172.21.15.79:0/3623560022 learned_addr learned my addr 172.21.15.79:0/3623560022 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:19.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110bfff700 1 --2- 172.21.15.79:0/3623560022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f110c15af30 0x7f110c06a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:19.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110affd700 1 -- 172.21.15.79:0/3623560022 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418299857 0 0) 0x7f110c0b2d90 con 0x7f110c15b310 2023-10-19T08:39:19.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110affd700 1 -- 172.21.15.79:0/3623560022 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10f40035b0 con 0x7f110c15b310 2023-10-19T08:39:19.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110affd700 1 -- 172.21.15.79:0/3623560022 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 273325679 0 0) 0x7f110c0cd350 con 0x7f110c06e7e0 2023-10-19T08:39:19.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110affd700 1 -- 172.21.15.79:0/3623560022 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f110c0b2d90 con 0x7f110c06e7e0 2023-10-19T08:39:19.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110affd700 1 -- 172.21.15.79:0/3623560022 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1519564157 0 0) 0x7f10f40035b0 con 0x7f110c15b310 2023-10-19T08:39:19.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110affd700 1 -- 172.21.15.79:0/3623560022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f110c15af30 msgr2=0x7f110c06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:19.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110affd700 1 --2- 172.21.15.79:0/3623560022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f110c15af30 0x7f110c06a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110affd700 1 -- 172.21.15.79:0/3623560022 >> v1:172.21.15.89:6789/0 conn(0x7f110c06e7e0 legacy=0x7f110c0ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:19.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110affd700 1 -- 172.21.15.79:0/3623560022 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c0ca910 con 0x7f110c15b310 2023-10-19T08:39:19.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110affd700 1 -- 172.21.15.79:0/3623560022 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f1100001670 con 0x7f110c15b310 2023-10-19T08:39:19.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110affd700 1 -- 172.21.15.79:0/3623560022 >> v1:172.21.15.79:6789/0 conn(0x7f110c15b310 legacy=0x7f110c0cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:19.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110affd700 1 --2- 172.21.15.79:0/3623560022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10f4003bc0 0x7f10f4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:19.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110affd700 1 --2- 172.21.15.79:0/3623560022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10f4004850 0x7f10f4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:19.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110affd700 1 --2- 172.21.15.79:0/3623560022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f110c15af30 0x7f10f4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:19.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110affd700 1 -- 172.21.15.79:0/3623560022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0ca630 con 0x7f10f4003bc0 2023-10-19T08:39:19.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110affd700 1 -- 172.21.15.79:0/3623560022 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f400bac0 con 0x7f10f4004850 2023-10-19T08:39:19.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110affd700 1 -- 172.21.15.79:0/3623560022 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f400bc50 con 0x7f110c15af30 2023-10-19T08:39:19.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110bfff700 1 --2- 172.21.15.79:0/3623560022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10f4003bc0 0x7f10f4003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:19.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f110b7fe700 1 --2- 172.21.15.79:0/3623560022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10f4004850 0x7f10f4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:19.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.942+0000 7f1110a45700 1 --2- 172.21.15.79:0/3623560022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f110c15af30 0x7f10f4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:19.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.943+0000 7f110bfff700 1 -- 172.21.15.79:0/3623560022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f110c15af30 msgr2=0x7f10f4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:19.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.943+0000 7f110bfff700 1 --2- 172.21.15.79:0/3623560022 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f110c15af30 0x7f10f4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.943+0000 7f110bfff700 1 -- 172.21.15.79:0/3623560022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10f4004850 msgr2=0x7f10f4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:19.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.943+0000 7f110bfff700 1 --2- 172.21.15.79:0/3623560022 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10f4004850 0x7f10f4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.943+0000 7f110bfff700 1 -- 172.21.15.79:0/3623560022 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f40035b0 con 0x7f10f4003bc0 2023-10-19T08:39:19.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.943+0000 7f110bfff700 1 --2- 172.21.15.79:0/3623560022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10f4003bc0 0x7f10f4003fc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f10fc009b60 tx=0x7f10f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a7678b9461b362 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:19.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.943+0000 7f110affd700 1 -- 172.21.15.79:0/3623560022 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc00e6c0 con 0x7f10f4003bc0 2023-10-19T08:39:19.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.943+0000 7f110affd700 1 -- 172.21.15.79:0/3623560022 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc00e820 con 0x7f10f4003bc0 2023-10-19T08:39:19.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.943+0000 7f110affd700 1 -- 172.21.15.79:0/3623560022 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc00eb90 con 0x7f10f4003bc0 2023-10-19T08:39:19.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.943+0000 7f11124a8700 1 -- 172.21.15.79:0/3623560022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10f4003bc0 msgr2=0x7f10f4003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:19.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.943+0000 7f11124a8700 1 --2- 172.21.15.79:0/3623560022 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10f4003bc0 0x7f10f4003fc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f10fc009b60 tx=0x7f10f4005880 comp rx=0 tx=0).stop 2023-10-19T08:39:19.956 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.943+0000 7f1110a45700 1 -- 172.21.15.79:0/3623560022 reap_dead start 2023-10-19T08:39:19.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.943+0000 7f11124a8700 1 -- 172.21.15.79:0/3623560022 shutdown_connections 2023-10-19T08:39:19.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.943+0000 7f11124a8700 1 -- 172.21.15.79:0/3623560022 >> 172.21.15.79:0/3623560022 conn(0x7f110c06dcc0 msgr2=0x7f110c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:19.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.943+0000 7f11124a8700 1 -- 172.21.15.79:0/3623560022 shutdown_connections 2023-10-19T08:39:19.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.943+0000 7f11124a8700 1 -- 172.21.15.79:0/3623560022 wait complete. 2023-10-19T08:39:19.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.945+0000 7f11124a8700 1 Processor -- start 2023-10-19T08:39:19.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.945+0000 7f11124a8700 1 -- start start 2023-10-19T08:39:19.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.945+0000 7f11124a8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10f4003bc0 0x7f110c0aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:19.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.945+0000 7f11124a8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f110c1567e0 0x7f110c149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:19.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.945+0000 7f11124a8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f110c0c7820 0x7f110c0a74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:19.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.945+0000 7f11124a8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0af4d0 con 0x7f110c0c7820 2023-10-19T08:39:19.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.945+0000 7f11124a8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0c8190 con 0x7f110c1567e0 2023-10-19T08:39:19.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.946+0000 7f11124a8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0c8470 con 0x7f10f4003bc0 2023-10-19T08:39:19.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.946+0000 7f1110a45700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f110c0c7820 0x7f110c0a74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:19.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.946+0000 7f1110a45700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f110c0c7820 0x7f110c0a74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48590/0 (socket says 172.21.15.79:48590) 2023-10-19T08:39:19.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.946+0000 7f1110a45700 1 -- 172.21.15.79:0/3922736518 learned_addr learned my addr 172.21.15.79:0/3922736518 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:19.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.946+0000 7f110b7fe700 1 --2- 172.21.15.79:0/3922736518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f110c1567e0 0x7f110c149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:19.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.946+0000 7f110bfff700 1 --2- 172.21.15.79:0/3922736518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10f4003bc0 0x7f110c0aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:19.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.946+0000 7f1110a45700 1 -- 172.21.15.79:0/3922736518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10f4003bc0 msgr2=0x7f110c0aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:19.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.946+0000 7f1110a45700 1 --2- 172.21.15.79:0/3922736518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10f4003bc0 0x7f110c0aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.946+0000 7f1110a45700 1 -- 172.21.15.79:0/3922736518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f110c1567e0 msgr2=0x7f110c149ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:19.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.946+0000 7f1110a45700 1 --2- 172.21.15.79:0/3922736518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f110c1567e0 0x7f110c149ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:19.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.946+0000 7f1110a45700 1 -- 172.21.15.79:0/3922736518 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c0c8750 con 0x7f110c0c7820 2023-10-19T08:39:19.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.946+0000 7f110bfff700 1 --2- 172.21.15.79:0/3922736518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10f4003bc0 0x7f110c0aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:19.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.946+0000 7f1110a45700 1 --2- 172.21.15.79:0/3922736518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f110c0c7820 0x7f110c0a74d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f110c0cbb80 tx=0x7f110400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:19.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.946+0000 7f1108ff9700 1 -- 172.21.15.79:0/3922736518 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104003c10 con 0x7f110c0c7820 2023-10-19T08:39:19.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.946+0000 7f1108ff9700 1 -- 172.21.15.79:0/3922736518 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1104003d90 con 0x7f110c0c7820 2023-10-19T08:39:19.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.946+0000 7f11124a8700 1 -- 172.21.15.79:0/3922736518 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110c0c8a30 con 0x7f110c0c7820 2023-10-19T08:39:19.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.946+0000 7f1108ff9700 1 -- 172.21.15.79:0/3922736518 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104005310 con 0x7f110c0c7820 2023-10-19T08:39:19.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.946+0000 7f11124a8700 1 -- 172.21.15.79:0/3922736518 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110c149ff0 con 0x7f110c0c7820 2023-10-19T08:39:19.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.947+0000 7f11124a8700 1 -- 172.21.15.79:0/3922736518 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f110c0c8f50 con 0x7f110c0c7820 2023-10-19T08:39:19.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.948+0000 7f1108ff9700 1 -- 172.21.15.79:0/3922736518 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1104005470 con 0x7f110c0c7820 2023-10-19T08:39:19.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.948+0000 7f1108ff9700 1 --2- 172.21.15.79:0/3922736518 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f10f806a110 0x7f10f806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:19.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.948+0000 7f1108ff9700 1 -- 172.21.15.79:0/3922736518 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1104088830 con 0x7f110c0c7820 2023-10-19T08:39:19.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.948+0000 7f110bfff700 1 --2- 172.21.15.79:0/3922736518 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f10f806a110 0x7f10f806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:19.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.948+0000 7f110bfff700 1 --2- 172.21.15.79:0/3922736518 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f10f806a110 0x7f10f806c5d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0090b0 tx=0x7f10fc008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:19.966 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:19.952+0000 7f1108ff9700 1 -- 172.21.15.79:0/3922736518 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f110c0c8f50 con 0x7f110c0c7820 2023-10-19T08:39:20.147 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.144+0000 7f11124a8700 1 -- 172.21.15.79:0/3922736518 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f110c0c8f50 con 0x7f110c0c7820 2023-10-19T08:39:20.149 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.145+0000 7f1108ff9700 1 -- 172.21.15.79:0/3922736518 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20155 (secure 0 0 0) 0x7f110c0c8f50 con 0x7f110c0c7820 2023-10-19T08:39:20.149 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:20.149 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:44.473795+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:39:20.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.147+0000 7f11124a8700 1 -- 172.21.15.79:0/3922736518 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f10f806a110 msgr2=0x7f10f806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:20.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.147+0000 7f11124a8700 1 --2- 172.21.15.79:0/3922736518 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f10f806a110 0x7f10f806c5d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0090b0 tx=0x7f10fc008030 comp rx=0 tx=0).stop 2023-10-19T08:39:20.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.147+0000 7f11124a8700 1 -- 172.21.15.79:0/3922736518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f110c0c7820 msgr2=0x7f110c0a74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:20.151 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.147+0000 7f11124a8700 1 --2- 172.21.15.79:0/3922736518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f110c0c7820 0x7f110c0a74d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f110c0cbb80 tx=0x7f110400ee70 comp rx=0 tx=0).stop 2023-10-19T08:39:20.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.147+0000 7f11124a8700 1 -- 172.21.15.79:0/3922736518 shutdown_connections 2023-10-19T08:39:20.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.147+0000 7f11124a8700 1 --2- 172.21.15.79:0/3922736518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f110c0c7820 0x7f110c0a74d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.147+0000 7f11124a8700 1 --2- 172.21.15.79:0/3922736518 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f10f806a110 0x7f10f806c5d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.152 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.147+0000 7f11124a8700 1 --2- 172.21.15.79:0/3922736518 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f10f4003bc0 0x7f110c0aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.147+0000 7f11124a8700 1 --2- 172.21.15.79:0/3922736518 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f110c1567e0 0x7f110c149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.147+0000 7f11124a8700 1 -- 172.21.15.79:0/3922736518 >> 172.21.15.79:0/3922736518 conn(0x7f110c06dcc0 msgr2=0x7f110c0af940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:20.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.147+0000 7f11124a8700 1 -- 172.21.15.79:0/3922736518 shutdown_connections 2023-10-19T08:39:20.153 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.147+0000 7f11124a8700 1 -- 172.21.15.79:0/3922736518 wait complete. 2023-10-19T08:39:20.163 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-19T08:39:20.164 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T08:39:20.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.280+0000 7f0bcbc26700 1 Processor -- start 2023-10-19T08:39:20.284 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.281+0000 7f0bcbc26700 1 -- start start 2023-10-19T08:39:20.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.281+0000 7f0bcbc26700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bc40b4cb0 0x7f0bc40ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:20.287 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.281+0000 7f0bcbc26700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0bc406b5b0 0x7f0bc406e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:20.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.281+0000 7f0bcbc26700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0bc406eb90 0x7f0bc415e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:20.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.281+0000 7f0bcbc26700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc406f020 con 0x7f0bc406b5b0 2023-10-19T08:39:20.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.281+0000 7f0bcbc26700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc406f4b0 con 0x7f0bc406eb90 2023-10-19T08:39:20.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.281+0000 7f0bcbc26700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc406f700 con 0x7f0bc40b4cb0 2023-10-19T08:39:20.288 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.282+0000 7f0bc91c1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0bc406b5b0 0x7f0bc406e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:20.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.282+0000 7f0bc91c1700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0bc406b5b0 0x7f0bc406e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48594/0 (socket says 172.21.15.79:48594) 2023-10-19T08:39:20.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.282+0000 7f0bc91c1700 1 -- 172.21.15.79:0/3696434402 learned_addr learned my addr 172.21.15.79:0/3696434402 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:20.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.282+0000 7f0bc99c2700 1 --2- 172.21.15.79:0/3696434402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bc40b4cb0 0x7f0bc40ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:20.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.282+0000 7f0bca1c3700 1 --2- 172.21.15.79:0/3696434402 >> v2:172.21.15.89:3300/0 conn(0x7f0bc406eb90 0x7f0bc415e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:20.289 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.282+0000 7f0bc91c1700 1 -- 172.21.15.79:0/3696434402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bc40b4cb0 msgr2=0x7f0bc40ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:20.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.282+0000 7f0bc91c1700 1 --2- 172.21.15.79:0/3696434402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bc40b4cb0 0x7f0bc40ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.282+0000 7f0bc91c1700 1 -- 172.21.15.79:0/3696434402 >> v2:172.21.15.89:3300/0 conn(0x7f0bc406eb90 msgr2=0x7f0bc415e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:20.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.282+0000 7f0bc91c1700 1 --2- 172.21.15.79:0/3696434402 >> v2:172.21.15.89:3300/0 conn(0x7f0bc406eb90 0x7f0bc415e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.282+0000 7f0bc91c1700 1 -- 172.21.15.79:0/3696434402 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc406f9e0 con 0x7f0bc406b5b0 2023-10-19T08:39:20.290 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.282+0000 7f0bc99c2700 1 --2- 172.21.15.79:0/3696434402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bc40b4cb0 0x7f0bc40ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:20.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.282+0000 7f0bca1c3700 1 --2- 172.21.15.79:0/3696434402 >> v2:172.21.15.89:3300/0 conn(0x7f0bc406eb90 0x7f0bc415e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:20.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.282+0000 7f0bc91c1700 1 --2- 172.21.15.79:0/3696434402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc406b5b0 0x7f0bc406e650 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4066120 tx=0x7f0bc0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644eac9841115b12 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:20.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.282+0000 7f0bc89c0700 1 -- 172.21.15.79:0/3696434402 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc000b870 con 0x7f0bc406b5b0 2023-10-19T08:39:20.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.282+0000 7f0bc89c0700 1 -- 172.21.15.79:0/3696434402 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc000b9d0 con 0x7f0bc406b5b0 2023-10-19T08:39:20.291 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.282+0000 7f0bc89c0700 1 -- 172.21.15.79:0/3696434402 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc000bd60 con 0x7f0bc406b5b0 2023-10-19T08:39:20.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.283+0000 7f0bcbc26700 1 -- 172.21.15.79:0/3696434402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc406b5b0 msgr2=0x7f0bc406e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:20.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.283+0000 7f0bcbc26700 1 --2- 172.21.15.79:0/3696434402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc406b5b0 0x7f0bc406e650 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4066120 tx=0x7f0bc0009bd0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.283+0000 7f0bcbc26700 1 -- 172.21.15.79:0/3696434402 shutdown_connections 2023-10-19T08:39:20.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.283+0000 7f0bcbc26700 1 --2- 172.21.15.79:0/3696434402 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bc40b4cb0 0x7f0bc40ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.292 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.283+0000 7f0bcbc26700 1 --2- 172.21.15.79:0/3696434402 >> v2:172.21.15.89:3300/0 conn(0x7f0bc406eb90 0x7f0bc415e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.283+0000 7f0bcbc26700 1 --2- 172.21.15.79:0/3696434402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc406b5b0 0x7f0bc406e650 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.283+0000 7f0bcbc26700 1 -- 172.21.15.79:0/3696434402 >> 172.21.15.79:0/3696434402 conn(0x7f0bc406d000 msgr2=0x7f0bc406d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:20.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.283+0000 7f0bcbc26700 1 -- 172.21.15.79:0/3696434402 shutdown_connections 2023-10-19T08:39:20.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.283+0000 7f0bcbc26700 1 -- 172.21.15.79:0/3696434402 wait complete. 2023-10-19T08:39:20.293 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.284+0000 7f0bcbc26700 1 Processor -- start 2023-10-19T08:39:20.294 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.284+0000 7f0bcbc26700 1 -- start start 2023-10-19T08:39:20.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bcbc26700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc406b5b0 0x7f0bc4159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:20.296 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bcbc26700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bc406eb90 0x7f0bc40c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:20.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bcbc26700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bc40b4cb0 0x7f0bc40c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:20.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bcbc26700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc40c5df0 con 0x7f0bc406b5b0 2023-10-19T08:39:20.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bcbc26700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc4159fb0 con 0x7f0bc40b4cb0 2023-10-19T08:39:20.297 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bcbc26700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc40c5170 con 0x7f0bc406eb90 2023-10-19T08:39:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bc99c2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc406b5b0 0x7f0bc4159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bc99c2700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc406b5b0 0x7f0bc4159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48600/0 (socket says 172.21.15.79:48600) 2023-10-19T08:39:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bc99c2700 1 -- 172.21.15.79:0/539388617 learned_addr learned my addr 172.21.15.79:0/539388617 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bca1c3700 1 --2- 172.21.15.79:0/539388617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bc40b4cb0 0x7f0bc40c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:20.298 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bc91c1700 1 --2- 172.21.15.79:0/539388617 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bc406eb90 0x7f0bc40c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:20.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bc99c2700 1 -- 172.21.15.79:0/539388617 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bc406eb90 msgr2=0x7f0bc40c4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:20.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bc99c2700 1 --2- 172.21.15.79:0/539388617 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bc406eb90 0x7f0bc40c4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bc99c2700 1 -- 172.21.15.79:0/539388617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bc40b4cb0 msgr2=0x7f0bc40c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:20.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bc99c2700 1 --2- 172.21.15.79:0/539388617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bc40b4cb0 0x7f0bc40c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.299 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bc99c2700 1 -- 172.21.15.79:0/539388617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc0009550 con 0x7f0bc406b5b0 2023-10-19T08:39:20.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bca1c3700 1 --2- 172.21.15.79:0/539388617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bc40b4cb0 0x7f0bc40c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:20.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bc99c2700 1 --2- 172.21.15.79:0/539388617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc406b5b0 0x7f0bc4159a70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0bb400e810 tx=0x7f0bb400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:20.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bba7fc700 1 -- 172.21.15.79:0/539388617 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4004230 con 0x7f0bc406b5b0 2023-10-19T08:39:20.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bba7fc700 1 -- 172.21.15.79:0/539388617 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb4004390 con 0x7f0bc406b5b0 2023-10-19T08:39:20.300 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bcbc26700 1 -- 172.21.15.79:0/539388617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc40c5450 con 0x7f0bc406b5b0 2023-10-19T08:39:20.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bba7fc700 1 -- 172.21.15.79:0/539388617 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb40036a0 con 0x7f0bc406b5b0 2023-10-19T08:39:20.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.285+0000 7f0bcbc26700 1 -- 172.21.15.79:0/539388617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc40c5a10 con 0x7f0bc406b5b0 2023-10-19T08:39:20.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.286+0000 7f0bcbc26700 1 -- 172.21.15.79:0/539388617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc404ee70 con 0x7f0bc406b5b0 2023-10-19T08:39:20.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.287+0000 7f0bba7fc700 1 -- 172.21.15.79:0/539388617 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0bb4003800 con 0x7f0bc406b5b0 2023-10-19T08:39:20.301 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.287+0000 7f0bba7fc700 1 --2- 172.21.15.79:0/539388617 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0ba806a0e0 0x7f0ba806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:20.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.287+0000 7f0bc91c1700 1 --2- 172.21.15.79:0/539388617 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0ba806a0e0 0x7f0ba806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:20.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.287+0000 7f0bba7fc700 1 -- 172.21.15.79:0/539388617 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0bb4088390 con 0x7f0bc406b5b0 2023-10-19T08:39:20.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.288+0000 7f0bc91c1700 1 --2- 172.21.15.79:0/539388617 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0ba806a0e0 0x7f0ba806c5a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0014040 tx=0x7f0bc0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:20.302 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.292+0000 7f0bba7fc700 1 -- 172.21.15.79:0/539388617 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f0bb4053750 con 0x7f0bc406b5b0 2023-10-19T08:39:20.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.524+0000 7f0bcbc26700 1 -- 172.21.15.79:0/539388617 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bc4066610 con 0x7f0bc406b5b0 2023-10-19T08:39:20.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.525+0000 7f0bba7fc700 1 -- 172.21.15.79:0/539388617 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4865 (secure 0 0 0) 0x7f0bb4056d70 con 0x7f0bc406b5b0 2023-10-19T08:39:20.529 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:20.529 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3710906518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3710906518},{"type":"v1","addr":"172.21.15.89:6835","nonce":3710906518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3037310614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3037310614},{"type":"v1","addr":"172.21.15.79:6835","nonce":3037310614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/79656061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":79656061},{"type":"v1","addr":"172.21.15.79:6837","nonce":79656061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-19T08:37:56.667105+0000","modified":"2023-10-19T08:38:20.379674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6833/3076620199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3076620199},{"type":"v1","addr":"172.21.15.89:6833","nonce":3076620199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-19T08:39:20.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.527+0000 7f0bcbc26700 1 -- 172.21.15.79:0/539388617 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0ba806a0e0 msgr2=0x7f0ba806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:20.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.527+0000 7f0bcbc26700 1 --2- 172.21.15.79:0/539388617 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0ba806a0e0 0x7f0ba806c5a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0014040 tx=0x7f0bc0008030 comp rx=0 tx=0).stop 2023-10-19T08:39:20.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.527+0000 7f0bcbc26700 1 -- 172.21.15.79:0/539388617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc406b5b0 msgr2=0x7f0bc4159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:20.531 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.527+0000 7f0bcbc26700 1 --2- 172.21.15.79:0/539388617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc406b5b0 0x7f0bc4159a70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0bb400e810 tx=0x7f0bb400ebd0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.527+0000 7f0bcbc26700 1 -- 172.21.15.79:0/539388617 shutdown_connections 2023-10-19T08:39:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.527+0000 7f0bcbc26700 1 --2- 172.21.15.79:0/539388617 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0bc40b4cb0 0x7f0bc40c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.527+0000 7f0bcbc26700 1 --2- 172.21.15.79:0/539388617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0bc406b5b0 0x7f0bc4159a70 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.527+0000 7f0bcbc26700 1 --2- 172.21.15.79:0/539388617 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f0ba806a0e0 0x7f0ba806c5a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.527+0000 7f0bcbc26700 1 --2- 172.21.15.79:0/539388617 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0bc406eb90 0x7f0bc40c4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.527+0000 7f0bcbc26700 1 -- 172.21.15.79:0/539388617 >> 172.21.15.79:0/539388617 conn(0x7f0bc406d000 msgr2=0x7f0bc40ca290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:20.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.527+0000 7f0bcbc26700 1 -- 172.21.15.79:0/539388617 shutdown_connections 2023-10-19T08:39:20.533 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.527+0000 7f0bcbc26700 1 -- 172.21.15.79:0/539388617 wait complete. 2023-10-19T08:39:20.533 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 9 2023-10-19T08:39:20.543 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T08:39:20.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.660+0000 7fac43f7f700 1 Processor -- start 2023-10-19T08:39:20.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.660+0000 7fac43f7f700 1 -- start start 2023-10-19T08:39:20.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.661+0000 7fac43f7f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac3c0cd0c0 0x7fac3c0cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:20.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.661+0000 7fac43f7f700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac3c0cd520 con 0x7fac3c0af170 2023-10-19T08:39:20.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.661+0000 7fac43f7f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac3c15de50 con 0x7fac3c0cdd40 2023-10-19T08:39:20.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.661+0000 7fac43f7f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c0af550 con 0x7fac3c0cd0c0 2023-10-19T08:39:20.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.661+0000 7fac41d1b700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fac3c0af170 0x7fac3c0b1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58680/0 (socket says 172.21.15.79:58680) 2023-10-19T08:39:20.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.661+0000 7fac41d1b700 1 -- 172.21.15.79:0/2253799011 learned_addr learned my addr 172.21.15.79:0/2253799011 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:20.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.661+0000 7fac4151a700 1 --2- 172.21.15.79:0/2253799011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac3c0cd0c0 0x7fac3c0cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:20.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.662+0000 7fac40d19700 1 -- 172.21.15.79:0/2253799011 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239134317 0 0) 0x7fac3c0cd520 con 0x7fac3c0af170 2023-10-19T08:39:20.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.662+0000 7fac40d19700 1 -- 172.21.15.79:0/2253799011 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac280035b0 con 0x7fac3c0af170 2023-10-19T08:39:20.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.662+0000 7fac40d19700 1 -- 172.21.15.79:0/2253799011 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504180854 0 0) 0x7fac3c15de50 con 0x7fac3c0cdd40 2023-10-19T08:39:20.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.662+0000 7fac40d19700 1 -- 172.21.15.79:0/2253799011 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac3c0cd520 con 0x7fac3c0cdd40 2023-10-19T08:39:20.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.662+0000 7fac40d19700 1 -- 172.21.15.79:0/2253799011 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2909073862 0 0) 0x7fac280035b0 con 0x7fac3c0af170 2023-10-19T08:39:20.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.662+0000 7fac4151a700 1 -- 172.21.15.79:0/2253799011 >> v1:172.21.15.89:6789/0 conn(0x7fac3c0cdd40 legacy=0x7fac3c06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:20.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.662+0000 7fac4151a700 1 -- 172.21.15.79:0/2253799011 >> v1:172.21.15.79:6789/0 conn(0x7fac3c0af170 legacy=0x7fac3c0b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:20.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.662+0000 7fac4151a700 1 -- 172.21.15.79:0/2253799011 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3c15e130 con 0x7fac3c0cd0c0 2023-10-19T08:39:20.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.662+0000 7fac4151a700 1 --2- 172.21.15.79:0/2253799011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac3c0cd0c0 0x7fac3c0cd800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fac38009870 tx=0x7fac38009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5f5fae2d8802afd server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:20.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.662+0000 7fac40d19700 1 -- 172.21.15.79:0/2253799011 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c001670 con 0x7fac3c0cd0c0 2023-10-19T08:39:20.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.662+0000 7fac40d19700 1 -- 172.21.15.79:0/2253799011 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac38004030 con 0x7fac3c0cd0c0 2023-10-19T08:39:20.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.662+0000 7fac40d19700 1 -- 172.21.15.79:0/2253799011 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac380043c0 con 0x7fac3c0cd0c0 2023-10-19T08:39:20.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.663+0000 7fac43f7f700 1 -- 172.21.15.79:0/2253799011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac3c0cd0c0 msgr2=0x7fac3c0cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:20.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.663+0000 7fac43f7f700 1 --2- 172.21.15.79:0/2253799011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac3c0cd0c0 0x7fac3c0cd800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fac38009870 tx=0x7fac38009b80 comp rx=0 tx=0).stop 2023-10-19T08:39:20.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.663+0000 7fac43f7f700 1 -- 172.21.15.79:0/2253799011 shutdown_connections 2023-10-19T08:39:20.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.663+0000 7fac43f7f700 1 --2- 172.21.15.79:0/2253799011 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac3c0cd0c0 0x7fac3c0cd800 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.663+0000 7fac43f7f700 1 -- 172.21.15.79:0/2253799011 >> 172.21.15.79:0/2253799011 conn(0x7fac3c06dcc0 msgr2=0x7fac3c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:20.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.663+0000 7fac43f7f700 1 -- 172.21.15.79:0/2253799011 shutdown_connections 2023-10-19T08:39:20.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.663+0000 7fac43f7f700 1 -- 172.21.15.79:0/2253799011 wait complete. 2023-10-19T08:39:20.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.664+0000 7fac43f7f700 1 Processor -- start 2023-10-19T08:39:20.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.664+0000 7fac43f7f700 1 -- start start 2023-10-19T08:39:20.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac43f7f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3c0af170 0x7fac3c15c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:20.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac43f7f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac3c0cd0c0 0x7fac3c0b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:20.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac43f7f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac3c0cdd40 0x7fac3c0af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:20.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac43f7f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c0c5600 con 0x7fac3c0af170 2023-10-19T08:39:20.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac43f7f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c0c4980 con 0x7fac3c0cd0c0 2023-10-19T08:39:20.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac43f7f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c0c4c60 con 0x7fac3c0cdd40 2023-10-19T08:39:20.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac41d1b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3c0af170 0x7fac3c15c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:20.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac41d1b700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3c0af170 0x7fac3c15c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48614/0 (socket says 172.21.15.79:48614) 2023-10-19T08:39:20.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac41d1b700 1 -- 172.21.15.79:0/1246109564 learned_addr learned my addr 172.21.15.79:0/1246109564 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:20.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac4251c700 1 --2- 172.21.15.79:0/1246109564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac3c0cdd40 0x7fac3c0af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:20.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac4151a700 1 --2- 172.21.15.79:0/1246109564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac3c0cd0c0 0x7fac3c0b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:20.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac41d1b700 1 -- 172.21.15.79:0/1246109564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac3c0cdd40 msgr2=0x7fac3c0af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:20.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac41d1b700 1 --2- 172.21.15.79:0/1246109564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac3c0cdd40 0x7fac3c0af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac41d1b700 1 -- 172.21.15.79:0/1246109564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac3c0cd0c0 msgr2=0x7fac3c0b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:20.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac41d1b700 1 --2- 172.21.15.79:0/1246109564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac3c0cd0c0 0x7fac3c0b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac41d1b700 1 -- 172.21.15.79:0/1246109564 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac380094a0 con 0x7fac3c0af170 2023-10-19T08:39:20.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac4251c700 1 --2- 172.21.15.79:0/1246109564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac3c0cdd40 0x7fac3c0af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:20.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac4151a700 1 --2- 172.21.15.79:0/1246109564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac3c0cd0c0 0x7fac3c0b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:20.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac41d1b700 1 --2- 172.21.15.79:0/1246109564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3c0af170 0x7fac3c15c370 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00c6d0 tx=0x7fac2c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:20.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac327fc700 1 -- 172.21.15.79:0/1246109564 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c004c80 con 0x7fac3c0af170 2023-10-19T08:39:20.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac327fc700 1 -- 172.21.15.79:0/1246109564 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2c004de0 con 0x7fac3c0af170 2023-10-19T08:39:20.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac43f7f700 1 -- 172.21.15.79:0/1246109564 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3c0c4f40 con 0x7fac3c0af170 2023-10-19T08:39:20.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac327fc700 1 -- 172.21.15.79:0/1246109564 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c007310 con 0x7fac3c0af170 2023-10-19T08:39:20.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.665+0000 7fac43f7f700 1 -- 172.21.15.79:0/1246109564 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3c15c8b0 con 0x7fac3c0af170 2023-10-19T08:39:20.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.666+0000 7fac43f7f700 1 -- 172.21.15.79:0/1246109564 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3c04ee70 con 0x7fac3c0af170 2023-10-19T08:39:20.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.667+0000 7fac327fc700 1 -- 172.21.15.79:0/1246109564 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fac2c007470 con 0x7fac3c0af170 2023-10-19T08:39:20.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.667+0000 7fac327fc700 1 --2- 172.21.15.79:0/1246109564 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fac2006a0e0 0x7fac2006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:20.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.667+0000 7fac327fc700 1 -- 172.21.15.79:0/1246109564 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fac2c088700 con 0x7fac3c0af170 2023-10-19T08:39:20.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.667+0000 7fac4151a700 1 --2- 172.21.15.79:0/1246109564 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fac2006a0e0 0x7fac2006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:20.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.667+0000 7fac4151a700 1 --2- 172.21.15.79:0/1246109564 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fac2006a0e0 0x7fac2006c5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fac3c0c34a0 tx=0x7fac38013040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:20.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.671+0000 7fac327fc700 1 -- 172.21.15.79:0/1246109564 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fac2c053ac0 con 0x7fac3c0af170 2023-10-19T08:39:20.905 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.902+0000 7fac43f7f700 1 -- 172.21.15.79:0/1246109564 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac3c06b110 con 0x7fac3c0af170 2023-10-19T08:39:20.906 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.903+0000 7fac327fc700 1 -- 172.21.15.79:0/1246109564 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4865 (secure 0 0 0) 0x7fac2c0570e0 con 0x7fac3c0af170 2023-10-19T08:39:20.907 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:20.907 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3710906518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":3710906518},{"type":"v1","addr":"172.21.15.89:6835","nonce":3710906518}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/3037310614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":3037310614},{"type":"v1","addr":"172.21.15.79:6835","nonce":3037310614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/79656061","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":79656061},{"type":"v1","addr":"172.21.15.79:6837","nonce":79656061}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-19T08:37:56.667105+0000","modified":"2023-10-19T08:38:20.379674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6833/3076620199","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3076620199},{"type":"v1","addr":"172.21.15.89:6833","nonce":3076620199}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-19T08:39:20.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.905+0000 7fac43f7f700 1 -- 172.21.15.79:0/1246109564 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fac2006a0e0 msgr2=0x7fac2006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:20.908 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.905+0000 7fac43f7f700 1 --2- 172.21.15.79:0/1246109564 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fac2006a0e0 0x7fac2006c5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fac3c0c34a0 tx=0x7fac38013040 comp rx=0 tx=0).stop 2023-10-19T08:39:20.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.905+0000 7fac43f7f700 1 -- 172.21.15.79:0/1246109564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3c0af170 msgr2=0x7fac3c15c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:20.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.905+0000 7fac43f7f700 1 --2- 172.21.15.79:0/1246109564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3c0af170 0x7fac3c15c370 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00c6d0 tx=0x7fac2c00ca90 comp rx=0 tx=0).stop 2023-10-19T08:39:20.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.905+0000 7fac43f7f700 1 -- 172.21.15.79:0/1246109564 shutdown_connections 2023-10-19T08:39:20.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.905+0000 7fac43f7f700 1 --2- 172.21.15.79:0/1246109564 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fac2006a0e0 0x7fac2006c5a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.909 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.905+0000 7fac43f7f700 1 --2- 172.21.15.79:0/1246109564 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fac3c0cdd40 0x7fac3c0af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.905+0000 7fac43f7f700 1 --2- 172.21.15.79:0/1246109564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fac3c0af170 0x7fac3c15c370 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.905+0000 7fac43f7f700 1 --2- 172.21.15.79:0/1246109564 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac3c0cd0c0 0x7fac3c0b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:20.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.905+0000 7fac43f7f700 1 -- 172.21.15.79:0/1246109564 >> 172.21.15.79:0/1246109564 conn(0x7fac3c06dcc0 msgr2=0x7fac3c0b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:20.910 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.905+0000 7fac43f7f700 1 -- 172.21.15.79:0/1246109564 shutdown_connections 2023-10-19T08:39:20.911 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:20.905+0000 7fac43f7f700 1 -- 172.21.15.79:0/1246109564 wait complete. 2023-10-19T08:39:20.911 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 9 2023-10-19T08:39:20.920 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:39:21.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.036+0000 7f17cef73700 1 Processor -- start 2023-10-19T08:39:21.040 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.036+0000 7f17cef73700 1 -- start start 2023-10-19T08:39:21.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.037+0000 7f17cef73700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17c80cfcf0 0x7f17c80d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:21.042 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.037+0000 7f17cef73700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f17c80b5f20 0x7f17c80b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:21.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.037+0000 7f17cef73700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c80d0610 con 0x7f17c80b2180 2023-10-19T08:39:21.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.037+0000 7f17cef73700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c80d2b20 con 0x7f17c80b5f20 2023-10-19T08:39:21.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.037+0000 7f17cef73700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c80d1120 con 0x7f17c80cfcf0 2023-10-19T08:39:21.043 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.038+0000 7f17ccd0f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17c80cfcf0 0x7f17c80d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:21.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.038+0000 7f17cd510700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f17c80b5f20 0x7f17c80b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:21.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.038+0000 7f17cd510700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f17c80b5f20 0x7f17c80b6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:34872/0 (socket says 172.21.15.79:34872) 2023-10-19T08:39:21.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.038+0000 7f17cd510700 1 -- 172.21.15.79:0/1255205609 learned_addr learned my addr 172.21.15.79:0/1255205609 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:21.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.038+0000 7f17c7fff700 1 --1- 172.21.15.79:0/1255205609 >> v1:172.21.15.89:6789/0 conn(0x7f17c80b2180 0x7f17c80d2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:43536/0 (socket says 172.21.15.79:43536) 2023-10-19T08:39:21.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.038+0000 7f17cd510700 1 -- 172.21.15.79:0/1255205609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17c80cfcf0 msgr2=0x7f17c80d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:21.044 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.038+0000 7f17cd510700 1 --2- 172.21.15.79:0/1255205609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17c80cfcf0 0x7f17c80d00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.038+0000 7f17cd510700 1 -- 172.21.15.79:0/1255205609 >> v1:172.21.15.89:6789/0 conn(0x7f17c80b2180 legacy=0x7f17c80d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:21.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.038+0000 7f17cd510700 1 -- 172.21.15.79:0/1255205609 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c80d1400 con 0x7f17c80b5f20 2023-10-19T08:39:21.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.038+0000 7f17cd510700 1 --2- 172.21.15.79:0/1255205609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c80b5f20 0x7f17c80b6390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f17c0009e50 tx=0x7f17c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aad3d78bc88b6d3d server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:21.045 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.038+0000 7f17c77fe700 1 -- 172.21.15.79:0/1255205609 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c000e070 con 0x7f17c80b5f20 2023-10-19T08:39:21.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.038+0000 7f17c77fe700 1 -- 172.21.15.79:0/1255205609 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c000b910 con 0x7f17c80b5f20 2023-10-19T08:39:21.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.038+0000 7f17c77fe700 1 -- 172.21.15.79:0/1255205609 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c000bcc0 con 0x7f17c80b5f20 2023-10-19T08:39:21.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.039+0000 7f17cef73700 1 -- 172.21.15.79:0/1255205609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c80b5f20 msgr2=0x7f17c80b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:21.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.039+0000 7f17cef73700 1 --2- 172.21.15.79:0/1255205609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c80b5f20 0x7f17c80b6390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f17c0009e50 tx=0x7f17c000b330 comp rx=0 tx=0).stop 2023-10-19T08:39:21.046 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.039+0000 7f17cef73700 1 -- 172.21.15.79:0/1255205609 shutdown_connections 2023-10-19T08:39:21.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.039+0000 7f17cef73700 1 --2- 172.21.15.79:0/1255205609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c80b5f20 0x7f17c80b6390 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.039+0000 7f17cef73700 1 --2- 172.21.15.79:0/1255205609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17c80cfcf0 0x7f17c80d00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.039+0000 7f17cef73700 1 -- 172.21.15.79:0/1255205609 >> 172.21.15.79:0/1255205609 conn(0x7f17c8071b30 msgr2=0x7f17c8071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:21.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.039+0000 7f17cef73700 1 -- 172.21.15.79:0/1255205609 shutdown_connections 2023-10-19T08:39:21.047 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.039+0000 7f17cef73700 1 -- 172.21.15.79:0/1255205609 wait complete. 2023-10-19T08:39:21.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.040+0000 7f17cef73700 1 Processor -- start 2023-10-19T08:39:21.050 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.040+0000 7f17cef73700 1 -- start start 2023-10-19T08:39:21.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.041+0000 7f17cef73700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c80b2180 0x7f17c81f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:21.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.041+0000 7f17cef73700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c80b5f20 0x7f17c81e7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:21.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.041+0000 7f17cef73700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17c80cfcf0 0x7f17c81f5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:21.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.041+0000 7f17cef73700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c81e7eb0 con 0x7f17c80b2180 2023-10-19T08:39:21.051 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.041+0000 7f17cef73700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c815e950 con 0x7f17c80b5f20 2023-10-19T08:39:21.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.041+0000 7f17cef73700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c815ec30 con 0x7f17c80cfcf0 2023-10-19T08:39:21.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.041+0000 7f17ccd0f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c80b2180 0x7f17c81f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:21.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.041+0000 7f17ccd0f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c80b2180 0x7f17c81f5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48628/0 (socket says 172.21.15.79:48628) 2023-10-19T08:39:21.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.041+0000 7f17ccd0f700 1 -- 172.21.15.79:0/210984377 learned_addr learned my addr 172.21.15.79:0/210984377 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:21.052 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.041+0000 7f17cd510700 1 --2- 172.21.15.79:0/210984377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17c80cfcf0 0x7f17c81f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:21.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.041+0000 7f17c7fff700 1 --2- 172.21.15.79:0/210984377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c80b5f20 0x7f17c81e7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:21.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.041+0000 7f17ccd0f700 1 -- 172.21.15.79:0/210984377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17c80cfcf0 msgr2=0x7f17c81f5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:21.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.041+0000 7f17ccd0f700 1 --2- 172.21.15.79:0/210984377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17c80cfcf0 0x7f17c81f5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.053 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.041+0000 7f17ccd0f700 1 -- 172.21.15.79:0/210984377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c80b5f20 msgr2=0x7f17c81e7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:21.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.041+0000 7f17ccd0f700 1 --2- 172.21.15.79:0/210984377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c80b5f20 0x7f17c81e7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.041+0000 7f17ccd0f700 1 -- 172.21.15.79:0/210984377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c0009b30 con 0x7f17c80b2180 2023-10-19T08:39:21.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.041+0000 7f17c7fff700 1 --2- 172.21.15.79:0/210984377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c80b5f20 0x7f17c81e7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:21.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.041+0000 7f17ccd0f700 1 --2- 172.21.15.79:0/210984377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c80b2180 0x7f17c81f5fd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00e870 tx=0x7f17bc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:21.054 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.042+0000 7f17c57fa700 1 -- 172.21.15.79:0/210984377 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc009590 con 0x7f17c80b2180 2023-10-19T08:39:21.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.042+0000 7f17c57fa700 1 -- 172.21.15.79:0/210984377 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc00ee70 con 0x7f17c80b2180 2023-10-19T08:39:21.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.042+0000 7f17cef73700 1 -- 172.21.15.79:0/210984377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c815ef10 con 0x7f17c80b2180 2023-10-19T08:39:21.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.042+0000 7f17c57fa700 1 -- 172.21.15.79:0/210984377 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc00ca50 con 0x7f17c80b2180 2023-10-19T08:39:21.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.042+0000 7f17cef73700 1 -- 172.21.15.79:0/210984377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c81f6a50 con 0x7f17c80b2180 2023-10-19T08:39:21.055 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.042+0000 7f17cef73700 1 -- 172.21.15.79:0/210984377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c804ee70 con 0x7f17c80b2180 2023-10-19T08:39:21.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.043+0000 7f17c57fa700 1 -- 172.21.15.79:0/210984377 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f17bc00cbb0 con 0x7f17c80b2180 2023-10-19T08:39:21.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.043+0000 7f17c57fa700 1 --2- 172.21.15.79:0/210984377 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f17ac06a0e0 0x7f17ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:21.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.043+0000 7f17c57fa700 1 -- 172.21.15.79:0/210984377 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f17bc088770 con 0x7f17c80b2180 2023-10-19T08:39:21.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.044+0000 7f17c7fff700 1 --2- 172.21.15.79:0/210984377 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f17ac06a0e0 0x7f17ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:21.056 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.044+0000 7f17c7fff700 1 --2- 172.21.15.79:0/210984377 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f17ac06a0e0 0x7f17ac06c5a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f17b4000f60 tx=0x7f17b4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:21.057 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.048+0000 7f17c57fa700 1 -- 172.21.15.79:0/210984377 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f17bc057650 con 0x7f17c80b2180 2023-10-19T08:39:21.242 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.239+0000 7f17cef73700 1 -- 172.21.15.79:0/210984377 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17c80b2660 con 0x7f17c80b2180 2023-10-19T08:39:21.243 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.240+0000 7f17c57fa700 1 -- 172.21.15.79:0/210984377 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20155 (secure 0 0 0) 0x7f17bc00ce60 con 0x7f17c80b2180 2023-10-19T08:39:21.244 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:21.244 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":27,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:38:44.473795+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:37:54.318159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-19T08:37:55.629862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-19T08:37:59.333062+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.10","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:39:21.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.242+0000 7f17cef73700 1 -- 172.21.15.79:0/210984377 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f17ac06a0e0 msgr2=0x7f17ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:21.246 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.242+0000 7f17cef73700 1 --2- 172.21.15.79:0/210984377 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f17ac06a0e0 0x7f17ac06c5a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f17b4000f60 tx=0x7f17b4009040 comp rx=0 tx=0).stop 2023-10-19T08:39:21.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.242+0000 7f17cef73700 1 -- 172.21.15.79:0/210984377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c80b2180 msgr2=0x7f17c81f5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:21.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.242+0000 7f17cef73700 1 --2- 172.21.15.79:0/210984377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c80b2180 0x7f17c81f5fd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00e870 tx=0x7f17bc00ec30 comp rx=0 tx=0).stop 2023-10-19T08:39:21.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.242+0000 7f17cef73700 1 -- 172.21.15.79:0/210984377 shutdown_connections 2023-10-19T08:39:21.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.242+0000 7f17cef73700 1 --2- 172.21.15.79:0/210984377 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f17ac06a0e0 0x7f17ac06c5a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.247 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.242+0000 7f17cef73700 1 --2- 172.21.15.79:0/210984377 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17c80cfcf0 0x7f17c81f5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.242+0000 7f17cef73700 1 --2- 172.21.15.79:0/210984377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f17c80b2180 0x7f17c81f5fd0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.242+0000 7f17cef73700 1 --2- 172.21.15.79:0/210984377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17c80b5f20 0x7f17c81e7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.243+0000 7f17cef73700 1 -- 172.21.15.79:0/210984377 >> 172.21.15.79:0/210984377 conn(0x7f17c8071b30 msgr2=0x7f17c80cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:21.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.243+0000 7f17cef73700 1 -- 172.21.15.79:0/210984377 shutdown_connections 2023-10-19T08:39:21.248 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.243+0000 7f17cef73700 1 -- 172.21.15.79:0/210984377 wait complete. 2023-10-19T08:39:21.258 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-19T08:39:21.382 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.379+0000 7f9fbfd11700 1 Processor -- start 2023-10-19T08:39:21.383 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.379+0000 7f9fbfd11700 1 -- start start 2023-10-19T08:39:21.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.380+0000 7f9fbfd11700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9fb815af30 0x7f9fb806a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:21.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.380+0000 7f9fbfd11700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9fb815b310 0x7f9fb806a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:21.385 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.380+0000 7f9fbfd11700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb80b2d90 con 0x7f9fb806e7e0 2023-10-19T08:39:21.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.380+0000 7f9fbfd11700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb80ca630 con 0x7f9fb815b310 2023-10-19T08:39:21.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.380+0000 7f9fbfd11700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb80ca910 con 0x7f9fb815af30 2023-10-19T08:39:21.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.380+0000 7f9fbd2ac700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9fb815b310 0x7f9fb806a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:21.386 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.380+0000 7f9fbe2ae700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9fb806e7e0 0x7f9fb80cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58712/0 (socket says 172.21.15.79:58712) 2023-10-19T08:39:21.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.380+0000 7f9fbe2ae700 1 -- 172.21.15.79:0/177583674 learned_addr learned my addr 172.21.15.79:0/177583674 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:21.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.380+0000 7f9fbd2ac700 1 -- 172.21.15.79:0/177583674 >> v2:172.21.15.89:3300/0 conn(0x7f9fb815af30 msgr2=0x7f9fb806a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:21.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.380+0000 7f9fbd2ac700 1 --2- 172.21.15.79:0/177583674 >> v2:172.21.15.89:3300/0 conn(0x7f9fb815af30 0x7f9fb806a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.380+0000 7f9fbd2ac700 1 -- 172.21.15.79:0/177583674 >> v1:172.21.15.79:6789/0 conn(0x7f9fb806e7e0 legacy=0x7f9fb80cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:21.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.380+0000 7f9fbcaab700 1 -- 172.21.15.79:0/177583674 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850203008 0 0) 0x7f9fb80b2d90 con 0x7f9fb806e7e0 2023-10-19T08:39:21.387 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.380+0000 7f9fbd2ac700 1 -- 172.21.15.79:0/177583674 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb80b20d0 con 0x7f9fb815b310 2023-10-19T08:39:21.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.381+0000 7f9fbd2ac700 1 --2- 172.21.15.79:0/177583674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fb815b310 0x7f9fb806a760 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80b2820 tx=0x7f9fb4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c67e52ee04fab60 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:21.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.381+0000 7f9fbcaab700 1 -- 172.21.15.79:0/177583674 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4011830 con 0x7f9fb815b310 2023-10-19T08:39:21.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.381+0000 7f9fbcaab700 1 -- 172.21.15.79:0/177583674 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb4011990 con 0x7f9fb815b310 2023-10-19T08:39:21.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.381+0000 7f9fbcaab700 1 -- 172.21.15.79:0/177583674 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4011d20 con 0x7f9fb815b310 2023-10-19T08:39:21.388 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.381+0000 7f9fbfd11700 1 -- 172.21.15.79:0/177583674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fb815b310 msgr2=0x7f9fb806a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.381+0000 7f9fbfd11700 1 --2- 172.21.15.79:0/177583674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fb815b310 0x7f9fb806a760 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80b2820 tx=0x7f9fb4009b20 comp rx=0 tx=0).stop 2023-10-19T08:39:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.381+0000 7f9fbfd11700 1 -- 172.21.15.79:0/177583674 shutdown_connections 2023-10-19T08:39:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.381+0000 7f9fbfd11700 1 --2- 172.21.15.79:0/177583674 >> v2:172.21.15.89:3300/0 conn(0x7f9fb815af30 0x7f9fb806a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.381+0000 7f9fbfd11700 1 --2- 172.21.15.79:0/177583674 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fb815b310 0x7f9fb806a760 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.389 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.381+0000 7f9fbfd11700 1 -- 172.21.15.79:0/177583674 >> 172.21.15.79:0/177583674 conn(0x7f9fb806dcc0 msgr2=0x7f9fb806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:21.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.381+0000 7f9fbfd11700 1 -- 172.21.15.79:0/177583674 shutdown_connections 2023-10-19T08:39:21.390 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.381+0000 7f9fbfd11700 1 -- 172.21.15.79:0/177583674 wait complete. 2023-10-19T08:39:21.392 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.382+0000 7f9fbfd11700 1 Processor -- start 2023-10-19T08:39:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.383+0000 7f9fbfd11700 1 -- start start 2023-10-19T08:39:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.383+0000 7f9fbfd11700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb806e7e0 0x7f9fb8143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.383+0000 7f9fbfd11700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fb815af30 0x7f9fb80c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.383+0000 7f9fbfd11700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb80cc730 0x7f9fb8140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:21.393 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.383+0000 7f9fbfd11700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb81525a0 con 0x7f9fb815af30 2023-10-19T08:39:21.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.383+0000 7f9fbfd11700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb8143c00 con 0x7f9fb806e7e0 2023-10-19T08:39:21.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.383+0000 7f9fbfd11700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb8143ee0 con 0x7f9fb80cc730 2023-10-19T08:39:21.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.384+0000 7f9fbd2ac700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fb815af30 0x7f9fb80c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:21.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.384+0000 7f9fbd2ac700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fb815af30 0x7f9fb80c3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48644/0 (socket says 172.21.15.79:48644) 2023-10-19T08:39:21.394 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.384+0000 7f9fbd2ac700 1 -- 172.21.15.79:0/1451088657 learned_addr learned my addr 172.21.15.79:0/1451088657 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:21.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.384+0000 7f9fbe2ae700 1 --2- 172.21.15.79:0/1451088657 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb80cc730 0x7f9fb8140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:21.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.384+0000 7f9fbd2ac700 1 -- 172.21.15.79:0/1451088657 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb80cc730 msgr2=0x7f9fb8140920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:21.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.384+0000 7f9fbdaad700 1 --2- 172.21.15.79:0/1451088657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb806e7e0 0x7f9fb8143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:21.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.384+0000 7f9fbd2ac700 1 --2- 172.21.15.79:0/1451088657 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb80cc730 0x7f9fb8140920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.395 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.384+0000 7f9fbd2ac700 1 -- 172.21.15.79:0/1451088657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb806e7e0 msgr2=0x7f9fb8143600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:21.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.384+0000 7f9fbd2ac700 1 --2- 172.21.15.79:0/1451088657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb806e7e0 0x7f9fb8143600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.384+0000 7f9fbd2ac700 1 -- 172.21.15.79:0/1451088657 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb40094a0 con 0x7f9fb815af30 2023-10-19T08:39:21.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.384+0000 7f9fbd2ac700 1 --2- 172.21.15.79:0/1451088657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fb815af30 0x7f9fb80c3f20 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40090b0 tx=0x7f9fb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:21.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.384+0000 7f9fae7fc700 1 -- 172.21.15.79:0/1451088657 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb40038a0 con 0x7f9fb815af30 2023-10-19T08:39:21.396 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.384+0000 7f9fae7fc700 1 -- 172.21.15.79:0/1451088657 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb401e070 con 0x7f9fb815af30 2023-10-19T08:39:21.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.384+0000 7f9fbfd11700 1 -- 172.21.15.79:0/1451088657 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb81441c0 con 0x7f9fb815af30 2023-10-19T08:39:21.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.384+0000 7f9fae7fc700 1 -- 172.21.15.79:0/1451088657 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb4003c40 con 0x7f9fb815af30 2023-10-19T08:39:21.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.384+0000 7f9fbfd11700 1 -- 172.21.15.79:0/1451088657 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb8141610 con 0x7f9fb815af30 2023-10-19T08:39:21.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.385+0000 7f9fbfd11700 1 -- 172.21.15.79:0/1451088657 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb8141800 con 0x7f9fb815af30 2023-10-19T08:39:21.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.385+0000 7f9fae7fc700 1 -- 172.21.15.79:0/1451088657 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9fb402d450 con 0x7f9fb815af30 2023-10-19T08:39:21.397 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.386+0000 7f9fae7fc700 1 --2- 172.21.15.79:0/1451088657 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9f9c06a0e0 0x7f9f9c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:21.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.386+0000 7f9fae7fc700 1 -- 172.21.15.79:0/1451088657 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9fb4089a10 con 0x7f9fb815af30 2023-10-19T08:39:21.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.386+0000 7f9fbdaad700 1 --2- 172.21.15.79:0/1451088657 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9f9c06a0e0 0x7f9f9c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:21.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.386+0000 7f9fbdaad700 1 --2- 172.21.15.79:0/1451088657 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9f9c06a0e0 0x7f9f9c06c5a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8006fd0 tx=0x7f9fa8008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:21.398 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.390+0000 7f9fae7fc700 1 -- 172.21.15.79:0/1451088657 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f9fb4054dd0 con 0x7f9fb815af30 2023-10-19T08:39:21.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.623+0000 7f9fbfd11700 1 -- 172.21.15.79:0/1451088657 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9fb804ee70 con 0x7f9fb815af30 2023-10-19T08:39:21.627 INFO:tasks.ceph.mon.a.smithi079.stderr:2023-10-19T08:39:21.624+0000 7f11afd7e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-19T08:39:21.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.627+0000 7f9fae7fc700 1 -- 172.21.15.79:0/1451088657 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9fb40583f0 con 0x7f9fb815af30 2023-10-19T08:39:21.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.629+0000 7f9fbfd11700 1 -- 172.21.15.79:0/1451088657 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9f9c06a0e0 msgr2=0x7f9f9c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:21.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.629+0000 7f9fbfd11700 1 --2- 172.21.15.79:0/1451088657 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9f9c06a0e0 0x7f9f9c06c5a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8006fd0 tx=0x7f9fa8008040 comp rx=0 tx=0).stop 2023-10-19T08:39:21.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.629+0000 7f9fbfd11700 1 -- 172.21.15.79:0/1451088657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fb815af30 msgr2=0x7f9fb80c3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:21.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.629+0000 7f9fbfd11700 1 --2- 172.21.15.79:0/1451088657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fb815af30 0x7f9fb80c3f20 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40090b0 tx=0x7f9fb4004750 comp rx=0 tx=0).stop 2023-10-19T08:39:21.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.629+0000 7f9fbfd11700 1 -- 172.21.15.79:0/1451088657 shutdown_connections 2023-10-19T08:39:21.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.629+0000 7f9fbfd11700 1 --2- 172.21.15.79:0/1451088657 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9f9c06a0e0 0x7f9f9c06c5a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.629+0000 7f9fbfd11700 1 --2- 172.21.15.79:0/1451088657 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb80cc730 0x7f9fb8140920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.629+0000 7f9fbfd11700 1 --2- 172.21.15.79:0/1451088657 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb806e7e0 0x7f9fb8143600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.629+0000 7f9fbfd11700 1 --2- 172.21.15.79:0/1451088657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9fb815af30 0x7f9fb80c3f20 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.629+0000 7f9fbfd11700 1 -- 172.21.15.79:0/1451088657 >> 172.21.15.79:0/1451088657 conn(0x7f9fb806dcc0 msgr2=0x7f9fb80b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:21.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.630+0000 7f9fbfd11700 1 -- 172.21.15.79:0/1451088657 shutdown_connections 2023-10-19T08:39:21.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.630+0000 7f9fbfd11700 1 -- 172.21.15.79:0/1451088657 wait complete. 2023-10-19T08:39:21.636 INFO:tasks.ceph.mds.b.smithi089.stderr: -5797> 2023-10-19T08:38:02.254+0000 7f95cd17f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-19T08:39:21.636 INFO:teuthology.orchestra.run.smithi079.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-19T08:39:21.645 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-19T08:39:21.667 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-10-19T08:39:21.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.764+0000 7efe88c6c700 1 Processor -- start 2023-10-19T08:39:21.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.764+0000 7efe88c6c700 1 -- start start 2023-10-19T08:39:21.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.765+0000 7efe88c6c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efe8415aec0 0x7efe840d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:21.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.765+0000 7efe88c6c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efe840b2ef0 0x7efe840af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:21.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.765+0000 7efe88c6c700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8415b2a0 con 0x7efe840d0790 2023-10-19T08:39:21.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.765+0000 7efe88c6c700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe840cf140 con 0x7efe840b2ef0 2023-10-19T08:39:21.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.765+0000 7efe88c6c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe840cf420 con 0x7efe8415aec0 2023-10-19T08:39:21.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.765+0000 7efe82d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efe840b2ef0 0x7efe840af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:21.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.765+0000 7efe82d9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efe840b2ef0 0x7efe840af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48654/0 (socket says 172.21.15.79:48654) 2023-10-19T08:39:21.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.765+0000 7efe82d9d700 1 -- 172.21.15.79:0/1471241826 learned_addr learned my addr 172.21.15.79:0/1471241826 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:21.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.765+0000 7efe8259c700 1 --2- 172.21.15.79:0/1471241826 >> v2:172.21.15.89:3300/0 conn(0x7efe8415aec0 0x7efe840d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:21.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.766+0000 7efe82d9d700 1 -- 172.21.15.79:0/1471241826 >> v2:172.21.15.89:3300/0 conn(0x7efe8415aec0 msgr2=0x7efe840d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:21.772 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.766+0000 7efe82d9d700 1 --2- 172.21.15.79:0/1471241826 >> v2:172.21.15.89:3300/0 conn(0x7efe8415aec0 0x7efe840d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.766+0000 7efe82d9d700 1 -- 172.21.15.79:0/1471241826 >> v1:172.21.15.79:6789/0 conn(0x7efe840d0790 legacy=0x7efe840b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:21.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.766+0000 7efe82d9d700 1 -- 172.21.15.79:0/1471241826 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe840cf700 con 0x7efe840b2ef0 2023-10-19T08:39:21.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.766+0000 7efe82d9d700 1 --2- 172.21.15.79:0/1471241826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe840b2ef0 0x7efe840af7d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7efe840ce4c0 tx=0x7efe74009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40a358fa45fa607 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:21.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.766+0000 7efe8159a700 1 -- 172.21.15.79:0/1471241826 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe74011830 con 0x7efe840b2ef0 2023-10-19T08:39:21.773 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.766+0000 7efe8159a700 1 -- 172.21.15.79:0/1471241826 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe74011990 con 0x7efe840b2ef0 2023-10-19T08:39:21.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.766+0000 7efe8159a700 1 -- 172.21.15.79:0/1471241826 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe74011d20 con 0x7efe840b2ef0 2023-10-19T08:39:21.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.766+0000 7efe88c6c700 1 -- 172.21.15.79:0/1471241826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe840b2ef0 msgr2=0x7efe840af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:21.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.766+0000 7efe88c6c700 1 --2- 172.21.15.79:0/1471241826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe840b2ef0 0x7efe840af7d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7efe840ce4c0 tx=0x7efe74009bd0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.767+0000 7efe88c6c700 1 -- 172.21.15.79:0/1471241826 shutdown_connections 2023-10-19T08:39:21.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.767+0000 7efe88c6c700 1 --2- 172.21.15.79:0/1471241826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe840b2ef0 0x7efe840af7d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.767+0000 7efe88c6c700 1 --2- 172.21.15.79:0/1471241826 >> v2:172.21.15.89:3300/0 conn(0x7efe8415aec0 0x7efe840d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.767+0000 7efe88c6c700 1 -- 172.21.15.79:0/1471241826 >> 172.21.15.79:0/1471241826 conn(0x7efe840cd7e0 msgr2=0x7efe840cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:21.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.767+0000 7efe88c6c700 1 -- 172.21.15.79:0/1471241826 shutdown_connections 2023-10-19T08:39:21.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.767+0000 7efe88c6c700 1 -- 172.21.15.79:0/1471241826 wait complete. 2023-10-19T08:39:21.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.768+0000 7efe88c6c700 1 Processor -- start 2023-10-19T08:39:21.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.768+0000 7efe88c6c700 1 -- start start 2023-10-19T08:39:21.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe88c6c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe840b2ef0 0x7efe841f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:21.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe88c6c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe840d0790 0x7efe8406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:21.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe88c6c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe8415aec0 0x7efe840c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:21.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe88c6c700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe840c7470 con 0x7efe840b2ef0 2023-10-19T08:39:21.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe88c6c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe841f22b0 con 0x7efe840d0790 2023-10-19T08:39:21.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe88c6c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe840c6860 con 0x7efe8415aec0 2023-10-19T08:39:21.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe8259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe840b2ef0 0x7efe841f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:21.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe8259c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe840b2ef0 0x7efe841f1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48656/0 (socket says 172.21.15.79:48656) 2023-10-19T08:39:21.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe8259c700 1 -- 172.21.15.79:0/394089889 learned_addr learned my addr 172.21.15.79:0/394089889 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:21.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe8259c700 1 -- 172.21.15.79:0/394089889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe8415aec0 msgr2=0x7efe840c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:21.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe8259c700 1 --2- 172.21.15.79:0/394089889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe8415aec0 0x7efe840c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe8259c700 1 -- 172.21.15.79:0/394089889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe840d0790 msgr2=0x7efe8406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:21.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe8259c700 1 --2- 172.21.15.79:0/394089889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe840d0790 0x7efe8406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:21.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe8259c700 1 -- 172.21.15.79:0/394089889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe74009550 con 0x7efe840b2ef0 2023-10-19T08:39:21.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe8259c700 1 --2- 172.21.15.79:0/394089889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe840b2ef0 0x7efe841f1d70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00efc0 tx=0x7efe7c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:21.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe72ffd700 1 -- 172.21.15.79:0/394089889 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c009b80 con 0x7efe840b2ef0 2023-10-19T08:39:21.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe72ffd700 1 -- 172.21.15.79:0/394089889 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c00f040 con 0x7efe840b2ef0 2023-10-19T08:39:21.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe88c6c700 1 -- 172.21.15.79:0/394089889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe840c6b40 con 0x7efe840b2ef0 2023-10-19T08:39:21.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe72ffd700 1 -- 172.21.15.79:0/394089889 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c014480 con 0x7efe840b2ef0 2023-10-19T08:39:21.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.769+0000 7efe88c6c700 1 -- 172.21.15.79:0/394089889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe840c7100 con 0x7efe840b2ef0 2023-10-19T08:39:21.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.770+0000 7efe88c6c700 1 -- 172.21.15.79:0/394089889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe84067470 con 0x7efe840b2ef0 2023-10-19T08:39:21.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.771+0000 7efe72ffd700 1 -- 172.21.15.79:0/394089889 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efe7c0145e0 con 0x7efe840b2ef0 2023-10-19T08:39:21.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.771+0000 7efe72ffd700 1 --2- 172.21.15.79:0/394089889 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efe6406a0e0 0x7efe6406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:21.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.771+0000 7efe72ffd700 1 -- 172.21.15.79:0/394089889 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6957+0+0 (secure 0 0 0) 0x7efe7c0895a0 con 0x7efe840b2ef0 2023-10-19T08:39:21.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.771+0000 7efe81d9b700 1 --2- 172.21.15.79:0/394089889 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efe6406a0e0 0x7efe6406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:21.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.771+0000 7efe81d9b700 1 --2- 172.21.15.79:0/394089889 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efe6406a0e0 0x7efe6406c5a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efe78000f60 tx=0x7efe78007a40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:21.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:21.775+0000 7efe72ffd700 1 -- 172.21.15.79:0/394089889 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7efe7c058310 con 0x7efe840b2ef0 2023-10-19T08:39:22.013 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.009+0000 7efe88c6c700 1 -- 172.21.15.79:0/394089889 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efe840c7750 con 0x7efe840b2ef0 2023-10-19T08:39:22.631 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.628+0000 7efe72ffd700 1 -- 172.21.15.79:0/394089889 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7efe7c057ea0 con 0x7efe840b2ef0 2023-10-19T08:39:22.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.630+0000 7efe88c6c700 1 -- 172.21.15.79:0/394089889 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efe6406a0e0 msgr2=0x7efe6406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:22.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.630+0000 7efe88c6c700 1 --2- 172.21.15.79:0/394089889 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efe6406a0e0 0x7efe6406c5a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efe78000f60 tx=0x7efe78007a40 comp rx=0 tx=0).stop 2023-10-19T08:39:22.634 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.630+0000 7efe88c6c700 1 -- 172.21.15.79:0/394089889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe840b2ef0 msgr2=0x7efe841f1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:22.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.630+0000 7efe88c6c700 1 --2- 172.21.15.79:0/394089889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe840b2ef0 0x7efe841f1d70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00efc0 tx=0x7efe7c00c3a0 comp rx=0 tx=0).stop 2023-10-19T08:39:22.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.630+0000 7efe88c6c700 1 -- 172.21.15.79:0/394089889 shutdown_connections 2023-10-19T08:39:22.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.630+0000 7efe88c6c700 1 --2- 172.21.15.79:0/394089889 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efe6406a0e0 0x7efe6406c5a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:22.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.630+0000 7efe88c6c700 1 --2- 172.21.15.79:0/394089889 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe8415aec0 0x7efe840c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:22.635 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.630+0000 7efe88c6c700 1 --2- 172.21.15.79:0/394089889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe840b2ef0 0x7efe841f1d70 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:22.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.630+0000 7efe88c6c700 1 --2- 172.21.15.79:0/394089889 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe840d0790 0x7efe8406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:22.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.630+0000 7efe88c6c700 1 -- 172.21.15.79:0/394089889 >> 172.21.15.79:0/394089889 conn(0x7efe840cd7e0 msgr2=0x7efe8415bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:22.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.631+0000 7efe88c6c700 1 -- 172.21.15.79:0/394089889 shutdown_connections 2023-10-19T08:39:22.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.631+0000 7efe88c6c700 1 -- 172.21.15.79:0/394089889 wait complete. 2023-10-19T08:39:22.649 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-19T08:39:22.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.775+0000 7efd8080f700 1 Processor -- start 2023-10-19T08:39:22.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.775+0000 7efd8080f700 1 -- start start 2023-10-19T08:39:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.776+0000 7efd8080f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd7c06ab80 0x7efd7c0cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.776+0000 7efd8080f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd7c0cea00 0x7efd7c06faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:22.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.776+0000 7efd8080f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c06af60 con 0x7efd7c0b1f80 2023-10-19T08:39:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.776+0000 7efd8080f700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7c15d9c0 con 0x7efd7c06ab80 2023-10-19T08:39:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.776+0000 7efd8080f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c15dca0 con 0x7efd7c0cea00 2023-10-19T08:39:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.776+0000 7efd7a59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd7c06ab80 0x7efd7c0cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:22.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.776+0000 7efd7a59c700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efd7c06ab80 0x7efd7c0cc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48664/0 (socket says 172.21.15.79:48664) 2023-10-19T08:39:22.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.776+0000 7efd7a59c700 1 -- 172.21.15.79:0/844279714 learned_addr learned my addr 172.21.15.79:0/844279714 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:22.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.776+0000 7efd7ad9d700 1 --2- 172.21.15.79:0/844279714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd7c0cea00 0x7efd7c06faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:22.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.776+0000 7efd7a59c700 1 -- 172.21.15.79:0/844279714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd7c0cea00 msgr2=0x7efd7c06faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:22.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.776+0000 7efd7a59c700 1 --2- 172.21.15.79:0/844279714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd7c0cea00 0x7efd7c06faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:22.783 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.776+0000 7efd7a59c700 1 -- 172.21.15.79:0/844279714 >> v1:172.21.15.89:6789/0 conn(0x7efd7c0b1f80 legacy=0x7efd7c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:22.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.776+0000 7efd7a59c700 1 -- 172.21.15.79:0/844279714 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c15df80 con 0x7efd7c06ab80 2023-10-19T08:39:22.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.776+0000 7efd7ad9d700 1 --2- 172.21.15.79:0/844279714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd7c0cea00 0x7efd7c06faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:22.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.776+0000 7efd7a59c700 1 --2- 172.21.15.79:0/844279714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd7c06ab80 0x7efd7c0cc340 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0098f0 tx=0x7efd6c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638ad40550a186cb server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:22.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.776+0000 7efd7959a700 1 -- 172.21.15.79:0/844279714 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c004230 con 0x7efd7c06ab80 2023-10-19T08:39:22.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.777+0000 7efd7959a700 1 -- 172.21.15.79:0/844279714 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c004390 con 0x7efd7c06ab80 2023-10-19T08:39:22.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.777+0000 7efd7959a700 1 -- 172.21.15.79:0/844279714 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0036a0 con 0x7efd7c06ab80 2023-10-19T08:39:22.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.777+0000 7efd8080f700 1 -- 172.21.15.79:0/844279714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd7c06ab80 msgr2=0x7efd7c0cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:22.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.777+0000 7efd8080f700 1 --2- 172.21.15.79:0/844279714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd7c06ab80 0x7efd7c0cc340 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efd6c0098f0 tx=0x7efd6c009c00 comp rx=0 tx=0).stop 2023-10-19T08:39:22.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.777+0000 7efd8080f700 1 -- 172.21.15.79:0/844279714 shutdown_connections 2023-10-19T08:39:22.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.777+0000 7efd8080f700 1 --2- 172.21.15.79:0/844279714 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd7c0cea00 0x7efd7c06faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:22.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.777+0000 7efd8080f700 1 --2- 172.21.15.79:0/844279714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd7c06ab80 0x7efd7c0cc340 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:22.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.777+0000 7efd8080f700 1 -- 172.21.15.79:0/844279714 >> 172.21.15.79:0/844279714 conn(0x7efd7c06dd90 msgr2=0x7efd7c06e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:22.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.777+0000 7efd8080f700 1 -- 172.21.15.79:0/844279714 shutdown_connections 2023-10-19T08:39:22.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.777+0000 7efd8080f700 1 -- 172.21.15.79:0/844279714 wait complete. 2023-10-19T08:39:22.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.779+0000 7efd8080f700 1 Processor -- start 2023-10-19T08:39:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.779+0000 7efd8080f700 1 -- start start 2023-10-19T08:39:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.779+0000 7efd8080f700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd7c06ab80 0x7efd7c0b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.779+0000 7efd8080f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd7c0b1f80 0x7efd7c15bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.779+0000 7efd8080f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd7c0cea00 0x7efd7c15c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:22.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.779+0000 7efd8080f700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c155b40 con 0x7efd7c06ab80 2023-10-19T08:39:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.779+0000 7efd8080f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0c9c00 con 0x7efd7c0b1f80 2023-10-19T08:39:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.779+0000 7efd8080f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c0c9640 con 0x7efd7c0cea00 2023-10-19T08:39:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.779+0000 7efd7a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd7c06ab80 0x7efd7c0b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.779+0000 7efd7a59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd7c06ab80 0x7efd7c0b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48670/0 (socket says 172.21.15.79:48670) 2023-10-19T08:39:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.779+0000 7efd7a59c700 1 -- 172.21.15.79:0/799239742 learned_addr learned my addr 172.21.15.79:0/799239742 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:22.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.780+0000 7efd79d9b700 1 --2- 172.21.15.79:0/799239742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd7c0b1f80 0x7efd7c15bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:22.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.780+0000 7efd7ad9d700 1 --2- 172.21.15.79:0/799239742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd7c0cea00 0x7efd7c15c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:22.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.780+0000 7efd7a59c700 1 -- 172.21.15.79:0/799239742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd7c0cea00 msgr2=0x7efd7c15c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:22.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.780+0000 7efd7a59c700 1 --2- 172.21.15.79:0/799239742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd7c0cea00 0x7efd7c15c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:22.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.780+0000 7efd7a59c700 1 -- 172.21.15.79:0/799239742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd7c0b1f80 msgr2=0x7efd7c15bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:22.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.780+0000 7efd7a59c700 1 --2- 172.21.15.79:0/799239742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd7c0b1f80 0x7efd7c15bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:22.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.780+0000 7efd7a59c700 1 -- 172.21.15.79:0/799239742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c009550 con 0x7efd7c06ab80 2023-10-19T08:39:22.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.780+0000 7efd7a59c700 1 --2- 172.21.15.79:0/799239742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd7c06ab80 0x7efd7c0b5200 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009130 tx=0x7efd6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:22.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.780+0000 7efd6affd700 1 -- 172.21.15.79:0/799239742 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c00b660 con 0x7efd7c06ab80 2023-10-19T08:39:22.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.780+0000 7efd6affd700 1 -- 172.21.15.79:0/799239742 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c00b7c0 con 0x7efd7c06ab80 2023-10-19T08:39:22.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.780+0000 7efd8080f700 1 -- 172.21.15.79:0/799239742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7c0c9920 con 0x7efd7c06ab80 2023-10-19T08:39:22.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.780+0000 7efd6affd700 1 -- 172.21.15.79:0/799239742 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c00bb70 con 0x7efd7c06ab80 2023-10-19T08:39:22.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.780+0000 7efd8080f700 1 -- 172.21.15.79:0/799239742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7c0b3080 con 0x7efd7c06ab80 2023-10-19T08:39:22.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.781+0000 7efd8080f700 1 -- 172.21.15.79:0/799239742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7c04ee70 con 0x7efd7c06ab80 2023-10-19T08:39:22.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.782+0000 7efd6affd700 1 -- 172.21.15.79:0/799239742 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efd6c00bcd0 con 0x7efd7c06ab80 2023-10-19T08:39:22.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.782+0000 7efd6affd700 1 --2- 172.21.15.79:0/799239742 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efd5c06a0e0 0x7efd5c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:22.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.782+0000 7efd79d9b700 1 --2- 172.21.15.79:0/799239742 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efd5c06a0e0 0x7efd5c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:22.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.782+0000 7efd6affd700 1 -- 172.21.15.79:0/799239742 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6957+0+0 (secure 0 0 0) 0x7efd6c089e50 con 0x7efd7c06ab80 2023-10-19T08:39:22.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.782+0000 7efd79d9b700 1 --2- 172.21.15.79:0/799239742 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efd5c06a0e0 0x7efd5c06c5a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efd70009960 tx=0x7efd700090e0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:22.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.787+0000 7efd6affd700 1 -- 172.21.15.79:0/799239742 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7efd6c055370 con 0x7efd7c06ab80 2023-10-19T08:39:22.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:22.976+0000 7efd8080f700 1 -- 172.21.15.79:0/799239742 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efd7c06af60 con 0x7efd7c06ab80 2023-10-19T08:39:23.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.634+0000 7efd6affd700 1 -- 172.21.15.79:0/799239742 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7efd7c06af60 con 0x7efd7c06ab80 2023-10-19T08:39:23.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.639+0000 7efd8080f700 1 -- 172.21.15.79:0/799239742 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efd5c06a0e0 msgr2=0x7efd5c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:23.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.639+0000 7efd8080f700 1 --2- 172.21.15.79:0/799239742 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efd5c06a0e0 0x7efd5c06c5a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efd70009960 tx=0x7efd700090e0 comp rx=0 tx=0).stop 2023-10-19T08:39:23.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.639+0000 7efd8080f700 1 -- 172.21.15.79:0/799239742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd7c06ab80 msgr2=0x7efd7c0b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.639+0000 7efd8080f700 1 --2- 172.21.15.79:0/799239742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd7c06ab80 0x7efd7c0b5200 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009130 tx=0x7efd6c004750 comp rx=0 tx=0).stop 2023-10-19T08:39:23.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.639+0000 7efd8080f700 1 -- 172.21.15.79:0/799239742 shutdown_connections 2023-10-19T08:39:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.639+0000 7efd8080f700 1 --2- 172.21.15.79:0/799239742 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efd5c06a0e0 0x7efd5c06c5a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.639+0000 7efd8080f700 1 --2- 172.21.15.79:0/799239742 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd7c0cea00 0x7efd7c15c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.639+0000 7efd8080f700 1 --2- 172.21.15.79:0/799239742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd7c06ab80 0x7efd7c0b5200 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.639+0000 7efd8080f700 1 --2- 172.21.15.79:0/799239742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd7c0b1f80 0x7efd7c15bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:23.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.639+0000 7efd8080f700 1 -- 172.21.15.79:0/799239742 >> 172.21.15.79:0/799239742 conn(0x7efd7c06dd90 msgr2=0x7efd7c06e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:23.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.640+0000 7efd8080f700 1 -- 172.21.15.79:0/799239742 shutdown_connections 2023-10-19T08:39:23.646 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.641+0000 7efd8080f700 1 -- 172.21.15.79:0/799239742 wait complete. 2023-10-19T08:39:23.646 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' removed 2023-10-19T08:39:23.660 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-19T08:39:23.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.786+0000 7fc266ec5700 1 Processor -- start 2023-10-19T08:39:23.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.786+0000 7fc266ec5700 1 -- start start 2023-10-19T08:39:23.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.787+0000 7fc266ec5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc26006ed80 0x7fc26006a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:23.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.787+0000 7fc266ec5700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc2600b3d50 0x7fc26006a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:23.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.787+0000 7fc266ec5700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2600ca3a0 con 0x7fc26015b060 2023-10-19T08:39:23.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.787+0000 7fc266ec5700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2600ca680 con 0x7fc2600b3d50 2023-10-19T08:39:23.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.787+0000 7fc266ec5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2600ca960 con 0x7fc26006ed80 2023-10-19T08:39:23.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.787+0000 7fc265462700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc2600b3d50 0x7fc26006a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:23.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.787+0000 7fc265462700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc2600b3d50 0x7fc26006a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48682/0 (socket says 172.21.15.79:48682) 2023-10-19T08:39:23.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.787+0000 7fc265462700 1 -- 172.21.15.79:0/2157399245 learned_addr learned my addr 172.21.15.79:0/2157399245 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:23.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.787+0000 7fc265462700 1 -- 172.21.15.79:0/2157399245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc26006ed80 msgr2=0x7fc26006a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:23.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.787+0000 7fc25ffff700 1 --2- 172.21.15.79:0/2157399245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc26006ed80 0x7fc26006a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:23.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.787+0000 7fc265462700 1 --2- 172.21.15.79:0/2157399245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc26006ed80 0x7fc26006a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:23.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.787+0000 7fc265462700 1 -- 172.21.15.79:0/2157399245 >> v1:172.21.15.79:6789/0 conn(0x7fc26015b060 legacy=0x7fc26006e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:23.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.787+0000 7fc265462700 1 -- 172.21.15.79:0/2157399245 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2600b2540 con 0x7fc2600b3d50 2023-10-19T08:39:23.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.787+0000 7fc25ffff700 1 --2- 172.21.15.79:0/2157399245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc26006ed80 0x7fc26006a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:23.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.788+0000 7fc265462700 1 --2- 172.21.15.79:0/2157399245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2600b3d50 0x7fc26006a760 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc258009e50 tx=0x7fc25800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7a34fdf0720ab4 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:23.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.788+0000 7fc25f7fe700 1 -- 172.21.15.79:0/2157399245 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25800e070 con 0x7fc2600b3d50 2023-10-19T08:39:23.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.788+0000 7fc25f7fe700 1 -- 172.21.15.79:0/2157399245 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25800b9c0 con 0x7fc2600b3d50 2023-10-19T08:39:23.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.788+0000 7fc25f7fe700 1 -- 172.21.15.79:0/2157399245 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25800bd70 con 0x7fc2600b3d50 2023-10-19T08:39:23.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.788+0000 7fc266ec5700 1 -- 172.21.15.79:0/2157399245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2600b3d50 msgr2=0x7fc26006a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:23.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.788+0000 7fc266ec5700 1 --2- 172.21.15.79:0/2157399245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2600b3d50 0x7fc26006a760 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc258009e50 tx=0x7fc25800b330 comp rx=0 tx=0).stop 2023-10-19T08:39:23.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.788+0000 7fc266ec5700 1 -- 172.21.15.79:0/2157399245 shutdown_connections 2023-10-19T08:39:23.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.788+0000 7fc266ec5700 1 --2- 172.21.15.79:0/2157399245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2600b3d50 0x7fc26006a760 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:23.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.788+0000 7fc266ec5700 1 --2- 172.21.15.79:0/2157399245 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc26006ed80 0x7fc26006a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:23.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.788+0000 7fc266ec5700 1 -- 172.21.15.79:0/2157399245 >> 172.21.15.79:0/2157399245 conn(0x7fc2600cbd20 msgr2=0x7fc2600cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:23.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.788+0000 7fc266ec5700 1 -- 172.21.15.79:0/2157399245 shutdown_connections 2023-10-19T08:39:23.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.788+0000 7fc266ec5700 1 -- 172.21.15.79:0/2157399245 wait complete. 2023-10-19T08:39:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.790+0000 7fc266ec5700 1 Processor -- start 2023-10-19T08:39:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.790+0000 7fc266ec5700 1 -- start start 2023-10-19T08:39:23.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.790+0000 7fc266ec5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc26006ed80 0x7fc26014e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.790+0000 7fc266ec5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2600b3d50 0x7fc2600c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.790+0000 7fc266ec5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26015b060 0x7fc2600c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.790+0000 7fc266ec5700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26015c9d0 con 0x7fc26015b060 2023-10-19T08:39:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.790+0000 7fc266ec5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26015be20 con 0x7fc26006ed80 2023-10-19T08:39:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.790+0000 7fc266ec5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26014ee10 con 0x7fc2600b3d50 2023-10-19T08:39:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.791+0000 7fc265462700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26015b060 0x7fc2600c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.791+0000 7fc265462700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26015b060 0x7fc2600c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48688/0 (socket says 172.21.15.79:48688) 2023-10-19T08:39:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.791+0000 7fc265462700 1 -- 172.21.15.79:0/188794939 learned_addr learned my addr 172.21.15.79:0/188794939 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.791+0000 7fc25ffff700 1 --2- 172.21.15.79:0/188794939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2600b3d50 0x7fc2600c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:23.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.791+0000 7fc264c61700 1 --2- 172.21.15.79:0/188794939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc26006ed80 0x7fc26014e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.791+0000 7fc265462700 1 -- 172.21.15.79:0/188794939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2600b3d50 msgr2=0x7fc2600c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.791+0000 7fc265462700 1 --2- 172.21.15.79:0/188794939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2600b3d50 0x7fc2600c7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.791+0000 7fc265462700 1 -- 172.21.15.79:0/188794939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc26006ed80 msgr2=0x7fc26014e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.791+0000 7fc265462700 1 --2- 172.21.15.79:0/188794939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc26006ed80 0x7fc26014e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:23.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.791+0000 7fc265462700 1 -- 172.21.15.79:0/188794939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc258009b30 con 0x7fc26015b060 2023-10-19T08:39:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.791+0000 7fc264c61700 1 --2- 172.21.15.79:0/188794939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc26006ed80 0x7fc26014e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.791+0000 7fc265462700 1 --2- 172.21.15.79:0/188794939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26015b060 0x7fc2600c7760 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc258012000 tx=0x7fc258004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.791+0000 7fc25d7fa700 1 -- 172.21.15.79:0/188794939 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2580048f0 con 0x7fc26015b060 2023-10-19T08:39:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.791+0000 7fc25d7fa700 1 -- 172.21.15.79:0/188794939 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2580099b0 con 0x7fc26015b060 2023-10-19T08:39:23.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.791+0000 7fc266ec5700 1 -- 172.21.15.79:0/188794939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc26015c0a0 con 0x7fc26015b060 2023-10-19T08:39:23.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.791+0000 7fc25d7fa700 1 -- 172.21.15.79:0/188794939 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25801c680 con 0x7fc26015b060 2023-10-19T08:39:23.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.791+0000 7fc266ec5700 1 -- 172.21.15.79:0/188794939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26015c660 con 0x7fc26015b060 2023-10-19T08:39:23.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.792+0000 7fc266ec5700 1 -- 172.21.15.79:0/188794939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2600667f0 con 0x7fc26015b060 2023-10-19T08:39:23.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.792+0000 7fc25d7fa700 1 -- 172.21.15.79:0/188794939 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc25801c7e0 con 0x7fc26015b060 2023-10-19T08:39:23.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.793+0000 7fc25d7fa700 1 --2- 172.21.15.79:0/188794939 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc24406a0e0 0x7fc24406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:23.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.793+0000 7fc25d7fa700 1 -- 172.21.15.79:0/188794939 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6519+0+0 (secure 0 0 0) 0x7fc25808a3b0 con 0x7fc26015b060 2023-10-19T08:39:23.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.793+0000 7fc264c61700 1 --2- 172.21.15.79:0/188794939 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc24406a0e0 0x7fc24406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:23.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.793+0000 7fc264c61700 1 --2- 172.21.15.79:0/188794939 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc24406a0e0 0x7fc24406c5a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc254000f60 tx=0x7fc254009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:23.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.797+0000 7fc25d7fa700 1 -- 172.21.15.79:0/188794939 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc2580593f0 con 0x7fc26015b060 2023-10-19T08:39:23.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:23.987+0000 7fc266ec5700 1 -- 172.21.15.79:0/188794939 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc26015c7f0 con 0x7fc26015b060 2023-10-19T08:39:24.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.639+0000 7fc25d7fa700 1 -- 172.21.15.79:0/188794939 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc258058f80 con 0x7fc26015b060 2023-10-19T08:39:24.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.642+0000 7fc266ec5700 1 -- 172.21.15.79:0/188794939 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc24406a0e0 msgr2=0x7fc24406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:24.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.642+0000 7fc266ec5700 1 --2- 172.21.15.79:0/188794939 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc24406a0e0 0x7fc24406c5a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc254000f60 tx=0x7fc254009040 comp rx=0 tx=0).stop 2023-10-19T08:39:24.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.642+0000 7fc266ec5700 1 -- 172.21.15.79:0/188794939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26015b060 msgr2=0x7fc2600c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:24.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.642+0000 7fc266ec5700 1 --2- 172.21.15.79:0/188794939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26015b060 0x7fc2600c7760 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc258012000 tx=0x7fc258004ad0 comp rx=0 tx=0).stop 2023-10-19T08:39:24.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.643+0000 7fc266ec5700 1 -- 172.21.15.79:0/188794939 shutdown_connections 2023-10-19T08:39:24.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.643+0000 7fc266ec5700 1 --2- 172.21.15.79:0/188794939 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26015b060 0x7fc2600c7760 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:24.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.643+0000 7fc266ec5700 1 --2- 172.21.15.79:0/188794939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc26006ed80 0x7fc26014e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:24.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.643+0000 7fc266ec5700 1 --2- 172.21.15.79:0/188794939 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc24406a0e0 0x7fc24406c5a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:24.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.643+0000 7fc266ec5700 1 --2- 172.21.15.79:0/188794939 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2600b3d50 0x7fc2600c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:24.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.643+0000 7fc266ec5700 1 -- 172.21.15.79:0/188794939 >> 172.21.15.79:0/188794939 conn(0x7fc2600cbd20 msgr2=0x7fc26006aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:24.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.643+0000 7fc266ec5700 1 -- 172.21.15.79:0/188794939 shutdown_connections 2023-10-19T08:39:24.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.643+0000 7fc266ec5700 1 -- 172.21.15.79:0/188794939 wait complete. 2023-10-19T08:39:24.650 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' removed 2023-10-19T08:39:24.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-19T08:39:24.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.785+0000 7f9ee4122700 1 Processor -- start 2023-10-19T08:39:24.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.786+0000 7f9ee4122700 1 -- start start 2023-10-19T08:39:24.793 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.786+0000 7f9ee4122700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9edc06ed80 0x7f9edc06a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:24.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.786+0000 7f9ee4122700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc0ca3a0 con 0x7f9edc15b060 2023-10-19T08:39:24.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.786+0000 7f9ee4122700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc0ca680 con 0x7f9edc0b3d50 2023-10-19T08:39:24.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.786+0000 7f9ee4122700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0ca960 con 0x7f9edc06ed80 2023-10-19T08:39:24.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee1ebe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f9edc15b060 0x7f9edc06e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58764/0 (socket says 172.21.15.79:58764) 2023-10-19T08:39:24.794 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee1ebe700 1 -- 172.21.15.79:0/2209552442 learned_addr learned my addr 172.21.15.79:0/2209552442 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:24.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee0ebc700 1 -- 172.21.15.79:0/2209552442 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860795058 0 0) 0x7f9edc0ca3a0 con 0x7f9edc15b060 2023-10-19T08:39:24.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee0ebc700 1 -- 172.21.15.79:0/2209552442 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ec80035b0 con 0x7f9edc15b060 2023-10-19T08:39:24.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee16bd700 1 --2- 172.21.15.79:0/2209552442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9edc06ed80 0x7f9edc06a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:24.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee0ebc700 1 -- 172.21.15.79:0/2209552442 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 329309752 0 0) 0x7f9ec80035b0 con 0x7f9edc15b060 2023-10-19T08:39:24.795 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee0ebc700 1 -- 172.21.15.79:0/2209552442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9edc06ed80 msgr2=0x7f9edc06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:24.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee0ebc700 1 --2- 172.21.15.79:0/2209552442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9edc06ed80 0x7f9edc06a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:24.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee0ebc700 1 -- 172.21.15.79:0/2209552442 >> v1:172.21.15.89:6789/0 conn(0x7f9edc0b3d50 legacy=0x7f9edc06a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:24.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee0ebc700 1 -- 172.21.15.79:0/2209552442 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc0b2540 con 0x7f9edc15b060 2023-10-19T08:39:24.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee0ebc700 1 -- 172.21.15.79:0/2209552442 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f9ecc001670 con 0x7f9edc15b060 2023-10-19T08:39:24.796 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee0ebc700 1 -- 172.21.15.79:0/2209552442 >> v1:172.21.15.79:6789/0 conn(0x7f9edc15b060 legacy=0x7f9edc06e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:24.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee0ebc700 1 --2- 172.21.15.79:0/2209552442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec8003aa0 0x7f9ec8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:24.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee0ebc700 1 --2- 172.21.15.79:0/2209552442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ec8004850 0x7f9ec8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:24.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee0ebc700 1 --2- 172.21.15.79:0/2209552442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9edc06ed80 0x7f9ec80052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:24.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee0ebc700 1 -- 172.21.15.79:0/2209552442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0ca960 con 0x7f9ec8004850 2023-10-19T08:39:24.797 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee0ebc700 1 -- 172.21.15.79:0/2209552442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec800bbd0 con 0x7f9ec8003aa0 2023-10-19T08:39:24.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee0ebc700 1 -- 172.21.15.79:0/2209552442 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec800bd90 con 0x7f9edc06ed80 2023-10-19T08:39:24.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee16bd700 1 --2- 172.21.15.79:0/2209552442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ec8004850 0x7f9ec8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:24.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee1ebe700 1 --2- 172.21.15.79:0/2209552442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec8003aa0 0x7f9ec8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:24.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.787+0000 7f9ee26bf700 1 --2- 172.21.15.79:0/2209552442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9edc06ed80 0x7f9ec80052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:24.798 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.788+0000 7f9ee16bd700 1 -- 172.21.15.79:0/2209552442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9edc06ed80 msgr2=0x7f9ec80052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:24.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.788+0000 7f9ee16bd700 1 --2- 172.21.15.79:0/2209552442 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9edc06ed80 0x7f9ec80052c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:24.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.788+0000 7f9ee16bd700 1 -- 172.21.15.79:0/2209552442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec8003aa0 msgr2=0x7f9ec8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:24.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.788+0000 7f9ee16bd700 1 --2- 172.21.15.79:0/2209552442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec8003aa0 0x7f9ec8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:24.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.788+0000 7f9ee16bd700 1 -- 172.21.15.79:0/2209552442 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec80035b0 con 0x7f9ec8004850 2023-10-19T08:39:24.799 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.788+0000 7f9ee16bd700 1 --2- 172.21.15.79:0/2209552442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ec8004850 0x7f9ec8004cd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8009b30 tx=0x7f9ec8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e1c03a0c9f63924 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:24.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.788+0000 7f9ee0ebc700 1 -- 172.21.15.79:0/2209552442 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed800e6c0 con 0x7f9ec8004850 2023-10-19T08:39:24.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.788+0000 7f9ee0ebc700 1 -- 172.21.15.79:0/2209552442 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed800e820 con 0x7f9ec8004850 2023-10-19T08:39:24.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.788+0000 7f9ee0ebc700 1 -- 172.21.15.79:0/2209552442 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed800ebb0 con 0x7f9ec8004850 2023-10-19T08:39:24.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.788+0000 7f9ee4122700 1 -- 172.21.15.79:0/2209552442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ec8004850 msgr2=0x7f9ec8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:24.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.788+0000 7f9ee4122700 1 --2- 172.21.15.79:0/2209552442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9ec8004850 0x7f9ec8004cd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8009b30 tx=0x7f9ec8005880 comp rx=0 tx=0).stop 2023-10-19T08:39:24.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.788+0000 7f9ee26bf700 1 -- 172.21.15.79:0/2209552442 reap_dead start 2023-10-19T08:39:24.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.788+0000 7f9ee4122700 1 -- 172.21.15.79:0/2209552442 shutdown_connections 2023-10-19T08:39:24.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.788+0000 7f9ee4122700 1 -- 172.21.15.79:0/2209552442 >> 172.21.15.79:0/2209552442 conn(0x7f9edc0cbd20 msgr2=0x7f9edc0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:24.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.789+0000 7f9ee4122700 1 -- 172.21.15.79:0/2209552442 shutdown_connections 2023-10-19T08:39:24.801 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.789+0000 7f9ee4122700 1 -- 172.21.15.79:0/2209552442 wait complete. 2023-10-19T08:39:24.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.790+0000 7f9ee4122700 1 Processor -- start 2023-10-19T08:39:24.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.790+0000 7f9ee4122700 1 -- start start 2023-10-19T08:39:24.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.790+0000 7f9ee4122700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec8004850 0x7f9edc15be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:24.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.790+0000 7f9ee4122700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9edc1481b0 0x7f9edc155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:24.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.790+0000 7f9ee4122700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9edc148630 0x7f9edc155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:24.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.790+0000 7f9ee4122700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc15b440 con 0x7f9edc1481b0 2023-10-19T08:39:24.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.790+0000 7f9ee4122700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc148df0 con 0x7f9ec8004850 2023-10-19T08:39:24.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.790+0000 7f9ee4122700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc1565f0 con 0x7f9edc148630 2023-10-19T08:39:24.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.791+0000 7f9ee16bd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9edc1481b0 0x7f9edc155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:24.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.791+0000 7f9ee16bd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9edc1481b0 0x7f9edc155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48704/0 (socket says 172.21.15.79:48704) 2023-10-19T08:39:24.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.791+0000 7f9ee16bd700 1 -- 172.21.15.79:0/667009570 learned_addr learned my addr 172.21.15.79:0/667009570 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:24.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.791+0000 7f9ee1ebe700 1 --2- 172.21.15.79:0/667009570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec8004850 0x7f9edc15be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:24.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.791+0000 7f9ee26bf700 1 --2- 172.21.15.79:0/667009570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9edc148630 0x7f9edc155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:24.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.791+0000 7f9ee16bd700 1 -- 172.21.15.79:0/667009570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9edc148630 msgr2=0x7f9edc155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:24.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.791+0000 7f9ee16bd700 1 --2- 172.21.15.79:0/667009570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9edc148630 0x7f9edc155fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:24.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.791+0000 7f9ee16bd700 1 -- 172.21.15.79:0/667009570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec8004850 msgr2=0x7f9edc15be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:24.807 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.791+0000 7f9ee16bd700 1 --2- 172.21.15.79:0/667009570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec8004850 0x7f9edc15be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:24.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.791+0000 7f9ee16bd700 1 -- 172.21.15.79:0/667009570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc1568d0 con 0x7f9edc1481b0 2023-10-19T08:39:24.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.791+0000 7f9ee16bd700 1 --2- 172.21.15.79:0/667009570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9edc1481b0 0x7f9edc155a80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80090b0 tx=0x7f9ed80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:24.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.791+0000 7f9ed27fc700 1 -- 172.21.15.79:0/667009570 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed800e6c0 con 0x7f9edc1481b0 2023-10-19T08:39:24.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.791+0000 7f9ed27fc700 1 -- 172.21.15.79:0/667009570 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed8013e70 con 0x7f9edc1481b0 2023-10-19T08:39:24.808 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.791+0000 7f9ee4122700 1 -- 172.21.15.79:0/667009570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9edc15b650 con 0x7f9edc1481b0 2023-10-19T08:39:24.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.791+0000 7f9ed27fc700 1 -- 172.21.15.79:0/667009570 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8028670 con 0x7f9edc1481b0 2023-10-19T08:39:24.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.791+0000 7f9ee4122700 1 -- 172.21.15.79:0/667009570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9edc15c390 con 0x7f9edc1481b0 2023-10-19T08:39:24.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.792+0000 7f9ee4122700 1 -- 172.21.15.79:0/667009570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9edc0667f0 con 0x7f9edc1481b0 2023-10-19T08:39:24.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.792+0000 7f9ed27fc700 1 -- 172.21.15.79:0/667009570 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9ed801c450 con 0x7f9edc1481b0 2023-10-19T08:39:24.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.793+0000 7f9ed27fc700 1 --2- 172.21.15.79:0/667009570 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9ec006a0e0 0x7f9ec006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:24.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.793+0000 7f9ed27fc700 1 -- 172.21.15.79:0/667009570 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f9ed8089e90 con 0x7f9edc1481b0 2023-10-19T08:39:24.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.793+0000 7f9ee1ebe700 1 --2- 172.21.15.79:0/667009570 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9ec006a0e0 0x7f9ec006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:24.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.793+0000 7f9ee1ebe700 1 --2- 172.21.15.79:0/667009570 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9ec006a0e0 0x7f9ec006c5a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc001790 tx=0x7f9ecc009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:24.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.797+0000 7f9ed27fc700 1 -- 172.21.15.79:0/667009570 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f9ed8055740 con 0x7f9edc1481b0 2023-10-19T08:39:24.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:24.986+0000 7f9ee4122700 1 -- 172.21.15.79:0/667009570 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9edc15c520 con 0x7f9edc1481b0 2023-10-19T08:39:25.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.645+0000 7f9ed27fc700 1 -- 172.21.15.79:0/667009570 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f9ed80170d0 con 0x7f9edc1481b0 2023-10-19T08:39:25.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.649+0000 7f9ee4122700 1 -- 172.21.15.79:0/667009570 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9ec006a0e0 msgr2=0x7f9ec006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:25.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.649+0000 7f9ee4122700 1 --2- 172.21.15.79:0/667009570 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9ec006a0e0 0x7f9ec006c5a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc001790 tx=0x7f9ecc009040 comp rx=0 tx=0).stop 2023-10-19T08:39:25.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.649+0000 7f9ee4122700 1 -- 172.21.15.79:0/667009570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9edc1481b0 msgr2=0x7f9edc155a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:25.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.649+0000 7f9ee4122700 1 --2- 172.21.15.79:0/667009570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9edc1481b0 0x7f9edc155a80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80090b0 tx=0x7f9ed80047c0 comp rx=0 tx=0).stop 2023-10-19T08:39:25.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.650+0000 7f9ee4122700 1 -- 172.21.15.79:0/667009570 shutdown_connections 2023-10-19T08:39:25.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.650+0000 7f9ee4122700 1 --2- 172.21.15.79:0/667009570 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9ec006a0e0 0x7f9ec006c5a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:25.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.650+0000 7f9ee4122700 1 --2- 172.21.15.79:0/667009570 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9edc148630 0x7f9edc155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:25.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.650+0000 7f9ee4122700 1 --2- 172.21.15.79:0/667009570 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec8004850 0x7f9edc15be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:25.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.650+0000 7f9ee4122700 1 --2- 172.21.15.79:0/667009570 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9edc1481b0 0x7f9edc155a80 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:25.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.650+0000 7f9ee4122700 1 -- 172.21.15.79:0/667009570 >> 172.21.15.79:0/667009570 conn(0x7f9edc0cbd20 msgr2=0x7f9edc158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:25.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.650+0000 7f9ee4122700 1 -- 172.21.15.79:0/667009570 shutdown_connections 2023-10-19T08:39:25.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.650+0000 7f9ee4122700 1 -- 172.21.15.79:0/667009570 wait complete. 2023-10-19T08:39:25.657 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data_ec' removed 2023-10-19T08:39:25.668 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-19T08:39:25.668 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-19T08:39:25.669 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-19T08:39:25.669 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:39:25.669 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-19T08:39:25.669 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-19T08:39:25.670 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-19T08:39:25.670 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:39:25.670 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-19T08:39:25.671 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-19T08:39:25.671 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-19T08:39:25.671 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:39:25.672 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-19T08:39:25.672 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-19T08:39:25.672 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-19T08:39:25.672 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:39:25.678 INFO:tasks.ceph.mds.a:Stopped 2023-10-19T08:39:25.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-19T08:39:25.680 INFO:tasks.ceph.mds.c:Stopped 2023-10-19T08:39:25.680 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-19T08:39:25.684 INFO:tasks.ceph.mds.b:Stopped 2023-10-19T08:39:25.685 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-19T08:39:25.686 INFO:tasks.ceph.mds.d:Stopped 2023-10-19T08:39:25.686 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-19T08:39:25.720 INFO:tasks.ceph.mds.a:Started 2023-10-19T08:39:25.721 DEBUG:teuthology.parallel:result is None 2023-10-19T08:39:25.721 INFO:tasks.ceph.mds.c:Started 2023-10-19T08:39:25.722 DEBUG:teuthology.parallel:result is None 2023-10-19T08:39:25.727 INFO:tasks.ceph.mds.b:Started 2023-10-19T08:39:25.728 DEBUG:teuthology.parallel:result is None 2023-10-19T08:39:25.728 INFO:tasks.ceph.mds.d:Started 2023-10-19T08:39:25.729 DEBUG:teuthology.parallel:result is None 2023-10-19T08:39:25.729 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-19T08:39:25.798 INFO:tasks.ceph.mds.a.smithi079.stdout:starting mds.a at 2023-10-19T08:39:25.799 INFO:tasks.ceph.mds.c.smithi079.stdout:starting mds.c at 2023-10-19T08:39:25.816 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-10-19T08:39:25.816 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-10-19T08:39:25.860 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.856+0000 7faaa69cb700 1 Processor -- start 2023-10-19T08:39:25.861 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.856+0000 7faaa69cb700 1 -- start start 2023-10-19T08:39:25.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.857+0000 7faaa69cb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faaa00c5020 0x7faaa015da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:25.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.857+0000 7faaa69cb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa01598c0 0x7faaa0159d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:25.863 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.857+0000 7faaa69cb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa00adfb0 con 0x7faaa00709a0 2023-10-19T08:39:25.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.857+0000 7faaa69cb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa0153d80 con 0x7faaa00c5020 2023-10-19T08:39:25.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.857+0000 7faaa69cb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa015a460 con 0x7faaa01598c0 2023-10-19T08:39:25.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.857+0000 7faa9ffff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7faaa00c5020 0x7faaa015da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:25.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.857+0000 7faa9f7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa01598c0 0x7faaa0159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:25.864 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.857+0000 7faaa4f68700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7faaa00709a0 0x7faaa00cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:43650/0 (socket says 172.21.15.79:43650) 2023-10-19T08:39:25.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.857+0000 7faaa4f68700 1 -- 172.21.15.79:0/3162250431 learned_addr learned my addr 172.21.15.79:0/3162250431 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:25.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.858+0000 7faa9f7fe700 1 -- 172.21.15.79:0/3162250431 >> v2:172.21.15.89:3300/0 conn(0x7faaa00c5020 msgr2=0x7faaa015da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:25.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.858+0000 7faa9f7fe700 1 --2- 172.21.15.79:0/3162250431 >> v2:172.21.15.89:3300/0 conn(0x7faaa00c5020 0x7faaa015da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:25.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.858+0000 7faa9f7fe700 1 -- 172.21.15.79:0/3162250431 >> v1:172.21.15.89:6789/0 conn(0x7faaa00709a0 legacy=0x7faaa00cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:25.865 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.858+0000 7faa9effd700 1 -- 172.21.15.79:0/3162250431 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633795788 0 0) 0x7faaa00adfb0 con 0x7faaa00709a0 2023-10-19T08:39:25.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.858+0000 7faa9f7fe700 1 -- 172.21.15.79:0/3162250431 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa015a740 con 0x7faaa01598c0 2023-10-19T08:39:25.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.858+0000 7faa9ffff700 1 --2- 172.21.15.79:0/3162250431 >> v2:172.21.15.89:3300/0 conn(0x7faaa00c5020 0x7faaa015da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:39:25.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.858+0000 7faa9f7fe700 1 --2- 172.21.15.79:0/3162250431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa01598c0 0x7faaa0159d50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faa9000a9e0 tx=0x7faa9000acf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5cb741f293f7dde server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:25.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.858+0000 7faa9effd700 1 -- 172.21.15.79:0/3162250431 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9000cb70 con 0x7faaa01598c0 2023-10-19T08:39:25.866 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.858+0000 7faa9effd700 1 -- 172.21.15.79:0/3162250431 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9000ccd0 con 0x7faaa01598c0 2023-10-19T08:39:25.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.858+0000 7faa9effd700 1 -- 172.21.15.79:0/3162250431 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa90018620 con 0x7faaa01598c0 2023-10-19T08:39:25.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.859+0000 7faaa69cb700 1 -- 172.21.15.79:0/3162250431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa01598c0 msgr2=0x7faaa0159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:25.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.859+0000 7faaa69cb700 1 --2- 172.21.15.79:0/3162250431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa01598c0 0x7faaa0159d50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faa9000a9e0 tx=0x7faa9000acf0 comp rx=0 tx=0).stop 2023-10-19T08:39:25.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.859+0000 7faaa69cb700 1 -- 172.21.15.79:0/3162250431 shutdown_connections 2023-10-19T08:39:25.867 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.859+0000 7faaa69cb700 1 --2- 172.21.15.79:0/3162250431 >> v2:172.21.15.89:3300/0 conn(0x7faaa00c5020 0x7faaa015da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:25.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.859+0000 7faaa69cb700 1 --2- 172.21.15.79:0/3162250431 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa01598c0 0x7faaa0159d50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:25.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.859+0000 7faaa69cb700 1 -- 172.21.15.79:0/3162250431 >> 172.21.15.79:0/3162250431 conn(0x7faaa00ce960 msgr2=0x7faaa00ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:25.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.859+0000 7faaa69cb700 1 -- 172.21.15.79:0/3162250431 shutdown_connections 2023-10-19T08:39:25.868 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.859+0000 7faaa69cb700 1 -- 172.21.15.79:0/3162250431 wait complete. 2023-10-19T08:39:25.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.860+0000 7faaa69cb700 1 Processor -- start 2023-10-19T08:39:25.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.860+0000 7faaa69cb700 1 -- start start 2023-10-19T08:39:25.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.861+0000 7faaa69cb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa00709a0 0x7faaa01f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:25.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.861+0000 7faaa69cb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa00c5020 0x7faaa0151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:25.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.861+0000 7faaa69cb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaa01598c0 0x7faaa00aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:25.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.861+0000 7faaa69cb700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa0151d80 con 0x7faaa00c5020 2023-10-19T08:39:25.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.861+0000 7faaa69cb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa00af300 con 0x7faaa01598c0 2023-10-19T08:39:25.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.861+0000 7faaa69cb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa00af890 con 0x7faaa00709a0 2023-10-19T08:39:25.872 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.861+0000 7faa9f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa00c5020 0x7faaa0151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:25.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.861+0000 7faa9f7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa00c5020 0x7faaa0151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48740/0 (socket says 172.21.15.79:48740) 2023-10-19T08:39:25.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.861+0000 7faa9f7fe700 1 -- 172.21.15.79:0/2143709432 learned_addr learned my addr 172.21.15.79:0/2143709432 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:25.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.861+0000 7faa9ffff700 1 --2- 172.21.15.79:0/2143709432 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa00709a0 0x7faaa01f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:25.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.861+0000 7faaa4f68700 1 --2- 172.21.15.79:0/2143709432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaa01598c0 0x7faaa00aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:25.873 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.861+0000 7faa9f7fe700 1 -- 172.21.15.79:0/2143709432 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa00709a0 msgr2=0x7faaa01f4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:25.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.861+0000 7faa9f7fe700 1 --2- 172.21.15.79:0/2143709432 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa00709a0 0x7faaa01f4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:25.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.861+0000 7faa9f7fe700 1 -- 172.21.15.79:0/2143709432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaa01598c0 msgr2=0x7faaa00aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:25.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.861+0000 7faa9f7fe700 1 --2- 172.21.15.79:0/2143709432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaa01598c0 0x7faaa00aedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:25.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.861+0000 7faa9f7fe700 1 -- 172.21.15.79:0/2143709432 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa940094a0 con 0x7faaa00c5020 2023-10-19T08:39:25.874 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.861+0000 7faa9f7fe700 1 --2- 172.21.15.79:0/2143709432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa00c5020 0x7faaa0151840 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7faa9000a1c0 tx=0x7faa90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:25.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.862+0000 7faa9cff9700 1 -- 172.21.15.79:0/2143709432 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9001c040 con 0x7faaa00c5020 2023-10-19T08:39:25.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.862+0000 7faa9cff9700 1 -- 172.21.15.79:0/2143709432 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa90018610 con 0x7faaa00c5020 2023-10-19T08:39:25.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.862+0000 7faaa69cb700 1 -- 172.21.15.79:0/2143709432 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa9000a640 con 0x7faaa00c5020 2023-10-19T08:39:25.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.862+0000 7faa9cff9700 1 -- 172.21.15.79:0/2143709432 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa90018c50 con 0x7faaa00c5020 2023-10-19T08:39:25.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.862+0000 7faaa69cb700 1 -- 172.21.15.79:0/2143709432 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa01f1730 con 0x7faaa00c5020 2023-10-19T08:39:25.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.863+0000 7faaa69cb700 1 -- 172.21.15.79:0/2143709432 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa004ee70 con 0x7faaa00c5020 2023-10-19T08:39:25.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.863+0000 7faa9cff9700 1 -- 172.21.15.79:0/2143709432 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faa900036a0 con 0x7faaa00c5020 2023-10-19T08:39:25.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.863+0000 7faa9cff9700 1 --2- 172.21.15.79:0/2143709432 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faa8c06a0e0 0x7faa8c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:25.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.863+0000 7faa9cff9700 1 -- 172.21.15.79:0/2143709432 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5616+0+0 (secure 0 0 0) 0x7faa90089760 con 0x7faaa00c5020 2023-10-19T08:39:25.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.863+0000 7faa9ffff700 1 --2- 172.21.15.79:0/2143709432 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faa8c06a0e0 0x7faa8c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:25.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.864+0000 7faa9ffff700 1 --2- 172.21.15.79:0/2143709432 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faa8c06a0e0 0x7faa8c06c5a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7faa94009d70 tx=0x7faa94009210 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:25.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:25.868+0000 7faa9cff9700 1 -- 172.21.15.79:0/2143709432 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7faa90055150 con 0x7faaa00c5020 2023-10-19T08:39:26.076 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.072+0000 7faaa69cb700 1 -- 172.21.15.79:0/2143709432 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7faaa0071a70 con 0x7faaa00c5020 2023-10-19T08:39:26.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.659+0000 7faa9cff9700 1 -- 172.21.15.79:0/2143709432 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7faa90058770 con 0x7faaa00c5020 2023-10-19T08:39:26.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.662+0000 7faaa69cb700 1 -- 172.21.15.79:0/2143709432 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faa8c06a0e0 msgr2=0x7faa8c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:26.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.662+0000 7faaa69cb700 1 --2- 172.21.15.79:0/2143709432 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faa8c06a0e0 0x7faa8c06c5a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7faa94009d70 tx=0x7faa94009210 comp rx=0 tx=0).stop 2023-10-19T08:39:26.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.662+0000 7faaa69cb700 1 -- 172.21.15.79:0/2143709432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa00c5020 msgr2=0x7faaa0151840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:26.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.662+0000 7faaa69cb700 1 --2- 172.21.15.79:0/2143709432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa00c5020 0x7faaa0151840 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7faa9000a1c0 tx=0x7faa90004750 comp rx=0 tx=0).stop 2023-10-19T08:39:26.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.663+0000 7faaa69cb700 1 -- 172.21.15.79:0/2143709432 shutdown_connections 2023-10-19T08:39:26.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.663+0000 7faaa69cb700 1 --2- 172.21.15.79:0/2143709432 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faaa01598c0 0x7faaa00aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:26.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.663+0000 7faaa69cb700 1 --2- 172.21.15.79:0/2143709432 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faa8c06a0e0 0x7faa8c06c5a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:26.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.663+0000 7faaa69cb700 1 --2- 172.21.15.79:0/2143709432 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faaa00709a0 0x7faaa01f4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:26.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.663+0000 7faaa69cb700 1 --2- 172.21.15.79:0/2143709432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faaa00c5020 0x7faaa0151840 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:26.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.663+0000 7faaa69cb700 1 -- 172.21.15.79:0/2143709432 >> 172.21.15.79:0/2143709432 conn(0x7faaa00ce960 msgr2=0x7faaa00ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:26.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.663+0000 7faaa69cb700 1 -- 172.21.15.79:0/2143709432 shutdown_connections 2023-10-19T08:39:26.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.663+0000 7faaa69cb700 1 -- 172.21.15.79:0/2143709432 wait complete. 2023-10-19T08:39:26.669 INFO:teuthology.orchestra.run.smithi079.stderr: removed all blocklist entries 2023-10-19T08:39:26.683 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-19T08:39:26.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.801+0000 7f1d110f8700 1 Processor -- start 2023-10-19T08:39:26.806 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.801+0000 7f1d110f8700 1 -- start start 2023-10-19T08:39:26.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.802+0000 7f1d110f8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d0c0af170 0x7f1d0c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:26.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.802+0000 7f1d110f8700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1d0c0b2240 0x7f1d0c06a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:26.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.802+0000 7f1d110f8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d0c15de50 con 0x7f1d0c0b1de0 2023-10-19T08:39:26.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.802+0000 7f1d110f8700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d0c0af550 con 0x7f1d0c0b2240 2023-10-19T08:39:26.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.802+0000 7f1d110f8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c0b26d0 con 0x7f1d0c0af170 2023-10-19T08:39:26.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.802+0000 7f1d0b59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1d0c0b2240 0x7f1d0c06a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:26.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.802+0000 7f1d0b59e700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1d0c0b2240 0x7f1d0c06a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48752/0 (socket says 172.21.15.79:48752) 2023-10-19T08:39:26.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.802+0000 7f1d0b59e700 1 -- 172.21.15.79:0/761821231 learned_addr learned my addr 172.21.15.79:0/761821231 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:26.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.803+0000 7f1d0b59e700 1 -- 172.21.15.79:0/761821231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d0c0af170 msgr2=0x7f1d0c0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:26.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.803+0000 7f1d0ad9d700 1 --2- 172.21.15.79:0/761821231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d0c0af170 0x7f1d0c0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:26.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.803+0000 7f1d0b59e700 1 --2- 172.21.15.79:0/761821231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d0c0af170 0x7f1d0c0cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:26.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.803+0000 7f1d0b59e700 1 -- 172.21.15.79:0/761821231 >> v1:172.21.15.89:6789/0 conn(0x7f1d0c0b1de0 legacy=0x7f1d0c0cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:26.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.803+0000 7f1d0b59e700 1 -- 172.21.15.79:0/761821231 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0c15e130 con 0x7f1d0c0b2240 2023-10-19T08:39:26.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.803+0000 7f1d0ad9d700 1 --2- 172.21.15.79:0/761821231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d0c0af170 0x7f1d0c0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:26.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.803+0000 7f1d0b59e700 1 --2- 172.21.15.79:0/761821231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d0c0b2240 0x7f1d0c06a220 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1d04009e50 tx=0x7f1d0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3a113dbd9c179b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:26.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.803+0000 7f1d09d9b700 1 -- 172.21.15.79:0/761821231 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0400e070 con 0x7f1d0c0b2240 2023-10-19T08:39:26.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.803+0000 7f1d09d9b700 1 -- 172.21.15.79:0/761821231 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d04003a20 con 0x7f1d0c0b2240 2023-10-19T08:39:26.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.803+0000 7f1d09d9b700 1 -- 172.21.15.79:0/761821231 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04003dd0 con 0x7f1d0c0b2240 2023-10-19T08:39:26.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.803+0000 7f1d110f8700 1 -- 172.21.15.79:0/761821231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d0c0b2240 msgr2=0x7f1d0c06a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:26.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.803+0000 7f1d110f8700 1 --2- 172.21.15.79:0/761821231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d0c0b2240 0x7f1d0c06a220 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1d04009e50 tx=0x7f1d0400b330 comp rx=0 tx=0).stop 2023-10-19T08:39:26.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.803+0000 7f1d110f8700 1 -- 172.21.15.79:0/761821231 shutdown_connections 2023-10-19T08:39:26.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.803+0000 7f1d110f8700 1 --2- 172.21.15.79:0/761821231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d0c0b2240 0x7f1d0c06a220 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:26.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.803+0000 7f1d110f8700 1 --2- 172.21.15.79:0/761821231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d0c0af170 0x7f1d0c0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:26.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.803+0000 7f1d110f8700 1 -- 172.21.15.79:0/761821231 >> 172.21.15.79:0/761821231 conn(0x7f1d0c06dcc0 msgr2=0x7f1d0c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:26.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.804+0000 7f1d110f8700 1 -- 172.21.15.79:0/761821231 shutdown_connections 2023-10-19T08:39:26.813 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.804+0000 7f1d110f8700 1 -- 172.21.15.79:0/761821231 wait complete. 2023-10-19T08:39:26.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.805+0000 7f1d110f8700 1 Processor -- start 2023-10-19T08:39:26.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.805+0000 7f1d110f8700 1 -- start start 2023-10-19T08:39:26.816 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1d110f8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d0c0af170 0x7f1d0c0ac7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:26.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1d110f8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d0c0b1de0 0x7f1d0c1572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:26.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1d110f8700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d0c0b2240 0x7f1d0c15f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:26.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1d110f8700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c0ace90 con 0x7f1d0c0b2240 2023-10-19T08:39:26.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1d110f8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c0ad170 con 0x7f1d0c0b1de0 2023-10-19T08:39:26.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1d110f8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c0ad450 con 0x7f1d0c0af170 2023-10-19T08:39:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1d0b59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d0c0b2240 0x7f1d0c15f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1d0b59e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d0c0b2240 0x7f1d0c15f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48758/0 (socket says 172.21.15.79:48758) 2023-10-19T08:39:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1d0b59e700 1 -- 172.21.15.79:0/3825459508 learned_addr learned my addr 172.21.15.79:0/3825459508 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1d0a59c700 1 --2- 172.21.15.79:0/3825459508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d0c0b1de0 0x7f1d0c1572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1d0ad9d700 1 --2- 172.21.15.79:0/3825459508 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d0c0af170 0x7f1d0c0ac7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:26.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1d0b59e700 1 -- 172.21.15.79:0/3825459508 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d0c0af170 msgr2=0x7f1d0c0ac7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:26.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1d0b59e700 1 --2- 172.21.15.79:0/3825459508 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d0c0af170 0x7f1d0c0ac7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:26.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1d0b59e700 1 -- 172.21.15.79:0/3825459508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d0c0b1de0 msgr2=0x7f1d0c1572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:26.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1d0b59e700 1 --2- 172.21.15.79:0/3825459508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d0c0b1de0 0x7f1d0c1572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:26.819 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1d0b59e700 1 -- 172.21.15.79:0/3825459508 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d04009b30 con 0x7f1d0c0b2240 2023-10-19T08:39:26.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1d0a59c700 1 --2- 172.21.15.79:0/3825459508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d0c0b1de0 0x7f1d0c1572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:26.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1d0b59e700 1 --2- 172.21.15.79:0/3825459508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d0c0b2240 0x7f1d0c15f820 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c067670 tx=0x7f1d04004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:26.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1cf37fe700 1 -- 172.21.15.79:0/3825459508 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04004440 con 0x7f1d0c0b2240 2023-10-19T08:39:26.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1cf37fe700 1 -- 172.21.15.79:0/3825459508 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d040045a0 con 0x7f1d0c0b2240 2023-10-19T08:39:26.820 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1d110f8700 1 -- 172.21.15.79:0/3825459508 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0c0ad730 con 0x7f1d0c0b2240 2023-10-19T08:39:26.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.806+0000 7f1cf37fe700 1 -- 172.21.15.79:0/3825459508 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04004950 con 0x7f1d0c0b2240 2023-10-19T08:39:26.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.807+0000 7f1d110f8700 1 -- 172.21.15.79:0/3825459508 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0c0ae660 con 0x7f1d0c0b2240 2023-10-19T08:39:26.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.807+0000 7f1d110f8700 1 -- 172.21.15.79:0/3825459508 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0c0b2dd0 con 0x7f1d0c0b2240 2023-10-19T08:39:26.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.808+0000 7f1cf37fe700 1 -- 172.21.15.79:0/3825459508 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1d04012430 con 0x7f1d0c0b2240 2023-10-19T08:39:26.821 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.808+0000 7f1cf37fe700 1 --2- 172.21.15.79:0/3825459508 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1cf806a0e0 0x7f1cf806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:26.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.809+0000 7f1d0ad9d700 1 --2- 172.21.15.79:0/3825459508 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1cf806a0e0 0x7f1cf806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:26.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.809+0000 7f1cf37fe700 1 -- 172.21.15.79:0/3825459508 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1d040898d0 con 0x7f1d0c0b2240 2023-10-19T08:39:26.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.809+0000 7f1d0ad9d700 1 --2- 172.21.15.79:0/3825459508 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1cf806a0e0 0x7f1cf806c5a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1d00006fd0 tx=0x7f1d00008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:26.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:26.813+0000 7f1cf37fe700 1 -- 172.21.15.79:0/3825459508 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f1d040551e0 con 0x7f1d0c0b2240 2023-10-19T08:39:27.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.076+0000 7f1d110f8700 1 -- 172.21.15.79:0/3825459508 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f1d0c04ee70 con 0x7f1d0c0b2240 2023-10-19T08:39:27.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.077+0000 7f1cf37fe700 1 -- 172.21.15.79:0/3825459508 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f1d04058800 con 0x7f1d0c0b2240 2023-10-19T08:39:27.082 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:27.082 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-19T08:39:27.082 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_dump": [ 2023-10-19T08:39:27.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.083 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.a", 2023-10-19T08:39:27.083 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCv6jBlnJvyIBAA5CCYUY/m7XTuBBbaH2faUQ==", 2023-10-19T08:39:27.083 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.083 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-19T08:39:27.083 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-19T08:39:27.084 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-19T08:39:27.084 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-19T08:39:27.084 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.085 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.b", 2023-10-19T08:39:27.085 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCv6jBlSGcxLRAArR4Yisfda8hNdE24VX+Iew==", 2023-10-19T08:39:27.085 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.085 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-19T08:39:27.085 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-19T08:39:27.085 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-19T08:39:27.086 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-19T08:39:27.086 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.086 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.c", 2023-10-19T08:39:27.087 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCv6jBlE+UmKBAAQcGew88xsfCbIeH6sKoKHg==", 2023-10-19T08:39:27.087 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.087 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-19T08:39:27.087 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-19T08:39:27.087 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-19T08:39:27.088 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-19T08:39:27.088 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.088 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mds.d", 2023-10-19T08:39:27.089 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCv6jBlfqWMNBAA+yfxFN/u0YqO3C8vNdaUQg==", 2023-10-19T08:39:27.089 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.089 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-19T08:39:27.089 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-19T08:39:27.089 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-19T08:39:27.089 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-19T08:39:27.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.090 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.0", 2023-10-19T08:39:27.090 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCz6jBlKpxjFRAA7bc2CQz4Nug/Fkzdoc7sHQ==", 2023-10-19T08:39:27.091 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.091 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-19T08:39:27.091 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-19T08:39:27.091 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-19T08:39:27.091 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.092 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.1", 2023-10-19T08:39:27.092 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQC26jBlCEmDFBAAKcEobHtHlfHwF2oJdyXONw==", 2023-10-19T08:39:27.092 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.093 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-19T08:39:27.093 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-19T08:39:27.093 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-19T08:39:27.093 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.094 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.2", 2023-10-19T08:39:27.094 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQC56jBl/ltwFBAAHdF1nNg0I5VDBPcVMzUl1g==", 2023-10-19T08:39:27.094 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.094 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-19T08:39:27.094 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-19T08:39:27.095 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-19T08:39:27.095 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.095 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.3", 2023-10-19T08:39:27.096 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQC86jBleC/cExAALSOi1fgmoBwhkgg+mY38ug==", 2023-10-19T08:39:27.096 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.096 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-19T08:39:27.096 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-19T08:39:27.096 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-19T08:39:27.097 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.097 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.4", 2023-10-19T08:39:27.097 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDC6jBll/jlIhAAn331gpqzITvkjY/ODrPORw==", 2023-10-19T08:39:27.097 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.098 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-19T08:39:27.098 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-19T08:39:27.098 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-19T08:39:27.098 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.099 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.5", 2023-10-19T08:39:27.099 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDF6jBl0MHDIhAALJq+E3GIdtx9z0pUISKVGQ==", 2023-10-19T08:39:27.099 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.099 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-19T08:39:27.100 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-19T08:39:27.100 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-19T08:39:27.100 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.101 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.6", 2023-10-19T08:39:27.101 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDI6jBlfxawIRAAfbj0ibYV6zAX5ItB2t4zKQ==", 2023-10-19T08:39:27.101 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.101 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-19T08:39:27.101 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-19T08:39:27.101 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-19T08:39:27.102 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.102 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "osd.7", 2023-10-19T08:39:27.102 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDL6jBldjkUIRAAWESg3WqLjepitJakeSSawA==", 2023-10-19T08:39:27.103 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.103 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow profile osd", 2023-10-19T08:39:27.103 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile osd", 2023-10-19T08:39:27.103 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-19T08:39:27.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.104 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.0", 2023-10-19T08:39:27.104 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCv6jBlFLbeOBAAsiQ+nNFDq+Mc3VC54pqOmw==", 2023-10-19T08:39:27.104 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.105 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-19T08:39:27.105 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-19T08:39:27.105 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-19T08:39:27.105 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-19T08:39:27.105 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.106 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.1", 2023-10-19T08:39:27.106 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCw6jBljjRbBhAANTvUjVBQixD9X3Qc3kbVgw==", 2023-10-19T08:39:27.106 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.106 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-19T08:39:27.107 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-19T08:39:27.107 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-19T08:39:27.107 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-19T08:39:27.107 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.108 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.2", 2023-10-19T08:39:27.108 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCw6jBln8MDAxAAAPzm3ecYTPTNPG9eq1dj/g==", 2023-10-19T08:39:27.108 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.108 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-19T08:39:27.108 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-19T08:39:27.109 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-19T08:39:27.109 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-19T08:39:27.109 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.110 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.3", 2023-10-19T08:39:27.110 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCw6jBlJy8eDBAAxtalioH9VY4HglfA57v1rA==", 2023-10-19T08:39:27.110 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.110 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow", 2023-10-19T08:39:27.110 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow r", 2023-10-19T08:39:27.111 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow rw", 2023-10-19T08:39:27.111 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow rwx" 2023-10-19T08:39:27.111 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.112 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.admin", 2023-10-19T08:39:27.112 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCv6jBln56EAxAA9p/byXabz7qUCHMwWgLUvA==", 2023-10-19T08:39:27.112 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.112 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-19T08:39:27.112 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": "allow *", 2023-10-19T08:39:27.112 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow *", 2023-10-19T08:39:27.113 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-19T08:39:27.113 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.113 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-mds", 2023-10-19T08:39:27.114 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDR6jBlpIM1HxAA9PA+MXdhxXhMQQMxuNAccg==", 2023-10-19T08:39:27.114 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.114 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-mds" 2023-10-19T08:39:27.114 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.115 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-mgr", 2023-10-19T08:39:27.115 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDR6jBlD441HxAAWfMQ5ee3CC++wGqK92j47g==", 2023-10-19T08:39:27.115 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.115 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-19T08:39:27.116 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.116 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-osd", 2023-10-19T08:39:27.116 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDR6jBl1Zc1HxAAUKMwcvBGJbJ9x8ZmtpTkbg==", 2023-10-19T08:39:27.117 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.117 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-osd" 2023-10-19T08:39:27.117 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.117 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-rbd", 2023-10-19T08:39:27.118 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDR6jBlCaM1HxAACUX8Tln4bfE3h6kNr9pNrw==", 2023-10-19T08:39:27.118 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.118 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-19T08:39:27.118 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.119 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-19T08:39:27.119 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDR6jBlTgs2HxAAqNNccxb6BBHsdxooryEjeA==", 2023-10-19T08:39:27.119 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.119 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-19T08:39:27.119 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.120 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "client.bootstrap-rgw", 2023-10-19T08:39:27.120 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQDR6jBlpBc2HxAAciw+4MSYVt5x8W5+mZS1sg==", 2023-10-19T08:39:27.120 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.121 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-19T08:39:27.121 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.121 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.x", 2023-10-19T08:39:27.122 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCv6jBlZFuYHRAAVAyQYSMzID3fBQDreAsrEQ==", 2023-10-19T08:39:27.122 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.122 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-19T08:39:27.125 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-19T08:39:27.125 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-19T08:39:27.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:27.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:27.126 INFO:teuthology.orchestra.run.smithi079.stdout: "entity": "mgr.y", 2023-10-19T08:39:27.126 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "AQCv6jBll1dKGRAAcKZS0nDWub5kgQZ4ShNAwA==", 2023-10-19T08:39:27.126 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": { 2023-10-19T08:39:27.126 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": "allow *", 2023-10-19T08:39:27.126 INFO:teuthology.orchestra.run.smithi079.stdout: "mon": "allow profile mgr", 2023-10-19T08:39:27.127 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": "allow *" 2023-10-19T08:39:27.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:27.127 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2023-10-19T08:39:27.127 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-19T08:39:27.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.079+0000 7f1d110f8700 1 -- 172.21.15.79:0/3825459508 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1cf806a0e0 msgr2=0x7f1cf806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:27.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.079+0000 7f1d110f8700 1 --2- 172.21.15.79:0/3825459508 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1cf806a0e0 0x7f1cf806c5a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1d00006fd0 tx=0x7f1d00008040 comp rx=0 tx=0).stop 2023-10-19T08:39:27.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.079+0000 7f1d110f8700 1 -- 172.21.15.79:0/3825459508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d0c0b2240 msgr2=0x7f1d0c15f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:27.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.079+0000 7f1d110f8700 1 --2- 172.21.15.79:0/3825459508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d0c0b2240 0x7f1d0c15f820 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c067670 tx=0x7f1d04004ad0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.079+0000 7f1d110f8700 1 -- 172.21.15.79:0/3825459508 shutdown_connections 2023-10-19T08:39:27.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.079+0000 7f1d110f8700 1 --2- 172.21.15.79:0/3825459508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d0c0b2240 0x7f1d0c15f820 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.079+0000 7f1d110f8700 1 --2- 172.21.15.79:0/3825459508 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1cf806a0e0 0x7f1cf806c5a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.079+0000 7f1d110f8700 1 --2- 172.21.15.79:0/3825459508 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1d0c0af170 0x7f1d0c0ac7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.079+0000 7f1d110f8700 1 --2- 172.21.15.79:0/3825459508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d0c0b1de0 0x7f1d0c1572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.079+0000 7f1d110f8700 1 -- 172.21.15.79:0/3825459508 >> 172.21.15.79:0/3825459508 conn(0x7f1d0c06dcc0 msgr2=0x7f1d0c0cc820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:27.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.079+0000 7f1d110f8700 1 -- 172.21.15.79:0/3825459508 shutdown_connections 2023-10-19T08:39:27.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.079+0000 7f1d110f8700 1 -- 172.21.15.79:0/3825459508 wait complete. 2023-10-19T08:39:27.132 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-19T08:39:27.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.249+0000 7fbe58a25700 1 Processor -- start 2023-10-19T08:39:27.254 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.249+0000 7fbe58a25700 1 -- start start 2023-10-19T08:39:27.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.250+0000 7fbe58a25700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbe5415d580 0x7fbe540b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:27.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.250+0000 7fbe58a25700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe54161490 con 0x7fbe54160f30 2023-10-19T08:39:27.256 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.250+0000 7fbe58a25700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe54161770 con 0x7fbe540ce270 2023-10-19T08:39:27.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.250+0000 7fbe58a25700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe54161a50 con 0x7fbe5415d580 2023-10-19T08:39:27.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.250+0000 7fbe51d9b700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbe5415d580 0x7fbe540b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:27.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.250+0000 7fbe52d9d700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbe54160f30 0x7fbe5406a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58838/0 (socket says 172.21.15.79:58838) 2023-10-19T08:39:27.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.250+0000 7fbe52d9d700 1 -- 172.21.15.79:0/828436768 learned_addr learned my addr 172.21.15.79:0/828436768 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:27.257 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.251+0000 7fbe51d9b700 1 -- 172.21.15.79:0/828436768 >> v1:172.21.15.89:6789/0 conn(0x7fbe540ce270 legacy=0x7fbe5415ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:27.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.251+0000 7fbe51d9b700 1 -- 172.21.15.79:0/828436768 >> v1:172.21.15.79:6789/0 conn(0x7fbe54160f30 legacy=0x7fbe5406a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:27.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.251+0000 7fbe51d9b700 1 -- 172.21.15.79:0/828436768 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe54161d30 con 0x7fbe5415d580 2023-10-19T08:39:27.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.251+0000 7fbe5159a700 1 -- 172.21.15.79:0/828436768 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976382629 0 0) 0x7fbe54161490 con 0x7fbe54160f30 2023-10-19T08:39:27.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.251+0000 7fbe51d9b700 1 --2- 172.21.15.79:0/828436768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe5415d580 0x7fbe540b1f70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbe44009840 tx=0x7fbe44009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5fc457ff2cc6f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:27.258 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.251+0000 7fbe5159a700 1 -- 172.21.15.79:0/828436768 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44011830 con 0x7fbe5415d580 2023-10-19T08:39:27.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.251+0000 7fbe5159a700 1 -- 172.21.15.79:0/828436768 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe44011990 con 0x7fbe5415d580 2023-10-19T08:39:27.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.251+0000 7fbe5159a700 1 -- 172.21.15.79:0/828436768 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44011d20 con 0x7fbe5415d580 2023-10-19T08:39:27.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.252+0000 7fbe58a25700 1 -- 172.21.15.79:0/828436768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe5415d580 msgr2=0x7fbe540b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:27.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.252+0000 7fbe58a25700 1 --2- 172.21.15.79:0/828436768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe5415d580 0x7fbe540b1f70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbe44009840 tx=0x7fbe44009b50 comp rx=0 tx=0).stop 2023-10-19T08:39:27.259 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.252+0000 7fbe58a25700 1 -- 172.21.15.79:0/828436768 shutdown_connections 2023-10-19T08:39:27.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.252+0000 7fbe58a25700 1 --2- 172.21.15.79:0/828436768 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe5415d580 0x7fbe540b1f70 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.252+0000 7fbe58a25700 1 -- 172.21.15.79:0/828436768 >> 172.21.15.79:0/828436768 conn(0x7fbe540cc560 msgr2=0x7fbe540cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:27.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.252+0000 7fbe58a25700 1 -- 172.21.15.79:0/828436768 shutdown_connections 2023-10-19T08:39:27.260 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.252+0000 7fbe58a25700 1 -- 172.21.15.79:0/828436768 wait complete. 2023-10-19T08:39:27.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.253+0000 7fbe58a25700 1 Processor -- start 2023-10-19T08:39:27.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.253+0000 7fbe58a25700 1 -- start start 2023-10-19T08:39:27.263 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe58a25700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe540ce270 0x7fbe54154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe58a25700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe5415d580 0x7fbe540cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe58a25700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe54160f30 0x7fbe540b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe58a25700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe540c6ea0 con 0x7fbe54160f30 2023-10-19T08:39:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe58a25700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe540c7180 con 0x7fbe5415d580 2023-10-19T08:39:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe58a25700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe540c7460 con 0x7fbe540ce270 2023-10-19T08:39:27.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe52d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe54160f30 0x7fbe540b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:27.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe52d9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe54160f30 0x7fbe540b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48772/0 (socket says 172.21.15.79:48772) 2023-10-19T08:39:27.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe52d9d700 1 -- 172.21.15.79:0/1007642414 learned_addr learned my addr 172.21.15.79:0/1007642414 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:27.265 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe51d9b700 1 --2- 172.21.15.79:0/1007642414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe5415d580 0x7fbe540cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:27.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe5259c700 1 --2- 172.21.15.79:0/1007642414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe540ce270 0x7fbe54154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:27.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe52d9d700 1 -- 172.21.15.79:0/1007642414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe540ce270 msgr2=0x7fbe54154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:27.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe52d9d700 1 --2- 172.21.15.79:0/1007642414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe540ce270 0x7fbe54154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe52d9d700 1 -- 172.21.15.79:0/1007642414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe5415d580 msgr2=0x7fbe540cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:27.266 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe52d9d700 1 --2- 172.21.15.79:0/1007642414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe5415d580 0x7fbe540cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe52d9d700 1 -- 172.21.15.79:0/1007642414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe440094a0 con 0x7fbe54160f30 2023-10-19T08:39:27.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe52d9d700 1 --2- 172.21.15.79:0/1007642414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe54160f30 0x7fbe540b06f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00cba0 tx=0x7fbe4c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:27.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe42ffd700 1 -- 172.21.15.79:0/1007642414 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c00ab80 con 0x7fbe54160f30 2023-10-19T08:39:27.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe42ffd700 1 -- 172.21.15.79:0/1007642414 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4c00ad00 con 0x7fbe54160f30 2023-10-19T08:39:27.267 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe42ffd700 1 -- 172.21.15.79:0/1007642414 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c007310 con 0x7fbe54160f30 2023-10-19T08:39:27.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.254+0000 7fbe58a25700 1 -- 172.21.15.79:0/1007642414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe540c7740 con 0x7fbe54160f30 2023-10-19T08:39:27.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.255+0000 7fbe58a25700 1 -- 172.21.15.79:0/1007642414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe54155350 con 0x7fbe54160f30 2023-10-19T08:39:27.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.255+0000 7fbe58a25700 1 -- 172.21.15.79:0/1007642414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe540c7c60 con 0x7fbe54160f30 2023-10-19T08:39:27.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.256+0000 7fbe42ffd700 1 -- 172.21.15.79:0/1007642414 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbe4c007470 con 0x7fbe54160f30 2023-10-19T08:39:27.268 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.256+0000 7fbe42ffd700 1 --2- 172.21.15.79:0/1007642414 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbe3406a0e0 0x7fbe3406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:27.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.256+0000 7fbe42ffd700 1 -- 172.21.15.79:0/1007642414 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fbe4c087d50 con 0x7fbe54160f30 2023-10-19T08:39:27.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.256+0000 7fbe5259c700 1 --2- 172.21.15.79:0/1007642414 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbe3406a0e0 0x7fbe3406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:27.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.257+0000 7fbe5259c700 1 --2- 172.21.15.79:0/1007642414 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbe3406a0e0 0x7fbe3406c5a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbe48000f60 tx=0x7fbe48009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:27.269 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.261+0000 7fbe42ffd700 1 -- 172.21.15.79:0/1007642414 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fbe540c7c60 con 0x7fbe54160f30 2023-10-19T08:39:27.532 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.528+0000 7fbe58a25700 1 -- 172.21.15.79:0/1007642414 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fbe540c7c60 con 0x7fbe54160f30 2023-10-19T08:39:27.535 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.531+0000 7fbe42ffd700 1 -- 172.21.15.79:0/1007642414 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbe540c7c60 con 0x7fbe54160f30 2023-10-19T08:39:27.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.533+0000 7fbe58a25700 1 -- 172.21.15.79:0/1007642414 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbe3406a0e0 msgr2=0x7fbe3406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:27.538 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.533+0000 7fbe58a25700 1 --2- 172.21.15.79:0/1007642414 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbe3406a0e0 0x7fbe3406c5a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbe48000f60 tx=0x7fbe48009040 comp rx=0 tx=0).stop 2023-10-19T08:39:27.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.533+0000 7fbe58a25700 1 -- 172.21.15.79:0/1007642414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe54160f30 msgr2=0x7fbe540b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:27.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.533+0000 7fbe58a25700 1 --2- 172.21.15.79:0/1007642414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe54160f30 0x7fbe540b06f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00cba0 tx=0x7fbe4c00cf60 comp rx=0 tx=0).stop 2023-10-19T08:39:27.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.533+0000 7fbe58a25700 1 -- 172.21.15.79:0/1007642414 shutdown_connections 2023-10-19T08:39:27.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.533+0000 7fbe58a25700 1 --2- 172.21.15.79:0/1007642414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe54160f30 0x7fbe540b06f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.539 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.533+0000 7fbe58a25700 1 --2- 172.21.15.79:0/1007642414 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbe3406a0e0 0x7fbe3406c5a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.533+0000 7fbe58a25700 1 --2- 172.21.15.79:0/1007642414 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbe540ce270 0x7fbe54154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.533+0000 7fbe58a25700 1 --2- 172.21.15.79:0/1007642414 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbe5415d580 0x7fbe540cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.533+0000 7fbe58a25700 1 -- 172.21.15.79:0/1007642414 >> 172.21.15.79:0/1007642414 conn(0x7fbe540cc560 msgr2=0x7fbe5415ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.534+0000 7fbe58a25700 1 -- 172.21.15.79:0/1007642414 shutdown_connections 2023-10-19T08:39:27.540 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.534+0000 7fbe58a25700 1 -- 172.21.15.79:0/1007642414 wait complete. 2023-10-19T08:39:27.550 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-19T08:39:27.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.668+0000 7f3c0c423700 1 Processor -- start 2023-10-19T08:39:27.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.668+0000 7f3c0c423700 1 -- start start 2023-10-19T08:39:27.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.669+0000 7f3c0c423700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3c040af170 0x7f3c040cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:27.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.669+0000 7f3c0c423700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3c040b2270 0x7f3c0406a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:27.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.669+0000 7f3c0c423700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c0415de50 con 0x7f3c040b1de0 2023-10-19T08:39:27.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.669+0000 7f3c0c423700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c040af550 con 0x7f3c040b2270 2023-10-19T08:39:27.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.669+0000 7f3c0c423700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c040b26c0 con 0x7f3c040af170 2023-10-19T08:39:27.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.669+0000 7f3c0a9c0700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3c040b2270 0x7f3c0406a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:27.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.669+0000 7f3c099be700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f3c040b1de0 0x7f3c040cd800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58852/0 (socket says 172.21.15.79:58852) 2023-10-19T08:39:27.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.669+0000 7f3c099be700 1 -- 172.21.15.79:0/813459173 learned_addr learned my addr 172.21.15.79:0/813459173 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:27.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.669+0000 7f3c0a9c0700 1 -- 172.21.15.79:0/813459173 >> v2:172.21.15.89:3300/0 conn(0x7f3c040af170 msgr2=0x7f3c040cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:27.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.669+0000 7f3c0a9c0700 1 --2- 172.21.15.79:0/813459173 >> v2:172.21.15.89:3300/0 conn(0x7f3c040af170 0x7f3c040cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.669+0000 7f3c0a9c0700 1 -- 172.21.15.79:0/813459173 >> v1:172.21.15.79:6789/0 conn(0x7f3c040b1de0 legacy=0x7f3c040cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:27.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.669+0000 7f3c0a9c0700 1 -- 172.21.15.79:0/813459173 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0415e130 con 0x7f3c040b2270 2023-10-19T08:39:27.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.669+0000 7f3c0a9c0700 1 --2- 172.21.15.79:0/813459173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c040b2270 0x7f3c0406a220 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc009d90 tx=0x7f3bfc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43907c087772952 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:27.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.670+0000 7f3c091bd700 1 -- 172.21.15.79:0/813459173 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc00e070 con 0x7f3c040b2270 2023-10-19T08:39:27.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.670+0000 7f3c091bd700 1 -- 172.21.15.79:0/813459173 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bfc00bb90 con 0x7f3c040b2270 2023-10-19T08:39:27.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.670+0000 7f3c091bd700 1 -- 172.21.15.79:0/813459173 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc012430 con 0x7f3c040b2270 2023-10-19T08:39:27.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.670+0000 7f3c0c423700 1 -- 172.21.15.79:0/813459173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c040b2270 msgr2=0x7f3c0406a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:27.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.670+0000 7f3c0c423700 1 --2- 172.21.15.79:0/813459173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c040b2270 0x7f3c0406a220 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc009d90 tx=0x7f3bfc00b330 comp rx=0 tx=0).stop 2023-10-19T08:39:27.679 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.670+0000 7f3c0c423700 1 -- 172.21.15.79:0/813459173 shutdown_connections 2023-10-19T08:39:27.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.670+0000 7f3c0c423700 1 --2- 172.21.15.79:0/813459173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c040b2270 0x7f3c0406a220 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.670+0000 7f3c0c423700 1 --2- 172.21.15.79:0/813459173 >> v2:172.21.15.89:3300/0 conn(0x7f3c040af170 0x7f3c040cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.670+0000 7f3c0c423700 1 -- 172.21.15.79:0/813459173 >> 172.21.15.79:0/813459173 conn(0x7f3c0406dcc0 msgr2=0x7f3c0406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:27.680 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.670+0000 7f3c0c423700 1 -- 172.21.15.79:0/813459173 shutdown_connections 2023-10-19T08:39:27.681 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.670+0000 7f3c0c423700 1 -- 172.21.15.79:0/813459173 wait complete. 2023-10-19T08:39:27.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.671+0000 7f3c0c423700 1 Processor -- start 2023-10-19T08:39:27.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.672+0000 7f3c0c423700 1 -- start start 2023-10-19T08:39:27.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.672+0000 7f3c0c423700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c040af170 0x7f3c041542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:27.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.672+0000 7f3c0c423700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c040b1de0 0x7f3c040ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:27.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.672+0000 7f3c0c423700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c040b2270 0x7f3c0415f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:27.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.672+0000 7f3c0c423700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c040c40f0 con 0x7f3c040af170 2023-10-19T08:39:27.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.672+0000 7f3c0c423700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c040adec0 con 0x7f3c040b2270 2023-10-19T08:39:27.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.672+0000 7f3c0c423700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c040c37c0 con 0x7f3c040b1de0 2023-10-19T08:39:27.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.672+0000 7f3c0a1bf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c040af170 0x7f3c041542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:27.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.672+0000 7f3c0a1bf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c040af170 0x7f3c041542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48784/0 (socket says 172.21.15.79:48784) 2023-10-19T08:39:27.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.672+0000 7f3c0a1bf700 1 -- 172.21.15.79:0/7673466 learned_addr learned my addr 172.21.15.79:0/7673466 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:27.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.672+0000 7f3c099be700 1 --2- 172.21.15.79:0/7673466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c040b1de0 0x7f3c040ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:27.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.672+0000 7f3c0a9c0700 1 --2- 172.21.15.79:0/7673466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c040b2270 0x7f3c0415f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:27.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.673+0000 7f3c0a1bf700 1 -- 172.21.15.79:0/7673466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c040b1de0 msgr2=0x7f3c040ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:27.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.673+0000 7f3c0a1bf700 1 --2- 172.21.15.79:0/7673466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c040b1de0 0x7f3c040ad670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.673+0000 7f3c0a1bf700 1 -- 172.21.15.79:0/7673466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c040b2270 msgr2=0x7f3c0415f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:27.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.673+0000 7f3c0a1bf700 1 --2- 172.21.15.79:0/7673466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c040b2270 0x7f3c0415f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.673+0000 7f3c0a1bf700 1 -- 172.21.15.79:0/7673466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc009a70 con 0x7f3c040af170 2023-10-19T08:39:27.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.673+0000 7f3c0a1bf700 1 --2- 172.21.15.79:0/7673466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c040af170 0x7f3c041542a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000b530 tx=0x7f3c0000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:27.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.673+0000 7f3bfaffd700 1 -- 172.21.15.79:0/7673466 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00011830 con 0x7f3c040af170 2023-10-19T08:39:27.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.673+0000 7f3bfaffd700 1 -- 172.21.15.79:0/7673466 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c00011990 con 0x7f3c040af170 2023-10-19T08:39:27.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.673+0000 7f3bfaffd700 1 -- 172.21.15.79:0/7673466 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00011d40 con 0x7f3c040af170 2023-10-19T08:39:27.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.673+0000 7f3c0c423700 1 -- 172.21.15.79:0/7673466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c040c3aa0 con 0x7f3c040af170 2023-10-19T08:39:27.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.673+0000 7f3c0c423700 1 -- 172.21.15.79:0/7673466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c041547e0 con 0x7f3c040af170 2023-10-19T08:39:27.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.674+0000 7f3c0c423700 1 -- 172.21.15.79:0/7673466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0404ee70 con 0x7f3c040af170 2023-10-19T08:39:27.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.674+0000 7f3bfaffd700 1 -- 172.21.15.79:0/7673466 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3c0001a400 con 0x7f3c040af170 2023-10-19T08:39:27.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.675+0000 7f3bfaffd700 1 --2- 172.21.15.79:0/7673466 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f3be806a0e0 0x7f3be806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:27.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.675+0000 7f3bfaffd700 1 -- 172.21.15.79:0/7673466 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f3c00088230 con 0x7f3c040af170 2023-10-19T08:39:27.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.675+0000 7f3c099be700 1 --2- 172.21.15.79:0/7673466 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f3be806a0e0 0x7f3be806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:27.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.675+0000 7f3c099be700 1 --2- 172.21.15.79:0/7673466 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f3be806a0e0 0x7f3be806c5a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3c040c9b10 tx=0x7f3bf4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:27.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.679+0000 7f3bfaffd700 1 -- 172.21.15.79:0/7673466 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f3c00053c80 con 0x7f3c040af170 2023-10-19T08:39:27.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.947+0000 7f3c0c423700 1 -- 172.21.15.79:0/7673466 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f3c040af690 con 0x7f3c040af170 2023-10-19T08:39:27.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.950+0000 7f3bfaffd700 1 -- 172.21.15.79:0/7673466 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3c000572a0 con 0x7f3c040af170 2023-10-19T08:39:27.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.952+0000 7f3c0c423700 1 -- 172.21.15.79:0/7673466 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f3be806a0e0 msgr2=0x7f3be806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:27.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.952+0000 7f3c0c423700 1 --2- 172.21.15.79:0/7673466 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f3be806a0e0 0x7f3be806c5a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3c040c9b10 tx=0x7f3bf4009040 comp rx=0 tx=0).stop 2023-10-19T08:39:27.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.952+0000 7f3c0c423700 1 -- 172.21.15.79:0/7673466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c040af170 msgr2=0x7f3c041542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:27.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.952+0000 7f3c0c423700 1 --2- 172.21.15.79:0/7673466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c040af170 0x7f3c041542a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3c0000b530 tx=0x7f3c0000b840 comp rx=0 tx=0).stop 2023-10-19T08:39:27.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.952+0000 7f3c0c423700 1 -- 172.21.15.79:0/7673466 shutdown_connections 2023-10-19T08:39:27.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.952+0000 7f3c0c423700 1 --2- 172.21.15.79:0/7673466 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3c040b2270 0x7f3c0415f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.952+0000 7f3c0c423700 1 --2- 172.21.15.79:0/7673466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c040af170 0x7f3c041542a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.952+0000 7f3c0c423700 1 --2- 172.21.15.79:0/7673466 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f3be806a0e0 0x7f3be806c5a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.952+0000 7f3c0c423700 1 --2- 172.21.15.79:0/7673466 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3c040b1de0 0x7f3c040ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:27.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.952+0000 7f3c0c423700 1 -- 172.21.15.79:0/7673466 >> 172.21.15.79:0/7673466 conn(0x7f3c0406dcc0 msgr2=0x7f3c040afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:27.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.953+0000 7f3c0c423700 1 -- 172.21.15.79:0/7673466 shutdown_connections 2023-10-19T08:39:27.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:27.953+0000 7f3c0c423700 1 -- 172.21.15.79:0/7673466 wait complete. 2023-10-19T08:39:27.969 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-19T08:39:28.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.085+0000 7f1b067f9700 1 Processor -- start 2023-10-19T08:39:28.090 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.085+0000 7f1b067f9700 1 -- start start 2023-10-19T08:39:28.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.086+0000 7f1b067f9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b0006bed0 0x7f1b000cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.086+0000 7f1b067f9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1b000cbd80 0x7f1b000cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.092 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.086+0000 7f1b067f9700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0015d910 con 0x7f1b0015d530 2023-10-19T08:39:28.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.086+0000 7f1b067f9700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b000b1c70 con 0x7f1b0006bed0 2023-10-19T08:39:28.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.086+0000 7f1b067f9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0015db10 con 0x7f1b000cbd80 2023-10-19T08:39:28.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.086+0000 7f1aff7fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b0006bed0 0x7f1b000cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.086+0000 7f1afffff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f1b0015d530 0x7f1b000b1560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58864/0 (socket says 172.21.15.79:58864) 2023-10-19T08:39:28.093 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.086+0000 7f1afffff700 1 -- 172.21.15.79:0/16630771 learned_addr learned my addr 172.21.15.79:0/16630771 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:28.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.086+0000 7f1aff7fe700 1 -- 172.21.15.79:0/16630771 >> v2:172.21.15.89:3300/0 conn(0x7f1b000cbd80 msgr2=0x7f1b000cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:28.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.086+0000 7f1aff7fe700 1 --2- 172.21.15.79:0/16630771 >> v2:172.21.15.89:3300/0 conn(0x7f1b000cbd80 0x7f1b000cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.086+0000 7f1aff7fe700 1 -- 172.21.15.79:0/16630771 >> v1:172.21.15.79:6789/0 conn(0x7f1b0015d530 legacy=0x7f1b000b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:28.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.086+0000 7f1afeffd700 1 -- 172.21.15.79:0/16630771 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064881760 0 0) 0x7f1b0015d910 con 0x7f1b0015d530 2023-10-19T08:39:28.094 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.086+0000 7f1aff7fe700 1 -- 172.21.15.79:0/16630771 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b000b1eb0 con 0x7f1b0006bed0 2023-10-19T08:39:28.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.086+0000 7f1aff7fe700 1 --2- 172.21.15.79:0/16630771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0006bed0 0x7f1b000cb840 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1b000ceca0 tx=0x7f1af4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31452508a02b7d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:28.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.087+0000 7f1afeffd700 1 -- 172.21.15.79:0/16630771 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4011830 con 0x7f1b0006bed0 2023-10-19T08:39:28.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.087+0000 7f1afeffd700 1 -- 172.21.15.79:0/16630771 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af4011990 con 0x7f1b0006bed0 2023-10-19T08:39:28.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.087+0000 7f1afeffd700 1 -- 172.21.15.79:0/16630771 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af4011d20 con 0x7f1b0006bed0 2023-10-19T08:39:28.095 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.087+0000 7f1b067f9700 1 -- 172.21.15.79:0/16630771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0006bed0 msgr2=0x7f1b000cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:28.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.087+0000 7f1b067f9700 1 --2- 172.21.15.79:0/16630771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0006bed0 0x7f1b000cb840 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f1b000ceca0 tx=0x7f1af4009b20 comp rx=0 tx=0).stop 2023-10-19T08:39:28.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.087+0000 7f1b067f9700 1 -- 172.21.15.79:0/16630771 shutdown_connections 2023-10-19T08:39:28.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.087+0000 7f1b067f9700 1 --2- 172.21.15.79:0/16630771 >> v2:172.21.15.89:3300/0 conn(0x7f1b000cbd80 0x7f1b000cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.087+0000 7f1b067f9700 1 --2- 172.21.15.79:0/16630771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0006bed0 0x7f1b000cb840 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.096 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.087+0000 7f1b067f9700 1 -- 172.21.15.79:0/16630771 >> 172.21.15.79:0/16630771 conn(0x7f1b000cc560 msgr2=0x7f1b000cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:28.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.087+0000 7f1b067f9700 1 -- 172.21.15.79:0/16630771 shutdown_connections 2023-10-19T08:39:28.097 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.087+0000 7f1b067f9700 1 -- 172.21.15.79:0/16630771 wait complete. 2023-10-19T08:39:28.099 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.088+0000 7f1b067f9700 1 Processor -- start 2023-10-19T08:39:28.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.089+0000 7f1b067f9700 1 -- start start 2023-10-19T08:39:28.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.089+0000 7f1b067f9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b0006bed0 0x7f1b001f1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.089+0000 7f1b067f9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b000cbd80 0x7f1b000c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.089+0000 7f1b067f9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0015d530 0x7f1b000c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.100 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.089+0000 7f1b067f9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b000c5cd0 con 0x7f1b0015d530 2023-10-19T08:39:28.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.089+0000 7f1b067f9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b000b3000 con 0x7f1b0006bed0 2023-10-19T08:39:28.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.089+0000 7f1b067f9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b00144fd0 con 0x7f1b000cbd80 2023-10-19T08:39:28.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.089+0000 7f1b04d96700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0015d530 0x7f1b000c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.089+0000 7f1b04d96700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0015d530 0x7f1b000c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48802/0 (socket says 172.21.15.79:48802) 2023-10-19T08:39:28.101 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.089+0000 7f1b04d96700 1 -- 172.21.15.79:0/1838610959 learned_addr learned my addr 172.21.15.79:0/1838610959 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:28.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.090+0000 7f1afffff700 1 --2- 172.21.15.79:0/1838610959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b0006bed0 0x7f1b001f1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.090+0000 7f1aff7fe700 1 --2- 172.21.15.79:0/1838610959 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b000cbd80 0x7f1b000c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.090+0000 7f1b04d96700 1 -- 172.21.15.79:0/1838610959 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b000cbd80 msgr2=0x7f1b000c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:28.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.090+0000 7f1b04d96700 1 --2- 172.21.15.79:0/1838610959 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b000cbd80 0x7f1b000c5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.102 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.090+0000 7f1b04d96700 1 -- 172.21.15.79:0/1838610959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b0006bed0 msgr2=0x7f1b001f1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:28.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.090+0000 7f1b04d96700 1 --2- 172.21.15.79:0/1838610959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b0006bed0 0x7f1b001f1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.090+0000 7f1b04d96700 1 -- 172.21.15.79:0/1838610959 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af40094a0 con 0x7f1b0015d530 2023-10-19T08:39:28.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.090+0000 7f1afffff700 1 --2- 172.21.15.79:0/1838610959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b0006bed0 0x7f1b001f1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:28.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.090+0000 7f1b04d96700 1 --2- 172.21.15.79:0/1838610959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0015d530 0x7f1b000c5790 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1af800b970 tx=0x7f1af800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:28.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.090+0000 7f1afcff9700 1 -- 172.21.15.79:0/1838610959 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af800c9b0 con 0x7f1b0015d530 2023-10-19T08:39:28.103 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.090+0000 7f1afcff9700 1 -- 172.21.15.79:0/1838610959 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af800cb30 con 0x7f1b0015d530 2023-10-19T08:39:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.090+0000 7f1b067f9700 1 -- 172.21.15.79:0/1838610959 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b001452b0 con 0x7f1b0015d530 2023-10-19T08:39:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.090+0000 7f1afcff9700 1 -- 172.21.15.79:0/1838610959 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8014440 con 0x7f1b0015d530 2023-10-19T08:39:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.090+0000 7f1b067f9700 1 -- 172.21.15.79:0/1838610959 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b000b3580 con 0x7f1b0015d530 2023-10-19T08:39:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.091+0000 7f1b067f9700 1 -- 172.21.15.79:0/1838610959 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b001454f0 con 0x7f1b0015d530 2023-10-19T08:39:28.104 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.091+0000 7f1afcff9700 1 -- 172.21.15.79:0/1838610959 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1af801d3b0 con 0x7f1b0015d530 2023-10-19T08:39:28.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.092+0000 7f1afcff9700 1 --2- 172.21.15.79:0/1838610959 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1aec06a0e0 0x7f1aec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.092+0000 7f1afcff9700 1 -- 172.21.15.79:0/1838610959 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1af8006e40 con 0x7f1b0015d530 2023-10-19T08:39:28.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.092+0000 7f1afffff700 1 --2- 172.21.15.79:0/1838610959 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1aec06a0e0 0x7f1aec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.105 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.092+0000 7f1afffff700 1 --2- 172.21.15.79:0/1838610959 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1aec06a0e0 0x7f1aec06c5a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1af0000f60 tx=0x7f1af0009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:28.106 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.096+0000 7f1afcff9700 1 -- 172.21.15.79:0/1838610959 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f1b001454f0 con 0x7f1b0015d530 2023-10-19T08:39:28.368 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.363+0000 7f1b067f9700 1 -- 172.21.15.79:0/1838610959 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f1b001454f0 con 0x7f1b0015d530 2023-10-19T08:39:28.371 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.367+0000 7f1afcff9700 1 -- 172.21.15.79:0/1838610959 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1b001454f0 con 0x7f1b0015d530 2023-10-19T08:39:28.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.369+0000 7f1b067f9700 1 -- 172.21.15.79:0/1838610959 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1aec06a0e0 msgr2=0x7f1aec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:28.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.369+0000 7f1b067f9700 1 --2- 172.21.15.79:0/1838610959 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1aec06a0e0 0x7f1aec06c5a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1af0000f60 tx=0x7f1af0009040 comp rx=0 tx=0).stop 2023-10-19T08:39:28.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.369+0000 7f1b067f9700 1 -- 172.21.15.79:0/1838610959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0015d530 msgr2=0x7f1b000c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:28.374 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.369+0000 7f1b067f9700 1 --2- 172.21.15.79:0/1838610959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0015d530 0x7f1b000c5790 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f1af800b970 tx=0x7f1af800bd30 comp rx=0 tx=0).stop 2023-10-19T08:39:28.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.369+0000 7f1b067f9700 1 -- 172.21.15.79:0/1838610959 shutdown_connections 2023-10-19T08:39:28.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.369+0000 7f1b067f9700 1 --2- 172.21.15.79:0/1838610959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b0015d530 0x7f1b000c5790 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.369+0000 7f1b067f9700 1 --2- 172.21.15.79:0/1838610959 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1b0006bed0 0x7f1b001f1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.369+0000 7f1b067f9700 1 --2- 172.21.15.79:0/1838610959 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f1aec06a0e0 0x7f1aec06c5a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.375 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.369+0000 7f1b067f9700 1 --2- 172.21.15.79:0/1838610959 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1b000cbd80 0x7f1b000c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.369+0000 7f1b067f9700 1 -- 172.21.15.79:0/1838610959 >> 172.21.15.79:0/1838610959 conn(0x7f1b000cc560 msgr2=0x7f1b000719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:28.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.369+0000 7f1b067f9700 1 -- 172.21.15.79:0/1838610959 shutdown_connections 2023-10-19T08:39:28.376 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.369+0000 7f1b067f9700 1 -- 172.21.15.79:0/1838610959 wait complete. 2023-10-19T08:39:28.385 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-19T08:39:28.505 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.501+0000 7f8de9342700 1 Processor -- start 2023-10-19T08:39:28.506 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.501+0000 7f8de9342700 1 -- start start 2023-10-19T08:39:28.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.502+0000 7f8de9342700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8de4160380 0x7f8de40cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.508 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.502+0000 7f8de9342700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de40cf7a0 0x7f8de406b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.502+0000 7f8de9342700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8de406b870 0x7f8de40d1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.502+0000 7f8de9342700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de406c3f0 con 0x7f8de4160380 2023-10-19T08:39:28.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.502+0000 7f8de9342700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de406be30 con 0x7f8de406b870 2023-10-19T08:39:28.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.502+0000 7f8de9342700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de406c110 con 0x7f8de40cf7a0 2023-10-19T08:39:28.509 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.502+0000 7f8de2ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8de4160380 0x7f8de40cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.502+0000 7f8de2ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8de4160380 0x7f8de40cf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48806/0 (socket says 172.21.15.79:48806) 2023-10-19T08:39:28.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.502+0000 7f8de2ffd700 1 -- 172.21.15.79:0/1354690882 learned_addr learned my addr 172.21.15.79:0/1354690882 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:28.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.502+0000 7f8de27fc700 1 --2- 172.21.15.79:0/1354690882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de40cf7a0 0x7f8de406b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.502+0000 7f8de37fe700 1 --2- 172.21.15.79:0/1354690882 >> v2:172.21.15.89:3300/0 conn(0x7f8de406b870 0x7f8de40d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.502+0000 7f8de2ffd700 1 -- 172.21.15.79:0/1354690882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de40cf7a0 msgr2=0x7f8de406b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:28.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.502+0000 7f8de2ffd700 1 --2- 172.21.15.79:0/1354690882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de40cf7a0 0x7f8de406b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.502+0000 7f8de2ffd700 1 -- 172.21.15.79:0/1354690882 >> v2:172.21.15.89:3300/0 conn(0x7f8de406b870 msgr2=0x7f8de40d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:28.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.502+0000 7f8de2ffd700 1 --2- 172.21.15.79:0/1354690882 >> v2:172.21.15.89:3300/0 conn(0x7f8de406b870 0x7f8de40d1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.511 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.502+0000 7f8de2ffd700 1 -- 172.21.15.79:0/1354690882 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de40cea60 con 0x7f8de4160380 2023-10-19T08:39:28.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.502+0000 7f8de2ffd700 1 --2- 172.21.15.79:0/1354690882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8de4160380 0x7f8de40cf260 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8de40c47f0 tx=0x7f8dd8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bd02d90d1a92df server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:28.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.502+0000 7f8de1ffb700 1 -- 172.21.15.79:0/1354690882 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd800b870 con 0x7f8de4160380 2023-10-19T08:39:28.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.503+0000 7f8de1ffb700 1 -- 172.21.15.79:0/1354690882 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd800b9d0 con 0x7f8de4160380 2023-10-19T08:39:28.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.503+0000 7f8de1ffb700 1 -- 172.21.15.79:0/1354690882 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd800bd60 con 0x7f8de4160380 2023-10-19T08:39:28.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.503+0000 7f8de9342700 1 -- 172.21.15.79:0/1354690882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8de4160380 msgr2=0x7f8de40cf260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:28.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.503+0000 7f8de9342700 1 --2- 172.21.15.79:0/1354690882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8de4160380 0x7f8de40cf260 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8de40c47f0 tx=0x7f8dd8009bd0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.503+0000 7f8de9342700 1 -- 172.21.15.79:0/1354690882 shutdown_connections 2023-10-19T08:39:28.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.503+0000 7f8de9342700 1 --2- 172.21.15.79:0/1354690882 >> v2:172.21.15.89:3300/0 conn(0x7f8de406b870 0x7f8de40d1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.503+0000 7f8de9342700 1 --2- 172.21.15.79:0/1354690882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8de4160380 0x7f8de40cf260 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.513 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.503+0000 7f8de9342700 1 --2- 172.21.15.79:0/1354690882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de40cf7a0 0x7f8de406b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.503+0000 7f8de9342700 1 -- 172.21.15.79:0/1354690882 >> 172.21.15.79:0/1354690882 conn(0x7f8de406a400 msgr2=0x7f8de406a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:28.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.503+0000 7f8de9342700 1 -- 172.21.15.79:0/1354690882 shutdown_connections 2023-10-19T08:39:28.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.503+0000 7f8de9342700 1 -- 172.21.15.79:0/1354690882 wait complete. 2023-10-19T08:39:28.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.504+0000 7f8de9342700 1 Processor -- start 2023-10-19T08:39:28.518 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.504+0000 7f8de9342700 1 -- start start 2023-10-19T08:39:28.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.505+0000 7f8de9342700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8de406b870 0x7f8de414f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.519 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.505+0000 7f8de9342700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8de4160380 0x7f8de414da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.505+0000 7f8de9342700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de40b2070 0x7f8de4155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.505+0000 7f8de9342700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de414df80 con 0x7f8de406b870 2023-10-19T08:39:28.520 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.505+0000 7f8de9342700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de40b39a0 con 0x7f8de4160380 2023-10-19T08:39:28.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.505+0000 7f8de9342700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de414f990 con 0x7f8de40b2070 2023-10-19T08:39:28.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.505+0000 7f8de2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8de406b870 0x7f8de414f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.521 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.505+0000 7f8de2ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8de406b870 0x7f8de414f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48810/0 (socket says 172.21.15.79:48810) 2023-10-19T08:39:28.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.505+0000 7f8de2ffd700 1 -- 172.21.15.79:0/3318752490 learned_addr learned my addr 172.21.15.79:0/3318752490 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:28.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.505+0000 7f8de27fc700 1 --2- 172.21.15.79:0/3318752490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8de4160380 0x7f8de414da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.522 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.505+0000 7f8de37fe700 1 --2- 172.21.15.79:0/3318752490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de40b2070 0x7f8de4155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.505+0000 7f8de2ffd700 1 -- 172.21.15.79:0/3318752490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de40b2070 msgr2=0x7f8de4155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:28.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.506+0000 7f8de2ffd700 1 --2- 172.21.15.79:0/3318752490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de40b2070 0x7f8de4155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.506+0000 7f8de2ffd700 1 -- 172.21.15.79:0/3318752490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8de4160380 msgr2=0x7f8de414da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:28.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.506+0000 7f8de2ffd700 1 --2- 172.21.15.79:0/3318752490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8de4160380 0x7f8de414da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.506+0000 7f8de2ffd700 1 -- 172.21.15.79:0/3318752490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd8009550 con 0x7f8de406b870 2023-10-19T08:39:28.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.506+0000 7f8de37fe700 1 --2- 172.21.15.79:0/3318752490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de40b2070 0x7f8de4155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:28.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.506+0000 7f8de2ffd700 1 --2- 172.21.15.79:0/3318752490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8de406b870 0x7f8de414f360 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8000c00 tx=0x7f8dd8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:28.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.506+0000 7f8dcb7fe700 1 -- 172.21.15.79:0/3318752490 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8004540 con 0x7f8de406b870 2023-10-19T08:39:28.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.506+0000 7f8dcb7fe700 1 -- 172.21.15.79:0/3318752490 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd80036a0 con 0x7f8de406b870 2023-10-19T08:39:28.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.506+0000 7f8de9342700 1 -- 172.21.15.79:0/3318752490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de414fc70 con 0x7f8de406b870 2023-10-19T08:39:28.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.506+0000 7f8dcb7fe700 1 -- 172.21.15.79:0/3318752490 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8003a50 con 0x7f8de406b870 2023-10-19T08:39:28.526 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.506+0000 7f8de9342700 1 -- 172.21.15.79:0/3318752490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de4150230 con 0x7f8de406b870 2023-10-19T08:39:28.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.507+0000 7f8de9342700 1 -- 172.21.15.79:0/3318752490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de41503f0 con 0x7f8de406b870 2023-10-19T08:39:28.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.507+0000 7f8dcb7fe700 1 -- 172.21.15.79:0/3318752490 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8dd8021070 con 0x7f8de406b870 2023-10-19T08:39:28.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.508+0000 7f8dcb7fe700 1 --2- 172.21.15.79:0/3318752490 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f8dd006a0e0 0x7f8dd006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.508+0000 7f8dcb7fe700 1 -- 172.21.15.79:0/3318752490 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f8dd8089a80 con 0x7f8de406b870 2023-10-19T08:39:28.527 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.508+0000 7f8de27fc700 1 --2- 172.21.15.79:0/3318752490 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f8dd006a0e0 0x7f8dd006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.508+0000 7f8de27fc700 1 --2- 172.21.15.79:0/3318752490 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f8dd006a0e0 0x7f8dd006c5a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4006b20 tx=0x7f8dd4008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:28.528 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.512+0000 7f8dcb7fe700 1 -- 172.21.15.79:0/3318752490 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f8dd80552e0 con 0x7f8de406b870 2023-10-19T08:39:28.784 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.780+0000 7f8de9342700 1 -- 172.21.15.79:0/3318752490 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f8de404ee70 con 0x7f8de406b870 2023-10-19T08:39:28.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.783+0000 7f8dcb7fe700 1 -- 172.21.15.79:0/3318752490 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8dd80150a0 con 0x7f8de406b870 2023-10-19T08:39:28.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.785+0000 7f8de9342700 1 -- 172.21.15.79:0/3318752490 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f8dd006a0e0 msgr2=0x7f8dd006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:28.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.785+0000 7f8de9342700 1 --2- 172.21.15.79:0/3318752490 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f8dd006a0e0 0x7f8dd006c5a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4006b20 tx=0x7f8dd4008040 comp rx=0 tx=0).stop 2023-10-19T08:39:28.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.785+0000 7f8de9342700 1 -- 172.21.15.79:0/3318752490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8de406b870 msgr2=0x7f8de414f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:28.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.785+0000 7f8de9342700 1 --2- 172.21.15.79:0/3318752490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8de406b870 0x7f8de414f360 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8000c00 tx=0x7f8dd8004750 comp rx=0 tx=0).stop 2023-10-19T08:39:28.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.785+0000 7f8de9342700 1 -- 172.21.15.79:0/3318752490 shutdown_connections 2023-10-19T08:39:28.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.785+0000 7f8de9342700 1 --2- 172.21.15.79:0/3318752490 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f8dd006a0e0 0x7f8dd006c5a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.785+0000 7f8de9342700 1 --2- 172.21.15.79:0/3318752490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8de40b2070 0x7f8de4155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.785+0000 7f8de9342700 1 --2- 172.21.15.79:0/3318752490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8de406b870 0x7f8de414f360 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.785+0000 7f8de9342700 1 --2- 172.21.15.79:0/3318752490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8de4160380 0x7f8de414da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.785+0000 7f8de9342700 1 -- 172.21.15.79:0/3318752490 >> 172.21.15.79:0/3318752490 conn(0x7f8de406a400 msgr2=0x7f8de4153e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:28.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.786+0000 7f8de9342700 1 -- 172.21.15.79:0/3318752490 shutdown_connections 2023-10-19T08:39:28.792 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.786+0000 7f8de9342700 1 -- 172.21.15.79:0/3318752490 wait complete. 2023-10-19T08:39:28.801 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-19T08:39:28.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.917+0000 7efd139a0700 1 Processor -- start 2023-10-19T08:39:28.922 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.918+0000 7efd139a0700 1 -- start start 2023-10-19T08:39:28.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.918+0000 7efd139a0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efd0c0b4cb0 0x7efd0c06a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.918+0000 7efd139a0700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0c0cec30 con 0x7efd0c0b45f0 2023-10-19T08:39:28.926 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.918+0000 7efd139a0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0c15e210 con 0x7efd0c06db20 2023-10-19T08:39:28.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.918+0000 7efd139a0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd0c15d920 con 0x7efd0c0b4cb0 2023-10-19T08:39:28.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd1173c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7efd0c0b45f0 0x7efd0c0cad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58890/0 (socket says 172.21.15.79:58890) 2023-10-19T08:39:28.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd1173c700 1 -- 172.21.15.79:0/864557050 learned_addr learned my addr 172.21.15.79:0/864557050 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:28.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd10f3b700 1 --2- 172.21.15.79:0/864557050 >> v2:172.21.15.89:3300/0 conn(0x7efd0c0b4cb0 0x7efd0c06a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.927 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd03fff700 1 -- 172.21.15.79:0/864557050 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536556634 0 0) 0x7efd0c0cec30 con 0x7efd0c0b45f0 2023-10-19T08:39:28.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd03fff700 1 -- 172.21.15.79:0/864557050 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcf80035b0 con 0x7efd0c0b45f0 2023-10-19T08:39:28.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd03fff700 1 -- 172.21.15.79:0/864557050 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2482675033 0 0) 0x7efcf80035b0 con 0x7efd0c0b45f0 2023-10-19T08:39:28.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd03fff700 1 -- 172.21.15.79:0/864557050 >> v2:172.21.15.89:3300/0 conn(0x7efd0c0b4cb0 msgr2=0x7efd0c06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:28.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd03fff700 1 --2- 172.21.15.79:0/864557050 >> v2:172.21.15.89:3300/0 conn(0x7efd0c0b4cb0 0x7efd0c06a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.928 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd03fff700 1 -- 172.21.15.79:0/864557050 >> v1:172.21.15.89:6789/0 conn(0x7efd0c06db20 legacy=0x7efd0c06a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:28.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd03fff700 1 -- 172.21.15.79:0/864557050 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c0cee80 con 0x7efd0c0b45f0 2023-10-19T08:39:28.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd03fff700 1 -- 172.21.15.79:0/864557050 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7efcfc001670 con 0x7efd0c0b45f0 2023-10-19T08:39:28.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd03fff700 1 -- 172.21.15.79:0/864557050 >> v1:172.21.15.79:6789/0 conn(0x7efd0c0b45f0 legacy=0x7efd0c0cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:28.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd03fff700 1 --2- 172.21.15.79:0/864557050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf8003a00 0x7efcf8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.929 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd03fff700 1 --2- 172.21.15.79:0/864557050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcf8004850 0x7efcf8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd03fff700 1 --2- 172.21.15.79:0/864557050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcf8005210 0x7efcf800dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd03fff700 1 -- 172.21.15.79:0/864557050 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c15d920 con 0x7efcf8003a00 2023-10-19T08:39:28.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd03fff700 1 -- 172.21.15.79:0/864557050 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf800e2c0 con 0x7efcf8005210 2023-10-19T08:39:28.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd03fff700 1 -- 172.21.15.79:0/864557050 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf800e480 con 0x7efcf8004850 2023-10-19T08:39:28.930 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd1173c700 1 --2- 172.21.15.79:0/864557050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf8003a00 0x7efcf8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd11f3d700 1 --2- 172.21.15.79:0/864557050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcf8005210 0x7efcf800dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.919+0000 7efd10f3b700 1 --2- 172.21.15.79:0/864557050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcf8004850 0x7efcf8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.920+0000 7efd1173c700 1 -- 172.21.15.79:0/864557050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcf8004850 msgr2=0x7efcf8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:28.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.920+0000 7efd1173c700 1 --2- 172.21.15.79:0/864557050 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efcf8004850 0x7efcf8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.931 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.920+0000 7efd1173c700 1 -- 172.21.15.79:0/864557050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcf8005210 msgr2=0x7efcf800dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:28.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.920+0000 7efd1173c700 1 --2- 172.21.15.79:0/864557050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efcf8005210 0x7efcf800dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.920+0000 7efd11f3d700 1 -- 172.21.15.79:0/864557050 reap_dead start 2023-10-19T08:39:28.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.920+0000 7efd1173c700 1 -- 172.21.15.79:0/864557050 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf80035b0 con 0x7efcf8003a00 2023-10-19T08:39:28.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.920+0000 7efd1173c700 1 --2- 172.21.15.79:0/864557050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf8003a00 0x7efcf8003e20 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c2a0 tx=0x7efcf8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70857928d396bc84 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:28.932 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.920+0000 7efd03fff700 1 -- 172.21.15.79:0/864557050 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc007c10 con 0x7efcf8003a00 2023-10-19T08:39:28.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.920+0000 7efd03fff700 1 -- 172.21.15.79:0/864557050 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc00cdc0 con 0x7efcf8003a00 2023-10-19T08:39:28.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.920+0000 7efd03fff700 1 -- 172.21.15.79:0/864557050 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc005ba0 con 0x7efcf8003a00 2023-10-19T08:39:28.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.920+0000 7efd139a0700 1 -- 172.21.15.79:0/864557050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf8003a00 msgr2=0x7efcf8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:28.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.920+0000 7efd139a0700 1 --2- 172.21.15.79:0/864557050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf8003a00 0x7efcf8003e20 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c2a0 tx=0x7efcf8005880 comp rx=0 tx=0).stop 2023-10-19T08:39:28.933 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.920+0000 7efd139a0700 1 -- 172.21.15.79:0/864557050 shutdown_connections 2023-10-19T08:39:28.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.920+0000 7efd139a0700 1 --2- 172.21.15.79:0/864557050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf8003a00 0x7efcf8003e20 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.920+0000 7efd139a0700 1 -- 172.21.15.79:0/864557050 >> 172.21.15.79:0/864557050 conn(0x7efd0c06d000 msgr2=0x7efd0c06d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:28.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.921+0000 7efd139a0700 1 -- 172.21.15.79:0/864557050 shutdown_connections 2023-10-19T08:39:28.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.921+0000 7efd139a0700 1 -- 172.21.15.79:0/864557050 wait complete. 2023-10-19T08:39:28.934 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.922+0000 7efd139a0700 1 Processor -- start 2023-10-19T08:39:28.935 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.922+0000 7efd139a0700 1 -- start start 2023-10-19T08:39:28.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.922+0000 7efd139a0700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf8003a00 0x7efd0c0c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.937 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.922+0000 7efd139a0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd0c15bf50 0x7efd0c0c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.922+0000 7efd139a0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd0c1567d0 0x7efd0c06e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.922+0000 7efd139a0700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0c69f0 con 0x7efcf8003a00 2023-10-19T08:39:28.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.922+0000 7efd139a0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c15c6c0 con 0x7efd0c1567d0 2023-10-19T08:39:28.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.922+0000 7efd139a0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c15c3e0 con 0x7efd0c15bf50 2023-10-19T08:39:28.938 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.923+0000 7efd1173c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf8003a00 0x7efd0c0c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.923+0000 7efd1173c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf8003a00 0x7efd0c0c6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48830/0 (socket says 172.21.15.79:48830) 2023-10-19T08:39:28.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.923+0000 7efd1173c700 1 -- 172.21.15.79:0/1691369981 learned_addr learned my addr 172.21.15.79:0/1691369981 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:28.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.923+0000 7efd10f3b700 1 --2- 172.21.15.79:0/1691369981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd0c15bf50 0x7efd0c0c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.923+0000 7efd11f3d700 1 --2- 172.21.15.79:0/1691369981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd0c1567d0 0x7efd0c06e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.939 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.923+0000 7efd1173c700 1 -- 172.21.15.79:0/1691369981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd0c15bf50 msgr2=0x7efd0c0c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:28.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.923+0000 7efd1173c700 1 --2- 172.21.15.79:0/1691369981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd0c15bf50 0x7efd0c0c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.923+0000 7efd1173c700 1 -- 172.21.15.79:0/1691369981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd0c1567d0 msgr2=0x7efd0c06e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:28.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.923+0000 7efd1173c700 1 --2- 172.21.15.79:0/1691369981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd0c1567d0 0x7efd0c06e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:28.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.923+0000 7efd1173c700 1 -- 172.21.15.79:0/1691369981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c0c63a0 con 0x7efcf8003a00 2023-10-19T08:39:28.940 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.923+0000 7efd11f3d700 1 --2- 172.21.15.79:0/1691369981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd0c1567d0 0x7efd0c06e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:28.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.923+0000 7efd1173c700 1 --2- 172.21.15.79:0/1691369981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf8003a00 0x7efd0c0c6e80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7efcf800e290 tx=0x7efd0c0725a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:28.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.923+0000 7efd01ffb700 1 -- 172.21.15.79:0/1691369981 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc001640 con 0x7efcf8003a00 2023-10-19T08:39:28.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.923+0000 7efd01ffb700 1 -- 172.21.15.79:0/1691369981 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc0070d0 con 0x7efcf8003a00 2023-10-19T08:39:28.941 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.923+0000 7efd139a0700 1 -- 172.21.15.79:0/1691369981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0c0c6680 con 0x7efcf8003a00 2023-10-19T08:39:28.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.923+0000 7efd01ffb700 1 -- 172.21.15.79:0/1691369981 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc007440 con 0x7efcf8003a00 2023-10-19T08:39:28.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.923+0000 7efd139a0700 1 -- 172.21.15.79:0/1691369981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0c0c5eb0 con 0x7efcf8003a00 2023-10-19T08:39:28.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.924+0000 7efd139a0700 1 -- 172.21.15.79:0/1691369981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0c0c6cd0 con 0x7efcf8003a00 2023-10-19T08:39:28.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.925+0000 7efd01ffb700 1 -- 172.21.15.79:0/1691369981 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efcfc0075a0 con 0x7efcf8003a00 2023-10-19T08:39:28.942 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.925+0000 7efd01ffb700 1 --2- 172.21.15.79:0/1691369981 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efcf006a0e0 0x7efcf006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:28.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.925+0000 7efd01ffb700 1 -- 172.21.15.79:0/1691369981 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7efcfc089710 con 0x7efcf8003a00 2023-10-19T08:39:28.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.925+0000 7efd10f3b700 1 --2- 172.21.15.79:0/1691369981 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efcf006a0e0 0x7efcf006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:28.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.925+0000 7efd10f3b700 1 --2- 172.21.15.79:0/1691369981 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efcf006a0e0 0x7efcf006c5a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efd08009b40 tx=0x7efd08008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:28.943 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:28.929+0000 7efd01ffb700 1 -- 172.21.15.79:0/1691369981 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7efcfc055020 con 0x7efcf8003a00 2023-10-19T08:39:29.201 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.197+0000 7efd139a0700 1 -- 172.21.15.79:0/1691369981 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7efd0c04ee70 con 0x7efcf8003a00 2023-10-19T08:39:29.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.200+0000 7efd01ffb700 1 -- 172.21.15.79:0/1691369981 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7efcfc007d70 con 0x7efcf8003a00 2023-10-19T08:39:29.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.202+0000 7efd139a0700 1 -- 172.21.15.79:0/1691369981 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efcf006a0e0 msgr2=0x7efcf006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:29.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.202+0000 7efd139a0700 1 --2- 172.21.15.79:0/1691369981 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efcf006a0e0 0x7efcf006c5a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efd08009b40 tx=0x7efd08008040 comp rx=0 tx=0).stop 2023-10-19T08:39:29.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.202+0000 7efd139a0700 1 -- 172.21.15.79:0/1691369981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf8003a00 msgr2=0x7efd0c0c6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:29.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.202+0000 7efd139a0700 1 --2- 172.21.15.79:0/1691369981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf8003a00 0x7efd0c0c6e80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7efcf800e290 tx=0x7efd0c0725a0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.202+0000 7efd139a0700 1 -- 172.21.15.79:0/1691369981 shutdown_connections 2023-10-19T08:39:29.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.202+0000 7efd139a0700 1 --2- 172.21.15.79:0/1691369981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efd0c1567d0 0x7efd0c06e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.202+0000 7efd139a0700 1 --2- 172.21.15.79:0/1691369981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efcf8003a00 0x7efd0c0c6e80 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.208 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.202+0000 7efd139a0700 1 --2- 172.21.15.79:0/1691369981 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7efcf006a0e0 0x7efcf006c5a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.202+0000 7efd139a0700 1 --2- 172.21.15.79:0/1691369981 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efd0c15bf50 0x7efd0c0c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.202+0000 7efd139a0700 1 -- 172.21.15.79:0/1691369981 >> 172.21.15.79:0/1691369981 conn(0x7efd0c06d000 msgr2=0x7efd0c06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:29.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.202+0000 7efd139a0700 1 -- 172.21.15.79:0/1691369981 shutdown_connections 2023-10-19T08:39:29.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.202+0000 7efd139a0700 1 -- 172.21.15.79:0/1691369981 wait complete. 2023-10-19T08:39:29.219 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-19T08:39:29.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.335+0000 7fd09dc55700 1 Processor -- start 2023-10-19T08:39:29.340 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.335+0000 7fd09dc55700 1 -- start start 2023-10-19T08:39:29.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.336+0000 7fd09dc55700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd0980cda10 0x7fd09815a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:29.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.336+0000 7fd09dc55700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd0980cddf0 0x7fd0980ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:29.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.336+0000 7fd09dc55700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0980cd4f0 con 0x7fd0980cd050 2023-10-19T08:39:29.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.336+0000 7fd09dc55700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0980cd7d0 con 0x7fd0980cddf0 2023-10-19T08:39:29.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.336+0000 7fd09dc55700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd098159a50 con 0x7fd0980cda10 2023-10-19T08:39:29.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.336+0000 7fd096ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd0980cddf0 0x7fd0980ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:29.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.336+0000 7fd097fff700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd0980cd050 0x7fd09806cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58914/0 (socket says 172.21.15.79:58914) 2023-10-19T08:39:29.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.336+0000 7fd097fff700 1 -- 172.21.15.79:0/29525256 learned_addr learned my addr 172.21.15.79:0/29525256 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:29.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.337+0000 7fd0977fe700 1 --2- 172.21.15.79:0/29525256 >> v2:172.21.15.89:3300/0 conn(0x7fd0980cda10 0x7fd09815a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:29.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.337+0000 7fd096ffd700 1 -- 172.21.15.79:0/29525256 >> v2:172.21.15.89:3300/0 conn(0x7fd0980cda10 msgr2=0x7fd09815a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:29.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.337+0000 7fd096ffd700 1 --2- 172.21.15.79:0/29525256 >> v2:172.21.15.89:3300/0 conn(0x7fd0980cda10 0x7fd09815a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.337+0000 7fd096ffd700 1 -- 172.21.15.79:0/29525256 >> v1:172.21.15.79:6789/0 conn(0x7fd0980cd050 legacy=0x7fd09806cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:29.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.337+0000 7fd0967fc700 1 -- 172.21.15.79:0/29525256 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696550042 0 0) 0x7fd0980cd4f0 con 0x7fd0980cd050 2023-10-19T08:39:29.345 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.337+0000 7fd096ffd700 1 -- 172.21.15.79:0/29525256 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd098159d30 con 0x7fd0980cddf0 2023-10-19T08:39:29.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.337+0000 7fd0977fe700 1 --2- 172.21.15.79:0/29525256 >> v2:172.21.15.89:3300/0 conn(0x7fd0980cda10 0x7fd09815a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:29.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.337+0000 7fd096ffd700 1 --2- 172.21.15.79:0/29525256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0980cddf0 0x7fd0980ccb10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd0980cfec0 tx=0x7fd080009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872fbec0026bb9b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:29.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.337+0000 7fd0967fc700 1 -- 172.21.15.79:0/29525256 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080011830 con 0x7fd0980cddf0 2023-10-19T08:39:29.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.337+0000 7fd0967fc700 1 -- 172.21.15.79:0/29525256 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd080011990 con 0x7fd0980cddf0 2023-10-19T08:39:29.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.337+0000 7fd0967fc700 1 -- 172.21.15.79:0/29525256 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080011d20 con 0x7fd0980cddf0 2023-10-19T08:39:29.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.338+0000 7fd09dc55700 1 -- 172.21.15.79:0/29525256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0980cddf0 msgr2=0x7fd0980ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:29.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.338+0000 7fd09dc55700 1 --2- 172.21.15.79:0/29525256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0980cddf0 0x7fd0980ccb10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd0980cfec0 tx=0x7fd080009b20 comp rx=0 tx=0).stop 2023-10-19T08:39:29.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.338+0000 7fd09dc55700 1 -- 172.21.15.79:0/29525256 shutdown_connections 2023-10-19T08:39:29.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.338+0000 7fd09dc55700 1 --2- 172.21.15.79:0/29525256 >> v2:172.21.15.89:3300/0 conn(0x7fd0980cda10 0x7fd09815a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.338+0000 7fd09dc55700 1 --2- 172.21.15.79:0/29525256 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0980cddf0 0x7fd0980ccb10 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.338+0000 7fd09dc55700 1 -- 172.21.15.79:0/29525256 >> 172.21.15.79:0/29525256 conn(0x7fd0980cefd0 msgr2=0x7fd0980cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:29.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.338+0000 7fd09dc55700 1 -- 172.21.15.79:0/29525256 shutdown_connections 2023-10-19T08:39:29.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.338+0000 7fd09dc55700 1 -- 172.21.15.79:0/29525256 wait complete. 2023-10-19T08:39:29.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.339+0000 7fd09dc55700 1 Processor -- start 2023-10-19T08:39:29.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.340+0000 7fd09dc55700 1 -- start start 2023-10-19T08:39:29.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.340+0000 7fd09dc55700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0980cd050 0x7fd09814b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:29.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.340+0000 7fd09dc55700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0980cda10 0x7fd0980c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:29.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.340+0000 7fd09dc55700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0980cddf0 0x7fd0981e2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:29.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.340+0000 7fd09dc55700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0980c6e00 con 0x7fd0980cda10 2023-10-19T08:39:29.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.340+0000 7fd09dc55700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0980c6f90 con 0x7fd0980cd050 2023-10-19T08:39:29.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.340+0000 7fd09dc55700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0980c33e0 con 0x7fd0980cddf0 2023-10-19T08:39:29.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.340+0000 7fd096ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0980cda10 0x7fd0980c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:29.353 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.341+0000 7fd096ffd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0980cda10 0x7fd0980c2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48846/0 (socket says 172.21.15.79:48846) 2023-10-19T08:39:29.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.341+0000 7fd096ffd700 1 -- 172.21.15.79:0/132199514 learned_addr learned my addr 172.21.15.79:0/132199514 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:29.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.341+0000 7fd0977fe700 1 --2- 172.21.15.79:0/132199514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0980cd050 0x7fd09814b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:29.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.341+0000 7fd097fff700 1 --2- 172.21.15.79:0/132199514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0980cddf0 0x7fd0981e2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:29.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.341+0000 7fd096ffd700 1 -- 172.21.15.79:0/132199514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0980cddf0 msgr2=0x7fd0981e2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:29.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.341+0000 7fd096ffd700 1 --2- 172.21.15.79:0/132199514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0980cddf0 0x7fd0981e2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.341+0000 7fd096ffd700 1 -- 172.21.15.79:0/132199514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0980cd050 msgr2=0x7fd09814b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:29.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.341+0000 7fd096ffd700 1 --2- 172.21.15.79:0/132199514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0980cd050 0x7fd09814b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.341+0000 7fd096ffd700 1 -- 172.21.15.79:0/132199514 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0800094a0 con 0x7fd0980cda10 2023-10-19T08:39:29.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.341+0000 7fd096ffd700 1 --2- 172.21.15.79:0/132199514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0980cda10 0x7fd0980c2a70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd0800090b0 tx=0x7fd080004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:29.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.341+0000 7fd08ffff700 1 -- 172.21.15.79:0/132199514 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0800044d0 con 0x7fd0980cda10 2023-10-19T08:39:29.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.341+0000 7fd08ffff700 1 -- 172.21.15.79:0/132199514 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0800036a0 con 0x7fd0980cda10 2023-10-19T08:39:29.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.341+0000 7fd08ffff700 1 -- 172.21.15.79:0/132199514 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080003a50 con 0x7fd0980cda10 2023-10-19T08:39:29.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.341+0000 7fd09dc55700 1 -- 172.21.15.79:0/132199514 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0980c36c0 con 0x7fd0980cda10 2023-10-19T08:39:29.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.341+0000 7fd09dc55700 1 -- 172.21.15.79:0/132199514 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0980c3c80 con 0x7fd0980cda10 2023-10-19T08:39:29.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.342+0000 7fd09dc55700 1 -- 172.21.15.79:0/132199514 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09804ee70 con 0x7fd0980cda10 2023-10-19T08:39:29.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.343+0000 7fd08ffff700 1 -- 172.21.15.79:0/132199514 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd080003bb0 con 0x7fd0980cda10 2023-10-19T08:39:29.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.343+0000 7fd08ffff700 1 --2- 172.21.15.79:0/132199514 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd07806a0e0 0x7fd07806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:29.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.343+0000 7fd08ffff700 1 -- 172.21.15.79:0/132199514 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd0800897e0 con 0x7fd0980cda10 2023-10-19T08:39:29.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.343+0000 7fd0977fe700 1 --2- 172.21.15.79:0/132199514 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd07806a0e0 0x7fd07806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:29.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.343+0000 7fd0977fe700 1 --2- 172.21.15.79:0/132199514 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd07806a0e0 0x7fd07806c5a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd08800abf0 tx=0x7fd088008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:29.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.347+0000 7fd08ffff700 1 -- 172.21.15.79:0/132199514 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd080055170 con 0x7fd0980cda10 2023-10-19T08:39:29.620 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.615+0000 7fd09dc55700 1 -- 172.21.15.79:0/132199514 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd0980c9b50 con 0x7fd0980cda10 2023-10-19T08:39:29.623 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.619+0000 7fd08ffff700 1 -- 172.21.15.79:0/132199514 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd0800150a0 con 0x7fd0980cda10 2023-10-19T08:39:29.626 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.621+0000 7fd09dc55700 1 -- 172.21.15.79:0/132199514 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd07806a0e0 msgr2=0x7fd07806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:29.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.621+0000 7fd09dc55700 1 --2- 172.21.15.79:0/132199514 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd07806a0e0 0x7fd07806c5a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd08800abf0 tx=0x7fd088008040 comp rx=0 tx=0).stop 2023-10-19T08:39:29.627 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.621+0000 7fd09dc55700 1 -- 172.21.15.79:0/132199514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0980cda10 msgr2=0x7fd0980c2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:29.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.621+0000 7fd09dc55700 1 --2- 172.21.15.79:0/132199514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0980cda10 0x7fd0980c2a70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fd0800090b0 tx=0x7fd080004750 comp rx=0 tx=0).stop 2023-10-19T08:39:29.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.621+0000 7fd09dc55700 1 -- 172.21.15.79:0/132199514 shutdown_connections 2023-10-19T08:39:29.628 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.621+0000 7fd09dc55700 1 --2- 172.21.15.79:0/132199514 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd07806a0e0 0x7fd07806c5a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.621+0000 7fd09dc55700 1 --2- 172.21.15.79:0/132199514 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0980cddf0 0x7fd0981e2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.621+0000 7fd09dc55700 1 --2- 172.21.15.79:0/132199514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0980cd050 0x7fd09814b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.629 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.621+0000 7fd09dc55700 1 --2- 172.21.15.79:0/132199514 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0980cda10 0x7fd0980c2a70 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.621+0000 7fd09dc55700 1 -- 172.21.15.79:0/132199514 >> 172.21.15.79:0/132199514 conn(0x7fd0980cefd0 msgr2=0x7fd0980ca4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:29.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.621+0000 7fd09dc55700 1 -- 172.21.15.79:0/132199514 shutdown_connections 2023-10-19T08:39:29.630 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.621+0000 7fd09dc55700 1 -- 172.21.15.79:0/132199514 wait complete. 2023-10-19T08:39:29.638 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:39:29.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.754+0000 7fd16392a700 1 Processor -- start 2023-10-19T08:39:29.759 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.754+0000 7fd16392a700 1 -- start start 2023-10-19T08:39:29.762 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.755+0000 7fd16392a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd15c15d8c0 0x7fd15c06a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:29.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.755+0000 7fd16392a700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15c0cd550 con 0x7fd15c0af170 2023-10-19T08:39:29.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.755+0000 7fd16392a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15c15de50 con 0x7fd15c0cd0c0 2023-10-19T08:39:29.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.755+0000 7fd16392a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15c0af550 con 0x7fd15c15d8c0 2023-10-19T08:39:29.763 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.755+0000 7fd1616c6700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd15c0af170 0x7fd15c0b1de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58924/0 (socket says 172.21.15.79:58924) 2023-10-19T08:39:29.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.755+0000 7fd1616c6700 1 -- 172.21.15.79:0/1437735005 learned_addr learned my addr 172.21.15.79:0/1437735005 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:29.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd153fff700 1 -- 172.21.15.79:0/1437735005 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189088529 0 0) 0x7fd14c001110 con 0x7fd15c0af170 2023-10-19T08:39:29.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd153fff700 1 -- 172.21.15.79:0/1437735005 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1480035b0 con 0x7fd15c0af170 2023-10-19T08:39:29.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd161ec7700 1 --2- 172.21.15.79:0/1437735005 >> v2:172.21.15.89:3300/0 conn(0x7fd15c15d8c0 0x7fd15c06a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:29.764 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd153fff700 1 -- 172.21.15.79:0/1437735005 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3040747213 0 0) 0x7fd1480035b0 con 0x7fd15c0af170 2023-10-19T08:39:29.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd153fff700 1 -- 172.21.15.79:0/1437735005 >> v2:172.21.15.89:3300/0 conn(0x7fd15c15d8c0 msgr2=0x7fd15c06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:29.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd153fff700 1 --2- 172.21.15.79:0/1437735005 >> v2:172.21.15.89:3300/0 conn(0x7fd15c15d8c0 0x7fd15c06a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd153fff700 1 -- 172.21.15.79:0/1437735005 >> v1:172.21.15.89:6789/0 conn(0x7fd15c0cd0c0 legacy=0x7fd15c0cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:29.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd153fff700 1 -- 172.21.15.79:0/1437735005 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c15e130 con 0x7fd15c0af170 2023-10-19T08:39:29.765 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd153fff700 1 -- 172.21.15.79:0/1437735005 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7fd14c001800 con 0x7fd15c0af170 2023-10-19T08:39:29.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd153fff700 1 -- 172.21.15.79:0/1437735005 >> v1:172.21.15.79:6789/0 conn(0x7fd15c0af170 legacy=0x7fd15c0b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:29.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd153fff700 1 --2- 172.21.15.79:0/1437735005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd148003a00 0x7fd148003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:29.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd153fff700 1 --2- 172.21.15.79:0/1437735005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd148004850 0x7fd148004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:29.766 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd153fff700 1 --2- 172.21.15.79:0/1437735005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd148005210 0x7fd14800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:29.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd153fff700 1 -- 172.21.15.79:0/1437735005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c0af550 con 0x7fd148003a00 2023-10-19T08:39:29.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd153fff700 1 -- 172.21.15.79:0/1437735005 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14800c0b0 con 0x7fd148005210 2023-10-19T08:39:29.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd153fff700 1 -- 172.21.15.79:0/1437735005 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14800c270 con 0x7fd148004850 2023-10-19T08:39:29.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd1616c6700 1 --2- 172.21.15.79:0/1437735005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd148003a00 0x7fd148003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:29.767 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd161ec7700 1 --2- 172.21.15.79:0/1437735005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd148005210 0x7fd14800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:29.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd160ec5700 1 --2- 172.21.15.79:0/1437735005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd148004850 0x7fd148004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:29.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd1616c6700 1 -- 172.21.15.79:0/1437735005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd148004850 msgr2=0x7fd148004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:29.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd1616c6700 1 --2- 172.21.15.79:0/1437735005 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd148004850 0x7fd148004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd1616c6700 1 -- 172.21.15.79:0/1437735005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd148005210 msgr2=0x7fd14800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:29.768 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd1616c6700 1 --2- 172.21.15.79:0/1437735005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd148005210 0x7fd14800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd1616c6700 1 -- 172.21.15.79:0/1437735005 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1480035b0 con 0x7fd148003a00 2023-10-19T08:39:29.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd161ec7700 1 --2- 172.21.15.79:0/1437735005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd148005210 0x7fd14800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:29.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd161ec7700 1 -- 172.21.15.79:0/1437735005 reap_dead start 2023-10-19T08:39:29.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.756+0000 7fd1616c6700 1 --2- 172.21.15.79:0/1437735005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd148003a00 0x7fd148003e20 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00c240 tx=0x7fd148005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9717e334e62e32d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:29.769 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.757+0000 7fd153fff700 1 -- 172.21.15.79:0/1437735005 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c007db0 con 0x7fd148003a00 2023-10-19T08:39:29.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.757+0000 7fd153fff700 1 -- 172.21.15.79:0/1437735005 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c00cde0 con 0x7fd148003a00 2023-10-19T08:39:29.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.757+0000 7fd153fff700 1 -- 172.21.15.79:0/1437735005 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c005b80 con 0x7fd148003a00 2023-10-19T08:39:29.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.757+0000 7fd16392a700 1 -- 172.21.15.79:0/1437735005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd148003a00 msgr2=0x7fd148003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:29.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.757+0000 7fd16392a700 1 --2- 172.21.15.79:0/1437735005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd148003a00 0x7fd148003e20 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00c240 tx=0x7fd148005880 comp rx=0 tx=0).stop 2023-10-19T08:39:29.770 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.757+0000 7fd16392a700 1 -- 172.21.15.79:0/1437735005 shutdown_connections 2023-10-19T08:39:29.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.757+0000 7fd16392a700 1 --2- 172.21.15.79:0/1437735005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd148003a00 0x7fd148003e20 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.757+0000 7fd16392a700 1 -- 172.21.15.79:0/1437735005 >> 172.21.15.79:0/1437735005 conn(0x7fd15c06dcc0 msgr2=0x7fd15c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:29.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.757+0000 7fd16392a700 1 -- 172.21.15.79:0/1437735005 shutdown_connections 2023-10-19T08:39:29.771 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.757+0000 7fd16392a700 1 -- 172.21.15.79:0/1437735005 wait complete. 2023-10-19T08:39:29.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.759+0000 7fd16392a700 1 Processor -- start 2023-10-19T08:39:29.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.759+0000 7fd16392a700 1 -- start start 2023-10-19T08:39:29.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.760+0000 7fd16392a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd148003a00 0x7fd15c0c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:29.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.760+0000 7fd16392a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd15c0cb6a0 0x7fd15c0c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:29.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.760+0000 7fd16392a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd15c158f60 0x7fd15c1593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:29.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.760+0000 7fd16392a700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c0c7240 con 0x7fd148003a00 2023-10-19T08:39:29.775 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.760+0000 7fd16392a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c159920 con 0x7fd15c0cb6a0 2023-10-19T08:39:29.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.760+0000 7fd16392a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c0c74a0 con 0x7fd15c158f60 2023-10-19T08:39:29.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.760+0000 7fd1616c6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd148003a00 0x7fd15c0c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:29.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.760+0000 7fd1616c6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd148003a00 0x7fd15c0c6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48862/0 (socket says 172.21.15.79:48862) 2023-10-19T08:39:29.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.760+0000 7fd1616c6700 1 -- 172.21.15.79:0/2602436788 learned_addr learned my addr 172.21.15.79:0/2602436788 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:29.776 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.760+0000 7fd1616c6700 1 -- 172.21.15.79:0/2602436788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd15c158f60 msgr2=0x7fd15c1593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:29.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.760+0000 7fd1616c6700 1 --2- 172.21.15.79:0/2602436788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd15c158f60 0x7fd15c1593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.760+0000 7fd1616c6700 1 -- 172.21.15.79:0/2602436788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd15c0cb6a0 msgr2=0x7fd15c0c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:29.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.760+0000 7fd1616c6700 1 --2- 172.21.15.79:0/2602436788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd15c0cb6a0 0x7fd15c0c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.760+0000 7fd1616c6700 1 -- 172.21.15.79:0/2602436788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c0c7780 con 0x7fd148003a00 2023-10-19T08:39:29.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.760+0000 7fd1616c6700 1 --2- 172.21.15.79:0/2602436788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd148003a00 0x7fd15c0c6d00 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd14c000c00 tx=0x7fd14c001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:29.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.760+0000 7fd151ffb700 1 -- 172.21.15.79:0/2602436788 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c005ea0 con 0x7fd148003a00 2023-10-19T08:39:29.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.760+0000 7fd151ffb700 1 -- 172.21.15.79:0/2602436788 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c001110 con 0x7fd148003a00 2023-10-19T08:39:29.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.760+0000 7fd16392a700 1 -- 172.21.15.79:0/2602436788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd15c0aba60 con 0x7fd148003a00 2023-10-19T08:39:29.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.760+0000 7fd151ffb700 1 -- 172.21.15.79:0/2602436788 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0072d0 con 0x7fd148003a00 2023-10-19T08:39:29.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.761+0000 7fd16392a700 1 -- 172.21.15.79:0/2602436788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd15c0c9760 con 0x7fd148003a00 2023-10-19T08:39:29.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.762+0000 7fd16392a700 1 -- 172.21.15.79:0/2602436788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd15c04ee70 con 0x7fd148003a00 2023-10-19T08:39:29.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.763+0000 7fd151ffb700 1 -- 172.21.15.79:0/2602436788 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd14c007430 con 0x7fd148003a00 2023-10-19T08:39:29.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.763+0000 7fd151ffb700 1 --2- 172.21.15.79:0/2602436788 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd14006a0e0 0x7fd14006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:29.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.763+0000 7fd151ffb700 1 -- 172.21.15.79:0/2602436788 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd14c089ba0 con 0x7fd148003a00 2023-10-19T08:39:29.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.763+0000 7fd160ec5700 1 --2- 172.21.15.79:0/2602436788 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd14006a0e0 0x7fd14006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:29.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.763+0000 7fd160ec5700 1 --2- 172.21.15.79:0/2602436788 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd14006a0e0 0x7fd14006c5a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0c9c00 tx=0x7fd158009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:29.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.767+0000 7fd151ffb700 1 -- 172.21.15.79:0/2602436788 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd14c089e60 con 0x7fd148003a00 2023-10-19T08:39:29.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.959+0000 7fd16392a700 1 -- 172.21.15.79:0/2602436788 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd15c0cd550 con 0x7fd148003a00 2023-10-19T08:39:29.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.960+0000 7fd151ffb700 1 -- 172.21.15.79:0/2602436788 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+14784 (secure 0 0 0) 0x7fd15c0cd550 con 0x7fd148003a00 2023-10-19T08:39:29.965 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:29.965 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":35,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:39:26.668473+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:39:29.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.962+0000 7fd16392a700 1 -- 172.21.15.79:0/2602436788 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd14006a0e0 msgr2=0x7fd14006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:29.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.962+0000 7fd16392a700 1 --2- 172.21.15.79:0/2602436788 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd14006a0e0 0x7fd14006c5a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0c9c00 tx=0x7fd158009040 comp rx=0 tx=0).stop 2023-10-19T08:39:29.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.962+0000 7fd16392a700 1 -- 172.21.15.79:0/2602436788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd148003a00 msgr2=0x7fd15c0c6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:29.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.962+0000 7fd16392a700 1 --2- 172.21.15.79:0/2602436788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd148003a00 0x7fd15c0c6d00 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd14c000c00 tx=0x7fd14c001b90 comp rx=0 tx=0).stop 2023-10-19T08:39:29.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.962+0000 7fd16392a700 1 -- 172.21.15.79:0/2602436788 shutdown_connections 2023-10-19T08:39:29.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.962+0000 7fd16392a700 1 --2- 172.21.15.79:0/2602436788 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd14006a0e0 0x7fd14006c5a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.962+0000 7fd16392a700 1 --2- 172.21.15.79:0/2602436788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd15c158f60 0x7fd15c1593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.962+0000 7fd16392a700 1 --2- 172.21.15.79:0/2602436788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd148003a00 0x7fd15c0c6d00 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.962+0000 7fd16392a700 1 --2- 172.21.15.79:0/2602436788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd15c0cb6a0 0x7fd15c0c9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.962+0000 7fd16392a700 1 -- 172.21.15.79:0/2602436788 >> 172.21.15.79:0/2602436788 conn(0x7fd15c06dcc0 msgr2=0x7fd15c15c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.962+0000 7fd16392a700 1 -- 172.21.15.79:0/2602436788 shutdown_connections 2023-10-19T08:39:29.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:29.962+0000 7fd16392a700 1 -- 172.21.15.79:0/2602436788 wait complete. 2023-10-19T08:39:29.979 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-19T08:37:49.135900+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-19T08:37:49.907772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-19T08:39:29.979 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-19T08:39:30.107 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.099+0000 7f4742428700 1 Processor -- start 2023-10-19T08:39:30.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.099+0000 7f4742428700 1 -- start start 2023-10-19T08:39:30.108 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.100+0000 7f4742428700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f473c15e570 0x7f473c0d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:30.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.100+0000 7f4742428700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f473c0b0c00 0x7f473c0ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:30.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.100+0000 7f4742428700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473c0b25f0 con 0x7f473c0cb6f0 2023-10-19T08:39:30.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.100+0000 7f4742428700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473c0afd60 con 0x7f473c0b0c00 2023-10-19T08:39:30.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.100+0000 7f4742428700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473c0af810 con 0x7f473c15e570 2023-10-19T08:39:30.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.100+0000 7f47409c5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f473c0b0c00 0x7f473c0ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:30.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.100+0000 7f473bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f473c15e570 0x7f473c0d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:30.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.100+0000 7f47409c5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f473c0b0c00 0x7f473c0ad9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:35118/0 (socket says 172.21.15.79:35118) 2023-10-19T08:39:30.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.100+0000 7f473bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f473c15e570 0x7f473c0d1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:51494/0 (socket says 172.21.15.79:51494) 2023-10-19T08:39:30.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.100+0000 7f47409c5700 1 -- 172.21.15.79:0/3045100159 learned_addr learned my addr 172.21.15.79:0/3045100159 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:30.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.100+0000 7f473bfff700 1 -- 172.21.15.79:0/3045100159 >> v2:172.21.15.89:3300/0 conn(0x7f473c0b0c00 msgr2=0x7f473c0ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:30.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.100+0000 7f473bfff700 1 --2- 172.21.15.79:0/3045100159 >> v2:172.21.15.89:3300/0 conn(0x7f473c0b0c00 0x7f473c0ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.100+0000 7f473bfff700 1 -- 172.21.15.79:0/3045100159 >> v1:172.21.15.89:6789/0 conn(0x7f473c0cb6f0 legacy=0x7f473c0b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:30.112 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.100+0000 7f473bfff700 1 -- 172.21.15.79:0/3045100159 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c0aef70 con 0x7f473c15e570 2023-10-19T08:39:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.100+0000 7f47409c5700 1 --2- 172.21.15.79:0/3045100159 >> v2:172.21.15.89:3300/0 conn(0x7f473c0b0c00 0x7f473c0ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:39:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.100+0000 7f473bfff700 1 --2- 172.21.15.79:0/3045100159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f473c15e570 0x7f473c0d1990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4730009840 tx=0x7f4730009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e732bc97cb69bf server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.101+0000 7f473affd700 1 -- 172.21.15.79:0/3045100159 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4730011830 con 0x7f473c15e570 2023-10-19T08:39:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.101+0000 7f473affd700 1 -- 172.21.15.79:0/3045100159 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4730011990 con 0x7f473c15e570 2023-10-19T08:39:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.101+0000 7f473affd700 1 -- 172.21.15.79:0/3045100159 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4730011d20 con 0x7f473c15e570 2023-10-19T08:39:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.101+0000 7f4742428700 1 -- 172.21.15.79:0/3045100159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f473c15e570 msgr2=0x7f473c0d1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.101+0000 7f4742428700 1 --2- 172.21.15.79:0/3045100159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f473c15e570 0x7f473c0d1990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4730009840 tx=0x7f4730009b50 comp rx=0 tx=0).stop 2023-10-19T08:39:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.101+0000 7f4742428700 1 -- 172.21.15.79:0/3045100159 shutdown_connections 2023-10-19T08:39:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.101+0000 7f4742428700 1 --2- 172.21.15.79:0/3045100159 >> v2:172.21.15.89:3300/0 conn(0x7f473c0b0c00 0x7f473c0ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.101+0000 7f4742428700 1 --2- 172.21.15.79:0/3045100159 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f473c15e570 0x7f473c0d1990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.101+0000 7f4742428700 1 -- 172.21.15.79:0/3045100159 >> 172.21.15.79:0/3045100159 conn(0x7f473c09a0b0 msgr2=0x7f473c0d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:30.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.101+0000 7f4742428700 1 -- 172.21.15.79:0/3045100159 shutdown_connections 2023-10-19T08:39:30.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.101+0000 7f4742428700 1 -- 172.21.15.79:0/3045100159 wait complete. 2023-10-19T08:39:30.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.103+0000 7f4742428700 1 Processor -- start 2023-10-19T08:39:30.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.103+0000 7f4742428700 1 -- start start 2023-10-19T08:39:30.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.104+0000 7f4742428700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f473c0b0c00 0x7f473c0c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:30.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.104+0000 7f4742428700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f473c0cb6f0 0x7f473c1f3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:30.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.104+0000 7f4742428700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f473c15e570 0x7f473c154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:30.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.104+0000 7f4742428700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c1f3a90 con 0x7f473c15e570 2023-10-19T08:39:30.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.104+0000 7f4742428700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c0c9460 con 0x7f473c0cb6f0 2023-10-19T08:39:30.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.104+0000 7f4742428700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473c0c8ea0 con 0x7f473c0b0c00 2023-10-19T08:39:30.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.104+0000 7f47409c5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f473c15e570 0x7f473c154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:30.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.104+0000 7f47409c5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f473c15e570 0x7f473c154620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48878/0 (socket says 172.21.15.79:48878) 2023-10-19T08:39:30.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.104+0000 7f47409c5700 1 -- 172.21.15.79:0/908948390 learned_addr learned my addr 172.21.15.79:0/908948390 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:30.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.104+0000 7f473bfff700 1 --2- 172.21.15.79:0/908948390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f473c0b0c00 0x7f473c0c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:30.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.104+0000 7f473b7fe700 1 --2- 172.21.15.79:0/908948390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f473c0cb6f0 0x7f473c1f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:30.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.104+0000 7f47409c5700 1 -- 172.21.15.79:0/908948390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f473c0b0c00 msgr2=0x7f473c0c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:30.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.104+0000 7f47409c5700 1 --2- 172.21.15.79:0/908948390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f473c0b0c00 0x7f473c0c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.104+0000 7f47409c5700 1 -- 172.21.15.79:0/908948390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f473c0cb6f0 msgr2=0x7f473c1f3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:30.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.104+0000 7f47409c5700 1 --2- 172.21.15.79:0/908948390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f473c0cb6f0 0x7f473c1f3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.104+0000 7f47409c5700 1 -- 172.21.15.79:0/908948390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4734009b30 con 0x7f473c15e570 2023-10-19T08:39:30.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.104+0000 7f473b7fe700 1 --2- 172.21.15.79:0/908948390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f473c0cb6f0 0x7f473c1f3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:30.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.104+0000 7f47409c5700 1 --2- 172.21.15.79:0/908948390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f473c15e570 0x7f473c154620 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f473400ef90 tx=0x7f473400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:30.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.105+0000 7f4738ff9700 1 -- 172.21.15.79:0/908948390 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734018070 con 0x7f473c15e570 2023-10-19T08:39:30.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.105+0000 7f4738ff9700 1 -- 172.21.15.79:0/908948390 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473400f040 con 0x7f473c15e570 2023-10-19T08:39:30.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.105+0000 7f4738ff9700 1 -- 172.21.15.79:0/908948390 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734003c60 con 0x7f473c15e570 2023-10-19T08:39:30.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.105+0000 7f4742428700 1 -- 172.21.15.79:0/908948390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47300094a0 con 0x7f473c15e570 2023-10-19T08:39:30.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.105+0000 7f4742428700 1 -- 172.21.15.79:0/908948390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473c06ef20 con 0x7f473c15e570 2023-10-19T08:39:30.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.106+0000 7f4742428700 1 -- 172.21.15.79:0/908948390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473c04ee70 con 0x7f473c15e570 2023-10-19T08:39:30.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.106+0000 7f4738ff9700 1 -- 172.21.15.79:0/908948390 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f473400c930 con 0x7f473c15e570 2023-10-19T08:39:30.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.106+0000 7f4738ff9700 1 --2- 172.21.15.79:0/908948390 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f472806a0e0 0x7f472806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:30.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.106+0000 7f4738ff9700 1 -- 172.21.15.79:0/908948390 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f47340884b0 con 0x7f473c15e570 2023-10-19T08:39:30.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.106+0000 7f473bfff700 1 --2- 172.21.15.79:0/908948390 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f472806a0e0 0x7f472806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:30.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.107+0000 7f473bfff700 1 --2- 172.21.15.79:0/908948390 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f472806a0e0 0x7f472806c5a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4730000c00 tx=0x7f473001c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:30.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.111+0000 7f4738ff9700 1 -- 172.21.15.79:0/908948390 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f4734053e40 con 0x7f473c15e570 2023-10-19T08:39:30.303 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.299+0000 7f4742428700 1 -- 172.21.15.79:0/908948390 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f473c0cdf90 con 0x7f473c15e570 2023-10-19T08:39:30.304 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.299+0000 7f4738ff9700 1 -- 172.21.15.79:0/908948390 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4734057460 con 0x7f473c15e570 2023-10-19T08:39:30.304 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 1 2023-10-19T08:39:30.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.301+0000 7f4742428700 1 -- 172.21.15.79:0/908948390 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f472806a0e0 msgr2=0x7f472806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:30.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.301+0000 7f4742428700 1 --2- 172.21.15.79:0/908948390 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f472806a0e0 0x7f472806c5a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4730000c00 tx=0x7f473001c040 comp rx=0 tx=0).stop 2023-10-19T08:39:30.306 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.301+0000 7f4742428700 1 -- 172.21.15.79:0/908948390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f473c15e570 msgr2=0x7f473c154620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:30.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.301+0000 7f4742428700 1 --2- 172.21.15.79:0/908948390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f473c15e570 0x7f473c154620 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f473400ef90 tx=0x7f473400c3a0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.301+0000 7f4742428700 1 -- 172.21.15.79:0/908948390 shutdown_connections 2023-10-19T08:39:30.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.301+0000 7f4742428700 1 --2- 172.21.15.79:0/908948390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f473c15e570 0x7f473c154620 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.301+0000 7f4742428700 1 --2- 172.21.15.79:0/908948390 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f472806a0e0 0x7f472806c5a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.307 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.301+0000 7f4742428700 1 --2- 172.21.15.79:0/908948390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f473c0b0c00 0x7f473c0c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.301+0000 7f4742428700 1 --2- 172.21.15.79:0/908948390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f473c0cb6f0 0x7f473c1f3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.301+0000 7f4742428700 1 -- 172.21.15.79:0/908948390 >> 172.21.15.79:0/908948390 conn(0x7f473c09a0b0 msgr2=0x7f473c070740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:30.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.301+0000 7f4742428700 1 -- 172.21.15.79:0/908948390 shutdown_connections 2023-10-19T08:39:30.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.301+0000 7f4742428700 1 -- 172.21.15.79:0/908948390 wait complete. 2023-10-19T08:39:30.317 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-19T08:39:30.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.436+0000 7f29556e6700 1 Processor -- start 2023-10-19T08:39:30.441 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.436+0000 7f29556e6700 1 -- start start 2023-10-19T08:39:30.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.437+0000 7f29556e6700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f29500b2180 0x7f29500d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:30.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.437+0000 7f29556e6700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29500d1120 con 0x7f29500cfcf0 2023-10-19T08:39:30.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.437+0000 7f29556e6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29500d1400 con 0x7f29500b5f20 2023-10-19T08:39:30.443 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.437+0000 7f29556e6700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29500d16e0 con 0x7f29500b2180 2023-10-19T08:39:30.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.437+0000 7f294e7fc700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f29500b2180 0x7f29500d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:30.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.437+0000 7f294effd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f29500cfcf0 0x7f29500d00d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58954/0 (socket says 172.21.15.79:58954) 2023-10-19T08:39:30.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.437+0000 7f294effd700 1 -- 172.21.15.79:0/2103772763 learned_addr learned my addr 172.21.15.79:0/2103772763 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:30.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.438+0000 7f294e7fc700 1 -- 172.21.15.79:0/2103772763 >> v1:172.21.15.89:6789/0 conn(0x7f29500b5f20 legacy=0x7f29500b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:30.444 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.438+0000 7f294e7fc700 1 -- 172.21.15.79:0/2103772763 >> v1:172.21.15.79:6789/0 conn(0x7f29500cfcf0 legacy=0x7f29500d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:30.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.438+0000 7f294e7fc700 1 -- 172.21.15.79:0/2103772763 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29500d19c0 con 0x7f29500b2180 2023-10-19T08:39:30.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.438+0000 7f294e7fc700 1 --2- 172.21.15.79:0/2103772763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29500b2180 0x7f29500d2410 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2940009840 tx=0x7f2940009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6316a1f5396cddb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:30.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.438+0000 7f294dffb700 1 -- 172.21.15.79:0/2103772763 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940004230 con 0x7f29500b2180 2023-10-19T08:39:30.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.438+0000 7f294dffb700 1 -- 172.21.15.79:0/2103772763 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2940004390 con 0x7f29500b2180 2023-10-19T08:39:30.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.438+0000 7f294dffb700 1 -- 172.21.15.79:0/2103772763 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29400036a0 con 0x7f29500b2180 2023-10-19T08:39:30.445 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.438+0000 7f29556e6700 1 -- 172.21.15.79:0/2103772763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29500b2180 msgr2=0x7f29500d2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:30.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.438+0000 7f29556e6700 1 --2- 172.21.15.79:0/2103772763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29500b2180 0x7f29500d2410 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2940009840 tx=0x7f2940009b50 comp rx=0 tx=0).stop 2023-10-19T08:39:30.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.438+0000 7f29556e6700 1 -- 172.21.15.79:0/2103772763 shutdown_connections 2023-10-19T08:39:30.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.438+0000 7f29556e6700 1 --2- 172.21.15.79:0/2103772763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29500b2180 0x7f29500d2410 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.438+0000 7f29556e6700 1 -- 172.21.15.79:0/2103772763 >> 172.21.15.79:0/2103772763 conn(0x7f2950071b30 msgr2=0x7f2950071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:30.446 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.438+0000 7f29556e6700 1 -- 172.21.15.79:0/2103772763 shutdown_connections 2023-10-19T08:39:30.447 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.438+0000 7f29556e6700 1 -- 172.21.15.79:0/2103772763 wait complete. 2023-10-19T08:39:30.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.440+0000 7f29556e6700 1 Processor -- start 2023-10-19T08:39:30.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.440+0000 7f29556e6700 1 -- start start 2023-10-19T08:39:30.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.440+0000 7f29556e6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29500b2180 0x7f2950159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:30.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.440+0000 7f29556e6700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29500b5f20 0x7f29500aa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:30.450 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.440+0000 7f29556e6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29500cfcf0 0x7f295015f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:30.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.440+0000 7f29556e6700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29501f49d0 con 0x7f29500b5f20 2023-10-19T08:39:30.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.440+0000 7f29556e6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29501597a0 con 0x7f29500b2180 2023-10-19T08:39:30.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.440+0000 7f29556e6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29501f3d50 con 0x7f29500cfcf0 2023-10-19T08:39:30.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.441+0000 7f294e7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29500b5f20 0x7f29500aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:30.451 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.441+0000 7f294e7fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29500b5f20 0x7f29500aa330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48890/0 (socket says 172.21.15.79:48890) 2023-10-19T08:39:30.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.441+0000 7f294e7fc700 1 -- 172.21.15.79:0/263094712 learned_addr learned my addr 172.21.15.79:0/263094712 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:30.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.441+0000 7f294effd700 1 --2- 172.21.15.79:0/263094712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29500b2180 0x7f2950159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:30.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.441+0000 7f294f7fe700 1 --2- 172.21.15.79:0/263094712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29500cfcf0 0x7f295015f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:30.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.441+0000 7f294e7fc700 1 -- 172.21.15.79:0/263094712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29500cfcf0 msgr2=0x7f295015f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:30.452 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.441+0000 7f294e7fc700 1 --2- 172.21.15.79:0/263094712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29500cfcf0 0x7f295015f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.441+0000 7f294e7fc700 1 -- 172.21.15.79:0/263094712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29500b2180 msgr2=0x7f2950159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:30.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.441+0000 7f294e7fc700 1 --2- 172.21.15.79:0/263094712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29500b2180 0x7f2950159260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.441+0000 7f294e7fc700 1 -- 172.21.15.79:0/263094712 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29400094a0 con 0x7f29500b5f20 2023-10-19T08:39:30.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.441+0000 7f294e7fc700 1 --2- 172.21.15.79:0/263094712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29500b5f20 0x7f29500aa330 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f29400090b0 tx=0x7f2940004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:30.453 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.441+0000 7f29377fe700 1 -- 172.21.15.79:0/263094712 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940003ea0 con 0x7f29500b5f20 2023-10-19T08:39:30.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.441+0000 7f29377fe700 1 -- 172.21.15.79:0/263094712 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294001e070 con 0x7f29500b5f20 2023-10-19T08:39:30.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.441+0000 7f29556e6700 1 -- 172.21.15.79:0/263094712 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29501f4030 con 0x7f29500b5f20 2023-10-19T08:39:30.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.441+0000 7f29377fe700 1 -- 172.21.15.79:0/263094712 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940011850 con 0x7f29500b5f20 2023-10-19T08:39:30.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.441+0000 7f29556e6700 1 -- 172.21.15.79:0/263094712 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29501f45f0 con 0x7f29500b5f20 2023-10-19T08:39:30.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.442+0000 7f29556e6700 1 -- 172.21.15.79:0/263094712 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29501f4b10 con 0x7f29500b5f20 2023-10-19T08:39:30.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.443+0000 7f29377fe700 1 -- 172.21.15.79:0/263094712 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f29400119b0 con 0x7f29500b5f20 2023-10-19T08:39:30.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.443+0000 7f29377fe700 1 --2- 172.21.15.79:0/263094712 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f293c06a0e0 0x7f293c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:30.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.443+0000 7f29377fe700 1 -- 172.21.15.79:0/263094712 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f29400895b0 con 0x7f29500b5f20 2023-10-19T08:39:30.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.443+0000 7f294effd700 1 --2- 172.21.15.79:0/263094712 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f293c06a0e0 0x7f293c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:30.455 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.444+0000 7f294effd700 1 --2- 172.21.15.79:0/263094712 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f293c06a0e0 0x7f293c06c5a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f29500ccc70 tx=0x7f2944007f10 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:30.456 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.448+0000 7f29377fe700 1 -- 172.21.15.79:0/263094712 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f29501f4b10 con 0x7f29500b5f20 2023-10-19T08:39:30.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.634+0000 7f29556e6700 1 -- 172.21.15.79:0/263094712 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f29501f4b10 con 0x7f29500b5f20 2023-10-19T08:39:30.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.635+0000 7f29377fe700 1 -- 172.21.15.79:0/263094712 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v35) v1 ==== 92+0+10 (secure 0 0 0) 0x7f29501f4b10 con 0x7f29500b5f20 2023-10-19T08:39:30.640 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2023-10-19T08:39:30.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.637+0000 7f29556e6700 1 -- 172.21.15.79:0/263094712 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f293c06a0e0 msgr2=0x7f293c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:30.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.637+0000 7f29556e6700 1 --2- 172.21.15.79:0/263094712 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f293c06a0e0 0x7f293c06c5a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f29500ccc70 tx=0x7f2944007f10 comp rx=0 tx=0).stop 2023-10-19T08:39:30.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.637+0000 7f29556e6700 1 -- 172.21.15.79:0/263094712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29500b5f20 msgr2=0x7f29500aa330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:30.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.637+0000 7f29556e6700 1 --2- 172.21.15.79:0/263094712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29500b5f20 0x7f29500aa330 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f29400090b0 tx=0x7f2940004750 comp rx=0 tx=0).stop 2023-10-19T08:39:30.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.637+0000 7f29556e6700 1 -- 172.21.15.79:0/263094712 shutdown_connections 2023-10-19T08:39:30.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.637+0000 7f29556e6700 1 --2- 172.21.15.79:0/263094712 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f293c06a0e0 0x7f293c06c5a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.637+0000 7f29556e6700 1 --2- 172.21.15.79:0/263094712 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29500cfcf0 0x7f295015f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.637+0000 7f29556e6700 1 --2- 172.21.15.79:0/263094712 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29500b2180 0x7f2950159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.637+0000 7f29556e6700 1 --2- 172.21.15.79:0/263094712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29500b5f20 0x7f29500aa330 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.637+0000 7f29556e6700 1 -- 172.21.15.79:0/263094712 >> 172.21.15.79:0/263094712 conn(0x7f2950071b30 msgr2=0x7f29500d2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:30.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.637+0000 7f29556e6700 1 -- 172.21.15.79:0/263094712 shutdown_connections 2023-10-19T08:39:30.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.637+0000 7f29556e6700 1 -- 172.21.15.79:0/263094712 wait complete. 2023-10-19T08:39:30.653 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-19T08:39:30.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.769+0000 7f625a6fd700 1 Processor -- start 2023-10-19T08:39:30.774 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.769+0000 7f625a6fd700 1 -- start start 2023-10-19T08:39:30.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.770+0000 7f625a6fd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f62540b5610 0x7f62540cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:30.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.770+0000 7f625a6fd700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62540b5aa0 con 0x7f62540ce5c0 2023-10-19T08:39:30.777 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.770+0000 7f625a6fd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62540cd800 con 0x7f6254159f40 2023-10-19T08:39:30.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.770+0000 7f625a6fd700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62540cdae0 con 0x7f62540b5610 2023-10-19T08:39:30.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.770+0000 7f62537fe700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f62540b5610 0x7f62540cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:30.778 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.770+0000 7f6258c9a700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f62540ce5c0 0x7f62540cb860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58972/0 (socket says 172.21.15.79:58972) 2023-10-19T08:39:30.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.770+0000 7f6258c9a700 1 -- 172.21.15.79:0/772663414 learned_addr learned my addr 172.21.15.79:0/772663414 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:30.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.770+0000 7f62537fe700 1 -- 172.21.15.79:0/772663414 >> v1:172.21.15.89:6789/0 conn(0x7f6254159f40 legacy=0x7f625415e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:30.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.770+0000 7f62537fe700 1 -- 172.21.15.79:0/772663414 >> v1:172.21.15.79:6789/0 conn(0x7f62540ce5c0 legacy=0x7f62540cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:30.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.770+0000 7f62537fe700 1 -- 172.21.15.79:0/772663414 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62540cddc0 con 0x7f62540b5610 2023-10-19T08:39:30.779 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.770+0000 7f6252ffd700 1 -- 172.21.15.79:0/772663414 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2386009419 0 0) 0x7f62540b5aa0 con 0x7f62540ce5c0 2023-10-19T08:39:30.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.771+0000 7f62537fe700 1 --2- 172.21.15.79:0/772663414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62540b5610 0x7f62540cf000 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6244009840 tx=0x7f6244009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fdf366aaf604757 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:30.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.771+0000 7f6252ffd700 1 -- 172.21.15.79:0/772663414 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6244004230 con 0x7f62540b5610 2023-10-19T08:39:30.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.771+0000 7f6252ffd700 1 -- 172.21.15.79:0/772663414 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6244004390 con 0x7f62540b5610 2023-10-19T08:39:30.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.771+0000 7f6252ffd700 1 -- 172.21.15.79:0/772663414 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62440036a0 con 0x7f62540b5610 2023-10-19T08:39:30.780 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.771+0000 7f625a6fd700 1 -- 172.21.15.79:0/772663414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62540b5610 msgr2=0x7f62540cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:30.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.771+0000 7f625a6fd700 1 --2- 172.21.15.79:0/772663414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62540b5610 0x7f62540cf000 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6244009840 tx=0x7f6244009b50 comp rx=0 tx=0).stop 2023-10-19T08:39:30.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.771+0000 7f625a6fd700 1 -- 172.21.15.79:0/772663414 shutdown_connections 2023-10-19T08:39:30.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.771+0000 7f625a6fd700 1 --2- 172.21.15.79:0/772663414 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62540b5610 0x7f62540cf000 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.771+0000 7f625a6fd700 1 -- 172.21.15.79:0/772663414 >> 172.21.15.79:0/772663414 conn(0x7f625406dcc0 msgr2=0x7f625406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:30.781 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.771+0000 7f625a6fd700 1 -- 172.21.15.79:0/772663414 shutdown_connections 2023-10-19T08:39:30.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.771+0000 7f625a6fd700 1 -- 172.21.15.79:0/772663414 wait complete. 2023-10-19T08:39:30.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.772+0000 7f625a6fd700 1 Processor -- start 2023-10-19T08:39:30.782 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.773+0000 7f625a6fd700 1 -- start start 2023-10-19T08:39:30.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.773+0000 7f625a6fd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62540ce5c0 0x7f62540cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:30.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.773+0000 7f625a6fd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6254159f40 0x7f62541e4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:30.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.773+0000 7f625a6fd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62541e4c50 0x7f6254153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:30.785 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.773+0000 7f625a6fd700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62540c8bb0 con 0x7f62541e4c50 2023-10-19T08:39:30.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.773+0000 7f625a6fd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62541e5140 con 0x7f6254159f40 2023-10-19T08:39:30.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.773+0000 7f625a6fd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62540c8210 con 0x7f62540ce5c0 2023-10-19T08:39:30.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.773+0000 7f6258c9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62541e4c50 0x7f6254153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:30.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.773+0000 7f6258c9a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62541e4c50 0x7f6254153ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48906/0 (socket says 172.21.15.79:48906) 2023-10-19T08:39:30.786 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.773+0000 7f6258c9a700 1 -- 172.21.15.79:0/655647886 learned_addr learned my addr 172.21.15.79:0/655647886 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:30.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.774+0000 7f62537fe700 1 --2- 172.21.15.79:0/655647886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6254159f40 0x7f62541e4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:30.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.774+0000 7f6253fff700 1 --2- 172.21.15.79:0/655647886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62540ce5c0 0x7f62540cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:30.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.774+0000 7f6258c9a700 1 -- 172.21.15.79:0/655647886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62540ce5c0 msgr2=0x7f62540cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:30.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.774+0000 7f6258c9a700 1 --2- 172.21.15.79:0/655647886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62540ce5c0 0x7f62540cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.787 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.774+0000 7f6258c9a700 1 -- 172.21.15.79:0/655647886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6254159f40 msgr2=0x7f62541e4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:30.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.774+0000 7f6258c9a700 1 --2- 172.21.15.79:0/655647886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6254159f40 0x7f62541e4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.774+0000 7f6258c9a700 1 -- 172.21.15.79:0/655647886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62440094a0 con 0x7f62541e4c50 2023-10-19T08:39:30.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.774+0000 7f6253fff700 1 --2- 172.21.15.79:0/655647886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62540ce5c0 0x7f62540cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:30.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.774+0000 7f62537fe700 1 --2- 172.21.15.79:0/655647886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6254159f40 0x7f62541e4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:30.788 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.774+0000 7f6258c9a700 1 --2- 172.21.15.79:0/655647886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62541e4c50 0x7f6254153ce0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f624c00cc10 tx=0x7f624c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:30.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.774+0000 7f6250ff9700 1 -- 172.21.15.79:0/655647886 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c00abb0 con 0x7f62541e4c50 2023-10-19T08:39:30.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.774+0000 7f6250ff9700 1 -- 172.21.15.79:0/655647886 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c00ad10 con 0x7f62541e4c50 2023-10-19T08:39:30.789 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.774+0000 7f625a6fd700 1 -- 172.21.15.79:0/655647886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62540c84f0 con 0x7f62541e4c50 2023-10-19T08:39:30.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.774+0000 7f6250ff9700 1 -- 172.21.15.79:0/655647886 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c007310 con 0x7f62541e4c50 2023-10-19T08:39:30.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.774+0000 7f625a6fd700 1 -- 172.21.15.79:0/655647886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62541e3ee0 con 0x7f62541e4c50 2023-10-19T08:39:30.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.775+0000 7f625a6fd700 1 -- 172.21.15.79:0/655647886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62540c8cf0 con 0x7f62541e4c50 2023-10-19T08:39:30.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.776+0000 7f6250ff9700 1 -- 172.21.15.79:0/655647886 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f624c007470 con 0x7f62541e4c50 2023-10-19T08:39:30.790 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.776+0000 7f6250ff9700 1 --2- 172.21.15.79:0/655647886 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f624006a0e0 0x7f624006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:30.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.776+0000 7f6253fff700 1 --2- 172.21.15.79:0/655647886 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f624006a0e0 0x7f624006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:30.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.776+0000 7f6250ff9700 1 -- 172.21.15.79:0/655647886 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f624c088190 con 0x7f62541e4c50 2023-10-19T08:39:30.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.777+0000 7f6253fff700 1 --2- 172.21.15.79:0/655647886 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f624006a0e0 0x7f624006c5a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6248006fd0 tx=0x7f6248008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:30.791 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.781+0000 7f6250ff9700 1 -- 172.21.15.79:0/655647886 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f62540c8cf0 con 0x7f62541e4c50 2023-10-19T08:39:30.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.974+0000 7f625a6fd700 1 -- 172.21.15.79:0/655647886 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f62540c8cf0 con 0x7f62541e4c50 2023-10-19T08:39:30.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.975+0000 7f6250ff9700 1 -- 172.21.15.79:0/655647886 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+126 (secure 0 0 0) 0x7f62540c8cf0 con 0x7f62541e4c50 2023-10-19T08:39:30.980 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:30.980 INFO:teuthology.orchestra.run.smithi079.stdout:[ 2023-10-19T08:39:30.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:30.981 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 1, 2023-10-19T08:39:30.981 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": ".mgr" 2023-10-19T08:39:30.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:30.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2023-10-19T08:39:30.982 INFO:teuthology.orchestra.run.smithi079.stdout: "poolnum": 2, 2023-10-19T08:39:30.983 INFO:teuthology.orchestra.run.smithi079.stdout: "poolname": "rbd" 2023-10-19T08:39:30.983 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:30.983 INFO:teuthology.orchestra.run.smithi079.stdout:] 2023-10-19T08:39:30.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.977+0000 7f625a6fd700 1 -- 172.21.15.79:0/655647886 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f624006a0e0 msgr2=0x7f624006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:30.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.977+0000 7f625a6fd700 1 --2- 172.21.15.79:0/655647886 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f624006a0e0 0x7f624006c5a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6248006fd0 tx=0x7f6248008040 comp rx=0 tx=0).stop 2023-10-19T08:39:30.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.977+0000 7f625a6fd700 1 -- 172.21.15.79:0/655647886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62541e4c50 msgr2=0x7f6254153ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:30.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.977+0000 7f625a6fd700 1 --2- 172.21.15.79:0/655647886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62541e4c50 0x7f6254153ce0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f624c00cc10 tx=0x7f624c00a060 comp rx=0 tx=0).stop 2023-10-19T08:39:30.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.977+0000 7f625a6fd700 1 -- 172.21.15.79:0/655647886 shutdown_connections 2023-10-19T08:39:30.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.977+0000 7f625a6fd700 1 --2- 172.21.15.79:0/655647886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62541e4c50 0x7f6254153ce0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.977+0000 7f625a6fd700 1 --2- 172.21.15.79:0/655647886 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f624006a0e0 0x7f624006c5a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.977+0000 7f625a6fd700 1 --2- 172.21.15.79:0/655647886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62540ce5c0 0x7f62540cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.977+0000 7f625a6fd700 1 --2- 172.21.15.79:0/655647886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6254159f40 0x7f62541e4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:30.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.977+0000 7f625a6fd700 1 -- 172.21.15.79:0/655647886 >> 172.21.15.79:0/655647886 conn(0x7f625406dcc0 msgr2=0x7f625415c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:30.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.977+0000 7f625a6fd700 1 -- 172.21.15.79:0/655647886 shutdown_connections 2023-10-19T08:39:30.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:30.977+0000 7f625a6fd700 1 -- 172.21.15.79:0/655647886 wait complete. 2023-10-19T08:39:30.993 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-19T08:39:30.994 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-19T08:39:31.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.113+0000 7f003dce4700 1 Processor -- start 2023-10-19T08:39:31.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.113+0000 7f003dce4700 1 -- start start 2023-10-19T08:39:31.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.114+0000 7f003dce4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f00380cea00 0x7f003806faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:31.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.114+0000 7f003dce4700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003806af60 con 0x7f003806ab80 2023-10-19T08:39:31.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.114+0000 7f003dce4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003815d9c0 con 0x7f00380cc340 2023-10-19T08:39:31.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.114+0000 7f003dce4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f003815dca0 con 0x7f00380cea00 2023-10-19T08:39:31.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.114+0000 7f00377fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f003806ab80 0x7f00380b1f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:58982/0 (socket says 172.21.15.79:58982) 2023-10-19T08:39:31.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.114+0000 7f00377fe700 1 -- 172.21.15.79:0/3773194486 learned_addr learned my addr 172.21.15.79:0/3773194486 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:31.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f00367fc700 1 -- 172.21.15.79:0/3773194486 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693821559 0 0) 0x7f002c001110 con 0x7f003806ab80 2023-10-19T08:39:31.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f00367fc700 1 -- 172.21.15.79:0/3773194486 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00200035b0 con 0x7f003806ab80 2023-10-19T08:39:31.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f0037fff700 1 --2- 172.21.15.79:0/3773194486 >> v2:172.21.15.89:3300/0 conn(0x7f00380cea00 0x7f003806faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:31.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f00367fc700 1 -- 172.21.15.79:0/3773194486 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1158321086 0 0) 0x7f00200035b0 con 0x7f003806ab80 2023-10-19T08:39:31.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f00367fc700 1 -- 172.21.15.79:0/3773194486 >> v2:172.21.15.89:3300/0 conn(0x7f00380cea00 msgr2=0x7f003806faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:31.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f00367fc700 1 --2- 172.21.15.79:0/3773194486 >> v2:172.21.15.89:3300/0 conn(0x7f00380cea00 0x7f003806faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:31.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f00367fc700 1 -- 172.21.15.79:0/3773194486 >> v1:172.21.15.89:6789/0 conn(0x7f00380cc340 legacy=0x7f00380ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:31.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f00367fc700 1 -- 172.21.15.79:0/3773194486 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003815df80 con 0x7f003806ab80 2023-10-19T08:39:31.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f00367fc700 1 -- 172.21.15.79:0/3773194486 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f002c001800 con 0x7f003806ab80 2023-10-19T08:39:31.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f00367fc700 1 -- 172.21.15.79:0/3773194486 >> v1:172.21.15.79:6789/0 conn(0x7f003806ab80 legacy=0x7f00380b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:31.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f00367fc700 1 --2- 172.21.15.79:0/3773194486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0020003a70 0x7f0020003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:31.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f00367fc700 1 --2- 172.21.15.79:0/3773194486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0020004850 0x7f0020004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:31.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f00367fc700 1 --2- 172.21.15.79:0/3773194486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0020005330 0x7f002000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:31.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f00367fc700 1 -- 172.21.15.79:0/3773194486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003815dca0 con 0x7f0020005330 2023-10-19T08:39:31.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f00367fc700 1 -- 172.21.15.79:0/3773194486 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002000c280 con 0x7f0020003a70 2023-10-19T08:39:31.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f00367fc700 1 -- 172.21.15.79:0/3773194486 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002000c440 con 0x7f0020004850 2023-10-19T08:39:31.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f0037fff700 1 --2- 172.21.15.79:0/3773194486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0020005330 0x7f002000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:31.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f00377fe700 1 --2- 172.21.15.79:0/3773194486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0020003a70 0x7f0020003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:31.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f0036ffd700 1 --2- 172.21.15.79:0/3773194486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0020004850 0x7f0020004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:31.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f0037fff700 1 -- 172.21.15.79:0/3773194486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0020004850 msgr2=0x7f0020004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:31.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f0037fff700 1 --2- 172.21.15.79:0/3773194486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0020004850 0x7f0020004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:31.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f0037fff700 1 -- 172.21.15.79:0/3773194486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0020003a70 msgr2=0x7f0020003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:31.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f0037fff700 1 --2- 172.21.15.79:0/3773194486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0020003a70 0x7f0020003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:31.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.115+0000 7f0037fff700 1 -- 172.21.15.79:0/3773194486 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00200035b0 con 0x7f0020005330 2023-10-19T08:39:31.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.116+0000 7f0037fff700 1 -- 172.21.15.79:0/3773194486 reap_dead start 2023-10-19T08:39:31.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.116+0000 7f0037fff700 1 --2- 172.21.15.79:0/3773194486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0020005330 0x7f002000ba10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f00380ca410 tx=0x7f0020005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358aae48714634ad server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:31.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.116+0000 7f00367fc700 1 -- 172.21.15.79:0/3773194486 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0030007e20 con 0x7f0020005330 2023-10-19T08:39:31.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.116+0000 7f00367fc700 1 -- 172.21.15.79:0/3773194486 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0030003a20 con 0x7f0020005330 2023-10-19T08:39:31.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.116+0000 7f00367fc700 1 -- 172.21.15.79:0/3773194486 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0030003dd0 con 0x7f0020005330 2023-10-19T08:39:31.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.116+0000 7f003dce4700 1 -- 172.21.15.79:0/3773194486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0020005330 msgr2=0x7f002000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:31.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.116+0000 7f003dce4700 1 --2- 172.21.15.79:0/3773194486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0020005330 0x7f002000ba10 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f00380ca410 tx=0x7f0020005880 comp rx=0 tx=0).stop 2023-10-19T08:39:31.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.116+0000 7f003dce4700 1 -- 172.21.15.79:0/3773194486 shutdown_connections 2023-10-19T08:39:31.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.116+0000 7f003dce4700 1 --2- 172.21.15.79:0/3773194486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0020005330 0x7f002000ba10 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:31.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.116+0000 7f003dce4700 1 -- 172.21.15.79:0/3773194486 >> 172.21.15.79:0/3773194486 conn(0x7f003806dd90 msgr2=0x7f003806e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:31.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.116+0000 7f003dce4700 1 -- 172.21.15.79:0/3773194486 shutdown_connections 2023-10-19T08:39:31.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.116+0000 7f003dce4700 1 -- 172.21.15.79:0/3773194486 wait complete. 2023-10-19T08:39:31.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.118+0000 7f003dce4700 1 Processor -- start 2023-10-19T08:39:31.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.118+0000 7f003dce4700 1 -- start start 2023-10-19T08:39:31.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.118+0000 7f003dce4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0020005330 0x7f00380c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:31.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.118+0000 7f003dce4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00381f3910 0x7f0038153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:31.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f003dce4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0038153e40 0x7f003815bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:31.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f003dce4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00380c78e0 con 0x7f0038153e40 2023-10-19T08:39:31.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f003dce4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00380c90f0 con 0x7f0020005330 2023-10-19T08:39:31.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f003dce4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00380b4900 con 0x7f00381f3910 2023-10-19T08:39:31.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f0037fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0038153e40 0x7f003815bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:31.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f0037fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0038153e40 0x7f003815bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48926/0 (socket says 172.21.15.79:48926) 2023-10-19T08:39:31.134 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f0037fff700 1 -- 172.21.15.79:0/3838288032 learned_addr learned my addr 172.21.15.79:0/3838288032 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:31.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f00377fe700 1 --2- 172.21.15.79:0/3838288032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0020005330 0x7f00380c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:31.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f0036ffd700 1 --2- 172.21.15.79:0/3838288032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00381f3910 0x7f0038153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:31.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f0037fff700 1 -- 172.21.15.79:0/3838288032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00381f3910 msgr2=0x7f0038153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:31.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f0037fff700 1 --2- 172.21.15.79:0/3838288032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00381f3910 0x7f0038153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:31.135 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f0037fff700 1 -- 172.21.15.79:0/3838288032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0020005330 msgr2=0x7f00380c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:31.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f0037fff700 1 --2- 172.21.15.79:0/3838288032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0020005330 0x7f00380c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:31.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f0037fff700 1 -- 172.21.15.79:0/3838288032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00380c6f80 con 0x7f0038153e40 2023-10-19T08:39:31.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f0037fff700 1 --2- 172.21.15.79:0/3838288032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0038153e40 0x7f003815bf00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f00380cbfe0 tx=0x7f0030004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:31.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f001ffff700 1 -- 172.21.15.79:0/3838288032 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0030009410 con 0x7f0038153e40 2023-10-19T08:39:31.136 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f001ffff700 1 -- 172.21.15.79:0/3838288032 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0030020470 con 0x7f0038153e40 2023-10-19T08:39:31.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f003dce4700 1 -- 172.21.15.79:0/3838288032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00380c7d00 con 0x7f0038153e40 2023-10-19T08:39:31.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f001ffff700 1 -- 172.21.15.79:0/3838288032 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0030020820 con 0x7f0038153e40 2023-10-19T08:39:31.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.119+0000 7f003dce4700 1 -- 172.21.15.79:0/3838288032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00380c7500 con 0x7f0038153e40 2023-10-19T08:39:31.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.120+0000 7f003dce4700 1 -- 172.21.15.79:0/3838288032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00380c7a20 con 0x7f0038153e40 2023-10-19T08:39:31.137 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.121+0000 7f001ffff700 1 -- 172.21.15.79:0/3838288032 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0030020980 con 0x7f0038153e40 2023-10-19T08:39:31.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.121+0000 7f001ffff700 1 --2- 172.21.15.79:0/3838288032 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f002406a0e0 0x7f002406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:31.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.121+0000 7f001ffff700 1 -- 172.21.15.79:0/3838288032 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f003008a3b0 con 0x7f0038153e40 2023-10-19T08:39:31.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.121+0000 7f00377fe700 1 --2- 172.21.15.79:0/3838288032 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f002406a0e0 0x7f002406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:31.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.121+0000 7f00377fe700 1 --2- 172.21.15.79:0/3838288032 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f002406a0e0 0x7f002406c5a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f002c000c00 tx=0x7f002c009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:31.138 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.125+0000 7f001ffff700 1 -- 172.21.15.79:0/3838288032 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f00380c7a20 con 0x7f0038153e40 2023-10-19T08:39:31.170 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-19T08:39:31.173 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-19T08:39:31.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.324+0000 7f003dce4700 1 -- 172.21.15.79:0/3838288032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f00380c7a20 con 0x7f0038153e40 2023-10-19T08:39:31.800 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.795+0000 7f001ffff700 1 -- 172.21.15.79:0/3838288032 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7f00380c7a20 con 0x7f0038153e40 2023-10-19T08:39:31.802 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.798+0000 7f003dce4700 1 -- 172.21.15.79:0/3838288032 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f002406a0e0 msgr2=0x7f002406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:31.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.798+0000 7f003dce4700 1 --2- 172.21.15.79:0/3838288032 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f002406a0e0 0x7f002406c5a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f002c000c00 tx=0x7f002c009040 comp rx=0 tx=0).stop 2023-10-19T08:39:31.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.798+0000 7f003dce4700 1 -- 172.21.15.79:0/3838288032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0038153e40 msgr2=0x7f003815bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:31.803 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.798+0000 7f003dce4700 1 --2- 172.21.15.79:0/3838288032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0038153e40 0x7f003815bf00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f00380cbfe0 tx=0x7f0030004b40 comp rx=0 tx=0).stop 2023-10-19T08:39:31.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.799+0000 7f003dce4700 1 -- 172.21.15.79:0/3838288032 shutdown_connections 2023-10-19T08:39:31.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.799+0000 7f003dce4700 1 --2- 172.21.15.79:0/3838288032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0038153e40 0x7f003815bf00 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:31.804 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.799+0000 7f003dce4700 1 --2- 172.21.15.79:0/3838288032 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0020005330 0x7f00380c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:31.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.799+0000 7f003dce4700 1 --2- 172.21.15.79:0/3838288032 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f002406a0e0 0x7f002406c5a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:31.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.799+0000 7f003dce4700 1 --2- 172.21.15.79:0/3838288032 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00381f3910 0x7f0038153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:31.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.799+0000 7f003dce4700 1 -- 172.21.15.79:0/3838288032 >> 172.21.15.79:0/3838288032 conn(0x7f003806dd90 msgr2=0x7f00380b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:31.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.799+0000 7f003dce4700 1 -- 172.21.15.79:0/3838288032 shutdown_connections 2023-10-19T08:39:31.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.799+0000 7f003dce4700 1 -- 172.21.15.79:0/3838288032 wait complete. 2023-10-19T08:39:31.808 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_metadata' created 2023-10-19T08:39:31.819 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-19T08:39:31.948 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.944+0000 7fadf50f9700 1 Processor -- start 2023-10-19T08:39:31.949 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.944+0000 7fadf50f9700 1 -- start start 2023-10-19T08:39:31.950 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.945+0000 7fadf50f9700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fadf015aec0 0x7fadf00d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:31.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.945+0000 7fadf50f9700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf015b2a0 con 0x7fadf00b2ef0 2023-10-19T08:39:31.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.945+0000 7fadf50f9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf00cf140 con 0x7fadf00d0790 2023-10-19T08:39:31.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.945+0000 7fadf50f9700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf00cf420 con 0x7fadf015aec0 2023-10-19T08:39:31.951 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.945+0000 7fadeed9d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fadf015aec0 0x7fadf00d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:31.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.945+0000 7fadef59e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fadf00b2ef0 0x7fadf00af7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59004/0 (socket says 172.21.15.79:59004) 2023-10-19T08:39:31.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.945+0000 7fadef59e700 1 -- 172.21.15.79:0/77532777 learned_addr learned my addr 172.21.15.79:0/77532777 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:31.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.945+0000 7fadeed9d700 1 -- 172.21.15.79:0/77532777 >> v1:172.21.15.89:6789/0 conn(0x7fadf00d0790 legacy=0x7fadf00b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:31.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.945+0000 7fadeed9d700 1 -- 172.21.15.79:0/77532777 >> v1:172.21.15.79:6789/0 conn(0x7fadf00b2ef0 legacy=0x7fadf00af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:31.952 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.945+0000 7fadeed9d700 1 -- 172.21.15.79:0/77532777 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf00cf700 con 0x7fadf015aec0 2023-10-19T08:39:31.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.945+0000 7fadeed9d700 1 --2- 172.21.15.79:0/77532777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf015aec0 0x7fadf00d0250 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fade0009840 tx=0x7fade0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8dd5e7dd75ae74d server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:31.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.945+0000 7fadedd9b700 1 -- 172.21.15.79:0/77532777 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0004230 con 0x7fadf015aec0 2023-10-19T08:39:31.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.945+0000 7fadedd9b700 1 -- 172.21.15.79:0/77532777 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade0004390 con 0x7fadf015aec0 2023-10-19T08:39:31.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.945+0000 7fadedd9b700 1 -- 172.21.15.79:0/77532777 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade00036a0 con 0x7fadf015aec0 2023-10-19T08:39:31.953 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.946+0000 7fadf50f9700 1 -- 172.21.15.79:0/77532777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf015aec0 msgr2=0x7fadf00d0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:31.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.946+0000 7fadf50f9700 1 --2- 172.21.15.79:0/77532777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf015aec0 0x7fadf00d0250 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fade0009840 tx=0x7fade0009b50 comp rx=0 tx=0).stop 2023-10-19T08:39:31.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.946+0000 7fadf50f9700 1 -- 172.21.15.79:0/77532777 shutdown_connections 2023-10-19T08:39:31.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.946+0000 7fadf50f9700 1 --2- 172.21.15.79:0/77532777 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf015aec0 0x7fadf00d0250 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:31.954 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.946+0000 7fadf50f9700 1 -- 172.21.15.79:0/77532777 >> 172.21.15.79:0/77532777 conn(0x7fadf00cd7e0 msgr2=0x7fadf00cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:31.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.946+0000 7fadf50f9700 1 -- 172.21.15.79:0/77532777 shutdown_connections 2023-10-19T08:39:31.955 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.946+0000 7fadf50f9700 1 -- 172.21.15.79:0/77532777 wait complete. 2023-10-19T08:39:31.957 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.947+0000 7fadf50f9700 1 Processor -- start 2023-10-19T08:39:31.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.947+0000 7fadf50f9700 1 -- start start 2023-10-19T08:39:31.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.948+0000 7fadf50f9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf00b2ef0 0x7fadf006bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:31.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.948+0000 7fadf50f9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf00d0790 0x7fadf01f2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:31.958 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.948+0000 7fadf50f9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf015aec0 0x7fadf00c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:31.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.948+0000 7fadf50f9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf006cfd0 con 0x7fadf00d0790 2023-10-19T08:39:31.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.948+0000 7fadf50f9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf01f40b0 con 0x7fadf015aec0 2023-10-19T08:39:31.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.948+0000 7fadf50f9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf006c120 con 0x7fadf00b2ef0 2023-10-19T08:39:31.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.948+0000 7fadee59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf00d0790 0x7fadf01f2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:31.959 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.948+0000 7fadee59c700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf00d0790 0x7fadf01f2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48936/0 (socket says 172.21.15.79:48936) 2023-10-19T08:39:31.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.948+0000 7fadee59c700 1 -- 172.21.15.79:0/4192838244 learned_addr learned my addr 172.21.15.79:0/4192838244 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:31.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.948+0000 7fadeed9d700 1 --2- 172.21.15.79:0/4192838244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf00b2ef0 0x7fadf006bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:31.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.949+0000 7fadef59e700 1 --2- 172.21.15.79:0/4192838244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf015aec0 0x7fadf00c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:31.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.949+0000 7fadee59c700 1 -- 172.21.15.79:0/4192838244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf00b2ef0 msgr2=0x7fadf006bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:31.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.949+0000 7fadee59c700 1 --2- 172.21.15.79:0/4192838244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf00b2ef0 0x7fadf006bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:31.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.949+0000 7fadee59c700 1 -- 172.21.15.79:0/4192838244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf015aec0 msgr2=0x7fadf00c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:31.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.949+0000 7fadee59c700 1 --2- 172.21.15.79:0/4192838244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf015aec0 0x7fadf00c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:31.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.949+0000 7fadee59c700 1 -- 172.21.15.79:0/4192838244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade00094a0 con 0x7fadf00d0790 2023-10-19T08:39:31.961 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.949+0000 7fadee59c700 1 --2- 172.21.15.79:0/4192838244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf00d0790 0x7fadf01f2a30 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fade400c4a0 tx=0x7fade400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:31.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.949+0000 7fadd77fe700 1 -- 172.21.15.79:0/4192838244 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade40054e0 con 0x7fadf00d0790 2023-10-19T08:39:31.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.949+0000 7fadd77fe700 1 -- 172.21.15.79:0/4192838244 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade4003680 con 0x7fadf00d0790 2023-10-19T08:39:31.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.949+0000 7fadf50f9700 1 -- 172.21.15.79:0/4192838244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf006c3c0 con 0x7fadf00d0790 2023-10-19T08:39:31.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.949+0000 7fadd77fe700 1 -- 172.21.15.79:0/4192838244 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade4003a30 con 0x7fadf00d0790 2023-10-19T08:39:31.962 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.949+0000 7fadf50f9700 1 -- 172.21.15.79:0/4192838244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf006c980 con 0x7fadf00d0790 2023-10-19T08:39:31.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.950+0000 7fadf50f9700 1 -- 172.21.15.79:0/4192838244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf0067470 con 0x7fadf00d0790 2023-10-19T08:39:31.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.951+0000 7fadd77fe700 1 -- 172.21.15.79:0/4192838244 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fade4003b90 con 0x7fadf00d0790 2023-10-19T08:39:31.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.951+0000 7fadd77fe700 1 --2- 172.21.15.79:0/4192838244 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faddc06a0e0 0x7faddc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:31.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.951+0000 7fadd77fe700 1 -- 172.21.15.79:0/4192838244 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5900+0+0 (secure 0 0 0) 0x7fade40879e0 con 0x7fadf00d0790 2023-10-19T08:39:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.951+0000 7fadeed9d700 1 --2- 172.21.15.79:0/4192838244 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faddc06a0e0 0x7faddc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.951+0000 7fadeed9d700 1 --2- 172.21.15.79:0/4192838244 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faddc06a0e0 0x7faddc06c5a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fade00090b0 tx=0x7fade0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:31.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:31.956+0000 7fadd77fe700 1 -- 172.21.15.79:0/4192838244 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fade4053170 con 0x7fadf00d0790 2023-10-19T08:39:32.148 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.144+0000 7fadf50f9700 1 -- 172.21.15.79:0/4192838244 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fadf004ee70 con 0x7fadf00d0790 2023-10-19T08:39:32.805 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.800+0000 7fadd77fe700 1 -- 172.21.15.79:0/4192838244 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7fade40170d0 con 0x7fadf00d0790 2023-10-19T08:39:32.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.804+0000 7fadf50f9700 1 -- 172.21.15.79:0/4192838244 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faddc06a0e0 msgr2=0x7faddc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:32.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.804+0000 7fadf50f9700 1 --2- 172.21.15.79:0/4192838244 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faddc06a0e0 0x7faddc06c5a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fade00090b0 tx=0x7fade0008030 comp rx=0 tx=0).stop 2023-10-19T08:39:32.809 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.804+0000 7fadf50f9700 1 -- 172.21.15.79:0/4192838244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf00d0790 msgr2=0x7fadf01f2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:32.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.804+0000 7fadf50f9700 1 --2- 172.21.15.79:0/4192838244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf00d0790 0x7fadf01f2a30 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fade400c4a0 tx=0x7fade400c860 comp rx=0 tx=0).stop 2023-10-19T08:39:32.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.805+0000 7fadf50f9700 1 -- 172.21.15.79:0/4192838244 shutdown_connections 2023-10-19T08:39:32.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.805+0000 7fadf50f9700 1 --2- 172.21.15.79:0/4192838244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fadf015aec0 0x7fadf00c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:32.810 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.805+0000 7fadf50f9700 1 --2- 172.21.15.79:0/4192838244 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7faddc06a0e0 0x7faddc06c5a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:32.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.805+0000 7fadf50f9700 1 --2- 172.21.15.79:0/4192838244 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fadf00b2ef0 0x7fadf006bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:32.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.805+0000 7fadf50f9700 1 --2- 172.21.15.79:0/4192838244 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadf00d0790 0x7fadf01f2a30 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:32.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.805+0000 7fadf50f9700 1 -- 172.21.15.79:0/4192838244 >> 172.21.15.79:0/4192838244 conn(0x7fadf00cd7e0 msgr2=0x7fadf00d0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:32.811 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.805+0000 7fadf50f9700 1 -- 172.21.15.79:0/4192838244 shutdown_connections 2023-10-19T08:39:32.812 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.806+0000 7fadf50f9700 1 -- 172.21.15.79:0/4192838244 wait complete. 2023-10-19T08:39:32.817 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'cephfs_data' created 2023-10-19T08:39:32.834 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-19T08:39:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.956+0000 7ff0b03c4700 1 Processor -- start 2023-10-19T08:39:32.960 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.956+0000 7ff0b03c4700 1 -- start start 2023-10-19T08:39:32.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.956+0000 7ff0b03c4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff0a815e570 0x7ff0a80d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:32.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.956+0000 7ff0b03c4700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0a80cb6f0 0x7ff0a80b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:32.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.956+0000 7ff0b03c4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0a80b0a30 0x7ff0a80b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:32.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.956+0000 7ff0b03c4700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a80b0ec0 con 0x7ff0a80cb6f0 2023-10-19T08:39:32.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.956+0000 7ff0b03c4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a80afd60 con 0x7ff0a815e570 2023-10-19T08:39:32.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.956+0000 7ff0b03c4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a80af810 con 0x7ff0a80b0a30 2023-10-19T08:39:32.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.957+0000 7ff0ad95f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0a80cb6f0 0x7ff0a80b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:32.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.957+0000 7ff0ad95f700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0a80cb6f0 0x7ff0a80b04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48942/0 (socket says 172.21.15.79:48942) 2023-10-19T08:39:32.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.957+0000 7ff0ad95f700 1 -- 172.21.15.79:0/2212684875 learned_addr learned my addr 172.21.15.79:0/2212684875 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:32.965 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.957+0000 7ff0ae961700 1 --2- 172.21.15.79:0/2212684875 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0a80b0a30 0x7ff0a80b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:32.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.957+0000 7ff0ae160700 1 --2- 172.21.15.79:0/2212684875 >> v2:172.21.15.89:3300/0 conn(0x7ff0a815e570 0x7ff0a80d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:32.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.957+0000 7ff0ad95f700 1 -- 172.21.15.79:0/2212684875 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0a80b0a30 msgr2=0x7ff0a80b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:32.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.957+0000 7ff0ad95f700 1 --2- 172.21.15.79:0/2212684875 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0a80b0a30 0x7ff0a80b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:32.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.957+0000 7ff0ad95f700 1 -- 172.21.15.79:0/2212684875 >> v2:172.21.15.89:3300/0 conn(0x7ff0a815e570 msgr2=0x7ff0a80d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:32.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.957+0000 7ff0ad95f700 1 --2- 172.21.15.79:0/2212684875 >> v2:172.21.15.89:3300/0 conn(0x7ff0a815e570 0x7ff0a80d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:32.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.957+0000 7ff0ad95f700 1 -- 172.21.15.79:0/2212684875 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a80aef70 con 0x7ff0a80cb6f0 2023-10-19T08:39:32.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.957+0000 7ff0ad95f700 1 --2- 172.21.15.79:0/2212684875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0a80cb6f0 0x7ff0a80b04f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8071540 tx=0x7ff0a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe9530276efb849 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:32.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.957+0000 7ff0ad15e700 1 -- 172.21.15.79:0/2212684875 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a400b870 con 0x7ff0a80cb6f0 2023-10-19T08:39:32.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.957+0000 7ff0ad15e700 1 -- 172.21.15.79:0/2212684875 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a400b9d0 con 0x7ff0a80cb6f0 2023-10-19T08:39:32.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.957+0000 7ff0ad15e700 1 -- 172.21.15.79:0/2212684875 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a400bd60 con 0x7ff0a80cb6f0 2023-10-19T08:39:32.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.958+0000 7ff0b03c4700 1 -- 172.21.15.79:0/2212684875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0a80cb6f0 msgr2=0x7ff0a80b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:32.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.958+0000 7ff0b03c4700 1 --2- 172.21.15.79:0/2212684875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0a80cb6f0 0x7ff0a80b04f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8071540 tx=0x7ff0a4009bd0 comp rx=0 tx=0).stop 2023-10-19T08:39:32.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.958+0000 7ff0b03c4700 1 -- 172.21.15.79:0/2212684875 shutdown_connections 2023-10-19T08:39:32.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.958+0000 7ff0b03c4700 1 --2- 172.21.15.79:0/2212684875 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0a80b0a30 0x7ff0a80b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:32.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.958+0000 7ff0b03c4700 1 --2- 172.21.15.79:0/2212684875 >> v2:172.21.15.89:3300/0 conn(0x7ff0a815e570 0x7ff0a80d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:32.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.958+0000 7ff0b03c4700 1 --2- 172.21.15.79:0/2212684875 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0a80cb6f0 0x7ff0a80b04f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:32.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.958+0000 7ff0b03c4700 1 -- 172.21.15.79:0/2212684875 >> 172.21.15.79:0/2212684875 conn(0x7ff0a809a0b0 msgr2=0x7ff0a80d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:32.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.958+0000 7ff0b03c4700 1 -- 172.21.15.79:0/2212684875 shutdown_connections 2023-10-19T08:39:32.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.958+0000 7ff0b03c4700 1 -- 172.21.15.79:0/2212684875 wait complete. 2023-10-19T08:39:32.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.959+0000 7ff0b03c4700 1 Processor -- start 2023-10-19T08:39:32.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.959+0000 7ff0b03c4700 1 -- start start 2023-10-19T08:39:32.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff0b03c4700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0a80b0a30 0x7ff0a80c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:32.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff0b03c4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0a80cb6f0 0x7ff0a80b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:32.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff0b03c4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0a815e570 0x7ff0a815a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:32.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff0b03c4700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a80b4530 con 0x7ff0a80b0a30 2023-10-19T08:39:32.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff0b03c4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a80c85b0 con 0x7ff0a80cb6f0 2023-10-19T08:39:32.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff0b03c4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a80c8890 con 0x7ff0a815e570 2023-10-19T08:39:32.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff0ae160700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0a80b0a30 0x7ff0a80c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:32.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff0ae160700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0a80b0a30 0x7ff0a80c7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48948/0 (socket says 172.21.15.79:48948) 2023-10-19T08:39:32.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff0ae160700 1 -- 172.21.15.79:0/1114843083 learned_addr learned my addr 172.21.15.79:0/1114843083 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:32.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff0ae961700 1 --2- 172.21.15.79:0/1114843083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0a815e570 0x7ff0a815a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:32.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff0ad95f700 1 --2- 172.21.15.79:0/1114843083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0a80cb6f0 0x7ff0a80b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:32.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff0ae160700 1 -- 172.21.15.79:0/1114843083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0a815e570 msgr2=0x7ff0a815a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:32.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff0ae160700 1 --2- 172.21.15.79:0/1114843083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0a815e570 0x7ff0a815a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:32.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff0ae160700 1 -- 172.21.15.79:0/1114843083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0a80cb6f0 msgr2=0x7ff0a80b5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:32.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff0ae160700 1 --2- 172.21.15.79:0/1114843083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0a80cb6f0 0x7ff0a80b5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:32.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff0ae160700 1 -- 172.21.15.79:0/1114843083 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a4009550 con 0x7ff0a80b0a30 2023-10-19T08:39:32.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff0ae160700 1 --2- 172.21.15.79:0/1114843083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0a80b0a30 0x7ff0a80c7eb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff09800d800 tx=0x7ff09800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:32.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff09effd700 1 -- 172.21.15.79:0/1114843083 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0980125f0 con 0x7ff0a80b0a30 2023-10-19T08:39:32.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff09effd700 1 -- 172.21.15.79:0/1114843083 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff098012750 con 0x7ff0a80b0a30 2023-10-19T08:39:32.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff0b03c4700 1 -- 172.21.15.79:0/1114843083 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a80c8b70 con 0x7ff0a80b0a30 2023-10-19T08:39:32.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.960+0000 7ff09effd700 1 -- 172.21.15.79:0/1114843083 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff098012b00 con 0x7ff0a80b0a30 2023-10-19T08:39:32.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.961+0000 7ff0b03c4700 1 -- 172.21.15.79:0/1114843083 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a80c9130 con 0x7ff0a80b0a30 2023-10-19T08:39:32.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.961+0000 7ff0b03c4700 1 -- 172.21.15.79:0/1114843083 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a80c92f0 con 0x7ff0a80b0a30 2023-10-19T08:39:32.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.962+0000 7ff09effd700 1 -- 172.21.15.79:0/1114843083 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff098012c60 con 0x7ff0a80b0a30 2023-10-19T08:39:32.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.962+0000 7ff09effd700 1 --2- 172.21.15.79:0/1114843083 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff08c06a0e0 0x7ff08c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:32.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.962+0000 7ff09effd700 1 -- 172.21.15.79:0/1114843083 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6282+0+0 (secure 0 0 0) 0x7ff0980889e0 con 0x7ff0a80b0a30 2023-10-19T08:39:32.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.962+0000 7ff0ad95f700 1 --2- 172.21.15.79:0/1114843083 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff08c06a0e0 0x7ff08c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:32.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.963+0000 7ff0ad95f700 1 --2- 172.21.15.79:0/1114843083 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff08c06a0e0 0x7ff08c06c5a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80cbaf0 tx=0x7ff0a4008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:32.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:32.967+0000 7ff09effd700 1 -- 172.21.15.79:0/1114843083 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ff098053f50 con 0x7ff0a80b0a30 2023-10-19T08:39:33.204 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.200+0000 7ff0b03c4700 1 -- 172.21.15.79:0/1114843083 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff0a80c94a0 con 0x7ff0a80b0a30 2023-10-19T08:39:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.812+0000 7ff09effd700 1 -- 172.21.15.79:0/1114843083 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff098057570 con 0x7ff0a80b0a30 2023-10-19T08:39:33.825 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.821+0000 7ff0b03c4700 1 -- 172.21.15.79:0/1114843083 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff08c06a0e0 msgr2=0x7ff08c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:33.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.821+0000 7ff0b03c4700 1 --2- 172.21.15.79:0/1114843083 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff08c06a0e0 0x7ff08c06c5a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80cbaf0 tx=0x7ff0a4008030 comp rx=0 tx=0).stop 2023-10-19T08:39:33.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.821+0000 7ff0b03c4700 1 -- 172.21.15.79:0/1114843083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0a80b0a30 msgr2=0x7ff0a80c7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:33.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.821+0000 7ff0b03c4700 1 --2- 172.21.15.79:0/1114843083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0a80b0a30 0x7ff0a80c7eb0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff09800d800 tx=0x7ff09800dbc0 comp rx=0 tx=0).stop 2023-10-19T08:39:33.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.822+0000 7ff0b03c4700 1 -- 172.21.15.79:0/1114843083 shutdown_connections 2023-10-19T08:39:33.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.822+0000 7ff0b03c4700 1 --2- 172.21.15.79:0/1114843083 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff08c06a0e0 0x7ff08c06c5a0 secure :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80cbaf0 tx=0x7ff0a4008030 comp rx=0 tx=0).stop 2023-10-19T08:39:33.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.822+0000 7ff0b03c4700 1 --2- 172.21.15.79:0/1114843083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff0a815e570 0x7ff0a815a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:33.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.822+0000 7ff0b03c4700 1 --2- 172.21.15.79:0/1114843083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0a80b0a30 0x7ff0a80c7eb0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:33.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.822+0000 7ff0b03c4700 1 --2- 172.21.15.79:0/1114843083 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0a80cb6f0 0x7ff0a80b5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.822+0000 7ff0b03c4700 1 -- 172.21.15.79:0/1114843083 >> 172.21.15.79:0/1114843083 conn(0x7ff0a809a0b0 msgr2=0x7ff0a8070760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.823+0000 7ff0b03c4700 1 -- 172.21.15.79:0/1114843083 shutdown_connections 2023-10-19T08:39:33.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.823+0000 7ff0b03c4700 1 -- 172.21.15.79:0/1114843083 wait complete. 2023-10-19T08:39:33.837 INFO:teuthology.orchestra.run.smithi079.stderr:new fs with metadata pool 6 and data pool 7 2023-10-19T08:39:33.847 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:39:33.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.962+0000 7f47dc74e700 1 Processor -- start 2023-10-19T08:39:33.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.963+0000 7f47dc74e700 1 -- start start 2023-10-19T08:39:33.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.963+0000 7f47dc74e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d415d530 0x7f47d40b1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:33.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.963+0000 7f47dc74e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f47d40cbf50 0x7f47d40cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:33.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.963+0000 7f47dc74e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d415d910 con 0x7f47d406bed0 2023-10-19T08:39:33.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.963+0000 7f47dc74e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d415db10 con 0x7f47d40cbf50 2023-10-19T08:39:33.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.963+0000 7f47dc74e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d40b1eb0 con 0x7f47d415d530 2023-10-19T08:39:33.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.964+0000 7f47daceb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f47d40cbf50 0x7f47d40cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:33.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.964+0000 7f47daceb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f47d40cbf50 0x7f47d40cd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:35220/0 (socket says 172.21.15.79:35220) 2023-10-19T08:39:33.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.964+0000 7f47daceb700 1 -- 172.21.15.79:0/1462054879 learned_addr learned my addr 172.21.15.79:0/1462054879 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:33.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.964+0000 7f47d9ce9700 1 --1- 172.21.15.79:0/1462054879 >> v1:172.21.15.89:6789/0 conn(0x7f47d406bed0 0x7f47d40cb840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.79:43884/0 (socket says 172.21.15.79:43884) 2023-10-19T08:39:33.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.964+0000 7f47da4ea700 1 --2- 172.21.15.79:0/1462054879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d415d530 0x7f47d40b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:33.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.964+0000 7f47daceb700 1 -- 172.21.15.79:0/1462054879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d415d530 msgr2=0x7f47d40b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:33.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.964+0000 7f47daceb700 1 --2- 172.21.15.79:0/1462054879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d415d530 0x7f47d40b1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:33.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.964+0000 7f47daceb700 1 -- 172.21.15.79:0/1462054879 >> v1:172.21.15.89:6789/0 conn(0x7f47d406bed0 legacy=0x7f47d40cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:33.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.964+0000 7f47d94e8700 1 -- 172.21.15.79:0/1462054879 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4025775134 0 0) 0x7f47d415d910 con 0x7f47d406bed0 2023-10-19T08:39:33.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.964+0000 7f47daceb700 1 -- 172.21.15.79:0/1462054879 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d415dd60 con 0x7f47d40cbf50 2023-10-19T08:39:33.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.964+0000 7f47daceb700 1 --2- 172.21.15.79:0/1462054879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d40cbf50 0x7f47d40cd620 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f47cc009e50 tx=0x7f47cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cab99abc13d84ec7 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:33.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.965+0000 7f47d94e8700 1 -- 172.21.15.79:0/1462054879 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc00e070 con 0x7f47d40cbf50 2023-10-19T08:39:33.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.965+0000 7f47d94e8700 1 -- 172.21.15.79:0/1462054879 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47cc00b910 con 0x7f47d40cbf50 2023-10-19T08:39:33.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.965+0000 7f47d94e8700 1 -- 172.21.15.79:0/1462054879 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47cc00bcc0 con 0x7f47d40cbf50 2023-10-19T08:39:33.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.965+0000 7f47dc74e700 1 -- 172.21.15.79:0/1462054879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d40cbf50 msgr2=0x7f47d40cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:33.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.965+0000 7f47dc74e700 1 --2- 172.21.15.79:0/1462054879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d40cbf50 0x7f47d40cd620 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f47cc009e50 tx=0x7f47cc00b330 comp rx=0 tx=0).stop 2023-10-19T08:39:33.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.965+0000 7f47dc74e700 1 -- 172.21.15.79:0/1462054879 shutdown_connections 2023-10-19T08:39:33.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.965+0000 7f47dc74e700 1 --2- 172.21.15.79:0/1462054879 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d40cbf50 0x7f47d40cd620 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:33.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.965+0000 7f47dc74e700 1 --2- 172.21.15.79:0/1462054879 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d415d530 0x7f47d40b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:33.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.965+0000 7f47dc74e700 1 -- 172.21.15.79:0/1462054879 >> 172.21.15.79:0/1462054879 conn(0x7f47d40cc560 msgr2=0x7f47d40cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:33.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.965+0000 7f47dc74e700 1 -- 172.21.15.79:0/1462054879 shutdown_connections 2023-10-19T08:39:33.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.965+0000 7f47dc74e700 1 -- 172.21.15.79:0/1462054879 wait complete. 2023-10-19T08:39:33.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.966+0000 7f47dc74e700 1 Processor -- start 2023-10-19T08:39:33.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.966+0000 7f47dc74e700 1 -- start start 2023-10-19T08:39:33.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.967+0000 7f47dc74e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d406bed0 0x7f47d414f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:33.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.967+0000 7f47dc74e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d40cbf50 0x7f47d40b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:33.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.967+0000 7f47dc74e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d415d530 0x7f47d4152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:33.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.967+0000 7f47dc74e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d40b1540 con 0x7f47d406bed0 2023-10-19T08:39:33.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.967+0000 7f47dc74e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d40b06b0 con 0x7f47d40cbf50 2023-10-19T08:39:33.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.967+0000 7f47dc74e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d4150340 con 0x7f47d415d530 2023-10-19T08:39:33.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.967+0000 7f47da4ea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d406bed0 0x7f47d414f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:33.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.967+0000 7f47da4ea700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d406bed0 0x7f47d414f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48976/0 (socket says 172.21.15.79:48976) 2023-10-19T08:39:33.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.967+0000 7f47da4ea700 1 -- 172.21.15.79:0/864157462 learned_addr learned my addr 172.21.15.79:0/864157462 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:33.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.967+0000 7f47d9ce9700 1 --2- 172.21.15.79:0/864157462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d40cbf50 0x7f47d40b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:33.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.967+0000 7f47daceb700 1 --2- 172.21.15.79:0/864157462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d415d530 0x7f47d4152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:33.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.968+0000 7f47da4ea700 1 -- 172.21.15.79:0/864157462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d415d530 msgr2=0x7f47d4152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:33.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.968+0000 7f47da4ea700 1 --2- 172.21.15.79:0/864157462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d415d530 0x7f47d4152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:33.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.968+0000 7f47da4ea700 1 -- 172.21.15.79:0/864157462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d40cbf50 msgr2=0x7f47d40b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:33.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.968+0000 7f47da4ea700 1 --2- 172.21.15.79:0/864157462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d40cbf50 0x7f47d40b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:33.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.968+0000 7f47da4ea700 1 -- 172.21.15.79:0/864157462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc009b30 con 0x7f47d406bed0 2023-10-19T08:39:33.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.968+0000 7f47d9ce9700 1 --2- 172.21.15.79:0/864157462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d40cbf50 0x7f47d40b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:39:33.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.968+0000 7f47da4ea700 1 --2- 172.21.15.79:0/864157462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d406bed0 0x7f47d414f390 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f47c400e870 tx=0x7f47c400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:33.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.968+0000 7f47caffd700 1 -- 172.21.15.79:0/864157462 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c4009590 con 0x7f47d406bed0 2023-10-19T08:39:33.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.968+0000 7f47caffd700 1 -- 172.21.15.79:0/864157462 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c4013680 con 0x7f47d406bed0 2023-10-19T08:39:33.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.968+0000 7f47dc74e700 1 -- 172.21.15.79:0/864157462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d40b08c0 con 0x7f47d406bed0 2023-10-19T08:39:33.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.968+0000 7f47caffd700 1 -- 172.21.15.79:0/864157462 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c40139f0 con 0x7f47d406bed0 2023-10-19T08:39:33.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.968+0000 7f47dc74e700 1 -- 172.21.15.79:0/864157462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d40b0e80 con 0x7f47d406bed0 2023-10-19T08:39:33.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.969+0000 7f47dc74e700 1 -- 172.21.15.79:0/864157462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d404ee70 con 0x7f47d406bed0 2023-10-19T08:39:33.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.969+0000 7f47caffd700 1 -- 172.21.15.79:0/864157462 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f47c4013b50 con 0x7f47d406bed0 2023-10-19T08:39:33.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.970+0000 7f47caffd700 1 --2- 172.21.15.79:0/864157462 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f47b806a0e0 0x7f47b806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:33.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.970+0000 7f47caffd700 1 -- 172.21.15.79:0/864157462 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f47c4088590 con 0x7f47d406bed0 2023-10-19T08:39:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.970+0000 7f47d9ce9700 1 --2- 172.21.15.79:0/864157462 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f47b806a0e0 0x7f47b806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.970+0000 7f47d9ce9700 1 --2- 172.21.15.79:0/864157462 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f47b806a0e0 0x7f47b806c5a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f47d40cf770 tx=0x7f47d0007de0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:33.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:33.974+0000 7f47caffd700 1 -- 172.21.15.79:0/864157462 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f47c4057530 con 0x7f47d406bed0 2023-10-19T08:39:34.174 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.169+0000 7f47dc74e700 1 -- 172.21.15.79:0/864157462 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47d406b7d0 con 0x7f47d406bed0 2023-10-19T08:39:34.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.170+0000 7f47caffd700 1 -- 172.21.15.79:0/864157462 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18453 (secure 0 0 0) 0x7f47c40570c0 con 0x7f47d406bed0 2023-10-19T08:39:34.175 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:34.176 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":38,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:39:33.201952+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:39:31.343441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-19T08:39:32.163349+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:39:34.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.172+0000 7f47dc74e700 1 -- 172.21.15.79:0/864157462 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f47b806a0e0 msgr2=0x7f47b806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:34.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.172+0000 7f47dc74e700 1 --2- 172.21.15.79:0/864157462 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f47b806a0e0 0x7f47b806c5a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f47d40cf770 tx=0x7f47d0007de0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.172+0000 7f47dc74e700 1 -- 172.21.15.79:0/864157462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d406bed0 msgr2=0x7f47d414f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:34.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.172+0000 7f47dc74e700 1 --2- 172.21.15.79:0/864157462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d406bed0 0x7f47d414f390 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f47c400e870 tx=0x7f47c400eb80 comp rx=0 tx=0).stop 2023-10-19T08:39:34.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.173+0000 7f47dc74e700 1 -- 172.21.15.79:0/864157462 shutdown_connections 2023-10-19T08:39:34.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.173+0000 7f47dc74e700 1 --2- 172.21.15.79:0/864157462 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f47b806a0e0 0x7f47b806c5a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.173+0000 7f47dc74e700 1 --2- 172.21.15.79:0/864157462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47d415d530 0x7f47d4152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.173+0000 7f47dc74e700 1 --2- 172.21.15.79:0/864157462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f47d406bed0 0x7f47d414f390 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.173+0000 7f47dc74e700 1 --2- 172.21.15.79:0/864157462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47d40cbf50 0x7f47d40b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.173+0000 7f47dc74e700 1 -- 172.21.15.79:0/864157462 >> 172.21.15.79:0/864157462 conn(0x7f47d40cc560 msgr2=0x7f47d415ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.173+0000 7f47dc74e700 1 -- 172.21.15.79:0/864157462 shutdown_connections 2023-10-19T08:39:34.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.173+0000 7f47dc74e700 1 -- 172.21.15.79:0/864157462 wait complete. 2023-10-19T08:39:34.189 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:39:34.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.304+0000 7f2d77b58700 1 Processor -- start 2023-10-19T08:39:34.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.304+0000 7f2d77b58700 1 -- start start 2023-10-19T08:39:34.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.305+0000 7f2d77b58700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2d700c5320 0x7f2d7006a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:34.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.305+0000 7f2d77b58700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d700caef0 con 0x7f2d700c3840 2023-10-19T08:39:34.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.305+0000 7f2d77b58700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d700cb150 con 0x7f2d70157830 2023-10-19T08:39:34.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.305+0000 7f2d77b58700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d700ad7d0 con 0x7f2d700c5320 2023-10-19T08:39:34.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.305+0000 7f2d760f5700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2d700c3840 0x7f2d7015a250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59060/0 (socket says 172.21.15.79:59060) 2023-10-19T08:39:34.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.305+0000 7f2d760f5700 1 -- 172.21.15.79:0/933982882 learned_addr learned my addr 172.21.15.79:0/933982882 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:34.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d750f3700 1 --2- 172.21.15.79:0/933982882 >> v2:172.21.15.89:3300/0 conn(0x7f2d700c5320 0x7f2d7006a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:34.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d748f2700 1 -- 172.21.15.79:0/933982882 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 853109675 0 0) 0x7f2d700caef0 con 0x7f2d700c3840 2023-10-19T08:39:34.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d748f2700 1 -- 172.21.15.79:0/933982882 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d5c0057c0 con 0x7f2d700c3840 2023-10-19T08:39:34.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d748f2700 1 -- 172.21.15.79:0/933982882 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1625596818 0 0) 0x7f2d5c0057c0 con 0x7f2d700c3840 2023-10-19T08:39:34.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d748f2700 1 -- 172.21.15.79:0/933982882 >> v2:172.21.15.89:3300/0 conn(0x7f2d700c5320 msgr2=0x7f2d7006a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:34.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d748f2700 1 --2- 172.21.15.79:0/933982882 >> v2:172.21.15.89:3300/0 conn(0x7f2d700c5320 0x7f2d7006a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d748f2700 1 -- 172.21.15.79:0/933982882 >> v1:172.21.15.89:6789/0 conn(0x7f2d70157830 legacy=0x7f2d700ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:34.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d748f2700 1 -- 172.21.15.79:0/933982882 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d700adab0 con 0x7f2d700c3840 2023-10-19T08:39:34.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d748f2700 1 -- 172.21.15.79:0/933982882 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f2d680019f0 con 0x7f2d700c3840 2023-10-19T08:39:34.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d748f2700 1 -- 172.21.15.79:0/933982882 >> v1:172.21.15.79:6789/0 conn(0x7f2d700c3840 legacy=0x7f2d7015a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:34.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d748f2700 1 --2- 172.21.15.79:0/933982882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d5c005c10 0x7f2d5c006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:34.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d748f2700 1 --2- 172.21.15.79:0/933982882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d5c006a60 0x7f2d5c006ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:34.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d748f2700 1 --2- 172.21.15.79:0/933982882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d5c007420 0x7f2d5c00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:34.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d748f2700 1 -- 172.21.15.79:0/933982882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d700ad7d0 con 0x7f2d5c007420 2023-10-19T08:39:34.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d748f2700 1 -- 172.21.15.79:0/933982882 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c00e2c0 con 0x7f2d5c006a60 2023-10-19T08:39:34.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d748f2700 1 -- 172.21.15.79:0/933982882 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c00e480 con 0x7f2d5c005c10 2023-10-19T08:39:34.317 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d760f5700 1 --2- 172.21.15.79:0/933982882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d5c007420 0x7f2d5c00dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:34.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d758f4700 1 --2- 172.21.15.79:0/933982882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d5c005c10 0x7f2d5c006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:34.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d750f3700 1 --2- 172.21.15.79:0/933982882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d5c006a60 0x7f2d5c006ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:34.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d760f5700 1 -- 172.21.15.79:0/933982882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d5c005c10 msgr2=0x7f2d5c006030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:34.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d760f5700 1 --2- 172.21.15.79:0/933982882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d5c005c10 0x7f2d5c006030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.318 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d760f5700 1 -- 172.21.15.79:0/933982882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d5c006a60 msgr2=0x7f2d5c006ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:34.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d760f5700 1 --2- 172.21.15.79:0/933982882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d5c006a60 0x7f2d5c006ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d760f5700 1 -- 172.21.15.79:0/933982882 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c0057c0 con 0x7f2d5c007420 2023-10-19T08:39:34.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.306+0000 7f2d758f4700 1 --2- 172.21.15.79:0/933982882 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d5c005c10 0x7f2d5c006030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:34.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.307+0000 7f2d760f5700 1 -- 172.21.15.79:0/933982882 reap_dead start 2023-10-19T08:39:34.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.307+0000 7f2d760f5700 1 --2- 172.21.15.79:0/933982882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d5c007420 0x7f2d5c00dc20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800a830 tx=0x7f2d5c007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4590042dcdc5cb9a server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:34.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.307+0000 7f2d748f2700 1 -- 172.21.15.79:0/933982882 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6800a2f0 con 0x7f2d5c007420 2023-10-19T08:39:34.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.307+0000 7f2d748f2700 1 -- 172.21.15.79:0/933982882 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d68012600 con 0x7f2d5c007420 2023-10-19T08:39:34.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.307+0000 7f2d748f2700 1 -- 172.21.15.79:0/933982882 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d680129b0 con 0x7f2d5c007420 2023-10-19T08:39:34.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.307+0000 7f2d77b58700 1 -- 172.21.15.79:0/933982882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d5c007420 msgr2=0x7f2d5c00dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:34.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.307+0000 7f2d77b58700 1 --2- 172.21.15.79:0/933982882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d5c007420 0x7f2d5c00dc20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800a830 tx=0x7f2d5c007a90 comp rx=0 tx=0).stop 2023-10-19T08:39:34.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.307+0000 7f2d77b58700 1 -- 172.21.15.79:0/933982882 shutdown_connections 2023-10-19T08:39:34.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.307+0000 7f2d77b58700 1 --2- 172.21.15.79:0/933982882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d5c007420 0x7f2d5c00dc20 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.307+0000 7f2d77b58700 1 -- 172.21.15.79:0/933982882 >> 172.21.15.79:0/933982882 conn(0x7f2d700ce960 msgr2=0x7f2d700ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:34.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.307+0000 7f2d77b58700 1 -- 172.21.15.79:0/933982882 shutdown_connections 2023-10-19T08:39:34.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.307+0000 7f2d77b58700 1 -- 172.21.15.79:0/933982882 wait complete. 2023-10-19T08:39:34.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.309+0000 7f2d77b58700 1 Processor -- start 2023-10-19T08:39:34.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.309+0000 7f2d77b58700 1 -- start start 2023-10-19T08:39:34.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.309+0000 7f2d77b58700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d5c007420 0x7f2d700c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:34.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.309+0000 7f2d77b58700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d7015a1c0 0x7f2d7006c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:34.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.309+0000 7f2d77b58700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d7015a640 0x7f2d7006cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:34.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.309+0000 7f2d77b58700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d701508e0 con 0x7f2d7015a640 2023-10-19T08:39:34.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.309+0000 7f2d77b58700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7015c210 con 0x7f2d7015a1c0 2023-10-19T08:39:34.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.309+0000 7f2d77b58700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7015c4f0 con 0x7f2d5c007420 2023-10-19T08:39:34.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.309+0000 7f2d760f5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d7015a640 0x7f2d7006cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:34.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.309+0000 7f2d760f5700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d7015a640 0x7f2d7006cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49000/0 (socket says 172.21.15.79:49000) 2023-10-19T08:39:34.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.309+0000 7f2d760f5700 1 -- 172.21.15.79:0/1980414747 learned_addr learned my addr 172.21.15.79:0/1980414747 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:34.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.309+0000 7f2d750f3700 1 --2- 172.21.15.79:0/1980414747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d7015a1c0 0x7f2d7006c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:34.326 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.309+0000 7f2d758f4700 1 --2- 172.21.15.79:0/1980414747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d5c007420 0x7f2d700c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:34.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.310+0000 7f2d760f5700 1 -- 172.21.15.79:0/1980414747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d5c007420 msgr2=0x7f2d700c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:34.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.310+0000 7f2d760f5700 1 --2- 172.21.15.79:0/1980414747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d5c007420 0x7f2d700c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.310+0000 7f2d760f5700 1 -- 172.21.15.79:0/1980414747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d7015a1c0 msgr2=0x7f2d7006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:34.327 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.310+0000 7f2d760f5700 1 --2- 172.21.15.79:0/1980414747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d7015a1c0 0x7f2d7006c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.310+0000 7f2d760f5700 1 -- 172.21.15.79:0/1980414747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7015c7d0 con 0x7f2d7015a640 2023-10-19T08:39:34.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.310+0000 7f2d760f5700 1 --2- 172.21.15.79:0/1980414747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d7015a640 0x7f2d7006cee0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2d700ca5b0 tx=0x7f2d68001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:34.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.310+0000 7f2d667fc700 1 -- 172.21.15.79:0/1980414747 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68001250 con 0x7f2d7015a640 2023-10-19T08:39:34.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.310+0000 7f2d667fc700 1 -- 172.21.15.79:0/1980414747 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6801d420 con 0x7f2d7015a640 2023-10-19T08:39:34.328 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.310+0000 7f2d77b58700 1 -- 172.21.15.79:0/1980414747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d7015cab0 con 0x7f2d7015a640 2023-10-19T08:39:34.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.310+0000 7f2d667fc700 1 -- 172.21.15.79:0/1980414747 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6801d7d0 con 0x7f2d7015a640 2023-10-19T08:39:34.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.310+0000 7f2d77b58700 1 -- 172.21.15.79:0/1980414747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d700c9310 con 0x7f2d7015a640 2023-10-19T08:39:34.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.311+0000 7f2d77b58700 1 -- 172.21.15.79:0/1980414747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d7015cfd0 con 0x7f2d7015a640 2023-10-19T08:39:34.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.311+0000 7f2d667fc700 1 -- 172.21.15.79:0/1980414747 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2d6801d930 con 0x7f2d7015a640 2023-10-19T08:39:34.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.312+0000 7f2d667fc700 1 --2- 172.21.15.79:0/1980414747 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f2d5406a0e0 0x7f2d5406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:34.329 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.312+0000 7f2d667fc700 1 -- 172.21.15.79:0/1980414747 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2d68089ed0 con 0x7f2d7015a640 2023-10-19T08:39:34.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.312+0000 7f2d758f4700 1 --2- 172.21.15.79:0/1980414747 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f2d5406a0e0 0x7f2d5406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:34.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.312+0000 7f2d758f4700 1 --2- 172.21.15.79:0/1980414747 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f2d5406a0e0 0x7f2d5406c5a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2d600016d0 tx=0x7f2d60009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:34.330 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.316+0000 7f2d667fc700 1 -- 172.21.15.79:0/1980414747 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f2d7015cfd0 con 0x7f2d7015a640 2023-10-19T08:39:34.510 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.506+0000 7f2d77b58700 1 -- 172.21.15.79:0/1980414747 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d7015ccf0 con 0x7f2d7015a640 2023-10-19T08:39:34.512 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.507+0000 7f2d667fc700 1 -- 172.21.15.79:0/1980414747 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18453 (secure 0 0 0) 0x7f2d7015ccf0 con 0x7f2d7015a640 2023-10-19T08:39:34.512 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":38,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:39:33.201952+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:39:31.343441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-19T08:39:32.163349+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:39:34.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.509+0000 7f2d77b58700 1 -- 172.21.15.79:0/1980414747 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f2d5406a0e0 msgr2=0x7f2d5406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:34.514 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.509+0000 7f2d77b58700 1 --2- 172.21.15.79:0/1980414747 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f2d5406a0e0 0x7f2d5406c5a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2d600016d0 tx=0x7f2d60009040 comp rx=0 tx=0).stop 2023-10-19T08:39:34.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.509+0000 7f2d77b58700 1 -- 172.21.15.79:0/1980414747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d7015a640 msgr2=0x7f2d7006cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:34.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.509+0000 7f2d77b58700 1 --2- 172.21.15.79:0/1980414747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d7015a640 0x7f2d7006cee0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f2d700ca5b0 tx=0x7f2d68001d80 comp rx=0 tx=0).stop 2023-10-19T08:39:34.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.509+0000 7f2d77b58700 1 -- 172.21.15.79:0/1980414747 shutdown_connections 2023-10-19T08:39:34.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.510+0000 7f2d77b58700 1 --2- 172.21.15.79:0/1980414747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d7015a640 0x7f2d7006cee0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.515 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.510+0000 7f2d77b58700 1 --2- 172.21.15.79:0/1980414747 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f2d5406a0e0 0x7f2d5406c5a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.510+0000 7f2d77b58700 1 --2- 172.21.15.79:0/1980414747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d5c007420 0x7f2d700c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.510+0000 7f2d77b58700 1 --2- 172.21.15.79:0/1980414747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d7015a1c0 0x7f2d7006c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.510+0000 7f2d77b58700 1 -- 172.21.15.79:0/1980414747 >> 172.21.15.79:0/1980414747 conn(0x7f2d700ce960 msgr2=0x7f2d700ae590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.510+0000 7f2d77b58700 1 -- 172.21.15.79:0/1980414747 shutdown_connections 2023-10-19T08:39:34.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.510+0000 7f2d77b58700 1 -- 172.21.15.79:0/1980414747 wait complete. 2023-10-19T08:39:34.526 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-19T08:39:34.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.644+0000 7fbbe8352700 1 Processor -- start 2023-10-19T08:39:34.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.644+0000 7fbbe8352700 1 -- start start 2023-10-19T08:39:34.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.645+0000 7fbbe8352700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fbbe015d0a0 0x7fbbe006f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:34.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.645+0000 7fbbe8352700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbbe006e650 0x7fbbe00cae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:34.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.645+0000 7fbbe8352700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe00c9de0 con 0x7fbbe00cb350 2023-10-19T08:39:34.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.645+0000 7fbbe8352700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe00ca050 con 0x7fbbe006e650 2023-10-19T08:39:34.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.645+0000 7fbbe8352700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe00ca330 con 0x7fbbe015d0a0 2023-10-19T08:39:34.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.645+0000 7fbbe58ed700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbbe006e650 0x7fbbe00cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:34.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.645+0000 7fbbe68ef700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbbe00cb350 0x7fbbe00cd360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59080/0 (socket says 172.21.15.79:59080) 2023-10-19T08:39:34.653 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.645+0000 7fbbe68ef700 1 -- 172.21.15.79:0/1556388774 learned_addr learned my addr 172.21.15.79:0/1556388774 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:34.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.646+0000 7fbbe60ee700 1 --2- 172.21.15.79:0/1556388774 >> v2:172.21.15.89:3300/0 conn(0x7fbbe015d0a0 0x7fbbe006f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:34.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.646+0000 7fbbe58ed700 1 -- 172.21.15.79:0/1556388774 >> v2:172.21.15.89:3300/0 conn(0x7fbbe015d0a0 msgr2=0x7fbbe006f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:34.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.646+0000 7fbbe58ed700 1 --2- 172.21.15.79:0/1556388774 >> v2:172.21.15.89:3300/0 conn(0x7fbbe015d0a0 0x7fbbe006f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.654 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.646+0000 7fbbe58ed700 1 -- 172.21.15.79:0/1556388774 >> v1:172.21.15.79:6789/0 conn(0x7fbbe00cb350 legacy=0x7fbbe00cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:34.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.646+0000 7fbbe50ec700 1 -- 172.21.15.79:0/1556388774 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148297952 0 0) 0x7fbbe00c9de0 con 0x7fbbe00cb350 2023-10-19T08:39:34.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.646+0000 7fbbe58ed700 1 -- 172.21.15.79:0/1556388774 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe00ca610 con 0x7fbbe006e650 2023-10-19T08:39:34.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.646+0000 7fbbe58ed700 1 --2- 172.21.15.79:0/1556388774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbe006e650 0x7fbbe00cae10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbbe006cc60 tx=0x7fbbdc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a41cfe2a49b183 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:34.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.646+0000 7fbbe50ec700 1 -- 172.21.15.79:0/1556388774 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc011830 con 0x7fbbe006e650 2023-10-19T08:39:34.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.646+0000 7fbbe50ec700 1 -- 172.21.15.79:0/1556388774 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc011990 con 0x7fbbe006e650 2023-10-19T08:39:34.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.646+0000 7fbbe50ec700 1 -- 172.21.15.79:0/1556388774 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc011d20 con 0x7fbbe006e650 2023-10-19T08:39:34.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.646+0000 7fbbe8352700 1 -- 172.21.15.79:0/1556388774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbe006e650 msgr2=0x7fbbe00cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:34.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.646+0000 7fbbe8352700 1 --2- 172.21.15.79:0/1556388774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbe006e650 0x7fbbe00cae10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbbe006cc60 tx=0x7fbbdc009b20 comp rx=0 tx=0).stop 2023-10-19T08:39:34.656 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.647+0000 7fbbe8352700 1 -- 172.21.15.79:0/1556388774 shutdown_connections 2023-10-19T08:39:34.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.647+0000 7fbbe8352700 1 --2- 172.21.15.79:0/1556388774 >> v2:172.21.15.89:3300/0 conn(0x7fbbe015d0a0 0x7fbbe006f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.647+0000 7fbbe8352700 1 --2- 172.21.15.79:0/1556388774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbe006e650 0x7fbbe00cae10 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.647+0000 7fbbe8352700 1 -- 172.21.15.79:0/1556388774 >> 172.21.15.79:0/1556388774 conn(0x7fbbe006d000 msgr2=0x7fbbe006d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:34.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.647+0000 7fbbe8352700 1 -- 172.21.15.79:0/1556388774 shutdown_connections 2023-10-19T08:39:34.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.647+0000 7fbbe8352700 1 -- 172.21.15.79:0/1556388774 wait complete. 2023-10-19T08:39:34.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.648+0000 7fbbe8352700 1 Processor -- start 2023-10-19T08:39:34.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.648+0000 7fbbe8352700 1 -- start start 2023-10-19T08:39:34.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.648+0000 7fbbe8352700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbbe006e650 0x7fbbe014b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:34.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.648+0000 7fbbe8352700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbe00cb350 0x7fbbe0148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:34.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbe8352700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbe015d0a0 0x7fbbe0148930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:34.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbe8352700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe01486c0 con 0x7fbbe00cb350 2023-10-19T08:39:34.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbe8352700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe0148e70 con 0x7fbbe015d0a0 2023-10-19T08:39:34.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbe8352700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe01490a0 con 0x7fbbe006e650 2023-10-19T08:39:34.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbe58ed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbe00cb350 0x7fbbe0148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:34.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbe58ed700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbe00cb350 0x7fbbe0148180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49012/0 (socket says 172.21.15.79:49012) 2023-10-19T08:39:34.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbe58ed700 1 -- 172.21.15.79:0/3661294093 learned_addr learned my addr 172.21.15.79:0/3661294093 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:34.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbe60ee700 1 --2- 172.21.15.79:0/3661294093 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbbe006e650 0x7fbbe014b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:34.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbe68ef700 1 --2- 172.21.15.79:0/3661294093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbe015d0a0 0x7fbbe0148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:34.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbe58ed700 1 -- 172.21.15.79:0/3661294093 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbbe006e650 msgr2=0x7fbbe014b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:34.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbe58ed700 1 --2- 172.21.15.79:0/3661294093 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbbe006e650 0x7fbbe014b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.663 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbe58ed700 1 -- 172.21.15.79:0/3661294093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbe015d0a0 msgr2=0x7fbbe0148930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:34.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbe58ed700 1 --2- 172.21.15.79:0/3661294093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbe015d0a0 0x7fbbe0148930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:34.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbe58ed700 1 -- 172.21.15.79:0/3661294093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc0094a0 con 0x7fbbe00cb350 2023-10-19T08:39:34.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbe68ef700 1 --2- 172.21.15.79:0/3661294093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbe015d0a0 0x7fbbe0148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:34.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbe58ed700 1 --2- 172.21.15.79:0/3661294093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbe00cb350 0x7fbbe0148180 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0090b0 tx=0x7fbbdc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:34.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbd6ffd700 1 -- 172.21.15.79:0/3661294093 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc0036a0 con 0x7fbbe00cb350 2023-10-19T08:39:34.664 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbd6ffd700 1 -- 172.21.15.79:0/3661294093 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc01f070 con 0x7fbbe00cb350 2023-10-19T08:39:34.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbe8352700 1 -- 172.21.15.79:0/3661294093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe0149380 con 0x7fbbe00cb350 2023-10-19T08:39:34.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbd6ffd700 1 -- 172.21.15.79:0/3661294093 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc003a00 con 0x7fbbe00cb350 2023-10-19T08:39:34.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.649+0000 7fbbe8352700 1 -- 172.21.15.79:0/3661294093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe0149940 con 0x7fbbe00cb350 2023-10-19T08:39:34.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.650+0000 7fbbe8352700 1 -- 172.21.15.79:0/3661294093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe0066490 con 0x7fbbe00cb350 2023-10-19T08:39:34.665 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.650+0000 7fbbd6ffd700 1 -- 172.21.15.79:0/3661294093 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbbdc003b60 con 0x7fbbe00cb350 2023-10-19T08:39:34.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.651+0000 7fbbd6ffd700 1 --2- 172.21.15.79:0/3661294093 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbbc406a0e0 0x7fbbc406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:34.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.651+0000 7fbbd6ffd700 1 -- 172.21.15.79:0/3661294093 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fbbdc021070 con 0x7fbbe00cb350 2023-10-19T08:39:34.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.651+0000 7fbbe60ee700 1 --2- 172.21.15.79:0/3661294093 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbbc406a0e0 0x7fbbc406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:34.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.651+0000 7fbbe60ee700 1 --2- 172.21.15.79:0/3661294093 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbbc406a0e0 0x7fbbc406c5a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009b40 tx=0x7fbbd0009210 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:34.666 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.655+0000 7fbbd6ffd700 1 -- 172.21.15.79:0/3661294093 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fbbdc055540 con 0x7fbbe00cb350 2023-10-19T08:39:34.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:34.890+0000 7fbbe8352700 1 -- 172.21.15.79:0/3661294093 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbbe004ee70 con 0x7fbbe00cb350 2023-10-19T08:39:35.822 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.818+0000 7fbbd6ffd700 1 -- 172.21.15.79:0/3661294093 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbbdc015020 con 0x7fbbe00cb350 2023-10-19T08:39:35.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.821+0000 7fbbe8352700 1 -- 172.21.15.79:0/3661294093 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbbc406a0e0 msgr2=0x7fbbc406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:35.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.821+0000 7fbbe8352700 1 --2- 172.21.15.79:0/3661294093 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbbc406a0e0 0x7fbbc406c5a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009b40 tx=0x7fbbd0009210 comp rx=0 tx=0).stop 2023-10-19T08:39:35.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.821+0000 7fbbe8352700 1 -- 172.21.15.79:0/3661294093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbe00cb350 msgr2=0x7fbbe0148180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:35.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.821+0000 7fbbe8352700 1 --2- 172.21.15.79:0/3661294093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbe00cb350 0x7fbbe0148180 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc0090b0 tx=0x7fbbdc004750 comp rx=0 tx=0).stop 2023-10-19T08:39:35.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.821+0000 7fbbe8352700 1 -- 172.21.15.79:0/3661294093 shutdown_connections 2023-10-19T08:39:35.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.821+0000 7fbbe8352700 1 --2- 172.21.15.79:0/3661294093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbe015d0a0 0x7fbbe0148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:35.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.821+0000 7fbbe8352700 1 --2- 172.21.15.79:0/3661294093 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fbbc406a0e0 0x7fbbc406c5a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:35.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.821+0000 7fbbe8352700 1 --2- 172.21.15.79:0/3661294093 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbbe006e650 0x7fbbe014b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:35.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.821+0000 7fbbe8352700 1 --2- 172.21.15.79:0/3661294093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbbe00cb350 0x7fbbe0148180 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:35.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.821+0000 7fbbe8352700 1 -- 172.21.15.79:0/3661294093 >> 172.21.15.79:0/3661294093 conn(0x7fbbe006d000 msgr2=0x7fbbe00ae320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:35.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.821+0000 7fbbe8352700 1 -- 172.21.15.79:0/3661294093 shutdown_connections 2023-10-19T08:39:35.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.821+0000 7fbbe8352700 1 -- 172.21.15.79:0/3661294093 wait complete. 2023-10-19T08:39:35.840 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-19T08:39:35.840 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-19T08:39:35.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.966+0000 7fe76b660700 1 Processor -- start 2023-10-19T08:39:35.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.966+0000 7fe76b660700 1 -- start start 2023-10-19T08:39:35.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.967+0000 7fe76b660700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe76415d060 0x7fe7640d2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:35.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.967+0000 7fe76b660700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe7640d2a70 0x7fe7640cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:35.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.967+0000 7fe76b660700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76406b8c0 con 0x7fe7640cde60 2023-10-19T08:39:35.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.967+0000 7fe76b660700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7640d2ef0 con 0x7fe7640d2a70 2023-10-19T08:39:35.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.967+0000 7fe76b660700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76406bba0 con 0x7fe76415d060 2023-10-19T08:39:35.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.967+0000 7fe769bfd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe7640cde60 0x7fe764160d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59094/0 (socket says 172.21.15.79:59094) 2023-10-19T08:39:35.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.967+0000 7fe769bfd700 1 -- 172.21.15.79:0/4145304609 learned_addr learned my addr 172.21.15.79:0/4145304609 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:35.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.967+0000 7fe768bfb700 1 --2- 172.21.15.79:0/4145304609 >> v2:172.21.15.89:3300/0 conn(0x7fe7640d2a70 0x7fe7640cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:35.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.967+0000 7fe7693fc700 1 --2- 172.21.15.79:0/4145304609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe76415d060 0x7fe7640d2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:35.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.967+0000 7fe75bfff700 1 -- 172.21.15.79:0/4145304609 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177624978 0 0) 0x7fe76406b8c0 con 0x7fe7640cde60 2023-10-19T08:39:35.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.967+0000 7fe75bfff700 1 -- 172.21.15.79:0/4145304609 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7500035b0 con 0x7fe7640cde60 2023-10-19T08:39:35.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe75bfff700 1 -- 172.21.15.79:0/4145304609 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4135835257 0 0) 0x7fe7500035b0 con 0x7fe7640cde60 2023-10-19T08:39:35.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe75bfff700 1 -- 172.21.15.79:0/4145304609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe76415d060 msgr2=0x7fe7640d2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:35.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe75bfff700 1 --2- 172.21.15.79:0/4145304609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe76415d060 0x7fe7640d2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:35.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe75bfff700 1 -- 172.21.15.79:0/4145304609 >> v2:172.21.15.89:3300/0 conn(0x7fe7640d2a70 msgr2=0x7fe7640cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:35.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe75bfff700 1 --2- 172.21.15.79:0/4145304609 >> v2:172.21.15.89:3300/0 conn(0x7fe7640d2a70 0x7fe7640cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:35.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe75bfff700 1 -- 172.21.15.79:0/4145304609 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76406be80 con 0x7fe7640cde60 2023-10-19T08:39:35.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe75bfff700 1 -- 172.21.15.79:0/4145304609 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7fe75c0019f0 con 0x7fe7640cde60 2023-10-19T08:39:35.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe75bfff700 1 -- 172.21.15.79:0/4145304609 >> v1:172.21.15.79:6789/0 conn(0x7fe7640cde60 legacy=0x7fe764160d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:35.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe75bfff700 1 --2- 172.21.15.79:0/4145304609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe750003a70 0x7fe750003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:35.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe75bfff700 1 --2- 172.21.15.79:0/4145304609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe76415d060 0x7fe750004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:35.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe75bfff700 1 --2- 172.21.15.79:0/4145304609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe750004d90 0x7fe750005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:35.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe75bfff700 1 -- 172.21.15.79:0/4145304609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7640d2ef0 con 0x7fe750003a70 2023-10-19T08:39:35.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe75bfff700 1 -- 172.21.15.79:0/4145304609 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76406bba0 con 0x7fe750004d90 2023-10-19T08:39:35.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe75bfff700 1 -- 172.21.15.79:0/4145304609 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75000ba10 con 0x7fe76415d060 2023-10-19T08:39:35.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe7693fc700 1 --2- 172.21.15.79:0/4145304609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe750003a70 0x7fe750003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:35.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe768bfb700 1 --2- 172.21.15.79:0/4145304609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe76415d060 0x7fe750004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:35.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe769bfd700 1 --2- 172.21.15.79:0/4145304609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe750004d90 0x7fe750005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:35.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe7693fc700 1 -- 172.21.15.79:0/4145304609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe76415d060 msgr2=0x7fe750004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:35.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe7693fc700 1 --2- 172.21.15.79:0/4145304609 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe76415d060 0x7fe750004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:35.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe7693fc700 1 -- 172.21.15.79:0/4145304609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe750004d90 msgr2=0x7fe750005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:35.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe7693fc700 1 --2- 172.21.15.79:0/4145304609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe750004d90 0x7fe750005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:35.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe7693fc700 1 -- 172.21.15.79:0/4145304609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7500035b0 con 0x7fe750003a70 2023-10-19T08:39:35.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe7693fc700 1 --2- 172.21.15.79:0/4145304609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe750003a70 0x7fe750003e90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe754009b60 tx=0x7fe750005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c596ff726260881e server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:35.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe75bfff700 1 -- 172.21.15.79:0/4145304609 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75400e6c0 con 0x7fe750003a70 2023-10-19T08:39:35.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe75bfff700 1 -- 172.21.15.79:0/4145304609 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75400e820 con 0x7fe750003a70 2023-10-19T08:39:35.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.968+0000 7fe75bfff700 1 -- 172.21.15.79:0/4145304609 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75400eb90 con 0x7fe750003a70 2023-10-19T08:39:35.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.969+0000 7fe76b660700 1 -- 172.21.15.79:0/4145304609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe750003a70 msgr2=0x7fe750003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:35.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.969+0000 7fe76b660700 1 --2- 172.21.15.79:0/4145304609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe750003a70 0x7fe750003e90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe754009b60 tx=0x7fe750005880 comp rx=0 tx=0).stop 2023-10-19T08:39:35.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.969+0000 7fe769bfd700 1 -- 172.21.15.79:0/4145304609 reap_dead start 2023-10-19T08:39:35.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.969+0000 7fe76b660700 1 -- 172.21.15.79:0/4145304609 shutdown_connections 2023-10-19T08:39:35.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.969+0000 7fe76b660700 1 -- 172.21.15.79:0/4145304609 >> 172.21.15.79:0/4145304609 conn(0x7fe7640d31a0 msgr2=0x7fe7640d35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:35.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.969+0000 7fe76b660700 1 -- 172.21.15.79:0/4145304609 shutdown_connections 2023-10-19T08:39:35.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.969+0000 7fe76b660700 1 -- 172.21.15.79:0/4145304609 wait complete. 2023-10-19T08:39:35.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.970+0000 7fe76b660700 1 Processor -- start 2023-10-19T08:39:35.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.970+0000 7fe76b660700 1 -- start start 2023-10-19T08:39:35.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.971+0000 7fe76b660700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe750003a70 0x7fe76415ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:35.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.971+0000 7fe76b660700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7641f65a0 0x7fe76414d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:35.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.971+0000 7fe76b660700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe764160c90 0x7fe764161120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:35.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.971+0000 7fe76b660700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe764161660 con 0x7fe7641f65a0 2023-10-19T08:39:35.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.971+0000 7fe76b660700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76414da90 con 0x7fe764160c90 2023-10-19T08:39:35.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.971+0000 7fe76b660700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76415f200 con 0x7fe750003a70 2023-10-19T08:39:35.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.971+0000 7fe768bfb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7641f65a0 0x7fe76414d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:35.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.971+0000 7fe768bfb700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7641f65a0 0x7fe76414d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49032/0 (socket says 172.21.15.79:49032) 2023-10-19T08:39:35.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.971+0000 7fe768bfb700 1 -- 172.21.15.79:0/1722704655 learned_addr learned my addr 172.21.15.79:0/1722704655 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:35.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.971+0000 7fe7693fc700 1 --2- 172.21.15.79:0/1722704655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe750003a70 0x7fe76415ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:35.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.971+0000 7fe769bfd700 1 --2- 172.21.15.79:0/1722704655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe764160c90 0x7fe764161120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:35.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.971+0000 7fe768bfb700 1 -- 172.21.15.79:0/1722704655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe750003a70 msgr2=0x7fe76415ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:35.990 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.971+0000 7fe768bfb700 1 --2- 172.21.15.79:0/1722704655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe750003a70 0x7fe76415ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:35.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.971+0000 7fe768bfb700 1 -- 172.21.15.79:0/1722704655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe764160c90 msgr2=0x7fe764161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:35.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.971+0000 7fe768bfb700 1 --2- 172.21.15.79:0/1722704655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe764160c90 0x7fe764161120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:35.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.971+0000 7fe768bfb700 1 -- 172.21.15.79:0/1722704655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76415f4e0 con 0x7fe7641f65a0 2023-10-19T08:39:35.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.971+0000 7fe769bfd700 1 --2- 172.21.15.79:0/1722704655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe764160c90 0x7fe764161120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:35.991 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.972+0000 7fe768bfb700 1 --2- 172.21.15.79:0/1722704655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7641f65a0 0x7fe76414d550 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe7600116f0 tx=0x7fe760011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:35.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.972+0000 7fe759ffb700 1 -- 172.21.15.79:0/1722704655 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760015870 con 0x7fe7641f65a0 2023-10-19T08:39:35.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.972+0000 7fe759ffb700 1 -- 172.21.15.79:0/1722704655 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7600159d0 con 0x7fe7641f65a0 2023-10-19T08:39:35.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.972+0000 7fe76b660700 1 -- 172.21.15.79:0/1722704655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76415f7c0 con 0x7fe7641f65a0 2023-10-19T08:39:35.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.972+0000 7fe759ffb700 1 -- 172.21.15.79:0/1722704655 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760015d40 con 0x7fe7641f65a0 2023-10-19T08:39:35.992 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.972+0000 7fe76b660700 1 -- 172.21.15.79:0/1722704655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76415fd80 con 0x7fe7641f65a0 2023-10-19T08:39:35.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.973+0000 7fe76b660700 1 -- 172.21.15.79:0/1722704655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe76404ee70 con 0x7fe7641f65a0 2023-10-19T08:39:35.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.973+0000 7fe759ffb700 1 -- 172.21.15.79:0/1722704655 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe760013400 con 0x7fe7641f65a0 2023-10-19T08:39:35.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.974+0000 7fe759ffb700 1 --2- 172.21.15.79:0/1722704655 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe74806a0e0 0x7fe74806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:35.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.974+0000 7fe7693fc700 1 --2- 172.21.15.79:0/1722704655 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe74806a0e0 0x7fe74806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:35.993 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.974+0000 7fe759ffb700 1 -- 172.21.15.79:0/1722704655 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe760088a20 con 0x7fe7641f65a0 2023-10-19T08:39:35.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.974+0000 7fe7693fc700 1 --2- 172.21.15.79:0/1722704655 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe74806a0e0 0x7fe74806c5a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe7540090b0 tx=0x7fe75401f040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:35.994 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:35.978+0000 7fe759ffb700 1 -- 172.21.15.79:0/1722704655 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fe760053f30 con 0x7fe7641f65a0 2023-10-19T08:39:36.214 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.210+0000 7fe76b660700 1 -- 172.21.15.79:0/1722704655 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe7640b6310 con 0x7fe7641f65a0 2023-10-19T08:39:36.656 INFO:tasks.ceph.mds.a.smithi079.stderr:2023-10-19T08:39:36.652+0000 7f66ea49c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-19T08:39:36.823 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.819+0000 7fe759ffb700 1 -- 172.21.15.79:0/1722704655 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe760057550 con 0x7fe7641f65a0 2023-10-19T08:39:36.826 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.822+0000 7fe76b660700 1 -- 172.21.15.79:0/1722704655 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe74806a0e0 msgr2=0x7fe74806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:36.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.822+0000 7fe76b660700 1 --2- 172.21.15.79:0/1722704655 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe74806a0e0 0x7fe74806c5a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe7540090b0 tx=0x7fe75401f040 comp rx=0 tx=0).stop 2023-10-19T08:39:36.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.822+0000 7fe76b660700 1 -- 172.21.15.79:0/1722704655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7641f65a0 msgr2=0x7fe76414d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:36.827 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.822+0000 7fe76b660700 1 --2- 172.21.15.79:0/1722704655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7641f65a0 0x7fe76414d550 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe7600116f0 tx=0x7fe760011a00 comp rx=0 tx=0).stop 2023-10-19T08:39:36.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.822+0000 7fe76b660700 1 -- 172.21.15.79:0/1722704655 shutdown_connections 2023-10-19T08:39:36.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.822+0000 7fe76b660700 1 --2- 172.21.15.79:0/1722704655 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe764160c90 0x7fe764161120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:36.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.822+0000 7fe76b660700 1 --2- 172.21.15.79:0/1722704655 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe74806a0e0 0x7fe74806c5a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:36.828 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.822+0000 7fe76b660700 1 --2- 172.21.15.79:0/1722704655 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe750003a70 0x7fe76415ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:36.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.822+0000 7fe76b660700 1 --2- 172.21.15.79:0/1722704655 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7641f65a0 0x7fe76414d550 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:36.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.822+0000 7fe76b660700 1 -- 172.21.15.79:0/1722704655 >> 172.21.15.79:0/1722704655 conn(0x7fe7640d31a0 msgr2=0x7fe76415c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:36.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.822+0000 7fe76b660700 1 -- 172.21.15.79:0/1722704655 shutdown_connections 2023-10-19T08:39:36.829 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.822+0000 7fe76b660700 1 -- 172.21.15.79:0/1722704655 wait complete. 2023-10-19T08:39:36.840 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-19T08:39:36.840 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T08:39:36.963 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.959+0000 7fd849176700 1 Processor -- start 2023-10-19T08:39:36.964 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.959+0000 7fd849176700 1 -- start start 2023-10-19T08:39:36.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd849176700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd8440af170 0x7fd8440cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:36.967 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd849176700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8440b1de0 0x7fd8440b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:36.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd849176700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84415de50 con 0x7fd8440cd800 2023-10-19T08:39:36.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd849176700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8440af550 con 0x7fd8440af170 2023-10-19T08:39:36.968 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd849176700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440b16b0 con 0x7fd8440b1de0 2023-10-19T08:39:36.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd84359e700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd8440cd800 0x7fd84406a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59114/0 (socket says 172.21.15.79:59114) 2023-10-19T08:39:36.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd84359e700 1 -- 172.21.15.79:0/2349003027 learned_addr learned my addr 172.21.15.79:0/2349003027 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:36.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd84259c700 1 --2- 172.21.15.79:0/2349003027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8440b1de0 0x7fd8440b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:36.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd842d9d700 1 --2- 172.21.15.79:0/2349003027 >> v2:172.21.15.89:3300/0 conn(0x7fd8440af170 0x7fd8440cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:36.969 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd841d9b700 1 -- 172.21.15.79:0/2349003027 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420735975 0 0) 0x7fd84415de50 con 0x7fd8440cd800 2023-10-19T08:39:36.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd841d9b700 1 -- 172.21.15.79:0/2349003027 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd82c0035b0 con 0x7fd8440cd800 2023-10-19T08:39:36.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd841d9b700 1 -- 172.21.15.79:0/2349003027 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4070003493 0 0) 0x7fd82c0035b0 con 0x7fd8440cd800 2023-10-19T08:39:36.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd841d9b700 1 -- 172.21.15.79:0/2349003027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8440b1de0 msgr2=0x7fd8440b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:36.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd841d9b700 1 --2- 172.21.15.79:0/2349003027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8440b1de0 0x7fd8440b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:36.970 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd841d9b700 1 -- 172.21.15.79:0/2349003027 >> v2:172.21.15.89:3300/0 conn(0x7fd8440af170 msgr2=0x7fd8440cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:36.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd841d9b700 1 --2- 172.21.15.79:0/2349003027 >> v2:172.21.15.89:3300/0 conn(0x7fd8440af170 0x7fd8440cd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:36.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd841d9b700 1 -- 172.21.15.79:0/2349003027 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84415e130 con 0x7fd8440cd800 2023-10-19T08:39:36.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd841d9b700 1 -- 172.21.15.79:0/2349003027 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7fd83c0019f0 con 0x7fd8440cd800 2023-10-19T08:39:36.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd841d9b700 1 -- 172.21.15.79:0/2349003027 >> v1:172.21.15.79:6789/0 conn(0x7fd8440cd800 legacy=0x7fd84406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:36.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd841d9b700 1 --2- 172.21.15.79:0/2349003027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8440b1de0 0x7fd82c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:36.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd841d9b700 1 --2- 172.21.15.79:0/2349003027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd82c003f80 0x7fd82c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:36.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd841d9b700 1 --2- 172.21.15.79:0/2349003027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd82c004d90 0x7fd82c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:36.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd841d9b700 1 -- 172.21.15.79:0/2349003027 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440af550 con 0x7fd82c004d90 2023-10-19T08:39:36.972 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd841d9b700 1 -- 172.21.15.79:0/2349003027 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440b16b0 con 0x7fd82c003f80 2023-10-19T08:39:36.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.960+0000 7fd841d9b700 1 -- 172.21.15.79:0/2349003027 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c00ba10 con 0x7fd8440b1de0 2023-10-19T08:39:36.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.961+0000 7fd84359e700 1 --2- 172.21.15.79:0/2349003027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd82c004d90 0x7fd82c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:36.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.961+0000 7fd84259c700 1 --2- 172.21.15.79:0/2349003027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd82c003f80 0x7fd82c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:36.973 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.961+0000 7fd842d9d700 1 --2- 172.21.15.79:0/2349003027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8440b1de0 0x7fd82c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:36.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.961+0000 7fd84359e700 1 -- 172.21.15.79:0/2349003027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8440b1de0 msgr2=0x7fd82c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:36.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.961+0000 7fd84359e700 1 --2- 172.21.15.79:0/2349003027 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd8440b1de0 0x7fd82c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:36.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.961+0000 7fd84359e700 1 -- 172.21.15.79:0/2349003027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd82c003f80 msgr2=0x7fd82c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:36.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.961+0000 7fd84359e700 1 --2- 172.21.15.79:0/2349003027 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd82c003f80 0x7fd82c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:36.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.961+0000 7fd84359e700 1 -- 172.21.15.79:0/2349003027 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c0035b0 con 0x7fd82c004d90 2023-10-19T08:39:36.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.961+0000 7fd84359e700 1 --2- 172.21.15.79:0/2349003027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd82c004d90 0x7fd82c005210 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00a8d0 tx=0x7fd82c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7fc1d57d21aa78 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:36.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.961+0000 7fd841d9b700 1 -- 172.21.15.79:0/2349003027 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00a340 con 0x7fd82c004d90 2023-10-19T08:39:36.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.961+0000 7fd841d9b700 1 -- 172.21.15.79:0/2349003027 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c012600 con 0x7fd82c004d90 2023-10-19T08:39:36.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.961+0000 7fd841d9b700 1 -- 172.21.15.79:0/2349003027 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c0129b0 con 0x7fd82c004d90 2023-10-19T08:39:36.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.962+0000 7fd849176700 1 -- 172.21.15.79:0/2349003027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd82c004d90 msgr2=0x7fd82c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:36.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.962+0000 7fd849176700 1 --2- 172.21.15.79:0/2349003027 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd82c004d90 0x7fd82c005210 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00a8d0 tx=0x7fd82c005880 comp rx=0 tx=0).stop 2023-10-19T08:39:36.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.962+0000 7fd84359e700 1 -- 172.21.15.79:0/2349003027 reap_dead start 2023-10-19T08:39:36.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.962+0000 7fd849176700 1 -- 172.21.15.79:0/2349003027 shutdown_connections 2023-10-19T08:39:36.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.962+0000 7fd849176700 1 -- 172.21.15.79:0/2349003027 >> 172.21.15.79:0/2349003027 conn(0x7fd84406dcc0 msgr2=0x7fd84406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:36.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.962+0000 7fd849176700 1 -- 172.21.15.79:0/2349003027 shutdown_connections 2023-10-19T08:39:36.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.962+0000 7fd849176700 1 -- 172.21.15.79:0/2349003027 wait complete. 2023-10-19T08:39:36.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.963+0000 7fd849176700 1 Processor -- start 2023-10-19T08:39:36.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.964+0000 7fd849176700 1 -- start start 2023-10-19T08:39:36.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.964+0000 7fd849176700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd82c004d90 0x7fd84415fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:36.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.964+0000 7fd849176700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd84415cab0 0x7fd84415c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:36.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.964+0000 7fd849176700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd84415d000 0x7fd8440c3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:36.981 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.964+0000 7fd849176700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd844161250 con 0x7fd84415d000 2023-10-19T08:39:36.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.964+0000 7fd849176700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440c45c0 con 0x7fd84415cab0 2023-10-19T08:39:36.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.964+0000 7fd849176700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd844160a40 con 0x7fd82c004d90 2023-10-19T08:39:36.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.965+0000 7fd84359e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd84415d000 0x7fd8440c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:36.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.965+0000 7fd84359e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd84415d000 0x7fd8440c3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49054/0 (socket says 172.21.15.79:49054) 2023-10-19T08:39:36.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.965+0000 7fd84359e700 1 -- 172.21.15.79:0/3836753068 learned_addr learned my addr 172.21.15.79:0/3836753068 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:36.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.965+0000 7fd84259c700 1 --2- 172.21.15.79:0/3836753068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd84415cab0 0x7fd84415c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:36.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.965+0000 7fd842d9d700 1 --2- 172.21.15.79:0/3836753068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd82c004d90 0x7fd84415fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:36.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.965+0000 7fd84359e700 1 -- 172.21.15.79:0/3836753068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd82c004d90 msgr2=0x7fd84415fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:36.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.965+0000 7fd84359e700 1 --2- 172.21.15.79:0/3836753068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd82c004d90 0x7fd84415fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:36.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.965+0000 7fd84359e700 1 -- 172.21.15.79:0/3836753068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd84415cab0 msgr2=0x7fd84415c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:36.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.965+0000 7fd84359e700 1 --2- 172.21.15.79:0/3836753068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd84415cab0 0x7fd84415c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:36.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.965+0000 7fd84359e700 1 -- 172.21.15.79:0/3836753068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84415f6a0 con 0x7fd84415d000 2023-10-19T08:39:36.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.965+0000 7fd84359e700 1 --2- 172.21.15.79:0/3836753068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd84415d000 0x7fd8440c3760 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd83c012000 tx=0x7fd83c001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:36.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.965+0000 7fd82b7fe700 1 -- 172.21.15.79:0/3836753068 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00a340 con 0x7fd84415d000 2023-10-19T08:39:36.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.965+0000 7fd82b7fe700 1 -- 172.21.15.79:0/3836753068 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c0019c0 con 0x7fd84415d000 2023-10-19T08:39:36.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.965+0000 7fd849176700 1 -- 172.21.15.79:0/3836753068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd844160c90 con 0x7fd84415d000 2023-10-19T08:39:36.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.965+0000 7fd82b7fe700 1 -- 172.21.15.79:0/3836753068 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c01e640 con 0x7fd84415d000 2023-10-19T08:39:36.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.965+0000 7fd849176700 1 -- 172.21.15.79:0/3836753068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84415f330 con 0x7fd84415d000 2023-10-19T08:39:36.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.966+0000 7fd849176700 1 -- 172.21.15.79:0/3836753068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84415f190 con 0x7fd84415d000 2023-10-19T08:39:36.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.967+0000 7fd82b7fe700 1 -- 172.21.15.79:0/3836753068 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd83c019030 con 0x7fd84415d000 2023-10-19T08:39:36.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.967+0000 7fd82b7fe700 1 --2- 172.21.15.79:0/3836753068 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd83006a0e0 0x7fd83006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:36.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.967+0000 7fd82b7fe700 1 -- 172.21.15.79:0/3836753068 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd83c08a050 con 0x7fd84415d000 2023-10-19T08:39:36.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.967+0000 7fd842d9d700 1 --2- 172.21.15.79:0/3836753068 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd83006a0e0 0x7fd83006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:36.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.968+0000 7fd842d9d700 1 --2- 172.21.15.79:0/3836753068 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd83006a0e0 0x7fd83006c5a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd834009ce0 tx=0x7fd834009210 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:36.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:36.972+0000 7fd82b7fe700 1 -- 172.21.15.79:0/3836753068 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fd84415f190 con 0x7fd84415d000 2023-10-19T08:39:37.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.202+0000 7fd849176700 1 -- 172.21.15.79:0/3836753068 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd84415f190 con 0x7fd84415d000 2023-10-19T08:39:37.207 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.203+0000 7fd82b7fe700 1 -- 172.21.15.79:0/3836753068 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4872 (secure 0 0 0) 0x7fd84415f190 con 0x7fd84415d000 2023-10-19T08:39:37.208 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:37.208 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/2135698128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2135698128},{"type":"v1","addr":"172.21.15.89:6834","nonce":2135698128}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5299,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3306148048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3306148048},{"type":"v1","addr":"172.21.15.89:6835","nonce":3306148048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3876408658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3876408658},{"type":"v1","addr":"172.21.15.79:6836","nonce":3876408658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-19T08:39:33.202270+0000","modified":"2023-10-19T08:39:36.817728+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/594110949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":594110949},{"type":"v1","addr":"172.21.15.79:6837","nonce":594110949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-19T08:39:37.209 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.205+0000 7fd849176700 1 -- 172.21.15.79:0/3836753068 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd83006a0e0 msgr2=0x7fd83006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:37.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.205+0000 7fd849176700 1 --2- 172.21.15.79:0/3836753068 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd83006a0e0 0x7fd83006c5a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd834009ce0 tx=0x7fd834009210 comp rx=0 tx=0).stop 2023-10-19T08:39:37.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.205+0000 7fd849176700 1 -- 172.21.15.79:0/3836753068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd84415d000 msgr2=0x7fd8440c3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:37.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.205+0000 7fd849176700 1 --2- 172.21.15.79:0/3836753068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd84415d000 0x7fd8440c3760 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd83c012000 tx=0x7fd83c001360 comp rx=0 tx=0).stop 2023-10-19T08:39:37.210 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.205+0000 7fd849176700 1 -- 172.21.15.79:0/3836753068 shutdown_connections 2023-10-19T08:39:37.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.205+0000 7fd849176700 1 --2- 172.21.15.79:0/3836753068 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd84415d000 0x7fd8440c3760 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.205+0000 7fd849176700 1 --2- 172.21.15.79:0/3836753068 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fd83006a0e0 0x7fd83006c5a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.205+0000 7fd849176700 1 --2- 172.21.15.79:0/3836753068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd82c004d90 0x7fd84415fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.205+0000 7fd849176700 1 --2- 172.21.15.79:0/3836753068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd84415cab0 0x7fd84415c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.211 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.205+0000 7fd849176700 1 -- 172.21.15.79:0/3836753068 >> 172.21.15.79:0/3836753068 conn(0x7fd84406dcc0 msgr2=0x7fd8440b0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:37.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.205+0000 7fd849176700 1 -- 172.21.15.79:0/3836753068 shutdown_connections 2023-10-19T08:39:37.212 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.205+0000 7fd849176700 1 -- 172.21.15.79:0/3836753068 wait complete. 2023-10-19T08:39:37.212 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 18 2023-10-19T08:39:37.222 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-19T08:39:37.343 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.339+0000 7f30522c3700 1 Processor -- start 2023-10-19T08:39:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.339+0000 7f30522c3700 1 -- start start 2023-10-19T08:39:37.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.340+0000 7f30522c3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f304c159f40 0x7f304c15e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:37.346 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.340+0000 7f30522c3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f304c0b5610 0x7f304c0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:37.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.340+0000 7f30522c3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304c0cc870 con 0x7f304c0ce5c0 2023-10-19T08:39:37.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.340+0000 7f30522c3700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304c15e870 con 0x7f304c159f40 2023-10-19T08:39:37.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.340+0000 7f30522c3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304c0b5aa0 con 0x7f304c0b5610 2023-10-19T08:39:37.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.340+0000 7f304bfff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f304c159f40 0x7f304c15e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:37.347 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.340+0000 7f3050860700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f304c0ce5c0 0x7f304c0b16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59134/0 (socket says 172.21.15.79:59134) 2023-10-19T08:39:37.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.340+0000 7f3050860700 1 -- 172.21.15.79:0/2899431886 learned_addr learned my addr 172.21.15.79:0/2899431886 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:37.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.340+0000 7f304b7fe700 1 --2- 172.21.15.79:0/2899431886 >> v2:172.21.15.89:3300/0 conn(0x7f304c0b5610 0x7f304c0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:37.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.340+0000 7f304affd700 1 -- 172.21.15.79:0/2899431886 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166956208 0 0) 0x7f3044001490 con 0x7f304c0ce5c0 2023-10-19T08:39:37.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.340+0000 7f304affd700 1 -- 172.21.15.79:0/2899431886 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30340057c0 con 0x7f304c0ce5c0 2023-10-19T08:39:37.348 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.340+0000 7f304bfff700 1 -- 172.21.15.79:0/2899431886 >> v2:172.21.15.89:3300/0 conn(0x7f304c0b5610 msgr2=0x7f304c0cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:37.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.340+0000 7f304bfff700 1 --2- 172.21.15.79:0/2899431886 >> v2:172.21.15.89:3300/0 conn(0x7f304c0b5610 0x7f304c0cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.340+0000 7f304bfff700 1 -- 172.21.15.79:0/2899431886 >> v1:172.21.15.79:6789/0 conn(0x7f304c0ce5c0 legacy=0x7f304c0b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:37.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.340+0000 7f304bfff700 1 -- 172.21.15.79:0/2899431886 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c0cd800 con 0x7f304c159f40 2023-10-19T08:39:37.349 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.340+0000 7f304bfff700 1 --2- 172.21.15.79:0/2899431886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f304c159f40 0x7f304c15e330 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f304c071c50 tx=0x7f3040009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec562d746a536c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:37.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.341+0000 7f304affd700 1 -- 172.21.15.79:0/2899431886 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040011830 con 0x7f304c159f40 2023-10-19T08:39:37.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.341+0000 7f304affd700 1 -- 172.21.15.79:0/2899431886 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3040011990 con 0x7f304c159f40 2023-10-19T08:39:37.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.341+0000 7f304affd700 1 -- 172.21.15.79:0/2899431886 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040011d20 con 0x7f304c159f40 2023-10-19T08:39:37.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.341+0000 7f30522c3700 1 -- 172.21.15.79:0/2899431886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f304c159f40 msgr2=0x7f304c15e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:37.350 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.341+0000 7f30522c3700 1 --2- 172.21.15.79:0/2899431886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f304c159f40 0x7f304c15e330 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f304c071c50 tx=0x7f3040009b20 comp rx=0 tx=0).stop 2023-10-19T08:39:37.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.341+0000 7f30522c3700 1 -- 172.21.15.79:0/2899431886 shutdown_connections 2023-10-19T08:39:37.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.341+0000 7f30522c3700 1 --2- 172.21.15.79:0/2899431886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f304c159f40 0x7f304c15e330 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.341+0000 7f30522c3700 1 --2- 172.21.15.79:0/2899431886 >> v2:172.21.15.89:3300/0 conn(0x7f304c0b5610 0x7f304c0cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.341+0000 7f30522c3700 1 -- 172.21.15.79:0/2899431886 >> 172.21.15.79:0/2899431886 conn(0x7f304c06dcc0 msgr2=0x7f304c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:37.351 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.341+0000 7f30522c3700 1 -- 172.21.15.79:0/2899431886 shutdown_connections 2023-10-19T08:39:37.352 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.341+0000 7f30522c3700 1 -- 172.21.15.79:0/2899431886 wait complete. 2023-10-19T08:39:37.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.342+0000 7f30522c3700 1 Processor -- start 2023-10-19T08:39:37.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.343+0000 7f30522c3700 1 -- start start 2023-10-19T08:39:37.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.343+0000 7f30522c3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f304c0ce5c0 0x7f304c1f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:37.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.343+0000 7f30522c3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f304c159f40 0x7f304c1ee160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:37.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.343+0000 7f30522c3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f304c153d50 0x7f304c0cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:37.355 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.343+0000 7f30522c3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c1ef150 con 0x7f304c153d50 2023-10-19T08:39:37.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.343+0000 7f30522c3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c1f26f0 con 0x7f304c0ce5c0 2023-10-19T08:39:37.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.343+0000 7f30522c3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c1ee6a0 con 0x7f304c159f40 2023-10-19T08:39:37.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.343+0000 7f3050860700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f304c153d50 0x7f304c0cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:37.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.343+0000 7f3050860700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f304c153d50 0x7f304c0cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49068/0 (socket says 172.21.15.79:49068) 2023-10-19T08:39:37.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.343+0000 7f3050860700 1 -- 172.21.15.79:0/2441188294 learned_addr learned my addr 172.21.15.79:0/2441188294 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:37.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.344+0000 7f304b7fe700 1 --2- 172.21.15.79:0/2441188294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f304c159f40 0x7f304c1ee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:37.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.344+0000 7f304bfff700 1 --2- 172.21.15.79:0/2441188294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f304c0ce5c0 0x7f304c1f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:37.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.344+0000 7f3050860700 1 -- 172.21.15.79:0/2441188294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f304c159f40 msgr2=0x7f304c1ee160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:37.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.344+0000 7f3050860700 1 --2- 172.21.15.79:0/2441188294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f304c159f40 0x7f304c1ee160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.344+0000 7f3050860700 1 -- 172.21.15.79:0/2441188294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f304c0ce5c0 msgr2=0x7f304c1f21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.344+0000 7f3050860700 1 --2- 172.21.15.79:0/2441188294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f304c0ce5c0 0x7f304c1f21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.344+0000 7f3050860700 1 -- 172.21.15.79:0/2441188294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30400094a0 con 0x7f304c153d50 2023-10-19T08:39:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.344+0000 7f3050860700 1 --2- 172.21.15.79:0/2441188294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f304c153d50 0x7f304c0cfad0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f304400cb40 tx=0x7f304400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:37.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.344+0000 7f3048ff9700 1 -- 172.21.15.79:0/2441188294 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400a980 con 0x7f304c153d50 2023-10-19T08:39:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.344+0000 7f3048ff9700 1 -- 172.21.15.79:0/2441188294 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304400aae0 con 0x7f304c153d50 2023-10-19T08:39:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.344+0000 7f30522c3700 1 -- 172.21.15.79:0/2441188294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304c1ee8b0 con 0x7f304c153d50 2023-10-19T08:39:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.344+0000 7f3048ff9700 1 -- 172.21.15.79:0/2441188294 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400ae50 con 0x7f304c153d50 2023-10-19T08:39:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.344+0000 7f30522c3700 1 -- 172.21.15.79:0/2441188294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c1eee70 con 0x7f304c153d50 2023-10-19T08:39:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.345+0000 7f30522c3700 1 -- 172.21.15.79:0/2441188294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304c04ee70 con 0x7f304c153d50 2023-10-19T08:39:37.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.345+0000 7f3048ff9700 1 -- 172.21.15.79:0/2441188294 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f304401b3b0 con 0x7f304c153d50 2023-10-19T08:39:37.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.346+0000 7f3048ff9700 1 --2- 172.21.15.79:0/2441188294 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f303806a0e0 0x7f303806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:37.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.346+0000 7f3048ff9700 1 -- 172.21.15.79:0/2441188294 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3044087fd0 con 0x7f304c153d50 2023-10-19T08:39:37.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.346+0000 7f304bfff700 1 --2- 172.21.15.79:0/2441188294 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f303806a0e0 0x7f303806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:37.360 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.346+0000 7f304bfff700 1 --2- 172.21.15.79:0/2441188294 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f303806a0e0 0x7f303806c5a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f30400090b0 tx=0x7f304001c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.351+0000 7f3048ff9700 1 -- 172.21.15.79:0/2441188294 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f3044053630 con 0x7f304c153d50 2023-10-19T08:39:37.546 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.542+0000 7f30522c3700 1 -- 172.21.15.79:0/2441188294 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f304c0cc870 con 0x7f304c153d50 2023-10-19T08:39:37.547 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.543+0000 7f3048ff9700 1 -- 172.21.15.79:0/2441188294 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18440 (secure 0 0 0) 0x7f304c0cc870 con 0x7f304c153d50 2023-10-19T08:39:37.548 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:37.548 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":39,"fsid":"98eaa3c1-94c8-49a6-8b8d-caae2bee3a98","created":"2023-10-19T08:37:37.523150+0000","modified":"2023-10-19T08:39:34.807538+0000","last_up_change":"2023-10-19T08:37:49.102853+0000","last_in_change":"2023-10-19T08:37:39.999281+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-19T08:37:49.135900+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-19T08:37:49.907772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-19T08:39:31.343441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-19T08:39:32.163349+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8fc732cf-6693-47af-b4fa-58f49d64d4b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6801","nonce":942045489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6805","nonce":942045489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6811","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6813","nonce":942045489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":942045489},{"type":"v1","addr":"172.21.15.79:6809","nonce":942045489}]},"public_addr":"172.21.15.79:6801/942045489","cluster_addr":"172.21.15.79:6805/942045489","heartbeat_back_addr":"172.21.15.79:6813/942045489","heartbeat_front_addr":"172.21.15.79:6809/942045489","state":["exists","up"]},{"osd":1,"uuid":"3df762c5-6cab-4019-84af-5d38457c64f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6818","nonce":2397905014}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6822","nonce":2397905014}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6830","nonce":2397905014}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":2397905014},{"type":"v1","addr":"172.21.15.79:6826","nonce":2397905014}]},"public_addr":"172.21.15.79:6818/2397905014","cluster_addr":"172.21.15.79:6822/2397905014","heartbeat_back_addr":"172.21.15.79:6830/2397905014","heartbeat_front_addr":"172.21.15.79:6826/2397905014","state":["exists","up"]},{"osd":2,"uuid":"c263a092-506b-4051-bd17-c7082ab857e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6804","nonce":184279381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6808","nonce":184279381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6815","nonce":184279381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":184279381},{"type":"v1","addr":"172.21.15.79:6812","nonce":184279381}]},"public_addr":"172.21.15.79:6804/184279381","cluster_addr":"172.21.15.79:6808/184279381","heartbeat_back_addr":"172.21.15.79:6815/184279381","heartbeat_front_addr":"172.21.15.79:6812/184279381","state":["exists","up"]},{"osd":3,"uuid":"0e13ba18-f5ea-4162-9665-4bf965b07b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6817","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6819","nonce":3593161836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6821","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6823","nonce":3593161836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6829","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6831","nonce":3593161836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6825","nonce":3593161836},{"type":"v1","addr":"172.21.15.79:6827","nonce":3593161836}]},"public_addr":"172.21.15.79:6819/3593161836","cluster_addr":"172.21.15.79:6823/3593161836","heartbeat_back_addr":"172.21.15.79:6831/3593161836","heartbeat_front_addr":"172.21.15.79:6827/3593161836","state":["exists","up"]},{"osd":4,"uuid":"98bd5f90-96c8-4ab8-9905-892af9c61de3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6809","nonce":1735906914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6811","nonce":1735906914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6815","nonce":1735906914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1735906914},{"type":"v1","addr":"172.21.15.89:6813","nonce":1735906914}]},"public_addr":"172.21.15.89:6809/1735906914","cluster_addr":"172.21.15.89:6811/1735906914","heartbeat_back_addr":"172.21.15.89:6815/1735906914","heartbeat_front_addr":"172.21.15.89:6813/1735906914","state":["exists","up"]},{"osd":5,"uuid":"34a448aa-ee32-4915-9c76-968440526e50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6817","nonce":4289815223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6819","nonce":4289815223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6823","nonce":4289815223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":4289815223},{"type":"v1","addr":"172.21.15.89:6821","nonce":4289815223}]},"public_addr":"172.21.15.89:6817/4289815223","cluster_addr":"172.21.15.89:6819/4289815223","heartbeat_back_addr":"172.21.15.89:6823/4289815223","heartbeat_front_addr":"172.21.15.89:6821/4289815223","state":["exists","up"]},{"osd":6,"uuid":"2f526ed0-57ba-44b2-9d4c-d07c5700b0e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6801","nonce":1904262341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6803","nonce":1904262341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6807","nonce":1904262341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1904262341},{"type":"v1","addr":"172.21.15.89:6805","nonce":1904262341}]},"public_addr":"172.21.15.89:6801/1904262341","cluster_addr":"172.21.15.89:6803/1904262341","heartbeat_back_addr":"172.21.15.89:6807/1904262341","heartbeat_front_addr":"172.21.15.89:6805/1904262341","state":["exists","up"]},{"osd":7,"uuid":"d0001967-3981-4ebe-8dfb-aa38db091f0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6825","nonce":3325999642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6827","nonce":3325999642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6831","nonce":3325999642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":3325999642},{"type":"v1","addr":"172.21.15.89:6829","nonce":3325999642}]},"public_addr":"172.21.15.89:6825/3325999642","cluster_addr":"172.21.15.89:6827/3325999642","heartbeat_back_addr":"172.21.15.89:6831/3325999642","heartbeat_front_addr":"172.21.15.89:6829/3325999642","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.192871+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.217182+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.172187+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.197040+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.277512+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.242986+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.248836+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-19T08:37:45.272545+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-19T08:39:37.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.545+0000 7f30522c3700 1 -- 172.21.15.79:0/2441188294 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f303806a0e0 msgr2=0x7f303806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:37.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.545+0000 7f30522c3700 1 --2- 172.21.15.79:0/2441188294 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f303806a0e0 0x7f303806c5a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f30400090b0 tx=0x7f304001c040 comp rx=0 tx=0).stop 2023-10-19T08:39:37.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.545+0000 7f30522c3700 1 -- 172.21.15.79:0/2441188294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f304c153d50 msgr2=0x7f304c0cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:37.550 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.545+0000 7f30522c3700 1 --2- 172.21.15.79:0/2441188294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f304c153d50 0x7f304c0cfad0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f304400cb40 tx=0x7f304400ce50 comp rx=0 tx=0).stop 2023-10-19T08:39:37.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.545+0000 7f30522c3700 1 -- 172.21.15.79:0/2441188294 shutdown_connections 2023-10-19T08:39:37.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.545+0000 7f30522c3700 1 --2- 172.21.15.79:0/2441188294 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f304c153d50 0x7f304c0cfad0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.545+0000 7f30522c3700 1 --2- 172.21.15.79:0/2441188294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f304c0ce5c0 0x7f304c1f21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.545+0000 7f30522c3700 1 --2- 172.21.15.79:0/2441188294 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f303806a0e0 0x7f303806c5a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.545+0000 7f30522c3700 1 --2- 172.21.15.79:0/2441188294 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f304c159f40 0x7f304c1ee160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.551 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.545+0000 7f30522c3700 1 -- 172.21.15.79:0/2441188294 >> 172.21.15.79:0/2441188294 conn(0x7f304c06dcc0 msgr2=0x7f304c158520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:37.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.545+0000 7f30522c3700 1 -- 172.21.15.79:0/2441188294 shutdown_connections 2023-10-19T08:39:37.552 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.545+0000 7f30522c3700 1 -- 172.21.15.79:0/2441188294 wait complete. 2023-10-19T08:39:37.562 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-19T08:39:37.562 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-19T08:39:37.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.678+0000 7f9c2af92700 1 Processor -- start 2023-10-19T08:39:37.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.678+0000 7f9c2af92700 1 -- start start 2023-10-19T08:39:37.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.678+0000 7f9c2af92700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9c2415e570 0x7f9c240d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:37.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.678+0000 7f9c2af92700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c240cb6f0 0x7f9c240b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:37.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.678+0000 7f9c2af92700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c240afd60 con 0x7f9c240b0a30 2023-10-19T08:39:37.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.678+0000 7f9c2af92700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c240b0ec0 con 0x7f9c2415e570 2023-10-19T08:39:37.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.678+0000 7f9c2af92700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c240af810 con 0x7f9c240cb6f0 2023-10-19T08:39:37.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.679+0000 7f9c23fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c240cb6f0 0x7f9c240b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:37.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.679+0000 7f9c28d2e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9c2415e570 0x7f9c240d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:37.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.679+0000 7f9c23fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c240cb6f0 0x7f9c240b04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.79:51696/0 (socket says 172.21.15.79:51696) 2023-10-19T08:39:37.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.679+0000 7f9c23fff700 1 -- 172.21.15.79:0/4169522259 learned_addr learned my addr 172.21.15.79:0/4169522259 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:37.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.679+0000 7f9c28d2e700 1 --2- 172.21.15.79:0/4169522259 >> v2:172.21.15.89:3300/0 conn(0x7f9c2415e570 0x7f9c240d1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.79:35320/0 (socket says 172.21.15.79:35320) 2023-10-19T08:39:37.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.679+0000 7f9c23fff700 1 -- 172.21.15.79:0/4169522259 >> v2:172.21.15.89:3300/0 conn(0x7f9c2415e570 msgr2=0x7f9c240d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:37.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.679+0000 7f9c23fff700 1 --2- 172.21.15.79:0/4169522259 >> v2:172.21.15.89:3300/0 conn(0x7f9c2415e570 0x7f9c240d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.679+0000 7f9c23fff700 1 -- 172.21.15.79:0/4169522259 >> v1:172.21.15.89:6789/0 conn(0x7f9c240b0a30 legacy=0x7f9c240b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:37.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.679+0000 7f9c237fe700 1 -- 172.21.15.79:0/4169522259 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313299441 0 0) 0x7f9c240afd60 con 0x7f9c240b0a30 2023-10-19T08:39:37.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.679+0000 7f9c23fff700 1 -- 172.21.15.79:0/4169522259 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c240aef70 con 0x7f9c240cb6f0 2023-10-19T08:39:37.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.679+0000 7f9c23fff700 1 --2- 172.21.15.79:0/4169522259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c240cb6f0 0x7f9c240b04f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9c100098f0 tx=0x7f9c10009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b60342b2c815a8a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:37.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.679+0000 7f9c237fe700 1 -- 172.21.15.79:0/4169522259 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c10011830 con 0x7f9c240cb6f0 2023-10-19T08:39:37.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.679+0000 7f9c237fe700 1 -- 172.21.15.79:0/4169522259 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c10011990 con 0x7f9c240cb6f0 2023-10-19T08:39:37.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.679+0000 7f9c237fe700 1 -- 172.21.15.79:0/4169522259 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c10011d20 con 0x7f9c240cb6f0 2023-10-19T08:39:37.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.680+0000 7f9c2af92700 1 -- 172.21.15.79:0/4169522259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c240cb6f0 msgr2=0x7f9c240b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:37.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.680+0000 7f9c2af92700 1 --2- 172.21.15.79:0/4169522259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c240cb6f0 0x7f9c240b04f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9c100098f0 tx=0x7f9c10009c00 comp rx=0 tx=0).stop 2023-10-19T08:39:37.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.680+0000 7f9c2af92700 1 -- 172.21.15.79:0/4169522259 shutdown_connections 2023-10-19T08:39:37.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.680+0000 7f9c2af92700 1 --2- 172.21.15.79:0/4169522259 >> v2:172.21.15.89:3300/0 conn(0x7f9c2415e570 0x7f9c240d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.680+0000 7f9c2af92700 1 --2- 172.21.15.79:0/4169522259 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c240cb6f0 0x7f9c240b04f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.680+0000 7f9c2af92700 1 -- 172.21.15.79:0/4169522259 >> 172.21.15.79:0/4169522259 conn(0x7f9c2409a0b0 msgr2=0x7f9c240d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:37.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.680+0000 7f9c2af92700 1 -- 172.21.15.79:0/4169522259 shutdown_connections 2023-10-19T08:39:37.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.680+0000 7f9c2af92700 1 -- 172.21.15.79:0/4169522259 wait complete. 2023-10-19T08:39:37.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.681+0000 7f9c2af92700 1 Processor -- start 2023-10-19T08:39:37.693 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.681+0000 7f9c2af92700 1 -- start start 2023-10-19T08:39:37.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.682+0000 7f9c2af92700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c240b0a30 0x7f9c2415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:37.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.682+0000 7f9c2af92700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c240cb6f0 0x7f9c24150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:37.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.682+0000 7f9c2af92700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c2415e570 0x7f9c241511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:37.694 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.682+0000 7f9c2af92700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c241518b0 con 0x7f9c240b0a30 2023-10-19T08:39:37.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.682+0000 7f9c2af92700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c24151b90 con 0x7f9c2415e570 2023-10-19T08:39:37.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.682+0000 7f9c2af92700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c24151e70 con 0x7f9c240cb6f0 2023-10-19T08:39:37.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.682+0000 7f9c28d2e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c240b0a30 0x7f9c2415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:37.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.682+0000 7f9c28d2e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c240b0a30 0x7f9c2415bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49078/0 (socket says 172.21.15.79:49078) 2023-10-19T08:39:37.695 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.682+0000 7f9c28d2e700 1 -- 172.21.15.79:0/3434683715 learned_addr learned my addr 172.21.15.79:0/3434683715 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:37.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.682+0000 7f9c23fff700 1 --2- 172.21.15.79:0/3434683715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c240cb6f0 0x7f9c24150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:37.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.682+0000 7f9c2952f700 1 --2- 172.21.15.79:0/3434683715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c2415e570 0x7f9c241511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:37.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.683+0000 7f9c28d2e700 1 -- 172.21.15.79:0/3434683715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c240cb6f0 msgr2=0x7f9c24150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:37.696 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.683+0000 7f9c28d2e700 1 --2- 172.21.15.79:0/3434683715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c240cb6f0 0x7f9c24150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.683+0000 7f9c28d2e700 1 -- 172.21.15.79:0/3434683715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c2415e570 msgr2=0x7f9c241511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:37.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.683+0000 7f9c28d2e700 1 --2- 172.21.15.79:0/3434683715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c2415e570 0x7f9c241511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.683+0000 7f9c28d2e700 1 -- 172.21.15.79:0/3434683715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c10009550 con 0x7f9c240b0a30 2023-10-19T08:39:37.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.683+0000 7f9c2952f700 1 --2- 172.21.15.79:0/3434683715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c2415e570 0x7f9c241511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:37.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.683+0000 7f9c28d2e700 1 --2- 172.21.15.79:0/3434683715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c240b0a30 0x7f9c2415bd50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800e870 tx=0x7f9c1800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:37.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.683+0000 7f9c217fa700 1 -- 172.21.15.79:0/3434683715 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18009590 con 0x7f9c240b0a30 2023-10-19T08:39:37.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.683+0000 7f9c217fa700 1 -- 172.21.15.79:0/3434683715 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c18013680 con 0x7f9c240b0a30 2023-10-19T08:39:37.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.683+0000 7f9c2af92700 1 -- 172.21.15.79:0/3434683715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c24152150 con 0x7f9c240b0a30 2023-10-19T08:39:37.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.683+0000 7f9c217fa700 1 -- 172.21.15.79:0/3434683715 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c180139f0 con 0x7f9c240b0a30 2023-10-19T08:39:37.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.683+0000 7f9c2af92700 1 -- 172.21.15.79:0/3434683715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2415c470 con 0x7f9c240b0a30 2023-10-19T08:39:37.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.684+0000 7f9c2af92700 1 -- 172.21.15.79:0/3434683715 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2404ee70 con 0x7f9c240b0a30 2023-10-19T08:39:37.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.684+0000 7f9c217fa700 1 -- 172.21.15.79:0/3434683715 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9c18013b50 con 0x7f9c240b0a30 2023-10-19T08:39:37.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.685+0000 7f9c217fa700 1 --2- 172.21.15.79:0/3434683715 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9c0806a0e0 0x7f9c0806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:37.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.685+0000 7f9c217fa700 1 -- 172.21.15.79:0/3434683715 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9c18088410 con 0x7f9c240b0a30 2023-10-19T08:39:37.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.685+0000 7f9c23fff700 1 --2- 172.21.15.79:0/3434683715 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9c0806a0e0 0x7f9c0806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:37.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.685+0000 7f9c23fff700 1 --2- 172.21.15.79:0/3434683715 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9c0806a0e0 0x7f9c0806c5a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9c240cbaf0 tx=0x7f9c10008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:37.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.689+0000 7f9c217fa700 1 -- 172.21.15.79:0/3434683715 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f9c180539c0 con 0x7f9c240b0a30 2023-10-19T08:39:37.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.876+0000 7f9c2af92700 1 -- 172.21.15.79:0/3434683715 --> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c240af530 con 0x7f9c0806a0e0 2023-10-19T08:39:37.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.885+0000 7f9c217fa700 1 -- 172.21.15.79:0/3434683715 <== mgr.4113 v2:172.21.15.79:6832/316135984 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311738 (secure 0 0 0) 0x7f9c10011b00 con 0x7f9c0806a0e0 2023-10-19T08:39:37.893 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:37.895 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.888+0000 7f9c2af92700 1 -- 172.21.15.79:0/3434683715 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9c0806a0e0 msgr2=0x7f9c0806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:37.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.888+0000 7f9c2af92700 1 --2- 172.21.15.79:0/3434683715 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9c0806a0e0 0x7f9c0806c5a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9c240cbaf0 tx=0x7f9c10008030 comp rx=0 tx=0).stop 2023-10-19T08:39:37.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.888+0000 7f9c2af92700 1 -- 172.21.15.79:0/3434683715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c240b0a30 msgr2=0x7f9c2415bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:37.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.888+0000 7f9c2af92700 1 --2- 172.21.15.79:0/3434683715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c240b0a30 0x7f9c2415bd50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800e870 tx=0x7f9c1800eb80 comp rx=0 tx=0).stop 2023-10-19T08:39:37.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.888+0000 7f9c2af92700 1 -- 172.21.15.79:0/3434683715 shutdown_connections 2023-10-19T08:39:37.896 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.888+0000 7f9c2af92700 1 --2- 172.21.15.79:0/3434683715 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9c2415e570 0x7f9c241511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.888+0000 7f9c2af92700 1 --2- 172.21.15.79:0/3434683715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c240b0a30 0x7f9c2415bd50 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.888+0000 7f9c2af92700 1 --2- 172.21.15.79:0/3434683715 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f9c0806a0e0 0x7f9c0806c5a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.888+0000 7f9c2af92700 1 --2- 172.21.15.79:0/3434683715 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9c240cb6f0 0x7f9c24150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:37.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.888+0000 7f9c2af92700 1 -- 172.21.15.79:0/3434683715 >> 172.21.15.79:0/3434683715 conn(0x7f9c2409a0b0 msgr2=0x7f9c24153070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:37.897 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.888+0000 7f9c2af92700 1 -- 172.21.15.79:0/3434683715 shutdown_connections 2023-10-19T08:39:37.898 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:37.888+0000 7f9c2af92700 1 -- 172.21.15.79:0/3434683715 wait complete. 2023-10-19T08:39:37.898 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-19T08:39:37.905 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2023-10-19T08:39:37.120784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220680,"kb_used_data":4508,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754040,"statfs":{"total":773094113280,"available":772868136960,"internally_reserved":0,"allocated":4616192,"data_stored":2700806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.325578"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.828861+0000","last_change":"2023-10-19T08:39:33.825725+0000","last_active":"2023-10-19T08:39:33.828861+0000","last_peered":"2023-10-19T08:39:33.828861+0000","last_clean":"2023-10-19T08:39:33.828861+0000","last_became_active":"2023-10-19T08:39:33.825404+0000","last_became_peered":"2023-10-19T08:39:33.825404+0000","last_unstale":"2023-10-19T08:39:33.828861+0000","last_undegraded":"2023-10-19T08:39:33.828861+0000","last_fullsized":"2023-10-19T08:39:33.828861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:23:26.872615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827101+0000","last_change":"2023-10-19T08:39:33.821855+0000","last_active":"2023-10-19T08:39:33.827101+0000","last_peered":"2023-10-19T08:39:33.827101+0000","last_clean":"2023-10-19T08:39:33.827101+0000","last_became_active":"2023-10-19T08:39:33.821591+0000","last_became_peered":"2023-10-19T08:39:33.821591+0000","last_unstale":"2023-10-19T08:39:33.827101+0000","last_undegraded":"2023-10-19T08:39:33.827101+0000","last_fullsized":"2023-10-19T08:39:33.827101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:23:26.872615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.840535+0000","last_change":"2023-10-19T08:39:33.836237+0000","last_active":"2023-10-19T08:39:33.840535+0000","last_peered":"2023-10-19T08:39:33.840535+0000","last_clean":"2023-10-19T08:39:33.840535+0000","last_became_active":"2023-10-19T08:39:33.835969+0000","last_became_peered":"2023-10-19T08:39:33.835969+0000","last_unstale":"2023-10-19T08:39:33.840535+0000","last_undegraded":"2023-10-19T08:39:33.840535+0000","last_fullsized":"2023-10-19T08:39:33.840535+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:02:09.367452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827321+0000","last_change":"2023-10-19T08:39:33.818503+0000","last_active":"2023-10-19T08:39:33.827321+0000","last_peered":"2023-10-19T08:39:33.827321+0000","last_clean":"2023-10-19T08:39:33.827321+0000","last_became_active":"2023-10-19T08:39:33.817725+0000","last_became_peered":"2023-10-19T08:39:33.817725+0000","last_unstale":"2023-10-19T08:39:33.827321+0000","last_undegraded":"2023-10-19T08:39:33.827321+0000","last_fullsized":"2023-10-19T08:39:33.827321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:01:24.685364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.826635+0000","last_change":"2023-10-19T08:39:33.821777+0000","last_active":"2023-10-19T08:39:33.826635+0000","last_peered":"2023-10-19T08:39:33.826635+0000","last_clean":"2023-10-19T08:39:33.826635+0000","last_became_active":"2023-10-19T08:39:33.821490+0000","last_became_peered":"2023-10-19T08:39:33.821490+0000","last_unstale":"2023-10-19T08:39:33.826635+0000","last_undegraded":"2023-10-19T08:39:33.826635+0000","last_fullsized":"2023-10-19T08:39:33.826635+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:14:05.573355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.826975+0000","last_change":"2023-10-19T08:39:33.826332+0000","last_active":"2023-10-19T08:39:33.826975+0000","last_peered":"2023-10-19T08:39:33.826975+0000","last_clean":"2023-10-19T08:39:33.826975+0000","last_became_active":"2023-10-19T08:39:33.826019+0000","last_became_peered":"2023-10-19T08:39:33.826019+0000","last_unstale":"2023-10-19T08:39:33.826975+0000","last_undegraded":"2023-10-19T08:39:33.826975+0000","last_fullsized":"2023-10-19T08:39:33.826975+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:53:45.585760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.828809+0000","last_change":"2023-10-19T08:39:33.825306+0000","last_active":"2023-10-19T08:39:33.828809+0000","last_peered":"2023-10-19T08:39:33.828809+0000","last_clean":"2023-10-19T08:39:33.828809+0000","last_became_active":"2023-10-19T08:39:33.824387+0000","last_became_peered":"2023-10-19T08:39:33.824387+0000","last_unstale":"2023-10-19T08:39:33.828809+0000","last_undegraded":"2023-10-19T08:39:33.828809+0000","last_fullsized":"2023-10-19T08:39:33.828809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T08:45:03.342309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827685+0000","last_change":"2023-10-19T08:39:33.810773+0000","last_active":"2023-10-19T08:39:33.827685+0000","last_peered":"2023-10-19T08:39:33.827685+0000","last_clean":"2023-10-19T08:39:33.827685+0000","last_became_active":"2023-10-19T08:39:33.810518+0000","last_became_peered":"2023-10-19T08:39:33.810518+0000","last_unstale":"2023-10-19T08:39:33.827685+0000","last_undegraded":"2023-10-19T08:39:33.827685+0000","last_fullsized":"2023-10-19T08:39:33.827685+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:43:06.230157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.824677+0000","last_change":"2023-10-19T08:39:33.815025+0000","last_active":"2023-10-19T08:39:33.824677+0000","last_peered":"2023-10-19T08:39:33.824677+0000","last_clean":"2023-10-19T08:39:33.824677+0000","last_became_active":"2023-10-19T08:39:33.814763+0000","last_became_peered":"2023-10-19T08:39:33.814763+0000","last_unstale":"2023-10-19T08:39:33.824677+0000","last_undegraded":"2023-10-19T08:39:33.824677+0000","last_fullsized":"2023-10-19T08:39:33.824677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:59:04.130649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.822849+0000","last_change":"2023-10-19T08:39:33.810259+0000","last_active":"2023-10-19T08:39:33.822849+0000","last_peered":"2023-10-19T08:39:33.822849+0000","last_clean":"2023-10-19T08:39:33.822849+0000","last_became_active":"2023-10-19T08:39:33.809992+0000","last_became_peered":"2023-10-19T08:39:33.809992+0000","last_unstale":"2023-10-19T08:39:33.822849+0000","last_undegraded":"2023-10-19T08:39:33.822849+0000","last_fullsized":"2023-10-19T08:39:33.822849+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:38:10.991152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827431+0000","last_change":"2023-10-19T08:39:33.822100+0000","last_active":"2023-10-19T08:39:33.827431+0000","last_peered":"2023-10-19T08:39:33.827431+0000","last_clean":"2023-10-19T08:39:33.827431+0000","last_became_active":"2023-10-19T08:39:33.821864+0000","last_became_peered":"2023-10-19T08:39:33.821864+0000","last_unstale":"2023-10-19T08:39:33.827431+0000","last_undegraded":"2023-10-19T08:39:33.827431+0000","last_fullsized":"2023-10-19T08:39:33.827431+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:44:51.262505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.837964+0000","last_change":"2023-10-19T08:39:33.831849+0000","last_active":"2023-10-19T08:39:33.837964+0000","last_peered":"2023-10-19T08:39:33.837964+0000","last_clean":"2023-10-19T08:39:33.837964+0000","last_became_active":"2023-10-19T08:39:33.831551+0000","last_became_peered":"2023-10-19T08:39:33.831551+0000","last_unstale":"2023-10-19T08:39:33.837964+0000","last_undegraded":"2023-10-19T08:39:33.837964+0000","last_fullsized":"2023-10-19T08:39:33.837964+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:19:57.962430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.833287+0000","last_change":"2023-10-19T08:39:33.828972+0000","last_active":"2023-10-19T08:39:33.833287+0000","last_peered":"2023-10-19T08:39:33.833287+0000","last_clean":"2023-10-19T08:39:33.833287+0000","last_became_active":"2023-10-19T08:39:33.828644+0000","last_became_peered":"2023-10-19T08:39:33.828644+0000","last_unstale":"2023-10-19T08:39:33.833287+0000","last_undegraded":"2023-10-19T08:39:33.833287+0000","last_fullsized":"2023-10-19T08:39:33.833287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:38:50.667101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827683+0000","last_change":"2023-10-19T08:39:33.815913+0000","last_active":"2023-10-19T08:39:33.827683+0000","last_peered":"2023-10-19T08:39:33.827683+0000","last_clean":"2023-10-19T08:39:33.827683+0000","last_became_active":"2023-10-19T08:39:33.815664+0000","last_became_peered":"2023-10-19T08:39:33.815664+0000","last_unstale":"2023-10-19T08:39:33.827683+0000","last_undegraded":"2023-10-19T08:39:33.827683+0000","last_fullsized":"2023-10-19T08:39:33.827683+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:49:21.321636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827073+0000","last_change":"2023-10-19T08:39:33.818873+0000","last_active":"2023-10-19T08:39:33.827073+0000","last_peered":"2023-10-19T08:39:33.827073+0000","last_clean":"2023-10-19T08:39:33.827073+0000","last_became_active":"2023-10-19T08:39:33.818362+0000","last_became_peered":"2023-10-19T08:39:33.818362+0000","last_unstale":"2023-10-19T08:39:33.827073+0000","last_undegraded":"2023-10-19T08:39:33.827073+0000","last_fullsized":"2023-10-19T08:39:33.827073+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:36:12.154264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.835267+0000","last_change":"2023-10-19T08:39:33.831004+0000","last_active":"2023-10-19T08:39:33.835267+0000","last_peered":"2023-10-19T08:39:33.835267+0000","last_clean":"2023-10-19T08:39:33.835267+0000","last_became_active":"2023-10-19T08:39:33.830690+0000","last_became_peered":"2023-10-19T08:39:33.830690+0000","last_unstale":"2023-10-19T08:39:33.835267+0000","last_undegraded":"2023-10-19T08:39:33.835267+0000","last_fullsized":"2023-10-19T08:39:33.835267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:38:50.667101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.823894+0000","last_change":"2023-10-19T08:39:33.816892+0000","last_active":"2023-10-19T08:39:33.823894+0000","last_peered":"2023-10-19T08:39:33.823894+0000","last_clean":"2023-10-19T08:39:33.823894+0000","last_became_active":"2023-10-19T08:39:33.816487+0000","last_became_peered":"2023-10-19T08:39:33.816487+0000","last_unstale":"2023-10-19T08:39:33.823894+0000","last_undegraded":"2023-10-19T08:39:33.823894+0000","last_fullsized":"2023-10-19T08:39:33.823894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:59:13.296658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.829936+0000","last_change":"2023-10-19T08:39:33.826968+0000","last_active":"2023-10-19T08:39:33.829936+0000","last_peered":"2023-10-19T08:39:33.829936+0000","last_clean":"2023-10-19T08:39:33.829936+0000","last_became_active":"2023-10-19T08:39:33.826651+0000","last_became_peered":"2023-10-19T08:39:33.826651+0000","last_unstale":"2023-10-19T08:39:33.829936+0000","last_undegraded":"2023-10-19T08:39:33.829936+0000","last_fullsized":"2023-10-19T08:39:33.829936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:42:05.007534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.835290+0000","last_change":"2023-10-19T08:39:33.830824+0000","last_active":"2023-10-19T08:39:33.835290+0000","last_peered":"2023-10-19T08:39:33.835290+0000","last_clean":"2023-10-19T08:39:33.835290+0000","last_became_active":"2023-10-19T08:39:33.830412+0000","last_became_peered":"2023-10-19T08:39:33.830412+0000","last_unstale":"2023-10-19T08:39:33.835290+0000","last_undegraded":"2023-10-19T08:39:33.835290+0000","last_fullsized":"2023-10-19T08:39:33.835290+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:51:22.501402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.834875+0000","last_change":"2023-10-19T08:39:33.831558+0000","last_active":"2023-10-19T08:39:33.834875+0000","last_peered":"2023-10-19T08:39:33.834875+0000","last_clean":"2023-10-19T08:39:33.834875+0000","last_became_active":"2023-10-19T08:39:33.831158+0000","last_became_peered":"2023-10-19T08:39:33.831158+0000","last_unstale":"2023-10-19T08:39:33.834875+0000","last_undegraded":"2023-10-19T08:39:33.834875+0000","last_fullsized":"2023-10-19T08:39:33.834875+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:11:38.529637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.826681+0000","last_change":"2023-10-19T08:39:33.818512+0000","last_active":"2023-10-19T08:39:33.826681+0000","last_peered":"2023-10-19T08:39:33.826681+0000","last_clean":"2023-10-19T08:39:33.826681+0000","last_became_active":"2023-10-19T08:39:33.818254+0000","last_became_peered":"2023-10-19T08:39:33.818254+0000","last_unstale":"2023-10-19T08:39:33.826681+0000","last_undegraded":"2023-10-19T08:39:33.826681+0000","last_fullsized":"2023-10-19T08:39:33.826681+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:09:12.700153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827661+0000","last_change":"2023-10-19T08:39:33.809916+0000","last_active":"2023-10-19T08:39:33.827661+0000","last_peered":"2023-10-19T08:39:33.827661+0000","last_clean":"2023-10-19T08:39:33.827661+0000","last_became_active":"2023-10-19T08:39:33.809147+0000","last_became_peered":"2023-10-19T08:39:33.809147+0000","last_unstale":"2023-10-19T08:39:33.827661+0000","last_undegraded":"2023-10-19T08:39:33.827661+0000","last_fullsized":"2023-10-19T08:39:33.827661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:43:35.690550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.824868+0000","last_change":"2023-10-19T08:39:33.820859+0000","last_active":"2023-10-19T08:39:33.824868+0000","last_peered":"2023-10-19T08:39:33.824868+0000","last_clean":"2023-10-19T08:39:33.824868+0000","last_became_active":"2023-10-19T08:39:33.820577+0000","last_became_peered":"2023-10-19T08:39:33.820577+0000","last_unstale":"2023-10-19T08:39:33.824868+0000","last_undegraded":"2023-10-19T08:39:33.824868+0000","last_fullsized":"2023-10-19T08:39:33.824868+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:03:46.549984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.824980+0000","last_change":"2023-10-19T08:39:33.820686+0000","last_active":"2023-10-19T08:39:33.824980+0000","last_peered":"2023-10-19T08:39:33.824980+0000","last_clean":"2023-10-19T08:39:33.824980+0000","last_became_active":"2023-10-19T08:39:33.820388+0000","last_became_peered":"2023-10-19T08:39:33.820388+0000","last_unstale":"2023-10-19T08:39:33.824980+0000","last_undegraded":"2023-10-19T08:39:33.824980+0000","last_fullsized":"2023-10-19T08:39:33.824980+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:55:00.386015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.816422+0000","last_change":"2023-10-19T08:39:33.814723+0000","last_active":"2023-10-19T08:39:33.816422+0000","last_peered":"2023-10-19T08:39:33.816422+0000","last_clean":"2023-10-19T08:39:33.816422+0000","last_became_active":"2023-10-19T08:39:33.814326+0000","last_became_peered":"2023-10-19T08:39:33.814326+0000","last_unstale":"2023-10-19T08:39:33.816422+0000","last_undegraded":"2023-10-19T08:39:33.816422+0000","last_fullsized":"2023-10-19T08:39:33.816422+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:42:37.823833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.833300+0000","last_change":"2023-10-19T08:39:33.828988+0000","last_active":"2023-10-19T08:39:33.833300+0000","last_peered":"2023-10-19T08:39:33.833300+0000","last_clean":"2023-10-19T08:39:33.833300+0000","last_became_active":"2023-10-19T08:39:33.828726+0000","last_became_peered":"2023-10-19T08:39:33.828726+0000","last_unstale":"2023-10-19T08:39:33.833300+0000","last_undegraded":"2023-10-19T08:39:33.833300+0000","last_fullsized":"2023-10-19T08:39:33.833300+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:30:56.482153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.824057+0000","last_change":"2023-10-19T08:39:33.816123+0000","last_active":"2023-10-19T08:39:33.824057+0000","last_peered":"2023-10-19T08:39:33.824057+0000","last_clean":"2023-10-19T08:39:33.824057+0000","last_became_active":"2023-10-19T08:39:33.815867+0000","last_became_peered":"2023-10-19T08:39:33.815867+0000","last_unstale":"2023-10-19T08:39:33.824057+0000","last_undegraded":"2023-10-19T08:39:33.824057+0000","last_fullsized":"2023-10-19T08:39:33.824057+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:31:16.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.832136+0000","last_change":"2023-10-19T08:39:33.828375+0000","last_active":"2023-10-19T08:39:33.832136+0000","last_peered":"2023-10-19T08:39:33.832136+0000","last_clean":"2023-10-19T08:39:33.832136+0000","last_became_active":"2023-10-19T08:39:33.828099+0000","last_became_peered":"2023-10-19T08:39:33.828099+0000","last_unstale":"2023-10-19T08:39:33.832136+0000","last_undegraded":"2023-10-19T08:39:33.832136+0000","last_fullsized":"2023-10-19T08:39:33.832136+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:48:36.777911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.819776+0000","last_change":"2023-10-19T08:39:33.816185+0000","last_active":"2023-10-19T08:39:33.819776+0000","last_peered":"2023-10-19T08:39:33.819776+0000","last_clean":"2023-10-19T08:39:33.819776+0000","last_became_active":"2023-10-19T08:39:33.815710+0000","last_became_peered":"2023-10-19T08:39:33.815710+0000","last_unstale":"2023-10-19T08:39:33.819776+0000","last_undegraded":"2023-10-19T08:39:33.819776+0000","last_fullsized":"2023-10-19T08:39:33.819776+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:35:13.276199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.829790+0000","last_change":"2023-10-19T08:39:33.826319+0000","last_active":"2023-10-19T08:39:33.829790+0000","last_peered":"2023-10-19T08:39:33.829790+0000","last_clean":"2023-10-19T08:39:33.829790+0000","last_became_active":"2023-10-19T08:39:33.826020+0000","last_became_peered":"2023-10-19T08:39:33.826020+0000","last_unstale":"2023-10-19T08:39:33.829790+0000","last_undegraded":"2023-10-19T08:39:33.829790+0000","last_fullsized":"2023-10-19T08:39:33.829790+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:11:52.565783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827091+0000","last_change":"2023-10-19T08:39:33.819293+0000","last_active":"2023-10-19T08:39:33.827091+0000","last_peered":"2023-10-19T08:39:33.827091+0000","last_clean":"2023-10-19T08:39:33.827091+0000","last_became_active":"2023-10-19T08:39:33.818642+0000","last_became_peered":"2023-10-19T08:39:33.818642+0000","last_unstale":"2023-10-19T08:39:33.827091+0000","last_undegraded":"2023-10-19T08:39:33.827091+0000","last_fullsized":"2023-10-19T08:39:33.827091+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:51:52.827830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.833199+0000","last_change":"2023-10-19T08:39:33.827289+0000","last_active":"2023-10-19T08:39:33.833199+0000","last_peered":"2023-10-19T08:39:33.833199+0000","last_clean":"2023-10-19T08:39:33.833199+0000","last_became_active":"2023-10-19T08:39:33.827057+0000","last_became_peered":"2023-10-19T08:39:33.827057+0000","last_unstale":"2023-10-19T08:39:33.833199+0000","last_undegraded":"2023-10-19T08:39:33.833199+0000","last_fullsized":"2023-10-19T08:39:33.833199+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:35:13.276199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.825426+0000","last_change":"2023-10-19T08:39:33.821220+0000","last_active":"2023-10-19T08:39:33.825426+0000","last_peered":"2023-10-19T08:39:33.825426+0000","last_clean":"2023-10-19T08:39:33.825426+0000","last_became_active":"2023-10-19T08:39:33.820652+0000","last_became_peered":"2023-10-19T08:39:33.820652+0000","last_unstale":"2023-10-19T08:39:33.825426+0000","last_undegraded":"2023-10-19T08:39:33.825426+0000","last_fullsized":"2023-10-19T08:39:33.825426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:49:21.321636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.826869+0000","last_change":"2023-10-19T08:39:32.826906+0000","last_active":"2023-10-19T08:39:33.826869+0000","last_peered":"2023-10-19T08:39:33.826869+0000","last_clean":"2023-10-19T08:39:33.826869+0000","last_became_active":"2023-10-19T08:39:32.826593+0000","last_became_peered":"2023-10-19T08:39:32.826593+0000","last_unstale":"2023-10-19T08:39:33.826869+0000","last_undegraded":"2023-10-19T08:39:33.826869+0000","last_fullsized":"2023-10-19T08:39:33.826869+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:15:38.255113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.829307+0000","last_change":"2023-10-19T08:39:33.822750+0000","last_active":"2023-10-19T08:39:33.829307+0000","last_peered":"2023-10-19T08:39:33.829307+0000","last_clean":"2023-10-19T08:39:33.829307+0000","last_became_active":"2023-10-19T08:39:33.822503+0000","last_became_peered":"2023-10-19T08:39:33.822503+0000","last_unstale":"2023-10-19T08:39:33.829307+0000","last_undegraded":"2023-10-19T08:39:33.829307+0000","last_fullsized":"2023-10-19T08:39:33.829307+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:22:04.091476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.824106+0000","last_change":"2023-10-19T08:39:32.822777+0000","last_active":"2023-10-19T08:39:33.824106+0000","last_peered":"2023-10-19T08:39:33.824106+0000","last_clean":"2023-10-19T08:39:33.824106+0000","last_became_active":"2023-10-19T08:39:32.822495+0000","last_became_peered":"2023-10-19T08:39:32.822495+0000","last_unstale":"2023-10-19T08:39:33.824106+0000","last_undegraded":"2023-10-19T08:39:33.824106+0000","last_fullsized":"2023-10-19T08:39:33.824106+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:40:19.778228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.826448+0000","last_change":"2023-10-19T08:39:33.821635+0000","last_active":"2023-10-19T08:39:33.826448+0000","last_peered":"2023-10-19T08:39:33.826448+0000","last_clean":"2023-10-19T08:39:33.826448+0000","last_became_active":"2023-10-19T08:39:33.821203+0000","last_became_peered":"2023-10-19T08:39:33.821203+0000","last_unstale":"2023-10-19T08:39:33.826448+0000","last_undegraded":"2023-10-19T08:39:33.826448+0000","last_fullsized":"2023-10-19T08:39:33.826448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:19:24.254619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827124+0000","last_change":"2023-10-19T08:39:32.826441+0000","last_active":"2023-10-19T08:39:33.827124+0000","last_peered":"2023-10-19T08:39:33.827124+0000","last_clean":"2023-10-19T08:39:33.827124+0000","last_became_active":"2023-10-19T08:39:32.826145+0000","last_became_peered":"2023-10-19T08:39:32.826145+0000","last_unstale":"2023-10-19T08:39:33.827124+0000","last_undegraded":"2023-10-19T08:39:33.827124+0000","last_fullsized":"2023-10-19T08:39:33.827124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:43:34.682478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.825577+0000","last_change":"2023-10-19T08:39:33.821956+0000","last_active":"2023-10-19T08:39:33.825577+0000","last_peered":"2023-10-19T08:39:33.825577+0000","last_clean":"2023-10-19T08:39:33.825577+0000","last_became_active":"2023-10-19T08:39:33.821710+0000","last_became_peered":"2023-10-19T08:39:33.821710+0000","last_unstale":"2023-10-19T08:39:33.825577+0000","last_undegraded":"2023-10-19T08:39:33.825577+0000","last_fullsized":"2023-10-19T08:39:33.825577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:44:32.380625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.824008+0000","last_change":"2023-10-19T08:39:32.826204+0000","last_active":"2023-10-19T08:39:33.824008+0000","last_peered":"2023-10-19T08:39:33.824008+0000","last_clean":"2023-10-19T08:39:33.824008+0000","last_became_active":"2023-10-19T08:39:32.825923+0000","last_became_peered":"2023-10-19T08:39:32.825923+0000","last_unstale":"2023-10-19T08:39:33.824008+0000","last_undegraded":"2023-10-19T08:39:33.824008+0000","last_fullsized":"2023-10-19T08:39:33.824008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:15:38.255113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.823901+0000","last_change":"2023-10-19T08:39:33.818669+0000","last_active":"2023-10-19T08:39:33.823901+0000","last_peered":"2023-10-19T08:39:33.823901+0000","last_clean":"2023-10-19T08:39:33.823901+0000","last_became_active":"2023-10-19T08:39:33.818406+0000","last_became_peered":"2023-10-19T08:39:33.818406+0000","last_unstale":"2023-10-19T08:39:33.823901+0000","last_undegraded":"2023-10-19T08:39:33.823901+0000","last_fullsized":"2023-10-19T08:39:33.823901+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:31:15.689646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.826073+0000","last_change":"2023-10-19T08:39:32.821759+0000","last_active":"2023-10-19T08:39:33.826073+0000","last_peered":"2023-10-19T08:39:33.826073+0000","last_clean":"2023-10-19T08:39:33.826073+0000","last_became_active":"2023-10-19T08:39:32.821445+0000","last_became_peered":"2023-10-19T08:39:32.821445+0000","last_unstale":"2023-10-19T08:39:33.826073+0000","last_undegraded":"2023-10-19T08:39:33.826073+0000","last_fullsized":"2023-10-19T08:39:33.826073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:24:43.050800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.844714+0000","last_change":"2023-10-19T08:39:33.838031+0000","last_active":"2023-10-19T08:39:33.844714+0000","last_peered":"2023-10-19T08:39:33.844714+0000","last_clean":"2023-10-19T08:39:33.844714+0000","last_became_active":"2023-10-19T08:39:33.837758+0000","last_became_peered":"2023-10-19T08:39:33.837758+0000","last_unstale":"2023-10-19T08:39:33.844714+0000","last_undegraded":"2023-10-19T08:39:33.844714+0000","last_fullsized":"2023-10-19T08:39:33.844714+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:02:12.636076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827254+0000","last_change":"2023-10-19T08:39:32.826320+0000","last_active":"2023-10-19T08:39:33.827254+0000","last_peered":"2023-10-19T08:39:33.827254+0000","last_clean":"2023-10-19T08:39:33.827254+0000","last_became_active":"2023-10-19T08:39:32.826017+0000","last_became_peered":"2023-10-19T08:39:32.826017+0000","last_unstale":"2023-10-19T08:39:33.827254+0000","last_undegraded":"2023-10-19T08:39:33.827254+0000","last_fullsized":"2023-10-19T08:39:33.827254+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:40:44.640487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827665+0000","last_change":"2023-10-19T08:39:33.810460+0000","last_active":"2023-10-19T08:39:33.827665+0000","last_peered":"2023-10-19T08:39:33.827665+0000","last_clean":"2023-10-19T08:39:33.827665+0000","last_became_active":"2023-10-19T08:39:33.810187+0000","last_became_peered":"2023-10-19T08:39:33.810187+0000","last_unstale":"2023-10-19T08:39:33.827665+0000","last_undegraded":"2023-10-19T08:39:33.827665+0000","last_fullsized":"2023-10-19T08:39:33.827665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:40:06.502405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.805769+0000","last_change":"2023-10-19T08:39:32.818005+0000","last_active":"2023-10-19T08:39:33.805769+0000","last_peered":"2023-10-19T08:39:33.805769+0000","last_clean":"2023-10-19T08:39:33.805769+0000","last_became_active":"2023-10-19T08:39:32.817695+0000","last_became_peered":"2023-10-19T08:39:32.817695+0000","last_unstale":"2023-10-19T08:39:33.805769+0000","last_undegraded":"2023-10-19T08:39:33.805769+0000","last_fullsized":"2023-10-19T08:39:33.805769+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:58:24.296882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.824847+0000","last_change":"2023-10-19T08:39:33.820779+0000","last_active":"2023-10-19T08:39:33.824847+0000","last_peered":"2023-10-19T08:39:33.824847+0000","last_clean":"2023-10-19T08:39:33.824847+0000","last_became_active":"2023-10-19T08:39:33.820475+0000","last_became_peered":"2023-10-19T08:39:33.820475+0000","last_unstale":"2023-10-19T08:39:33.824847+0000","last_undegraded":"2023-10-19T08:39:33.824847+0000","last_fullsized":"2023-10-19T08:39:33.824847+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:32:46.412920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.803031+0000","last_change":"2023-10-19T08:39:32.814169+0000","last_active":"2023-10-19T08:39:33.803031+0000","last_peered":"2023-10-19T08:39:33.803031+0000","last_clean":"2023-10-19T08:39:33.803031+0000","last_became_active":"2023-10-19T08:39:32.813911+0000","last_became_peered":"2023-10-19T08:39:32.813911+0000","last_unstale":"2023-10-19T08:39:33.803031+0000","last_undegraded":"2023-10-19T08:39:33.803031+0000","last_fullsized":"2023-10-19T08:39:33.803031+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:54:09.689815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.829917+0000","last_change":"2023-10-19T08:39:33.826910+0000","last_active":"2023-10-19T08:39:33.829917+0000","last_peered":"2023-10-19T08:39:33.829917+0000","last_clean":"2023-10-19T08:39:33.829917+0000","last_became_active":"2023-10-19T08:39:33.826620+0000","last_became_peered":"2023-10-19T08:39:33.826620+0000","last_unstale":"2023-10-19T08:39:33.829917+0000","last_undegraded":"2023-10-19T08:39:33.829917+0000","last_fullsized":"2023-10-19T08:39:33.829917+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:07:32.228734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.810200+0000","last_change":"2023-10-19T08:39:32.815994+0000","last_active":"2023-10-19T08:39:33.810200+0000","last_peered":"2023-10-19T08:39:33.810200+0000","last_clean":"2023-10-19T08:39:33.810200+0000","last_became_active":"2023-10-19T08:39:32.815684+0000","last_became_peered":"2023-10-19T08:39:32.815684+0000","last_unstale":"2023-10-19T08:39:33.810200+0000","last_undegraded":"2023-10-19T08:39:33.810200+0000","last_fullsized":"2023-10-19T08:39:33.810200+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:19:03.560245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.828709+0000","last_change":"2023-10-19T08:39:33.824468+0000","last_active":"2023-10-19T08:39:33.828709+0000","last_peered":"2023-10-19T08:39:33.828709+0000","last_clean":"2023-10-19T08:39:33.828709+0000","last_became_active":"2023-10-19T08:39:33.823997+0000","last_became_peered":"2023-10-19T08:39:33.823997+0000","last_unstale":"2023-10-19T08:39:33.828709+0000","last_undegraded":"2023-10-19T08:39:33.828709+0000","last_fullsized":"2023-10-19T08:39:33.828709+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:19:57.962430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.803547+0000","last_change":"2023-10-19T08:39:32.814606+0000","last_active":"2023-10-19T08:39:33.803547+0000","last_peered":"2023-10-19T08:39:33.803547+0000","last_clean":"2023-10-19T08:39:33.803547+0000","last_became_active":"2023-10-19T08:39:32.814345+0000","last_became_peered":"2023-10-19T08:39:32.814345+0000","last_unstale":"2023-10-19T08:39:33.803547+0000","last_undegraded":"2023-10-19T08:39:33.803547+0000","last_fullsized":"2023-10-19T08:39:33.803547+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:51:51.819759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.838250+0000","last_change":"2023-10-19T08:39:33.831621+0000","last_active":"2023-10-19T08:39:33.838250+0000","last_peered":"2023-10-19T08:39:33.838250+0000","last_clean":"2023-10-19T08:39:33.838250+0000","last_became_active":"2023-10-19T08:39:33.831341+0000","last_became_peered":"2023-10-19T08:39:33.831341+0000","last_unstale":"2023-10-19T08:39:33.838250+0000","last_undegraded":"2023-10-19T08:39:33.838250+0000","last_fullsized":"2023-10-19T08:39:33.838250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:30:02.806663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.829511+0000","last_change":"2023-10-19T08:39:32.823847+0000","last_active":"2023-10-19T08:39:33.829511+0000","last_peered":"2023-10-19T08:39:33.829511+0000","last_clean":"2023-10-19T08:39:33.829511+0000","last_became_active":"2023-10-19T08:39:32.823571+0000","last_became_peered":"2023-10-19T08:39:32.823571+0000","last_unstale":"2023-10-19T08:39:33.829511+0000","last_undegraded":"2023-10-19T08:39:33.829511+0000","last_fullsized":"2023-10-19T08:39:33.829511+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:24:56.540389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.828897+0000","last_change":"2023-10-19T08:39:33.826289+0000","last_active":"2023-10-19T08:39:33.828897+0000","last_peered":"2023-10-19T08:39:33.828897+0000","last_clean":"2023-10-19T08:39:33.828897+0000","last_became_active":"2023-10-19T08:39:33.826012+0000","last_became_peered":"2023-10-19T08:39:33.826012+0000","last_unstale":"2023-10-19T08:39:33.828897+0000","last_undegraded":"2023-10-19T08:39:33.828897+0000","last_fullsized":"2023-10-19T08:39:33.828897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:14:05.573355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.844670+0000","last_change":"2023-10-19T08:39:32.818624+0000","last_active":"2023-10-19T08:39:33.844670+0000","last_peered":"2023-10-19T08:39:33.844670+0000","last_clean":"2023-10-19T08:39:33.844670+0000","last_became_active":"2023-10-19T08:39:32.818341+0000","last_became_peered":"2023-10-19T08:39:32.818341+0000","last_unstale":"2023-10-19T08:39:33.844670+0000","last_undegraded":"2023-10-19T08:39:33.844670+0000","last_fullsized":"2023-10-19T08:39:33.844670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:46:08.009463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.835231+0000","last_change":"2023-10-19T08:39:33.830751+0000","last_active":"2023-10-19T08:39:33.835231+0000","last_peered":"2023-10-19T08:39:33.835231+0000","last_clean":"2023-10-19T08:39:33.835231+0000","last_became_active":"2023-10-19T08:39:33.830466+0000","last_became_peered":"2023-10-19T08:39:33.830466+0000","last_unstale":"2023-10-19T08:39:33.835231+0000","last_undegraded":"2023-10-19T08:39:33.835231+0000","last_fullsized":"2023-10-19T08:39:33.835231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:11:38.529637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.830819+0000","last_change":"2023-10-19T08:39:32.816960+0000","last_active":"2023-10-19T08:39:33.830819+0000","last_peered":"2023-10-19T08:39:33.830819+0000","last_clean":"2023-10-19T08:39:33.830819+0000","last_became_active":"2023-10-19T08:39:32.816656+0000","last_became_peered":"2023-10-19T08:39:32.816656+0000","last_unstale":"2023-10-19T08:39:33.830819+0000","last_undegraded":"2023-10-19T08:39:33.830819+0000","last_fullsized":"2023-10-19T08:39:33.830819+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:40:02.903702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.836286+0000","last_change":"2023-10-19T08:39:33.826458+0000","last_active":"2023-10-19T08:39:33.836286+0000","last_peered":"2023-10-19T08:39:33.836286+0000","last_clean":"2023-10-19T08:39:33.836286+0000","last_became_active":"2023-10-19T08:39:33.824840+0000","last_became_peered":"2023-10-19T08:39:33.824840+0000","last_unstale":"2023-10-19T08:39:33.836286+0000","last_undegraded":"2023-10-19T08:39:33.836286+0000","last_fullsized":"2023-10-19T08:39:33.836286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:53:45.585760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.813231+0000","last_change":"2023-10-19T08:39:32.818573+0000","last_active":"2023-10-19T08:39:33.813231+0000","last_peered":"2023-10-19T08:39:33.813231+0000","last_clean":"2023-10-19T08:39:33.813231+0000","last_became_active":"2023-10-19T08:39:32.818297+0000","last_became_peered":"2023-10-19T08:39:32.818297+0000","last_unstale":"2023-10-19T08:39:33.813231+0000","last_undegraded":"2023-10-19T08:39:33.813231+0000","last_fullsized":"2023-10-19T08:39:33.813231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:14:15.069436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.836346+0000","last_change":"2023-10-19T08:39:33.828893+0000","last_active":"2023-10-19T08:39:33.836346+0000","last_peered":"2023-10-19T08:39:33.836346+0000","last_clean":"2023-10-19T08:39:33.836346+0000","last_became_active":"2023-10-19T08:39:33.828246+0000","last_became_peered":"2023-10-19T08:39:33.828246+0000","last_unstale":"2023-10-19T08:39:33.836346+0000","last_undegraded":"2023-10-19T08:39:33.836346+0000","last_fullsized":"2023-10-19T08:39:33.836346+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:18:22.788693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.809125+0000","last_change":"2023-10-19T08:39:32.816838+0000","last_active":"2023-10-19T08:39:33.809125+0000","last_peered":"2023-10-19T08:39:33.809125+0000","last_clean":"2023-10-19T08:39:33.809125+0000","last_became_active":"2023-10-19T08:39:32.816523+0000","last_became_peered":"2023-10-19T08:39:32.816523+0000","last_unstale":"2023-10-19T08:39:33.809125+0000","last_undegraded":"2023-10-19T08:39:33.809125+0000","last_fullsized":"2023-10-19T08:39:33.809125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:01:23.677293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.828782+0000","last_change":"2023-10-19T08:39:33.825276+0000","last_active":"2023-10-19T08:39:33.828782+0000","last_peered":"2023-10-19T08:39:33.828782+0000","last_clean":"2023-10-19T08:39:33.828782+0000","last_became_active":"2023-10-19T08:39:33.823928+0000","last_became_peered":"2023-10-19T08:39:33.823928+0000","last_unstale":"2023-10-19T08:39:33.828782+0000","last_undegraded":"2023-10-19T08:39:33.828782+0000","last_fullsized":"2023-10-19T08:39:33.828782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:24:44.058871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.838178+0000","last_change":"2023-10-19T08:39:32.806959+0000","last_active":"2023-10-19T08:39:33.838178+0000","last_peered":"2023-10-19T08:39:33.838178+0000","last_clean":"2023-10-19T08:39:33.838178+0000","last_became_active":"2023-10-19T08:39:32.806550+0000","last_became_peered":"2023-10-19T08:39:32.806550+0000","last_unstale":"2023-10-19T08:39:33.838178+0000","last_undegraded":"2023-10-19T08:39:33.838178+0000","last_fullsized":"2023-10-19T08:39:33.838178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:40:20.938332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.833645+0000","last_change":"2023-10-19T08:39:33.831888+0000","last_active":"2023-10-19T08:39:33.833645+0000","last_peered":"2023-10-19T08:39:33.833645+0000","last_clean":"2023-10-19T08:39:33.833645+0000","last_became_active":"2023-10-19T08:39:33.831694+0000","last_became_peered":"2023-10-19T08:39:33.831694+0000","last_unstale":"2023-10-19T08:39:33.833645+0000","last_undegraded":"2023-10-19T08:39:33.833645+0000","last_fullsized":"2023-10-19T08:39:33.833645+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:32:46.412920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.839715+0000","last_change":"2023-10-19T08:39:32.826541+0000","last_active":"2023-10-19T08:39:33.839715+0000","last_peered":"2023-10-19T08:39:33.839715+0000","last_clean":"2023-10-19T08:39:33.839715+0000","last_became_active":"2023-10-19T08:39:32.826055+0000","last_became_peered":"2023-10-19T08:39:32.826055+0000","last_unstale":"2023-10-19T08:39:33.839715+0000","last_undegraded":"2023-10-19T08:39:33.839715+0000","last_fullsized":"2023-10-19T08:39:33.839715+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:59:32.877236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.835981+0000","last_change":"2023-10-19T08:39:33.830383+0000","last_active":"2023-10-19T08:39:33.835981+0000","last_peered":"2023-10-19T08:39:33.835981+0000","last_clean":"2023-10-19T08:39:33.835981+0000","last_became_active":"2023-10-19T08:39:33.830119+0000","last_became_peered":"2023-10-19T08:39:33.830119+0000","last_unstale":"2023-10-19T08:39:33.835981+0000","last_undegraded":"2023-10-19T08:39:33.835981+0000","last_fullsized":"2023-10-19T08:39:33.835981+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:17:58.990653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.828247+0000","last_change":"2023-10-19T08:39:32.817405+0000","last_active":"2023-10-19T08:39:33.828247+0000","last_peered":"2023-10-19T08:39:33.828247+0000","last_clean":"2023-10-19T08:39:33.828247+0000","last_became_active":"2023-10-19T08:39:32.817113+0000","last_became_peered":"2023-10-19T08:39:32.817113+0000","last_unstale":"2023-10-19T08:39:33.828247+0000","last_undegraded":"2023-10-19T08:39:33.828247+0000","last_fullsized":"2023-10-19T08:39:33.828247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:25:37.651977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.824933+0000","last_change":"2023-10-19T08:39:33.820321+0000","last_active":"2023-10-19T08:39:33.824933+0000","last_peered":"2023-10-19T08:39:33.824933+0000","last_clean":"2023-10-19T08:39:33.824933+0000","last_became_active":"2023-10-19T08:39:33.820009+0000","last_became_peered":"2023-10-19T08:39:33.820009+0000","last_unstale":"2023-10-19T08:39:33.824933+0000","last_undegraded":"2023-10-19T08:39:33.824933+0000","last_fullsized":"2023-10-19T08:39:33.824933+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:59:33.885308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.828495+0000","last_change":"2023-10-19T08:39:32.818017+0000","last_active":"2023-10-19T08:39:33.828495+0000","last_peered":"2023-10-19T08:39:33.828495+0000","last_clean":"2023-10-19T08:39:33.828495+0000","last_became_active":"2023-10-19T08:39:32.817755+0000","last_became_peered":"2023-10-19T08:39:32.817755+0000","last_unstale":"2023-10-19T08:39:33.828495+0000","last_undegraded":"2023-10-19T08:39:33.828495+0000","last_fullsized":"2023-10-19T08:39:33.828495+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:21:04.138383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.830010+0000","last_change":"2023-10-19T08:39:33.827088+0000","last_active":"2023-10-19T08:39:33.830010+0000","last_peered":"2023-10-19T08:39:33.830010+0000","last_clean":"2023-10-19T08:39:33.830010+0000","last_became_active":"2023-10-19T08:39:33.826847+0000","last_became_peered":"2023-10-19T08:39:33.826847+0000","last_unstale":"2023-10-19T08:39:33.830010+0000","last_undegraded":"2023-10-19T08:39:33.830010+0000","last_fullsized":"2023-10-19T08:39:33.830010+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:46:09.017534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.812394+0000","last_change":"2023-10-19T08:39:32.826828+0000","last_active":"2023-10-19T08:39:33.812394+0000","last_peered":"2023-10-19T08:39:33.812394+0000","last_clean":"2023-10-19T08:39:33.812394+0000","last_became_active":"2023-10-19T08:39:32.826549+0000","last_became_peered":"2023-10-19T08:39:32.826549+0000","last_unstale":"2023-10-19T08:39:33.812394+0000","last_undegraded":"2023-10-19T08:39:33.812394+0000","last_fullsized":"2023-10-19T08:39:33.812394+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:14:15.069436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.836394+0000","last_change":"2023-10-19T08:39:33.829149+0000","last_active":"2023-10-19T08:39:33.836394+0000","last_peered":"2023-10-19T08:39:33.836394+0000","last_clean":"2023-10-19T08:39:33.836394+0000","last_became_active":"2023-10-19T08:39:33.828337+0000","last_became_peered":"2023-10-19T08:39:33.828337+0000","last_unstale":"2023-10-19T08:39:33.836394+0000","last_undegraded":"2023-10-19T08:39:33.836394+0000","last_fullsized":"2023-10-19T08:39:33.836394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:33:59.978489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.826143+0000","last_change":"2023-10-19T08:39:32.821741+0000","last_active":"2023-10-19T08:39:33.826143+0000","last_peered":"2023-10-19T08:39:33.826143+0000","last_clean":"2023-10-19T08:39:33.826143+0000","last_became_active":"2023-10-19T08:39:32.821168+0000","last_became_peered":"2023-10-19T08:39:32.821168+0000","last_unstale":"2023-10-19T08:39:33.826143+0000","last_undegraded":"2023-10-19T08:39:33.826143+0000","last_fullsized":"2023-10-19T08:39:33.826143+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:47:14.307452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.825451+0000","last_change":"2023-10-19T08:39:33.821198+0000","last_active":"2023-10-19T08:39:33.825451+0000","last_peered":"2023-10-19T08:39:33.825451+0000","last_clean":"2023-10-19T08:39:33.825451+0000","last_became_active":"2023-10-19T08:39:33.820918+0000","last_became_peered":"2023-10-19T08:39:33.820918+0000","last_unstale":"2023-10-19T08:39:33.825451+0000","last_undegraded":"2023-10-19T08:39:33.825451+0000","last_fullsized":"2023-10-19T08:39:33.825451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:43:06.230157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.805694+0000","last_change":"2023-10-19T08:39:32.822330+0000","last_active":"2023-10-19T08:39:33.805694+0000","last_peered":"2023-10-19T08:39:33.805694+0000","last_clean":"2023-10-19T08:39:33.805694+0000","last_became_active":"2023-10-19T08:39:32.822085+0000","last_became_peered":"2023-10-19T08:39:32.822085+0000","last_unstale":"2023-10-19T08:39:33.805694+0000","last_undegraded":"2023-10-19T08:39:33.805694+0000","last_fullsized":"2023-10-19T08:39:33.805694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:28:42.468616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.833228+0000","last_change":"2023-10-19T08:39:33.827781+0000","last_active":"2023-10-19T08:39:33.833228+0000","last_peered":"2023-10-19T08:39:33.833228+0000","last_clean":"2023-10-19T08:39:33.833228+0000","last_became_active":"2023-10-19T08:39:33.827518+0000","last_became_peered":"2023-10-19T08:39:33.827518+0000","last_unstale":"2023-10-19T08:39:33.833228+0000","last_undegraded":"2023-10-19T08:39:33.833228+0000","last_fullsized":"2023-10-19T08:39:33.833228+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:51:22.501402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.802738+0000","last_change":"2023-10-19T08:39:32.818950+0000","last_active":"2023-10-19T08:39:33.802738+0000","last_peered":"2023-10-19T08:39:33.802738+0000","last_clean":"2023-10-19T08:39:33.802738+0000","last_became_active":"2023-10-19T08:39:32.818638+0000","last_became_peered":"2023-10-19T08:39:32.818638+0000","last_unstale":"2023-10-19T08:39:33.802738+0000","last_undegraded":"2023-10-19T08:39:33.802738+0000","last_fullsized":"2023-10-19T08:39:33.802738+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:30:10.487263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.823014+0000","last_change":"2023-10-19T08:39:33.815028+0000","last_active":"2023-10-19T08:39:33.823014+0000","last_peered":"2023-10-19T08:39:33.823014+0000","last_clean":"2023-10-19T08:39:33.823014+0000","last_became_active":"2023-10-19T08:39:33.814818+0000","last_became_peered":"2023-10-19T08:39:33.814818+0000","last_unstale":"2023-10-19T08:39:33.823014+0000","last_undegraded":"2023-10-19T08:39:33.823014+0000","last_fullsized":"2023-10-19T08:39:33.823014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:44:32.380625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.812856+0000","last_change":"2023-10-19T08:39:32.818087+0000","last_active":"2023-10-19T08:39:33.812856+0000","last_peered":"2023-10-19T08:39:33.812856+0000","last_clean":"2023-10-19T08:39:33.812856+0000","last_became_active":"2023-10-19T08:39:32.817846+0000","last_became_peered":"2023-10-19T08:39:32.817846+0000","last_unstale":"2023-10-19T08:39:33.812856+0000","last_undegraded":"2023-10-19T08:39:33.812856+0000","last_fullsized":"2023-10-19T08:39:33.812856+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:30:01.798592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.825945+0000","last_change":"2023-10-19T08:39:33.822013+0000","last_active":"2023-10-19T08:39:33.825945+0000","last_peered":"2023-10-19T08:39:33.825945+0000","last_clean":"2023-10-19T08:39:33.825945+0000","last_became_active":"2023-10-19T08:39:33.821741+0000","last_became_peered":"2023-10-19T08:39:33.821741+0000","last_unstale":"2023-10-19T08:39:33.825945+0000","last_undegraded":"2023-10-19T08:39:33.825945+0000","last_fullsized":"2023-10-19T08:39:33.825945+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:40:13.906183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.803347+0000","last_change":"2023-10-19T08:39:32.823187+0000","last_active":"2023-10-19T08:39:33.803347+0000","last_peered":"2023-10-19T08:39:33.803347+0000","last_clean":"2023-10-19T08:39:33.803347+0000","last_became_active":"2023-10-19T08:39:32.822889+0000","last_became_peered":"2023-10-19T08:39:32.822889+0000","last_unstale":"2023-10-19T08:39:33.803347+0000","last_undegraded":"2023-10-19T08:39:33.803347+0000","last_fullsized":"2023-10-19T08:39:33.803347+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:45:57.193432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.811721+0000","last_change":"2023-10-19T08:37:51.153209+0000","last_active":"2023-10-19T08:39:33.811721+0000","last_peered":"2023-10-19T08:39:33.811721+0000","last_clean":"2023-10-19T08:39:33.811721+0000","last_became_active":"2023-10-19T08:37:51.152844+0000","last_became_peered":"2023-10-19T08:37:51.152844+0000","last_unstale":"2023-10-19T08:39:33.811721+0000","last_undegraded":"2023-10-19T08:39:33.811721+0000","last_fullsized":"2023-10-19T08:39:33.811721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:36:28.300995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.835252+0000","last_change":"2023-10-19T08:39:33.830820+0000","last_active":"2023-10-19T08:39:33.835252+0000","last_peered":"2023-10-19T08:39:33.835252+0000","last_clean":"2023-10-19T08:39:33.835252+0000","last_became_active":"2023-10-19T08:39:33.830540+0000","last_became_peered":"2023-10-19T08:39:33.830540+0000","last_unstale":"2023-10-19T08:39:33.835252+0000","last_undegraded":"2023-10-19T08:39:33.835252+0000","last_fullsized":"2023-10-19T08:39:33.835252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:30:56.482153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.807594+0000","last_change":"2023-10-19T08:39:32.823640+0000","last_active":"2023-10-19T08:39:33.807594+0000","last_peered":"2023-10-19T08:39:33.807594+0000","last_clean":"2023-10-19T08:39:33.807594+0000","last_became_active":"2023-10-19T08:39:32.823448+0000","last_became_peered":"2023-10-19T08:39:32.823448+0000","last_unstale":"2023-10-19T08:39:33.807594+0000","last_undegraded":"2023-10-19T08:39:33.807594+0000","last_fullsized":"2023-10-19T08:39:33.807594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:17:57.982582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.805871+0000","last_change":"2023-10-19T08:37:51.116743+0000","last_active":"2023-10-19T08:39:33.805871+0000","last_peered":"2023-10-19T08:39:33.805871+0000","last_clean":"2023-10-19T08:39:33.805871+0000","last_became_active":"2023-10-19T08:37:51.116511+0000","last_became_peered":"2023-10-19T08:37:51.116511+0000","last_unstale":"2023-10-19T08:39:33.805871+0000","last_undegraded":"2023-10-19T08:39:33.805871+0000","last_fullsized":"2023-10-19T08:39:33.805871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:24:04.010131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.823018+0000","last_change":"2023-10-19T08:39:33.814490+0000","last_active":"2023-10-19T08:39:33.823018+0000","last_peered":"2023-10-19T08:39:33.823018+0000","last_clean":"2023-10-19T08:39:33.823018+0000","last_became_active":"2023-10-19T08:39:33.814255+0000","last_became_peered":"2023-10-19T08:39:33.814255+0000","last_unstale":"2023-10-19T08:39:33.823018+0000","last_undegraded":"2023-10-19T08:39:33.823018+0000","last_fullsized":"2023-10-19T08:39:33.823018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:36:12.154264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.815212+0000","last_change":"2023-10-19T08:39:32.822970+0000","last_active":"2023-10-19T08:39:33.815212+0000","last_peered":"2023-10-19T08:39:33.815212+0000","last_clean":"2023-10-19T08:39:33.815212+0000","last_became_active":"2023-10-19T08:39:32.822651+0000","last_became_peered":"2023-10-19T08:39:32.822651+0000","last_unstale":"2023-10-19T08:39:33.815212+0000","last_undegraded":"2023-10-19T08:39:33.815212+0000","last_fullsized":"2023-10-19T08:39:33.815212+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:28:42.468616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.813336+0000","last_change":"2023-10-19T08:37:51.114782+0000","last_active":"2023-10-19T08:39:33.813336+0000","last_peered":"2023-10-19T08:39:33.813336+0000","last_clean":"2023-10-19T08:39:33.813336+0000","last_became_active":"2023-10-19T08:37:51.114388+0000","last_became_peered":"2023-10-19T08:37:51.114388+0000","last_unstale":"2023-10-19T08:39:33.813336+0000","last_undegraded":"2023-10-19T08:39:33.813336+0000","last_fullsized":"2023-10-19T08:39:33.813336+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:20:21.401319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.829560+0000","last_change":"2023-10-19T08:39:33.822768+0000","last_active":"2023-10-19T08:39:33.829560+0000","last_peered":"2023-10-19T08:39:33.829560+0000","last_clean":"2023-10-19T08:39:33.829560+0000","last_became_active":"2023-10-19T08:39:33.822492+0000","last_became_peered":"2023-10-19T08:39:33.822492+0000","last_unstale":"2023-10-19T08:39:33.829560+0000","last_undegraded":"2023-10-19T08:39:33.829560+0000","last_fullsized":"2023-10-19T08:39:33.829560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:18:22.788693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.828106+0000","last_change":"2023-10-19T08:39:32.822994+0000","last_active":"2023-10-19T08:39:33.828106+0000","last_peered":"2023-10-19T08:39:33.828106+0000","last_clean":"2023-10-19T08:39:33.828106+0000","last_became_active":"2023-10-19T08:39:32.822725+0000","last_became_peered":"2023-10-19T08:39:32.822725+0000","last_unstale":"2023-10-19T08:39:33.828106+0000","last_undegraded":"2023-10-19T08:39:33.828106+0000","last_fullsized":"2023-10-19T08:39:33.828106+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:27:20.665194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.805619+0000","last_change":"2023-10-19T08:37:51.115141+0000","last_active":"2023-10-19T08:39:33.805619+0000","last_peered":"2023-10-19T08:39:33.805619+0000","last_clean":"2023-10-19T08:39:33.805619+0000","last_became_active":"2023-10-19T08:37:51.114829+0000","last_became_peered":"2023-10-19T08:37:51.114829+0000","last_unstale":"2023-10-19T08:39:33.805619+0000","last_undegraded":"2023-10-19T08:39:33.805619+0000","last_fullsized":"2023-10-19T08:39:33.805619+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:23:14.858302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":201,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.810066+0000","last_change":"2023-10-19T08:37:51.153453+0000","last_active":"2023-10-19T08:39:33.810066+0000","last_peered":"2023-10-19T08:39:33.810066+0000","last_clean":"2023-10-19T08:39:33.810066+0000","last_became_active":"2023-10-19T08:37:51.153093+0000","last_became_peered":"2023-10-19T08:37:51.153093+0000","last_unstale":"2023-10-19T08:39:33.810066+0000","last_undegraded":"2023-10-19T08:39:33.810066+0000","last_fullsized":"2023-10-19T08:39:33.810066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:38:21.221616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.840412+0000","last_change":"2023-10-19T08:39:33.836339+0000","last_active":"2023-10-19T08:39:33.840412+0000","last_peered":"2023-10-19T08:39:33.840412+0000","last_clean":"2023-10-19T08:39:33.840412+0000","last_became_active":"2023-10-19T08:39:33.836065+0000","last_became_peered":"2023-10-19T08:39:33.836065+0000","last_unstale":"2023-10-19T08:39:33.840412+0000","last_undegraded":"2023-10-19T08:39:33.840412+0000","last_fullsized":"2023-10-19T08:39:33.840412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:48:36.777911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.811641+0000","last_change":"2023-10-19T08:39:32.826314+0000","last_active":"2023-10-19T08:39:33.811641+0000","last_peered":"2023-10-19T08:39:33.811641+0000","last_clean":"2023-10-19T08:39:33.811641+0000","last_became_active":"2023-10-19T08:39:32.826040+0000","last_became_peered":"2023-10-19T08:39:32.826040+0000","last_unstale":"2023-10-19T08:39:33.811641+0000","last_undegraded":"2023-10-19T08:39:33.811641+0000","last_fullsized":"2023-10-19T08:39:33.811641+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:40:20.938332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.810238+0000","last_change":"2023-10-19T08:37:51.118439+0000","last_active":"2023-10-19T08:39:33.810238+0000","last_peered":"2023-10-19T08:39:33.810238+0000","last_clean":"2023-10-19T08:39:33.810238+0000","last_became_active":"2023-10-19T08:37:51.118146+0000","last_became_peered":"2023-10-19T08:37:51.118146+0000","last_unstale":"2023-10-19T08:39:33.810238+0000","last_undegraded":"2023-10-19T08:39:33.810238+0000","last_fullsized":"2023-10-19T08:39:33.810238+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:45:32.625366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.818269+0000","last_change":"2023-10-19T08:39:33.815120+0000","last_active":"2023-10-19T08:39:33.818269+0000","last_peered":"2023-10-19T08:39:33.818269+0000","last_clean":"2023-10-19T08:39:33.818269+0000","last_became_active":"2023-10-19T08:39:33.814753+0000","last_became_peered":"2023-10-19T08:39:33.814753+0000","last_unstale":"2023-10-19T08:39:33.818269+0000","last_undegraded":"2023-10-19T08:39:33.818269+0000","last_fullsized":"2023-10-19T08:39:33.818269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T08:45:03.342309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.808949+0000","last_change":"2023-10-19T08:39:32.822349+0000","last_active":"2023-10-19T08:39:33.808949+0000","last_peered":"2023-10-19T08:39:33.808949+0000","last_clean":"2023-10-19T08:39:33.808949+0000","last_became_active":"2023-10-19T08:39:32.822022+0000","last_became_peered":"2023-10-19T08:39:32.822022+0000","last_unstale":"2023-10-19T08:39:33.808949+0000","last_undegraded":"2023-10-19T08:39:33.808949+0000","last_fullsized":"2023-10-19T08:39:33.808949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:54:09.689815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.815287+0000","last_change":"2023-10-19T08:37:51.153416+0000","last_active":"2023-10-19T08:39:33.815287+0000","last_peered":"2023-10-19T08:39:33.815287+0000","last_clean":"2023-10-19T08:39:33.815287+0000","last_became_active":"2023-10-19T08:37:51.152844+0000","last_became_peered":"2023-10-19T08:37:51.152844+0000","last_unstale":"2023-10-19T08:39:33.815287+0000","last_undegraded":"2023-10-19T08:39:33.815287+0000","last_fullsized":"2023-10-19T08:39:33.815287+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:56:42.614796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.838219+0000","last_change":"2023-10-19T08:39:33.831602+0000","last_active":"2023-10-19T08:39:33.838219+0000","last_peered":"2023-10-19T08:39:33.838219+0000","last_clean":"2023-10-19T08:39:33.838219+0000","last_became_active":"2023-10-19T08:39:33.831323+0000","last_became_peered":"2023-10-19T08:39:33.831323+0000","last_unstale":"2023-10-19T08:39:33.838219+0000","last_undegraded":"2023-10-19T08:39:33.838219+0000","last_fullsized":"2023-10-19T08:39:33.838219+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:38:10.831276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.811651+0000","last_change":"2023-10-19T08:39:32.817001+0000","last_active":"2023-10-19T08:39:33.811651+0000","last_peered":"2023-10-19T08:39:33.811651+0000","last_clean":"2023-10-19T08:39:33.811651+0000","last_became_active":"2023-10-19T08:39:32.816732+0000","last_became_peered":"2023-10-19T08:39:32.816732+0000","last_unstale":"2023-10-19T08:39:33.811651+0000","last_undegraded":"2023-10-19T08:39:33.811651+0000","last_fullsized":"2023-10-19T08:39:33.811651+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:13:17.845844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.820870+0000","last_change":"2023-10-19T08:37:51.124188+0000","last_active":"2023-10-19T08:39:33.820870+0000","last_peered":"2023-10-19T08:39:33.820870+0000","last_clean":"2023-10-19T08:39:33.820870+0000","last_became_active":"2023-10-19T08:37:51.123944+0000","last_became_peered":"2023-10-19T08:37:51.123944+0000","last_unstale":"2023-10-19T08:39:33.820870+0000","last_undegraded":"2023-10-19T08:39:33.820870+0000","last_fullsized":"2023-10-19T08:39:33.820870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:00:29.945919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.826941+0000","last_change":"2023-10-19T08:39:33.823225+0000","last_active":"2023-10-19T08:39:33.826941+0000","last_peered":"2023-10-19T08:39:33.826941+0000","last_clean":"2023-10-19T08:39:33.826941+0000","last_became_active":"2023-10-19T08:39:33.822950+0000","last_became_peered":"2023-10-19T08:39:33.822950+0000","last_unstale":"2023-10-19T08:39:33.826941+0000","last_undegraded":"2023-10-19T08:39:33.826941+0000","last_fullsized":"2023-10-19T08:39:33.826941+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:44:51.262505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.813486+0000","last_change":"2023-10-19T08:39:32.822792+0000","last_active":"2023-10-19T08:39:33.813486+0000","last_peered":"2023-10-19T08:39:33.813486+0000","last_clean":"2023-10-19T08:39:33.813486+0000","last_became_active":"2023-10-19T08:39:32.822531+0000","last_became_peered":"2023-10-19T08:39:32.822531+0000","last_unstale":"2023-10-19T08:39:33.813486+0000","last_undegraded":"2023-10-19T08:39:33.813486+0000","last_fullsized":"2023-10-19T08:39:33.813486+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:19:23.246548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.810600+0000","last_change":"2023-10-19T08:37:52.296732+0000","last_active":"2023-10-19T08:39:33.810600+0000","last_peered":"2023-10-19T08:39:33.810600+0000","last_clean":"2023-10-19T08:39:33.810600+0000","last_became_active":"2023-10-19T08:37:52.296445+0000","last_became_peered":"2023-10-19T08:37:52.296445+0000","last_unstale":"2023-10-19T08:39:33.810600+0000","last_undegraded":"2023-10-19T08:39:33.810600+0000","last_fullsized":"2023-10-19T08:39:33.810600+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:45:14.282785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1036288,"data_stored":786496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.437}]},{"osd":1,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.503}]},{"osd":2,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.378}]},{"osd":5,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59399999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":188590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.626},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.83799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":188590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.246}]},{"osd":2,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.433,"5min":0.433,"15min":0.433},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.316}]},{"osd":3,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.5},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.60199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1015808,"data_stored":777597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.50600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":187606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.309}]},{"osd":1,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.251},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.26900000000000002}]},{"osd":3,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.29699999999999999}]},{"osd":4,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":4.7300000000000004,"5min":4.7300000000000004,"15min":4.7300000000000004},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":4.7119999999999997,"5min":4.7119999999999997,"15min":4.7119999999999997},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":4.7469999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":4.7690000000000001,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.40000000000000002}]},{"osd":7,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":4.79,"5min":4.79,"15min":4.79},"last":0.501},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.432}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":188590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.307}]},{"osd":2,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.372},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.499},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.54600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":187229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.504},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.38700000000000001}]},{"osd":5,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.36399999999999999}]},{"osd":6,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.433},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":196108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.63},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.497},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.44}]},{"osd":6,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.372},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.41099999999999998}]},{"osd":7,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.45200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-19T08:39:37.912 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-19T08:39:38.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.062+0000 7f17515f3700 1 Processor -- start 2023-10-19T08:39:38.067 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.062+0000 7f17515f3700 1 -- start start 2023-10-19T08:39:38.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.063+0000 7f17515f3700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f174c0cfcf0 0x7f174c0d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.063+0000 7f17515f3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f174c0b2180 0x7f174c0d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.070 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.063+0000 7f17515f3700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f174c0d0610 con 0x7f174c0d2eb0 2023-10-19T08:39:38.071 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.063+0000 7f17515f3700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174c0d1120 con 0x7f174c0cfcf0 2023-10-19T08:39:38.071 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.063+0000 7f17515f3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0d1400 con 0x7f174c0b2180 2023-10-19T08:39:38.071 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.063+0000 7f174affd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f174c0cfcf0 0x7f174c0d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.071 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.063+0000 7f174b7fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f174c0d2eb0 0x7f174c0d3320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59160/0 (socket says 172.21.15.79:59160) 2023-10-19T08:39:38.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.063+0000 7f174affd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f174c0cfcf0 0x7f174c0d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49086/0 (socket says 172.21.15.79:49086) 2023-10-19T08:39:38.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.063+0000 7f174b7fe700 1 -- 172.21.15.79:0/2358287969 learned_addr learned my addr 172.21.15.79:0/2358287969 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:38.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.064+0000 7f174a7fc700 1 --2- 172.21.15.79:0/2358287969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f174c0b2180 0x7f174c0d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.064+0000 7f174affd700 1 -- 172.21.15.79:0/2358287969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f174c0b2180 msgr2=0x7f174c0d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:38.072 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.064+0000 7f174affd700 1 --2- 172.21.15.79:0/2358287969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f174c0b2180 0x7f174c0d2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.064+0000 7f174affd700 1 -- 172.21.15.79:0/2358287969 >> v1:172.21.15.79:6789/0 conn(0x7f174c0d2eb0 legacy=0x7f174c0d3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:38.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.064+0000 7f1749ffb700 1 -- 172.21.15.79:0/2358287969 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744945901 0 0) 0x7f174c0d0610 con 0x7f174c0d2eb0 2023-10-19T08:39:38.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.064+0000 7f174affd700 1 -- 172.21.15.79:0/2358287969 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c0d16e0 con 0x7f174c0cfcf0 2023-10-19T08:39:38.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.064+0000 7f174affd700 1 --2- 172.21.15.79:0/2358287969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f174c0cfcf0 0x7f174c0d00d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1740009840 tx=0x7f1740009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db4d63e7fe93fdf server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:38.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.064+0000 7f1749ffb700 1 -- 172.21.15.79:0/2358287969 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740011830 con 0x7f174c0cfcf0 2023-10-19T08:39:38.073 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.064+0000 7f1749ffb700 1 -- 172.21.15.79:0/2358287969 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1740011990 con 0x7f174c0cfcf0 2023-10-19T08:39:38.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.064+0000 7f1749ffb700 1 -- 172.21.15.79:0/2358287969 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740011d20 con 0x7f174c0cfcf0 2023-10-19T08:39:38.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.065+0000 7f17515f3700 1 -- 172.21.15.79:0/2358287969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f174c0cfcf0 msgr2=0x7f174c0d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:38.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.065+0000 7f17515f3700 1 --2- 172.21.15.79:0/2358287969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f174c0cfcf0 0x7f174c0d00d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1740009840 tx=0x7f1740009b50 comp rx=0 tx=0).stop 2023-10-19T08:39:38.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.065+0000 7f17515f3700 1 -- 172.21.15.79:0/2358287969 shutdown_connections 2023-10-19T08:39:38.074 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.065+0000 7f17515f3700 1 --2- 172.21.15.79:0/2358287969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f174c0cfcf0 0x7f174c0d00d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.065+0000 7f17515f3700 1 --2- 172.21.15.79:0/2358287969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f174c0b2180 0x7f174c0d2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.065+0000 7f17515f3700 1 -- 172.21.15.79:0/2358287969 >> 172.21.15.79:0/2358287969 conn(0x7f174c071b30 msgr2=0x7f174c071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:38.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.065+0000 7f17515f3700 1 -- 172.21.15.79:0/2358287969 shutdown_connections 2023-10-19T08:39:38.075 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.065+0000 7f17515f3700 1 -- 172.21.15.79:0/2358287969 wait complete. 2023-10-19T08:39:38.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.066+0000 7f17515f3700 1 Processor -- start 2023-10-19T08:39:38.078 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.066+0000 7f17515f3700 1 -- start start 2023-10-19T08:39:38.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.067+0000 7f17515f3700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f174c0b2180 0x7f174c0a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.067+0000 7f17515f3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f174c0cfcf0 0x7f174c0ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.067+0000 7f17515f3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f174c0d2eb0 0x7f174c0cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.079 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.067+0000 7f17515f3700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0aa6d0 con 0x7f174c0b2180 2023-10-19T08:39:38.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.067+0000 7f17515f3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0aa9b0 con 0x7f174c0d2eb0 2023-10-19T08:39:38.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.067+0000 7f17515f3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0aac90 con 0x7f174c0cfcf0 2023-10-19T08:39:38.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.067+0000 7f174affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f174c0b2180 0x7f174c0a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.080 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.067+0000 7f174affd700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f174c0b2180 0x7f174c0a9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49090/0 (socket says 172.21.15.79:49090) 2023-10-19T08:39:38.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.067+0000 7f174affd700 1 -- 172.21.15.79:0/763813283 learned_addr learned my addr 172.21.15.79:0/763813283 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:38.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.068+0000 7f174a7fc700 1 --2- 172.21.15.79:0/763813283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f174c0cfcf0 0x7f174c0ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.068+0000 7f174b7fe700 1 --2- 172.21.15.79:0/763813283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f174c0d2eb0 0x7f174c0cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.068+0000 7f174affd700 1 -- 172.21.15.79:0/763813283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f174c0cfcf0 msgr2=0x7f174c0ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:38.081 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.068+0000 7f174affd700 1 --2- 172.21.15.79:0/763813283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f174c0cfcf0 0x7f174c0ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.068+0000 7f174affd700 1 -- 172.21.15.79:0/763813283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f174c0d2eb0 msgr2=0x7f174c0cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:38.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.068+0000 7f174affd700 1 --2- 172.21.15.79:0/763813283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f174c0d2eb0 0x7f174c0cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.068+0000 7f174affd700 1 -- 172.21.15.79:0/763813283 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17400094a0 con 0x7f174c0b2180 2023-10-19T08:39:38.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.068+0000 7f174affd700 1 --2- 172.21.15.79:0/763813283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f174c0b2180 0x7f174c0a9d70 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1740009fd0 tx=0x7f1740004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:38.082 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.068+0000 7f17337fe700 1 -- 172.21.15.79:0/763813283 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400036a0 con 0x7f174c0b2180 2023-10-19T08:39:38.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.068+0000 7f17337fe700 1 -- 172.21.15.79:0/763813283 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174001f070 con 0x7f174c0b2180 2023-10-19T08:39:38.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.068+0000 7f17515f3700 1 -- 172.21.15.79:0/763813283 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174c1f3670 con 0x7f174c0b2180 2023-10-19T08:39:38.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.068+0000 7f17337fe700 1 -- 172.21.15.79:0/763813283 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740003a60 con 0x7f174c0b2180 2023-10-19T08:39:38.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.068+0000 7f17515f3700 1 -- 172.21.15.79:0/763813283 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174c0aa2b0 con 0x7f174c0b2180 2023-10-19T08:39:38.083 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.069+0000 7f17515f3700 1 -- 172.21.15.79:0/763813283 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174c1f34d0 con 0x7f174c0b2180 2023-10-19T08:39:38.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.069+0000 7f17337fe700 1 -- 172.21.15.79:0/763813283 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1740003bc0 con 0x7f174c0b2180 2023-10-19T08:39:38.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.070+0000 7f17337fe700 1 --2- 172.21.15.79:0/763813283 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f173806a0e0 0x7f173806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.070+0000 7f17337fe700 1 -- 172.21.15.79:0/763813283 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1740021070 con 0x7f174c0b2180 2023-10-19T08:39:38.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.070+0000 7f174a7fc700 1 --2- 172.21.15.79:0/763813283 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f173806a0e0 0x7f173806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.070+0000 7f174a7fc700 1 --2- 172.21.15.79:0/763813283 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f173806a0e0 0x7f173806c5a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f174c0ab260 tx=0x7f173c009210 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:38.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.074+0000 7f17337fe700 1 -- 172.21.15.79:0/763813283 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f174c1f34d0 con 0x7f174c0b2180 2023-10-19T08:39:38.264 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.260+0000 7f17515f3700 1 -- 172.21.15.79:0/763813283 --> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f174c0d1ca0 con 0x7f173806a0e0 2023-10-19T08:39:38.272 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.268+0000 7f17337fe700 1 -- 172.21.15.79:0/763813283 <== mgr.4113 v2:172.21.15.79:6832/316135984 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311738 (secure 0 0 0) 0x7f173c011830 con 0x7f173806a0e0 2023-10-19T08:39:38.275 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:38.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.271+0000 7f17515f3700 1 -- 172.21.15.79:0/763813283 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f173806a0e0 msgr2=0x7f173806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:38.278 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.271+0000 7f17515f3700 1 --2- 172.21.15.79:0/763813283 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f173806a0e0 0x7f173806c5a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f174c0ab260 tx=0x7f173c009210 comp rx=0 tx=0).stop 2023-10-19T08:39:38.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.271+0000 7f17515f3700 1 -- 172.21.15.79:0/763813283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f174c0b2180 msgr2=0x7f174c0a9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:38.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.271+0000 7f17515f3700 1 --2- 172.21.15.79:0/763813283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f174c0b2180 0x7f174c0a9d70 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1740009fd0 tx=0x7f1740004750 comp rx=0 tx=0).stop 2023-10-19T08:39:38.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.271+0000 7f17515f3700 1 -- 172.21.15.79:0/763813283 shutdown_connections 2023-10-19T08:39:38.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.271+0000 7f17515f3700 1 --2- 172.21.15.79:0/763813283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f174c0d2eb0 0x7f174c0cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.279 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.271+0000 7f17515f3700 1 --2- 172.21.15.79:0/763813283 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f174c0b2180 0x7f174c0a9d70 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.271+0000 7f17515f3700 1 --2- 172.21.15.79:0/763813283 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f173806a0e0 0x7f173806c5a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.271+0000 7f17515f3700 1 --2- 172.21.15.79:0/763813283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f174c0cfcf0 0x7f174c0ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.271+0000 7f17515f3700 1 -- 172.21.15.79:0/763813283 >> 172.21.15.79:0/763813283 conn(0x7f174c071b30 msgr2=0x7f174c0d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:38.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.271+0000 7f17515f3700 1 -- 172.21.15.79:0/763813283 shutdown_connections 2023-10-19T08:39:38.280 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.271+0000 7f17515f3700 1 -- 172.21.15.79:0/763813283 wait complete. 2023-10-19T08:39:38.280 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2023-10-19T08:39:38.287 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2023-10-19T08:39:37.120784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":134,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220680,"kb_used_data":4508,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754040,"statfs":{"total":773094113280,"available":772868136960,"internally_reserved":0,"allocated":4616192,"data_stored":2700806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.325578"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.828861+0000","last_change":"2023-10-19T08:39:33.825725+0000","last_active":"2023-10-19T08:39:33.828861+0000","last_peered":"2023-10-19T08:39:33.828861+0000","last_clean":"2023-10-19T08:39:33.828861+0000","last_became_active":"2023-10-19T08:39:33.825404+0000","last_became_peered":"2023-10-19T08:39:33.825404+0000","last_unstale":"2023-10-19T08:39:33.828861+0000","last_undegraded":"2023-10-19T08:39:33.828861+0000","last_fullsized":"2023-10-19T08:39:33.828861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:23:26.872615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827101+0000","last_change":"2023-10-19T08:39:33.821855+0000","last_active":"2023-10-19T08:39:33.827101+0000","last_peered":"2023-10-19T08:39:33.827101+0000","last_clean":"2023-10-19T08:39:33.827101+0000","last_became_active":"2023-10-19T08:39:33.821591+0000","last_became_peered":"2023-10-19T08:39:33.821591+0000","last_unstale":"2023-10-19T08:39:33.827101+0000","last_undegraded":"2023-10-19T08:39:33.827101+0000","last_fullsized":"2023-10-19T08:39:33.827101+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:23:26.872615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.840535+0000","last_change":"2023-10-19T08:39:33.836237+0000","last_active":"2023-10-19T08:39:33.840535+0000","last_peered":"2023-10-19T08:39:33.840535+0000","last_clean":"2023-10-19T08:39:33.840535+0000","last_became_active":"2023-10-19T08:39:33.835969+0000","last_became_peered":"2023-10-19T08:39:33.835969+0000","last_unstale":"2023-10-19T08:39:33.840535+0000","last_undegraded":"2023-10-19T08:39:33.840535+0000","last_fullsized":"2023-10-19T08:39:33.840535+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:02:09.367452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827321+0000","last_change":"2023-10-19T08:39:33.818503+0000","last_active":"2023-10-19T08:39:33.827321+0000","last_peered":"2023-10-19T08:39:33.827321+0000","last_clean":"2023-10-19T08:39:33.827321+0000","last_became_active":"2023-10-19T08:39:33.817725+0000","last_became_peered":"2023-10-19T08:39:33.817725+0000","last_unstale":"2023-10-19T08:39:33.827321+0000","last_undegraded":"2023-10-19T08:39:33.827321+0000","last_fullsized":"2023-10-19T08:39:33.827321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:01:24.685364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.826635+0000","last_change":"2023-10-19T08:39:33.821777+0000","last_active":"2023-10-19T08:39:33.826635+0000","last_peered":"2023-10-19T08:39:33.826635+0000","last_clean":"2023-10-19T08:39:33.826635+0000","last_became_active":"2023-10-19T08:39:33.821490+0000","last_became_peered":"2023-10-19T08:39:33.821490+0000","last_unstale":"2023-10-19T08:39:33.826635+0000","last_undegraded":"2023-10-19T08:39:33.826635+0000","last_fullsized":"2023-10-19T08:39:33.826635+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:14:05.573355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.826975+0000","last_change":"2023-10-19T08:39:33.826332+0000","last_active":"2023-10-19T08:39:33.826975+0000","last_peered":"2023-10-19T08:39:33.826975+0000","last_clean":"2023-10-19T08:39:33.826975+0000","last_became_active":"2023-10-19T08:39:33.826019+0000","last_became_peered":"2023-10-19T08:39:33.826019+0000","last_unstale":"2023-10-19T08:39:33.826975+0000","last_undegraded":"2023-10-19T08:39:33.826975+0000","last_fullsized":"2023-10-19T08:39:33.826975+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:53:45.585760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.828809+0000","last_change":"2023-10-19T08:39:33.825306+0000","last_active":"2023-10-19T08:39:33.828809+0000","last_peered":"2023-10-19T08:39:33.828809+0000","last_clean":"2023-10-19T08:39:33.828809+0000","last_became_active":"2023-10-19T08:39:33.824387+0000","last_became_peered":"2023-10-19T08:39:33.824387+0000","last_unstale":"2023-10-19T08:39:33.828809+0000","last_undegraded":"2023-10-19T08:39:33.828809+0000","last_fullsized":"2023-10-19T08:39:33.828809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T08:45:03.342309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827685+0000","last_change":"2023-10-19T08:39:33.810773+0000","last_active":"2023-10-19T08:39:33.827685+0000","last_peered":"2023-10-19T08:39:33.827685+0000","last_clean":"2023-10-19T08:39:33.827685+0000","last_became_active":"2023-10-19T08:39:33.810518+0000","last_became_peered":"2023-10-19T08:39:33.810518+0000","last_unstale":"2023-10-19T08:39:33.827685+0000","last_undegraded":"2023-10-19T08:39:33.827685+0000","last_fullsized":"2023-10-19T08:39:33.827685+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:43:06.230157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.824677+0000","last_change":"2023-10-19T08:39:33.815025+0000","last_active":"2023-10-19T08:39:33.824677+0000","last_peered":"2023-10-19T08:39:33.824677+0000","last_clean":"2023-10-19T08:39:33.824677+0000","last_became_active":"2023-10-19T08:39:33.814763+0000","last_became_peered":"2023-10-19T08:39:33.814763+0000","last_unstale":"2023-10-19T08:39:33.824677+0000","last_undegraded":"2023-10-19T08:39:33.824677+0000","last_fullsized":"2023-10-19T08:39:33.824677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:59:04.130649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.822849+0000","last_change":"2023-10-19T08:39:33.810259+0000","last_active":"2023-10-19T08:39:33.822849+0000","last_peered":"2023-10-19T08:39:33.822849+0000","last_clean":"2023-10-19T08:39:33.822849+0000","last_became_active":"2023-10-19T08:39:33.809992+0000","last_became_peered":"2023-10-19T08:39:33.809992+0000","last_unstale":"2023-10-19T08:39:33.822849+0000","last_undegraded":"2023-10-19T08:39:33.822849+0000","last_fullsized":"2023-10-19T08:39:33.822849+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:38:10.991152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827431+0000","last_change":"2023-10-19T08:39:33.822100+0000","last_active":"2023-10-19T08:39:33.827431+0000","last_peered":"2023-10-19T08:39:33.827431+0000","last_clean":"2023-10-19T08:39:33.827431+0000","last_became_active":"2023-10-19T08:39:33.821864+0000","last_became_peered":"2023-10-19T08:39:33.821864+0000","last_unstale":"2023-10-19T08:39:33.827431+0000","last_undegraded":"2023-10-19T08:39:33.827431+0000","last_fullsized":"2023-10-19T08:39:33.827431+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:44:51.262505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.837964+0000","last_change":"2023-10-19T08:39:33.831849+0000","last_active":"2023-10-19T08:39:33.837964+0000","last_peered":"2023-10-19T08:39:33.837964+0000","last_clean":"2023-10-19T08:39:33.837964+0000","last_became_active":"2023-10-19T08:39:33.831551+0000","last_became_peered":"2023-10-19T08:39:33.831551+0000","last_unstale":"2023-10-19T08:39:33.837964+0000","last_undegraded":"2023-10-19T08:39:33.837964+0000","last_fullsized":"2023-10-19T08:39:33.837964+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:19:57.962430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.833287+0000","last_change":"2023-10-19T08:39:33.828972+0000","last_active":"2023-10-19T08:39:33.833287+0000","last_peered":"2023-10-19T08:39:33.833287+0000","last_clean":"2023-10-19T08:39:33.833287+0000","last_became_active":"2023-10-19T08:39:33.828644+0000","last_became_peered":"2023-10-19T08:39:33.828644+0000","last_unstale":"2023-10-19T08:39:33.833287+0000","last_undegraded":"2023-10-19T08:39:33.833287+0000","last_fullsized":"2023-10-19T08:39:33.833287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:38:50.667101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827683+0000","last_change":"2023-10-19T08:39:33.815913+0000","last_active":"2023-10-19T08:39:33.827683+0000","last_peered":"2023-10-19T08:39:33.827683+0000","last_clean":"2023-10-19T08:39:33.827683+0000","last_became_active":"2023-10-19T08:39:33.815664+0000","last_became_peered":"2023-10-19T08:39:33.815664+0000","last_unstale":"2023-10-19T08:39:33.827683+0000","last_undegraded":"2023-10-19T08:39:33.827683+0000","last_fullsized":"2023-10-19T08:39:33.827683+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:49:21.321636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827073+0000","last_change":"2023-10-19T08:39:33.818873+0000","last_active":"2023-10-19T08:39:33.827073+0000","last_peered":"2023-10-19T08:39:33.827073+0000","last_clean":"2023-10-19T08:39:33.827073+0000","last_became_active":"2023-10-19T08:39:33.818362+0000","last_became_peered":"2023-10-19T08:39:33.818362+0000","last_unstale":"2023-10-19T08:39:33.827073+0000","last_undegraded":"2023-10-19T08:39:33.827073+0000","last_fullsized":"2023-10-19T08:39:33.827073+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:36:12.154264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.835267+0000","last_change":"2023-10-19T08:39:33.831004+0000","last_active":"2023-10-19T08:39:33.835267+0000","last_peered":"2023-10-19T08:39:33.835267+0000","last_clean":"2023-10-19T08:39:33.835267+0000","last_became_active":"2023-10-19T08:39:33.830690+0000","last_became_peered":"2023-10-19T08:39:33.830690+0000","last_unstale":"2023-10-19T08:39:33.835267+0000","last_undegraded":"2023-10-19T08:39:33.835267+0000","last_fullsized":"2023-10-19T08:39:33.835267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:38:50.667101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.823894+0000","last_change":"2023-10-19T08:39:33.816892+0000","last_active":"2023-10-19T08:39:33.823894+0000","last_peered":"2023-10-19T08:39:33.823894+0000","last_clean":"2023-10-19T08:39:33.823894+0000","last_became_active":"2023-10-19T08:39:33.816487+0000","last_became_peered":"2023-10-19T08:39:33.816487+0000","last_unstale":"2023-10-19T08:39:33.823894+0000","last_undegraded":"2023-10-19T08:39:33.823894+0000","last_fullsized":"2023-10-19T08:39:33.823894+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:59:13.296658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.829936+0000","last_change":"2023-10-19T08:39:33.826968+0000","last_active":"2023-10-19T08:39:33.829936+0000","last_peered":"2023-10-19T08:39:33.829936+0000","last_clean":"2023-10-19T08:39:33.829936+0000","last_became_active":"2023-10-19T08:39:33.826651+0000","last_became_peered":"2023-10-19T08:39:33.826651+0000","last_unstale":"2023-10-19T08:39:33.829936+0000","last_undegraded":"2023-10-19T08:39:33.829936+0000","last_fullsized":"2023-10-19T08:39:33.829936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:42:05.007534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.835290+0000","last_change":"2023-10-19T08:39:33.830824+0000","last_active":"2023-10-19T08:39:33.835290+0000","last_peered":"2023-10-19T08:39:33.835290+0000","last_clean":"2023-10-19T08:39:33.835290+0000","last_became_active":"2023-10-19T08:39:33.830412+0000","last_became_peered":"2023-10-19T08:39:33.830412+0000","last_unstale":"2023-10-19T08:39:33.835290+0000","last_undegraded":"2023-10-19T08:39:33.835290+0000","last_fullsized":"2023-10-19T08:39:33.835290+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:51:22.501402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.834875+0000","last_change":"2023-10-19T08:39:33.831558+0000","last_active":"2023-10-19T08:39:33.834875+0000","last_peered":"2023-10-19T08:39:33.834875+0000","last_clean":"2023-10-19T08:39:33.834875+0000","last_became_active":"2023-10-19T08:39:33.831158+0000","last_became_peered":"2023-10-19T08:39:33.831158+0000","last_unstale":"2023-10-19T08:39:33.834875+0000","last_undegraded":"2023-10-19T08:39:33.834875+0000","last_fullsized":"2023-10-19T08:39:33.834875+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:11:38.529637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.826681+0000","last_change":"2023-10-19T08:39:33.818512+0000","last_active":"2023-10-19T08:39:33.826681+0000","last_peered":"2023-10-19T08:39:33.826681+0000","last_clean":"2023-10-19T08:39:33.826681+0000","last_became_active":"2023-10-19T08:39:33.818254+0000","last_became_peered":"2023-10-19T08:39:33.818254+0000","last_unstale":"2023-10-19T08:39:33.826681+0000","last_undegraded":"2023-10-19T08:39:33.826681+0000","last_fullsized":"2023-10-19T08:39:33.826681+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:09:12.700153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827661+0000","last_change":"2023-10-19T08:39:33.809916+0000","last_active":"2023-10-19T08:39:33.827661+0000","last_peered":"2023-10-19T08:39:33.827661+0000","last_clean":"2023-10-19T08:39:33.827661+0000","last_became_active":"2023-10-19T08:39:33.809147+0000","last_became_peered":"2023-10-19T08:39:33.809147+0000","last_unstale":"2023-10-19T08:39:33.827661+0000","last_undegraded":"2023-10-19T08:39:33.827661+0000","last_fullsized":"2023-10-19T08:39:33.827661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:43:35.690550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.824868+0000","last_change":"2023-10-19T08:39:33.820859+0000","last_active":"2023-10-19T08:39:33.824868+0000","last_peered":"2023-10-19T08:39:33.824868+0000","last_clean":"2023-10-19T08:39:33.824868+0000","last_became_active":"2023-10-19T08:39:33.820577+0000","last_became_peered":"2023-10-19T08:39:33.820577+0000","last_unstale":"2023-10-19T08:39:33.824868+0000","last_undegraded":"2023-10-19T08:39:33.824868+0000","last_fullsized":"2023-10-19T08:39:33.824868+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:03:46.549984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.824980+0000","last_change":"2023-10-19T08:39:33.820686+0000","last_active":"2023-10-19T08:39:33.824980+0000","last_peered":"2023-10-19T08:39:33.824980+0000","last_clean":"2023-10-19T08:39:33.824980+0000","last_became_active":"2023-10-19T08:39:33.820388+0000","last_became_peered":"2023-10-19T08:39:33.820388+0000","last_unstale":"2023-10-19T08:39:33.824980+0000","last_undegraded":"2023-10-19T08:39:33.824980+0000","last_fullsized":"2023-10-19T08:39:33.824980+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:55:00.386015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.816422+0000","last_change":"2023-10-19T08:39:33.814723+0000","last_active":"2023-10-19T08:39:33.816422+0000","last_peered":"2023-10-19T08:39:33.816422+0000","last_clean":"2023-10-19T08:39:33.816422+0000","last_became_active":"2023-10-19T08:39:33.814326+0000","last_became_peered":"2023-10-19T08:39:33.814326+0000","last_unstale":"2023-10-19T08:39:33.816422+0000","last_undegraded":"2023-10-19T08:39:33.816422+0000","last_fullsized":"2023-10-19T08:39:33.816422+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:42:37.823833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.833300+0000","last_change":"2023-10-19T08:39:33.828988+0000","last_active":"2023-10-19T08:39:33.833300+0000","last_peered":"2023-10-19T08:39:33.833300+0000","last_clean":"2023-10-19T08:39:33.833300+0000","last_became_active":"2023-10-19T08:39:33.828726+0000","last_became_peered":"2023-10-19T08:39:33.828726+0000","last_unstale":"2023-10-19T08:39:33.833300+0000","last_undegraded":"2023-10-19T08:39:33.833300+0000","last_fullsized":"2023-10-19T08:39:33.833300+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:30:56.482153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.824057+0000","last_change":"2023-10-19T08:39:33.816123+0000","last_active":"2023-10-19T08:39:33.824057+0000","last_peered":"2023-10-19T08:39:33.824057+0000","last_clean":"2023-10-19T08:39:33.824057+0000","last_became_active":"2023-10-19T08:39:33.815867+0000","last_became_peered":"2023-10-19T08:39:33.815867+0000","last_unstale":"2023-10-19T08:39:33.824057+0000","last_undegraded":"2023-10-19T08:39:33.824057+0000","last_fullsized":"2023-10-19T08:39:33.824057+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:31:16.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.832136+0000","last_change":"2023-10-19T08:39:33.828375+0000","last_active":"2023-10-19T08:39:33.832136+0000","last_peered":"2023-10-19T08:39:33.832136+0000","last_clean":"2023-10-19T08:39:33.832136+0000","last_became_active":"2023-10-19T08:39:33.828099+0000","last_became_peered":"2023-10-19T08:39:33.828099+0000","last_unstale":"2023-10-19T08:39:33.832136+0000","last_undegraded":"2023-10-19T08:39:33.832136+0000","last_fullsized":"2023-10-19T08:39:33.832136+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:48:36.777911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.819776+0000","last_change":"2023-10-19T08:39:33.816185+0000","last_active":"2023-10-19T08:39:33.819776+0000","last_peered":"2023-10-19T08:39:33.819776+0000","last_clean":"2023-10-19T08:39:33.819776+0000","last_became_active":"2023-10-19T08:39:33.815710+0000","last_became_peered":"2023-10-19T08:39:33.815710+0000","last_unstale":"2023-10-19T08:39:33.819776+0000","last_undegraded":"2023-10-19T08:39:33.819776+0000","last_fullsized":"2023-10-19T08:39:33.819776+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:35:13.276199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.829790+0000","last_change":"2023-10-19T08:39:33.826319+0000","last_active":"2023-10-19T08:39:33.829790+0000","last_peered":"2023-10-19T08:39:33.829790+0000","last_clean":"2023-10-19T08:39:33.829790+0000","last_became_active":"2023-10-19T08:39:33.826020+0000","last_became_peered":"2023-10-19T08:39:33.826020+0000","last_unstale":"2023-10-19T08:39:33.829790+0000","last_undegraded":"2023-10-19T08:39:33.829790+0000","last_fullsized":"2023-10-19T08:39:33.829790+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:11:52.565783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827091+0000","last_change":"2023-10-19T08:39:33.819293+0000","last_active":"2023-10-19T08:39:33.827091+0000","last_peered":"2023-10-19T08:39:33.827091+0000","last_clean":"2023-10-19T08:39:33.827091+0000","last_became_active":"2023-10-19T08:39:33.818642+0000","last_became_peered":"2023-10-19T08:39:33.818642+0000","last_unstale":"2023-10-19T08:39:33.827091+0000","last_undegraded":"2023-10-19T08:39:33.827091+0000","last_fullsized":"2023-10-19T08:39:33.827091+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:51:52.827830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.833199+0000","last_change":"2023-10-19T08:39:33.827289+0000","last_active":"2023-10-19T08:39:33.833199+0000","last_peered":"2023-10-19T08:39:33.833199+0000","last_clean":"2023-10-19T08:39:33.833199+0000","last_became_active":"2023-10-19T08:39:33.827057+0000","last_became_peered":"2023-10-19T08:39:33.827057+0000","last_unstale":"2023-10-19T08:39:33.833199+0000","last_undegraded":"2023-10-19T08:39:33.833199+0000","last_fullsized":"2023-10-19T08:39:33.833199+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:35:13.276199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.825426+0000","last_change":"2023-10-19T08:39:33.821220+0000","last_active":"2023-10-19T08:39:33.825426+0000","last_peered":"2023-10-19T08:39:33.825426+0000","last_clean":"2023-10-19T08:39:33.825426+0000","last_became_active":"2023-10-19T08:39:33.820652+0000","last_became_peered":"2023-10-19T08:39:33.820652+0000","last_unstale":"2023-10-19T08:39:33.825426+0000","last_undegraded":"2023-10-19T08:39:33.825426+0000","last_fullsized":"2023-10-19T08:39:33.825426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T15:49:21.321636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.826869+0000","last_change":"2023-10-19T08:39:32.826906+0000","last_active":"2023-10-19T08:39:33.826869+0000","last_peered":"2023-10-19T08:39:33.826869+0000","last_clean":"2023-10-19T08:39:33.826869+0000","last_became_active":"2023-10-19T08:39:32.826593+0000","last_became_peered":"2023-10-19T08:39:32.826593+0000","last_unstale":"2023-10-19T08:39:33.826869+0000","last_undegraded":"2023-10-19T08:39:33.826869+0000","last_fullsized":"2023-10-19T08:39:33.826869+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:15:38.255113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.829307+0000","last_change":"2023-10-19T08:39:33.822750+0000","last_active":"2023-10-19T08:39:33.829307+0000","last_peered":"2023-10-19T08:39:33.829307+0000","last_clean":"2023-10-19T08:39:33.829307+0000","last_became_active":"2023-10-19T08:39:33.822503+0000","last_became_peered":"2023-10-19T08:39:33.822503+0000","last_unstale":"2023-10-19T08:39:33.829307+0000","last_undegraded":"2023-10-19T08:39:33.829307+0000","last_fullsized":"2023-10-19T08:39:33.829307+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:22:04.091476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.824106+0000","last_change":"2023-10-19T08:39:32.822777+0000","last_active":"2023-10-19T08:39:33.824106+0000","last_peered":"2023-10-19T08:39:33.824106+0000","last_clean":"2023-10-19T08:39:33.824106+0000","last_became_active":"2023-10-19T08:39:32.822495+0000","last_became_peered":"2023-10-19T08:39:32.822495+0000","last_unstale":"2023-10-19T08:39:33.824106+0000","last_undegraded":"2023-10-19T08:39:33.824106+0000","last_fullsized":"2023-10-19T08:39:33.824106+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:40:19.778228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.826448+0000","last_change":"2023-10-19T08:39:33.821635+0000","last_active":"2023-10-19T08:39:33.826448+0000","last_peered":"2023-10-19T08:39:33.826448+0000","last_clean":"2023-10-19T08:39:33.826448+0000","last_became_active":"2023-10-19T08:39:33.821203+0000","last_became_peered":"2023-10-19T08:39:33.821203+0000","last_unstale":"2023-10-19T08:39:33.826448+0000","last_undegraded":"2023-10-19T08:39:33.826448+0000","last_fullsized":"2023-10-19T08:39:33.826448+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:19:24.254619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827124+0000","last_change":"2023-10-19T08:39:32.826441+0000","last_active":"2023-10-19T08:39:33.827124+0000","last_peered":"2023-10-19T08:39:33.827124+0000","last_clean":"2023-10-19T08:39:33.827124+0000","last_became_active":"2023-10-19T08:39:32.826145+0000","last_became_peered":"2023-10-19T08:39:32.826145+0000","last_unstale":"2023-10-19T08:39:33.827124+0000","last_undegraded":"2023-10-19T08:39:33.827124+0000","last_fullsized":"2023-10-19T08:39:33.827124+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:43:34.682478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.825577+0000","last_change":"2023-10-19T08:39:33.821956+0000","last_active":"2023-10-19T08:39:33.825577+0000","last_peered":"2023-10-19T08:39:33.825577+0000","last_clean":"2023-10-19T08:39:33.825577+0000","last_became_active":"2023-10-19T08:39:33.821710+0000","last_became_peered":"2023-10-19T08:39:33.821710+0000","last_unstale":"2023-10-19T08:39:33.825577+0000","last_undegraded":"2023-10-19T08:39:33.825577+0000","last_fullsized":"2023-10-19T08:39:33.825577+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:44:32.380625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.824008+0000","last_change":"2023-10-19T08:39:32.826204+0000","last_active":"2023-10-19T08:39:33.824008+0000","last_peered":"2023-10-19T08:39:33.824008+0000","last_clean":"2023-10-19T08:39:33.824008+0000","last_became_active":"2023-10-19T08:39:32.825923+0000","last_became_peered":"2023-10-19T08:39:32.825923+0000","last_unstale":"2023-10-19T08:39:33.824008+0000","last_undegraded":"2023-10-19T08:39:33.824008+0000","last_fullsized":"2023-10-19T08:39:33.824008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:15:38.255113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.823901+0000","last_change":"2023-10-19T08:39:33.818669+0000","last_active":"2023-10-19T08:39:33.823901+0000","last_peered":"2023-10-19T08:39:33.823901+0000","last_clean":"2023-10-19T08:39:33.823901+0000","last_became_active":"2023-10-19T08:39:33.818406+0000","last_became_peered":"2023-10-19T08:39:33.818406+0000","last_unstale":"2023-10-19T08:39:33.823901+0000","last_undegraded":"2023-10-19T08:39:33.823901+0000","last_fullsized":"2023-10-19T08:39:33.823901+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:31:15.689646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.826073+0000","last_change":"2023-10-19T08:39:32.821759+0000","last_active":"2023-10-19T08:39:33.826073+0000","last_peered":"2023-10-19T08:39:33.826073+0000","last_clean":"2023-10-19T08:39:33.826073+0000","last_became_active":"2023-10-19T08:39:32.821445+0000","last_became_peered":"2023-10-19T08:39:32.821445+0000","last_unstale":"2023-10-19T08:39:33.826073+0000","last_undegraded":"2023-10-19T08:39:33.826073+0000","last_fullsized":"2023-10-19T08:39:33.826073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:24:43.050800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.844714+0000","last_change":"2023-10-19T08:39:33.838031+0000","last_active":"2023-10-19T08:39:33.844714+0000","last_peered":"2023-10-19T08:39:33.844714+0000","last_clean":"2023-10-19T08:39:33.844714+0000","last_became_active":"2023-10-19T08:39:33.837758+0000","last_became_peered":"2023-10-19T08:39:33.837758+0000","last_unstale":"2023-10-19T08:39:33.844714+0000","last_undegraded":"2023-10-19T08:39:33.844714+0000","last_fullsized":"2023-10-19T08:39:33.844714+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:02:12.636076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827254+0000","last_change":"2023-10-19T08:39:32.826320+0000","last_active":"2023-10-19T08:39:33.827254+0000","last_peered":"2023-10-19T08:39:33.827254+0000","last_clean":"2023-10-19T08:39:33.827254+0000","last_became_active":"2023-10-19T08:39:32.826017+0000","last_became_peered":"2023-10-19T08:39:32.826017+0000","last_unstale":"2023-10-19T08:39:33.827254+0000","last_undegraded":"2023-10-19T08:39:33.827254+0000","last_fullsized":"2023-10-19T08:39:33.827254+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:40:44.640487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.827665+0000","last_change":"2023-10-19T08:39:33.810460+0000","last_active":"2023-10-19T08:39:33.827665+0000","last_peered":"2023-10-19T08:39:33.827665+0000","last_clean":"2023-10-19T08:39:33.827665+0000","last_became_active":"2023-10-19T08:39:33.810187+0000","last_became_peered":"2023-10-19T08:39:33.810187+0000","last_unstale":"2023-10-19T08:39:33.827665+0000","last_undegraded":"2023-10-19T08:39:33.827665+0000","last_fullsized":"2023-10-19T08:39:33.827665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:40:06.502405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.805769+0000","last_change":"2023-10-19T08:39:32.818005+0000","last_active":"2023-10-19T08:39:33.805769+0000","last_peered":"2023-10-19T08:39:33.805769+0000","last_clean":"2023-10-19T08:39:33.805769+0000","last_became_active":"2023-10-19T08:39:32.817695+0000","last_became_peered":"2023-10-19T08:39:32.817695+0000","last_unstale":"2023-10-19T08:39:33.805769+0000","last_undegraded":"2023-10-19T08:39:33.805769+0000","last_fullsized":"2023-10-19T08:39:33.805769+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:58:24.296882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.824847+0000","last_change":"2023-10-19T08:39:33.820779+0000","last_active":"2023-10-19T08:39:33.824847+0000","last_peered":"2023-10-19T08:39:33.824847+0000","last_clean":"2023-10-19T08:39:33.824847+0000","last_became_active":"2023-10-19T08:39:33.820475+0000","last_became_peered":"2023-10-19T08:39:33.820475+0000","last_unstale":"2023-10-19T08:39:33.824847+0000","last_undegraded":"2023-10-19T08:39:33.824847+0000","last_fullsized":"2023-10-19T08:39:33.824847+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:32:46.412920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.803031+0000","last_change":"2023-10-19T08:39:32.814169+0000","last_active":"2023-10-19T08:39:33.803031+0000","last_peered":"2023-10-19T08:39:33.803031+0000","last_clean":"2023-10-19T08:39:33.803031+0000","last_became_active":"2023-10-19T08:39:32.813911+0000","last_became_peered":"2023-10-19T08:39:32.813911+0000","last_unstale":"2023-10-19T08:39:33.803031+0000","last_undegraded":"2023-10-19T08:39:33.803031+0000","last_fullsized":"2023-10-19T08:39:33.803031+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:54:09.689815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.829917+0000","last_change":"2023-10-19T08:39:33.826910+0000","last_active":"2023-10-19T08:39:33.829917+0000","last_peered":"2023-10-19T08:39:33.829917+0000","last_clean":"2023-10-19T08:39:33.829917+0000","last_became_active":"2023-10-19T08:39:33.826620+0000","last_became_peered":"2023-10-19T08:39:33.826620+0000","last_unstale":"2023-10-19T08:39:33.829917+0000","last_undegraded":"2023-10-19T08:39:33.829917+0000","last_fullsized":"2023-10-19T08:39:33.829917+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:07:32.228734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.810200+0000","last_change":"2023-10-19T08:39:32.815994+0000","last_active":"2023-10-19T08:39:33.810200+0000","last_peered":"2023-10-19T08:39:33.810200+0000","last_clean":"2023-10-19T08:39:33.810200+0000","last_became_active":"2023-10-19T08:39:32.815684+0000","last_became_peered":"2023-10-19T08:39:32.815684+0000","last_unstale":"2023-10-19T08:39:33.810200+0000","last_undegraded":"2023-10-19T08:39:33.810200+0000","last_fullsized":"2023-10-19T08:39:33.810200+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:19:03.560245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.828709+0000","last_change":"2023-10-19T08:39:33.824468+0000","last_active":"2023-10-19T08:39:33.828709+0000","last_peered":"2023-10-19T08:39:33.828709+0000","last_clean":"2023-10-19T08:39:33.828709+0000","last_became_active":"2023-10-19T08:39:33.823997+0000","last_became_peered":"2023-10-19T08:39:33.823997+0000","last_unstale":"2023-10-19T08:39:33.828709+0000","last_undegraded":"2023-10-19T08:39:33.828709+0000","last_fullsized":"2023-10-19T08:39:33.828709+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:19:57.962430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.803547+0000","last_change":"2023-10-19T08:39:32.814606+0000","last_active":"2023-10-19T08:39:33.803547+0000","last_peered":"2023-10-19T08:39:33.803547+0000","last_clean":"2023-10-19T08:39:33.803547+0000","last_became_active":"2023-10-19T08:39:32.814345+0000","last_became_peered":"2023-10-19T08:39:32.814345+0000","last_unstale":"2023-10-19T08:39:33.803547+0000","last_undegraded":"2023-10-19T08:39:33.803547+0000","last_fullsized":"2023-10-19T08:39:33.803547+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:51:51.819759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.838250+0000","last_change":"2023-10-19T08:39:33.831621+0000","last_active":"2023-10-19T08:39:33.838250+0000","last_peered":"2023-10-19T08:39:33.838250+0000","last_clean":"2023-10-19T08:39:33.838250+0000","last_became_active":"2023-10-19T08:39:33.831341+0000","last_became_peered":"2023-10-19T08:39:33.831341+0000","last_unstale":"2023-10-19T08:39:33.838250+0000","last_undegraded":"2023-10-19T08:39:33.838250+0000","last_fullsized":"2023-10-19T08:39:33.838250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:30:02.806663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.829511+0000","last_change":"2023-10-19T08:39:32.823847+0000","last_active":"2023-10-19T08:39:33.829511+0000","last_peered":"2023-10-19T08:39:33.829511+0000","last_clean":"2023-10-19T08:39:33.829511+0000","last_became_active":"2023-10-19T08:39:32.823571+0000","last_became_peered":"2023-10-19T08:39:32.823571+0000","last_unstale":"2023-10-19T08:39:33.829511+0000","last_undegraded":"2023-10-19T08:39:33.829511+0000","last_fullsized":"2023-10-19T08:39:33.829511+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:24:56.540389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.828897+0000","last_change":"2023-10-19T08:39:33.826289+0000","last_active":"2023-10-19T08:39:33.828897+0000","last_peered":"2023-10-19T08:39:33.828897+0000","last_clean":"2023-10-19T08:39:33.828897+0000","last_became_active":"2023-10-19T08:39:33.826012+0000","last_became_peered":"2023-10-19T08:39:33.826012+0000","last_unstale":"2023-10-19T08:39:33.828897+0000","last_undegraded":"2023-10-19T08:39:33.828897+0000","last_fullsized":"2023-10-19T08:39:33.828897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:14:05.573355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.844670+0000","last_change":"2023-10-19T08:39:32.818624+0000","last_active":"2023-10-19T08:39:33.844670+0000","last_peered":"2023-10-19T08:39:33.844670+0000","last_clean":"2023-10-19T08:39:33.844670+0000","last_became_active":"2023-10-19T08:39:32.818341+0000","last_became_peered":"2023-10-19T08:39:32.818341+0000","last_unstale":"2023-10-19T08:39:33.844670+0000","last_undegraded":"2023-10-19T08:39:33.844670+0000","last_fullsized":"2023-10-19T08:39:33.844670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:46:08.009463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.835231+0000","last_change":"2023-10-19T08:39:33.830751+0000","last_active":"2023-10-19T08:39:33.835231+0000","last_peered":"2023-10-19T08:39:33.835231+0000","last_clean":"2023-10-19T08:39:33.835231+0000","last_became_active":"2023-10-19T08:39:33.830466+0000","last_became_peered":"2023-10-19T08:39:33.830466+0000","last_unstale":"2023-10-19T08:39:33.835231+0000","last_undegraded":"2023-10-19T08:39:33.835231+0000","last_fullsized":"2023-10-19T08:39:33.835231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:11:38.529637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.830819+0000","last_change":"2023-10-19T08:39:32.816960+0000","last_active":"2023-10-19T08:39:33.830819+0000","last_peered":"2023-10-19T08:39:33.830819+0000","last_clean":"2023-10-19T08:39:33.830819+0000","last_became_active":"2023-10-19T08:39:32.816656+0000","last_became_peered":"2023-10-19T08:39:32.816656+0000","last_unstale":"2023-10-19T08:39:33.830819+0000","last_undegraded":"2023-10-19T08:39:33.830819+0000","last_fullsized":"2023-10-19T08:39:33.830819+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:40:02.903702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.836286+0000","last_change":"2023-10-19T08:39:33.826458+0000","last_active":"2023-10-19T08:39:33.836286+0000","last_peered":"2023-10-19T08:39:33.836286+0000","last_clean":"2023-10-19T08:39:33.836286+0000","last_became_active":"2023-10-19T08:39:33.824840+0000","last_became_peered":"2023-10-19T08:39:33.824840+0000","last_unstale":"2023-10-19T08:39:33.836286+0000","last_undegraded":"2023-10-19T08:39:33.836286+0000","last_fullsized":"2023-10-19T08:39:33.836286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:53:45.585760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.813231+0000","last_change":"2023-10-19T08:39:32.818573+0000","last_active":"2023-10-19T08:39:33.813231+0000","last_peered":"2023-10-19T08:39:33.813231+0000","last_clean":"2023-10-19T08:39:33.813231+0000","last_became_active":"2023-10-19T08:39:32.818297+0000","last_became_peered":"2023-10-19T08:39:32.818297+0000","last_unstale":"2023-10-19T08:39:33.813231+0000","last_undegraded":"2023-10-19T08:39:33.813231+0000","last_fullsized":"2023-10-19T08:39:33.813231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:14:15.069436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.836346+0000","last_change":"2023-10-19T08:39:33.828893+0000","last_active":"2023-10-19T08:39:33.836346+0000","last_peered":"2023-10-19T08:39:33.836346+0000","last_clean":"2023-10-19T08:39:33.836346+0000","last_became_active":"2023-10-19T08:39:33.828246+0000","last_became_peered":"2023-10-19T08:39:33.828246+0000","last_unstale":"2023-10-19T08:39:33.836346+0000","last_undegraded":"2023-10-19T08:39:33.836346+0000","last_fullsized":"2023-10-19T08:39:33.836346+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:18:22.788693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.809125+0000","last_change":"2023-10-19T08:39:32.816838+0000","last_active":"2023-10-19T08:39:33.809125+0000","last_peered":"2023-10-19T08:39:33.809125+0000","last_clean":"2023-10-19T08:39:33.809125+0000","last_became_active":"2023-10-19T08:39:32.816523+0000","last_became_peered":"2023-10-19T08:39:32.816523+0000","last_unstale":"2023-10-19T08:39:33.809125+0000","last_undegraded":"2023-10-19T08:39:33.809125+0000","last_fullsized":"2023-10-19T08:39:33.809125+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:01:23.677293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.828782+0000","last_change":"2023-10-19T08:39:33.825276+0000","last_active":"2023-10-19T08:39:33.828782+0000","last_peered":"2023-10-19T08:39:33.828782+0000","last_clean":"2023-10-19T08:39:33.828782+0000","last_became_active":"2023-10-19T08:39:33.823928+0000","last_became_peered":"2023-10-19T08:39:33.823928+0000","last_unstale":"2023-10-19T08:39:33.828782+0000","last_undegraded":"2023-10-19T08:39:33.828782+0000","last_fullsized":"2023-10-19T08:39:33.828782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:24:44.058871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.838178+0000","last_change":"2023-10-19T08:39:32.806959+0000","last_active":"2023-10-19T08:39:33.838178+0000","last_peered":"2023-10-19T08:39:33.838178+0000","last_clean":"2023-10-19T08:39:33.838178+0000","last_became_active":"2023-10-19T08:39:32.806550+0000","last_became_peered":"2023-10-19T08:39:32.806550+0000","last_unstale":"2023-10-19T08:39:33.838178+0000","last_undegraded":"2023-10-19T08:39:33.838178+0000","last_fullsized":"2023-10-19T08:39:33.838178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:40:20.938332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.833645+0000","last_change":"2023-10-19T08:39:33.831888+0000","last_active":"2023-10-19T08:39:33.833645+0000","last_peered":"2023-10-19T08:39:33.833645+0000","last_clean":"2023-10-19T08:39:33.833645+0000","last_became_active":"2023-10-19T08:39:33.831694+0000","last_became_peered":"2023-10-19T08:39:33.831694+0000","last_unstale":"2023-10-19T08:39:33.833645+0000","last_undegraded":"2023-10-19T08:39:33.833645+0000","last_fullsized":"2023-10-19T08:39:33.833645+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:32:46.412920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.839715+0000","last_change":"2023-10-19T08:39:32.826541+0000","last_active":"2023-10-19T08:39:33.839715+0000","last_peered":"2023-10-19T08:39:33.839715+0000","last_clean":"2023-10-19T08:39:33.839715+0000","last_became_active":"2023-10-19T08:39:32.826055+0000","last_became_peered":"2023-10-19T08:39:32.826055+0000","last_unstale":"2023-10-19T08:39:33.839715+0000","last_undegraded":"2023-10-19T08:39:33.839715+0000","last_fullsized":"2023-10-19T08:39:33.839715+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:59:32.877236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.835981+0000","last_change":"2023-10-19T08:39:33.830383+0000","last_active":"2023-10-19T08:39:33.835981+0000","last_peered":"2023-10-19T08:39:33.835981+0000","last_clean":"2023-10-19T08:39:33.835981+0000","last_became_active":"2023-10-19T08:39:33.830119+0000","last_became_peered":"2023-10-19T08:39:33.830119+0000","last_unstale":"2023-10-19T08:39:33.835981+0000","last_undegraded":"2023-10-19T08:39:33.835981+0000","last_fullsized":"2023-10-19T08:39:33.835981+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:17:58.990653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.828247+0000","last_change":"2023-10-19T08:39:32.817405+0000","last_active":"2023-10-19T08:39:33.828247+0000","last_peered":"2023-10-19T08:39:33.828247+0000","last_clean":"2023-10-19T08:39:33.828247+0000","last_became_active":"2023-10-19T08:39:32.817113+0000","last_became_peered":"2023-10-19T08:39:32.817113+0000","last_unstale":"2023-10-19T08:39:33.828247+0000","last_undegraded":"2023-10-19T08:39:33.828247+0000","last_fullsized":"2023-10-19T08:39:33.828247+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:25:37.651977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.824933+0000","last_change":"2023-10-19T08:39:33.820321+0000","last_active":"2023-10-19T08:39:33.824933+0000","last_peered":"2023-10-19T08:39:33.824933+0000","last_clean":"2023-10-19T08:39:33.824933+0000","last_became_active":"2023-10-19T08:39:33.820009+0000","last_became_peered":"2023-10-19T08:39:33.820009+0000","last_unstale":"2023-10-19T08:39:33.824933+0000","last_undegraded":"2023-10-19T08:39:33.824933+0000","last_fullsized":"2023-10-19T08:39:33.824933+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:59:33.885308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.828495+0000","last_change":"2023-10-19T08:39:32.818017+0000","last_active":"2023-10-19T08:39:33.828495+0000","last_peered":"2023-10-19T08:39:33.828495+0000","last_clean":"2023-10-19T08:39:33.828495+0000","last_became_active":"2023-10-19T08:39:32.817755+0000","last_became_peered":"2023-10-19T08:39:32.817755+0000","last_unstale":"2023-10-19T08:39:33.828495+0000","last_undegraded":"2023-10-19T08:39:33.828495+0000","last_fullsized":"2023-10-19T08:39:33.828495+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:21:04.138383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.830010+0000","last_change":"2023-10-19T08:39:33.827088+0000","last_active":"2023-10-19T08:39:33.830010+0000","last_peered":"2023-10-19T08:39:33.830010+0000","last_clean":"2023-10-19T08:39:33.830010+0000","last_became_active":"2023-10-19T08:39:33.826847+0000","last_became_peered":"2023-10-19T08:39:33.826847+0000","last_unstale":"2023-10-19T08:39:33.830010+0000","last_undegraded":"2023-10-19T08:39:33.830010+0000","last_fullsized":"2023-10-19T08:39:33.830010+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:46:09.017534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.812394+0000","last_change":"2023-10-19T08:39:32.826828+0000","last_active":"2023-10-19T08:39:33.812394+0000","last_peered":"2023-10-19T08:39:33.812394+0000","last_clean":"2023-10-19T08:39:33.812394+0000","last_became_active":"2023-10-19T08:39:32.826549+0000","last_became_peered":"2023-10-19T08:39:32.826549+0000","last_unstale":"2023-10-19T08:39:33.812394+0000","last_undegraded":"2023-10-19T08:39:33.812394+0000","last_fullsized":"2023-10-19T08:39:33.812394+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:14:15.069436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.836394+0000","last_change":"2023-10-19T08:39:33.829149+0000","last_active":"2023-10-19T08:39:33.836394+0000","last_peered":"2023-10-19T08:39:33.836394+0000","last_clean":"2023-10-19T08:39:33.836394+0000","last_became_active":"2023-10-19T08:39:33.828337+0000","last_became_peered":"2023-10-19T08:39:33.828337+0000","last_unstale":"2023-10-19T08:39:33.836394+0000","last_undegraded":"2023-10-19T08:39:33.836394+0000","last_fullsized":"2023-10-19T08:39:33.836394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:33:59.978489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.826143+0000","last_change":"2023-10-19T08:39:32.821741+0000","last_active":"2023-10-19T08:39:33.826143+0000","last_peered":"2023-10-19T08:39:33.826143+0000","last_clean":"2023-10-19T08:39:33.826143+0000","last_became_active":"2023-10-19T08:39:32.821168+0000","last_became_peered":"2023-10-19T08:39:32.821168+0000","last_unstale":"2023-10-19T08:39:33.826143+0000","last_undegraded":"2023-10-19T08:39:33.826143+0000","last_fullsized":"2023-10-19T08:39:33.826143+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:47:14.307452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.825451+0000","last_change":"2023-10-19T08:39:33.821198+0000","last_active":"2023-10-19T08:39:33.825451+0000","last_peered":"2023-10-19T08:39:33.825451+0000","last_clean":"2023-10-19T08:39:33.825451+0000","last_became_active":"2023-10-19T08:39:33.820918+0000","last_became_peered":"2023-10-19T08:39:33.820918+0000","last_unstale":"2023-10-19T08:39:33.825451+0000","last_undegraded":"2023-10-19T08:39:33.825451+0000","last_fullsized":"2023-10-19T08:39:33.825451+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:43:06.230157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.805694+0000","last_change":"2023-10-19T08:39:32.822330+0000","last_active":"2023-10-19T08:39:33.805694+0000","last_peered":"2023-10-19T08:39:33.805694+0000","last_clean":"2023-10-19T08:39:33.805694+0000","last_became_active":"2023-10-19T08:39:32.822085+0000","last_became_peered":"2023-10-19T08:39:32.822085+0000","last_unstale":"2023-10-19T08:39:33.805694+0000","last_undegraded":"2023-10-19T08:39:33.805694+0000","last_fullsized":"2023-10-19T08:39:33.805694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:28:42.468616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.833228+0000","last_change":"2023-10-19T08:39:33.827781+0000","last_active":"2023-10-19T08:39:33.833228+0000","last_peered":"2023-10-19T08:39:33.833228+0000","last_clean":"2023-10-19T08:39:33.833228+0000","last_became_active":"2023-10-19T08:39:33.827518+0000","last_became_peered":"2023-10-19T08:39:33.827518+0000","last_unstale":"2023-10-19T08:39:33.833228+0000","last_undegraded":"2023-10-19T08:39:33.833228+0000","last_fullsized":"2023-10-19T08:39:33.833228+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:51:22.501402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.802738+0000","last_change":"2023-10-19T08:39:32.818950+0000","last_active":"2023-10-19T08:39:33.802738+0000","last_peered":"2023-10-19T08:39:33.802738+0000","last_clean":"2023-10-19T08:39:33.802738+0000","last_became_active":"2023-10-19T08:39:32.818638+0000","last_became_peered":"2023-10-19T08:39:32.818638+0000","last_unstale":"2023-10-19T08:39:33.802738+0000","last_undegraded":"2023-10-19T08:39:33.802738+0000","last_fullsized":"2023-10-19T08:39:33.802738+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:30:10.487263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.823014+0000","last_change":"2023-10-19T08:39:33.815028+0000","last_active":"2023-10-19T08:39:33.823014+0000","last_peered":"2023-10-19T08:39:33.823014+0000","last_clean":"2023-10-19T08:39:33.823014+0000","last_became_active":"2023-10-19T08:39:33.814818+0000","last_became_peered":"2023-10-19T08:39:33.814818+0000","last_unstale":"2023-10-19T08:39:33.823014+0000","last_undegraded":"2023-10-19T08:39:33.823014+0000","last_fullsized":"2023-10-19T08:39:33.823014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:44:32.380625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.812856+0000","last_change":"2023-10-19T08:39:32.818087+0000","last_active":"2023-10-19T08:39:33.812856+0000","last_peered":"2023-10-19T08:39:33.812856+0000","last_clean":"2023-10-19T08:39:33.812856+0000","last_became_active":"2023-10-19T08:39:32.817846+0000","last_became_peered":"2023-10-19T08:39:32.817846+0000","last_unstale":"2023-10-19T08:39:33.812856+0000","last_undegraded":"2023-10-19T08:39:33.812856+0000","last_fullsized":"2023-10-19T08:39:33.812856+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:30:01.798592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.825945+0000","last_change":"2023-10-19T08:39:33.822013+0000","last_active":"2023-10-19T08:39:33.825945+0000","last_peered":"2023-10-19T08:39:33.825945+0000","last_clean":"2023-10-19T08:39:33.825945+0000","last_became_active":"2023-10-19T08:39:33.821741+0000","last_became_peered":"2023-10-19T08:39:33.821741+0000","last_unstale":"2023-10-19T08:39:33.825945+0000","last_undegraded":"2023-10-19T08:39:33.825945+0000","last_fullsized":"2023-10-19T08:39:33.825945+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T18:40:13.906183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.803347+0000","last_change":"2023-10-19T08:39:32.823187+0000","last_active":"2023-10-19T08:39:33.803347+0000","last_peered":"2023-10-19T08:39:33.803347+0000","last_clean":"2023-10-19T08:39:33.803347+0000","last_became_active":"2023-10-19T08:39:32.822889+0000","last_became_peered":"2023-10-19T08:39:32.822889+0000","last_unstale":"2023-10-19T08:39:33.803347+0000","last_undegraded":"2023-10-19T08:39:33.803347+0000","last_fullsized":"2023-10-19T08:39:33.803347+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:45:57.193432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.811721+0000","last_change":"2023-10-19T08:37:51.153209+0000","last_active":"2023-10-19T08:39:33.811721+0000","last_peered":"2023-10-19T08:39:33.811721+0000","last_clean":"2023-10-19T08:39:33.811721+0000","last_became_active":"2023-10-19T08:37:51.152844+0000","last_became_peered":"2023-10-19T08:37:51.152844+0000","last_unstale":"2023-10-19T08:39:33.811721+0000","last_undegraded":"2023-10-19T08:39:33.811721+0000","last_fullsized":"2023-10-19T08:39:33.811721+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T10:36:28.300995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.835252+0000","last_change":"2023-10-19T08:39:33.830820+0000","last_active":"2023-10-19T08:39:33.835252+0000","last_peered":"2023-10-19T08:39:33.835252+0000","last_clean":"2023-10-19T08:39:33.835252+0000","last_became_active":"2023-10-19T08:39:33.830540+0000","last_became_peered":"2023-10-19T08:39:33.830540+0000","last_unstale":"2023-10-19T08:39:33.835252+0000","last_undegraded":"2023-10-19T08:39:33.835252+0000","last_fullsized":"2023-10-19T08:39:33.835252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:30:56.482153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.807594+0000","last_change":"2023-10-19T08:39:32.823640+0000","last_active":"2023-10-19T08:39:33.807594+0000","last_peered":"2023-10-19T08:39:33.807594+0000","last_clean":"2023-10-19T08:39:33.807594+0000","last_became_active":"2023-10-19T08:39:32.823448+0000","last_became_peered":"2023-10-19T08:39:32.823448+0000","last_unstale":"2023-10-19T08:39:33.807594+0000","last_undegraded":"2023-10-19T08:39:33.807594+0000","last_fullsized":"2023-10-19T08:39:33.807594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:17:57.982582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.805871+0000","last_change":"2023-10-19T08:37:51.116743+0000","last_active":"2023-10-19T08:39:33.805871+0000","last_peered":"2023-10-19T08:39:33.805871+0000","last_clean":"2023-10-19T08:39:33.805871+0000","last_became_active":"2023-10-19T08:37:51.116511+0000","last_became_peered":"2023-10-19T08:37:51.116511+0000","last_unstale":"2023-10-19T08:39:33.805871+0000","last_undegraded":"2023-10-19T08:39:33.805871+0000","last_fullsized":"2023-10-19T08:39:33.805871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:24:04.010131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.823018+0000","last_change":"2023-10-19T08:39:33.814490+0000","last_active":"2023-10-19T08:39:33.823018+0000","last_peered":"2023-10-19T08:39:33.823018+0000","last_clean":"2023-10-19T08:39:33.823018+0000","last_became_active":"2023-10-19T08:39:33.814255+0000","last_became_peered":"2023-10-19T08:39:33.814255+0000","last_unstale":"2023-10-19T08:39:33.823018+0000","last_undegraded":"2023-10-19T08:39:33.823018+0000","last_fullsized":"2023-10-19T08:39:33.823018+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:36:12.154264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.815212+0000","last_change":"2023-10-19T08:39:32.822970+0000","last_active":"2023-10-19T08:39:33.815212+0000","last_peered":"2023-10-19T08:39:33.815212+0000","last_clean":"2023-10-19T08:39:33.815212+0000","last_became_active":"2023-10-19T08:39:32.822651+0000","last_became_peered":"2023-10-19T08:39:32.822651+0000","last_unstale":"2023-10-19T08:39:33.815212+0000","last_undegraded":"2023-10-19T08:39:33.815212+0000","last_fullsized":"2023-10-19T08:39:33.815212+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T17:28:42.468616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.813336+0000","last_change":"2023-10-19T08:37:51.114782+0000","last_active":"2023-10-19T08:39:33.813336+0000","last_peered":"2023-10-19T08:39:33.813336+0000","last_clean":"2023-10-19T08:39:33.813336+0000","last_became_active":"2023-10-19T08:37:51.114388+0000","last_became_peered":"2023-10-19T08:37:51.114388+0000","last_unstale":"2023-10-19T08:39:33.813336+0000","last_undegraded":"2023-10-19T08:39:33.813336+0000","last_fullsized":"2023-10-19T08:39:33.813336+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:20:21.401319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.829560+0000","last_change":"2023-10-19T08:39:33.822768+0000","last_active":"2023-10-19T08:39:33.829560+0000","last_peered":"2023-10-19T08:39:33.829560+0000","last_clean":"2023-10-19T08:39:33.829560+0000","last_became_active":"2023-10-19T08:39:33.822492+0000","last_became_peered":"2023-10-19T08:39:33.822492+0000","last_unstale":"2023-10-19T08:39:33.829560+0000","last_undegraded":"2023-10-19T08:39:33.829560+0000","last_fullsized":"2023-10-19T08:39:33.829560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:18:22.788693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.828106+0000","last_change":"2023-10-19T08:39:32.822994+0000","last_active":"2023-10-19T08:39:33.828106+0000","last_peered":"2023-10-19T08:39:33.828106+0000","last_clean":"2023-10-19T08:39:33.828106+0000","last_became_active":"2023-10-19T08:39:32.822725+0000","last_became_peered":"2023-10-19T08:39:32.822725+0000","last_unstale":"2023-10-19T08:39:33.828106+0000","last_undegraded":"2023-10-19T08:39:33.828106+0000","last_fullsized":"2023-10-19T08:39:33.828106+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T19:27:20.665194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.805619+0000","last_change":"2023-10-19T08:37:51.115141+0000","last_active":"2023-10-19T08:39:33.805619+0000","last_peered":"2023-10-19T08:39:33.805619+0000","last_clean":"2023-10-19T08:39:33.805619+0000","last_became_active":"2023-10-19T08:37:51.114829+0000","last_became_peered":"2023-10-19T08:37:51.114829+0000","last_unstale":"2023-10-19T08:39:33.805619+0000","last_undegraded":"2023-10-19T08:39:33.805619+0000","last_fullsized":"2023-10-19T08:39:33.805619+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:23:14.858302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":201,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.810066+0000","last_change":"2023-10-19T08:37:51.153453+0000","last_active":"2023-10-19T08:39:33.810066+0000","last_peered":"2023-10-19T08:39:33.810066+0000","last_clean":"2023-10-19T08:39:33.810066+0000","last_became_active":"2023-10-19T08:37:51.153093+0000","last_became_peered":"2023-10-19T08:37:51.153093+0000","last_unstale":"2023-10-19T08:39:33.810066+0000","last_undegraded":"2023-10-19T08:39:33.810066+0000","last_fullsized":"2023-10-19T08:39:33.810066+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:38:21.221616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.840412+0000","last_change":"2023-10-19T08:39:33.836339+0000","last_active":"2023-10-19T08:39:33.840412+0000","last_peered":"2023-10-19T08:39:33.840412+0000","last_clean":"2023-10-19T08:39:33.840412+0000","last_became_active":"2023-10-19T08:39:33.836065+0000","last_became_peered":"2023-10-19T08:39:33.836065+0000","last_unstale":"2023-10-19T08:39:33.840412+0000","last_undegraded":"2023-10-19T08:39:33.840412+0000","last_fullsized":"2023-10-19T08:39:33.840412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:48:36.777911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.811641+0000","last_change":"2023-10-19T08:39:32.826314+0000","last_active":"2023-10-19T08:39:33.811641+0000","last_peered":"2023-10-19T08:39:33.811641+0000","last_clean":"2023-10-19T08:39:33.811641+0000","last_became_active":"2023-10-19T08:39:32.826040+0000","last_became_peered":"2023-10-19T08:39:32.826040+0000","last_unstale":"2023-10-19T08:39:33.811641+0000","last_undegraded":"2023-10-19T08:39:33.811641+0000","last_fullsized":"2023-10-19T08:39:33.811641+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:40:20.938332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.810238+0000","last_change":"2023-10-19T08:37:51.118439+0000","last_active":"2023-10-19T08:39:33.810238+0000","last_peered":"2023-10-19T08:39:33.810238+0000","last_clean":"2023-10-19T08:39:33.810238+0000","last_became_active":"2023-10-19T08:37:51.118146+0000","last_became_peered":"2023-10-19T08:37:51.118146+0000","last_unstale":"2023-10-19T08:39:33.810238+0000","last_undegraded":"2023-10-19T08:39:33.810238+0000","last_fullsized":"2023-10-19T08:39:33.810238+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:45:32.625366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.818269+0000","last_change":"2023-10-19T08:39:33.815120+0000","last_active":"2023-10-19T08:39:33.818269+0000","last_peered":"2023-10-19T08:39:33.818269+0000","last_clean":"2023-10-19T08:39:33.818269+0000","last_became_active":"2023-10-19T08:39:33.814753+0000","last_became_peered":"2023-10-19T08:39:33.814753+0000","last_unstale":"2023-10-19T08:39:33.818269+0000","last_undegraded":"2023-10-19T08:39:33.818269+0000","last_fullsized":"2023-10-19T08:39:33.818269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T08:45:03.342309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.808949+0000","last_change":"2023-10-19T08:39:32.822349+0000","last_active":"2023-10-19T08:39:33.808949+0000","last_peered":"2023-10-19T08:39:33.808949+0000","last_clean":"2023-10-19T08:39:33.808949+0000","last_became_active":"2023-10-19T08:39:32.822022+0000","last_became_peered":"2023-10-19T08:39:32.822022+0000","last_unstale":"2023-10-19T08:39:33.808949+0000","last_undegraded":"2023-10-19T08:39:33.808949+0000","last_fullsized":"2023-10-19T08:39:33.808949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:54:09.689815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.815287+0000","last_change":"2023-10-19T08:37:51.153416+0000","last_active":"2023-10-19T08:39:33.815287+0000","last_peered":"2023-10-19T08:39:33.815287+0000","last_clean":"2023-10-19T08:39:33.815287+0000","last_became_active":"2023-10-19T08:37:51.152844+0000","last_became_peered":"2023-10-19T08:37:51.152844+0000","last_unstale":"2023-10-19T08:39:33.815287+0000","last_undegraded":"2023-10-19T08:39:33.815287+0000","last_fullsized":"2023-10-19T08:39:33.815287+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T11:56:42.614796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.838219+0000","last_change":"2023-10-19T08:39:33.831602+0000","last_active":"2023-10-19T08:39:33.838219+0000","last_peered":"2023-10-19T08:39:33.838219+0000","last_clean":"2023-10-19T08:39:33.838219+0000","last_became_active":"2023-10-19T08:39:33.831323+0000","last_became_peered":"2023-10-19T08:39:33.831323+0000","last_unstale":"2023-10-19T08:39:33.838219+0000","last_undegraded":"2023-10-19T08:39:33.838219+0000","last_fullsized":"2023-10-19T08:39:33.838219+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T16:38:10.831276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.811651+0000","last_change":"2023-10-19T08:39:32.817001+0000","last_active":"2023-10-19T08:39:33.811651+0000","last_peered":"2023-10-19T08:39:33.811651+0000","last_clean":"2023-10-19T08:39:33.811651+0000","last_became_active":"2023-10-19T08:39:32.816732+0000","last_became_peered":"2023-10-19T08:39:32.816732+0000","last_unstale":"2023-10-19T08:39:33.811651+0000","last_undegraded":"2023-10-19T08:39:33.811651+0000","last_fullsized":"2023-10-19T08:39:33.811651+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T14:13:17.845844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.820870+0000","last_change":"2023-10-19T08:37:51.124188+0000","last_active":"2023-10-19T08:39:33.820870+0000","last_peered":"2023-10-19T08:39:33.820870+0000","last_clean":"2023-10-19T08:39:33.820870+0000","last_became_active":"2023-10-19T08:37:51.123944+0000","last_became_peered":"2023-10-19T08:37:51.123944+0000","last_unstale":"2023-10-19T08:39:33.820870+0000","last_undegraded":"2023-10-19T08:39:33.820870+0000","last_fullsized":"2023-10-19T08:39:33.820870+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T13:00:29.945919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.826941+0000","last_change":"2023-10-19T08:39:33.823225+0000","last_active":"2023-10-19T08:39:33.826941+0000","last_peered":"2023-10-19T08:39:33.826941+0000","last_clean":"2023-10-19T08:39:33.826941+0000","last_became_active":"2023-10-19T08:39:33.822950+0000","last_became_peered":"2023-10-19T08:39:33.822950+0000","last_unstale":"2023-10-19T08:39:33.826941+0000","last_undegraded":"2023-10-19T08:39:33.826941+0000","last_fullsized":"2023-10-19T08:39:33.826941+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:32.794574+0000","last_clean_scrub_stamp":"2023-10-19T08:39:32.794574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T12:44:51.262505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.813486+0000","last_change":"2023-10-19T08:39:32.822792+0000","last_active":"2023-10-19T08:39:33.813486+0000","last_peered":"2023-10-19T08:39:33.813486+0000","last_clean":"2023-10-19T08:39:33.813486+0000","last_became_active":"2023-10-19T08:39:32.822531+0000","last_became_peered":"2023-10-19T08:39:32.822531+0000","last_unstale":"2023-10-19T08:39:33.813486+0000","last_undegraded":"2023-10-19T08:39:33.813486+0000","last_fullsized":"2023-10-19T08:39:33.813486+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:39:31.786503+0000","last_clean_scrub_stamp":"2023-10-19T08:39:31.786503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T20:19:23.246548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-19T08:39:33.810600+0000","last_change":"2023-10-19T08:37:52.296732+0000","last_active":"2023-10-19T08:39:33.810600+0000","last_peered":"2023-10-19T08:39:33.810600+0000","last_clean":"2023-10-19T08:39:33.810600+0000","last_became_active":"2023-10-19T08:37:52.296445+0000","last_became_peered":"2023-10-19T08:37:52.296445+0000","last_unstale":"2023-10-19T08:39:33.810600+0000","last_undegraded":"2023-10-19T08:39:33.810600+0000","last_fullsized":"2023-10-19T08:39:33.810600+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-19T08:37:50.104417+0000","last_clean_scrub_stamp":"2023-10-19T08:37:50.104417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-20T09:45:14.282785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1036288,"data_stored":786496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.437}]},{"osd":1,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.503}]},{"osd":2,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.378}]},{"osd":5,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59399999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":188590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.389,"5min":1.389,"15min":1.389},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.626},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.83799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":188590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.246}]},{"osd":2,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.433,"5min":0.433,"15min":0.433},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.316}]},{"osd":3,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.61299999999999999}]},{"osd":7,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.5},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.60199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1015808,"data_stored":777597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.50600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":187606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.309}]},{"osd":1,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.251},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.26900000000000002}]},{"osd":3,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.29699999999999999}]},{"osd":4,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":4.7300000000000004,"5min":4.7300000000000004,"15min":4.7300000000000004},"last":0.45500000000000002}]},{"osd":5,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":4.7119999999999997,"5min":4.7119999999999997,"15min":4.7119999999999997},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":4.7469999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":4.7690000000000001,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.40000000000000002}]},{"osd":7,"last update":"Thu Oct 19 08:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":4.79,"5min":4.79,"15min":4.79},"last":0.501},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.432}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":188590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.307}]},{"osd":2,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.372},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.499},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.54600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":187229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.504},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.38700000000000001}]},{"osd":5,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.36399999999999999}]},{"osd":6,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.433},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":196108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.63},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.497},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.44}]},{"osd":6,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.372},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.41099999999999998}]},{"osd":7,"last update":"Thu Oct 19 08:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.45200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-19T08:39:38.294 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-19T08:39:38.294 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-19T08:39:38.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.449+0000 7fce46797700 1 Processor -- start 2023-10-19T08:39:38.454 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.449+0000 7fce46797700 1 -- start start 2023-10-19T08:39:38.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.450+0000 7fce46797700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fce4015ce70 0x7fce400cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.457 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.450+0000 7fce46797700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce400cb600 0x7fce40161500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.450+0000 7fce46797700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fce400b27e0 0x7fce400b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.450+0000 7fce46797700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce40161a40 con 0x7fce4015ce70 2023-10-19T08:39:38.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.450+0000 7fce46797700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce400b3190 con 0x7fce400b27e0 2023-10-19T08:39:38.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.450+0000 7fce46797700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce400cf790 con 0x7fce400cb600 2023-10-19T08:39:38.458 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.450+0000 7fce3ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fce4015ce70 0x7fce400cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.450+0000 7fce3ffff700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fce4015ce70 0x7fce400cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49098/0 (socket says 172.21.15.79:49098) 2023-10-19T08:39:38.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.450+0000 7fce3ffff700 1 -- 172.21.15.79:0/4293322092 learned_addr learned my addr 172.21.15.79:0/4293322092 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:38.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.451+0000 7fce3f7fe700 1 --2- 172.21.15.79:0/4293322092 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce400cb600 0x7fce40161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.459 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.451+0000 7fce44d34700 1 --2- 172.21.15.79:0/4293322092 >> v2:172.21.15.89:3300/0 conn(0x7fce400b27e0 0x7fce400b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.451+0000 7fce3ffff700 1 -- 172.21.15.79:0/4293322092 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce400cb600 msgr2=0x7fce40161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:38.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.451+0000 7fce3ffff700 1 --2- 172.21.15.79:0/4293322092 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce400cb600 0x7fce40161500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.451+0000 7fce3ffff700 1 -- 172.21.15.79:0/4293322092 >> v2:172.21.15.89:3300/0 conn(0x7fce400b27e0 msgr2=0x7fce400b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:38.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.451+0000 7fce3ffff700 1 --2- 172.21.15.79:0/4293322092 >> v2:172.21.15.89:3300/0 conn(0x7fce400b27e0 0x7fce400b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.460 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.451+0000 7fce3ffff700 1 -- 172.21.15.79:0/4293322092 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4006b960 con 0x7fce4015ce70 2023-10-19T08:39:38.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.451+0000 7fce3ffff700 1 --2- 172.21.15.79:0/4293322092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4015ce70 0x7fce400cf1b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fce400b3880 tx=0x7fce34009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43eb02566421fb1f server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:38.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.451+0000 7fce3effd700 1 -- 172.21.15.79:0/4293322092 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34011830 con 0x7fce4015ce70 2023-10-19T08:39:38.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.451+0000 7fce3effd700 1 -- 172.21.15.79:0/4293322092 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce34011990 con 0x7fce4015ce70 2023-10-19T08:39:38.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.451+0000 7fce3effd700 1 -- 172.21.15.79:0/4293322092 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34011d20 con 0x7fce4015ce70 2023-10-19T08:39:38.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.451+0000 7fce46797700 1 -- 172.21.15.79:0/4293322092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4015ce70 msgr2=0x7fce400cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:38.461 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.451+0000 7fce46797700 1 --2- 172.21.15.79:0/4293322092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4015ce70 0x7fce400cf1b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fce400b3880 tx=0x7fce34009c00 comp rx=0 tx=0).stop 2023-10-19T08:39:38.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.452+0000 7fce46797700 1 -- 172.21.15.79:0/4293322092 shutdown_connections 2023-10-19T08:39:38.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.452+0000 7fce46797700 1 --2- 172.21.15.79:0/4293322092 >> v2:172.21.15.89:3300/0 conn(0x7fce400b27e0 0x7fce400b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.452+0000 7fce46797700 1 --2- 172.21.15.79:0/4293322092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4015ce70 0x7fce400cf1b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.462 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.452+0000 7fce46797700 1 --2- 172.21.15.79:0/4293322092 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce400cb600 0x7fce40161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.452+0000 7fce46797700 1 -- 172.21.15.79:0/4293322092 >> 172.21.15.79:0/4293322092 conn(0x7fce400cd7e0 msgr2=0x7fce400cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:38.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.452+0000 7fce46797700 1 -- 172.21.15.79:0/4293322092 shutdown_connections 2023-10-19T08:39:38.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.452+0000 7fce46797700 1 -- 172.21.15.79:0/4293322092 wait complete. 2023-10-19T08:39:38.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.453+0000 7fce46797700 1 Processor -- start 2023-10-19T08:39:38.463 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.453+0000 7fce46797700 1 -- start start 2023-10-19T08:39:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce46797700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce400b27e0 0x7fce4015ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce46797700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce400cb600 0x7fce4015f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce46797700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4015ce70 0x7fce4015f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.467 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce46797700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce401f2840 con 0x7fce4015ce70 2023-10-19T08:39:38.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce46797700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce400c5420 con 0x7fce400cb600 2023-10-19T08:39:38.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce46797700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4015b390 con 0x7fce400b27e0 2023-10-19T08:39:38.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce44d34700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4015ce70 0x7fce4015f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce44d34700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4015ce70 0x7fce4015f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49108/0 (socket says 172.21.15.79:49108) 2023-10-19T08:39:38.468 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce44d34700 1 -- 172.21.15.79:0/742810559 learned_addr learned my addr 172.21.15.79:0/742810559 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:38.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce3f7fe700 1 --2- 172.21.15.79:0/742810559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce400cb600 0x7fce4015f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce3ffff700 1 --2- 172.21.15.79:0/742810559 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce400b27e0 0x7fce4015ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce44d34700 1 -- 172.21.15.79:0/742810559 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce400b27e0 msgr2=0x7fce4015ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:38.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce44d34700 1 --2- 172.21.15.79:0/742810559 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce400b27e0 0x7fce4015ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.469 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce44d34700 1 -- 172.21.15.79:0/742810559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce400cb600 msgr2=0x7fce4015f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:38.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce44d34700 1 --2- 172.21.15.79:0/742810559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce400cb600 0x7fce4015f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce44d34700 1 -- 172.21.15.79:0/742810559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce34009550 con 0x7fce4015ce70 2023-10-19T08:39:38.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce3ffff700 1 --2- 172.21.15.79:0/742810559 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce400b27e0 0x7fce4015ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:38.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce44d34700 1 --2- 172.21.15.79:0/742810559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4015ce70 0x7fce4015f7a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fce3800efc0 tx=0x7fce3800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:38.470 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce3cff9700 1 -- 172.21.15.79:0/742810559 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce38009ea0 con 0x7fce4015ce70 2023-10-19T08:39:38.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce3cff9700 1 -- 172.21.15.79:0/742810559 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3800f040 con 0x7fce4015ce70 2023-10-19T08:39:38.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce46797700 1 -- 172.21.15.79:0/742810559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce400c56c0 con 0x7fce4015ce70 2023-10-19T08:39:38.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce3cff9700 1 -- 172.21.15.79:0/742810559 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce38014480 con 0x7fce4015ce70 2023-10-19T08:39:38.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.454+0000 7fce46797700 1 -- 172.21.15.79:0/742810559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce400c5c80 con 0x7fce4015ce70 2023-10-19T08:39:38.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.455+0000 7fce46797700 1 -- 172.21.15.79:0/742810559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce40067470 con 0x7fce4015ce70 2023-10-19T08:39:38.471 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.456+0000 7fce3cff9700 1 -- 172.21.15.79:0/742810559 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fce380145e0 con 0x7fce4015ce70 2023-10-19T08:39:38.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.456+0000 7fce3cff9700 1 --2- 172.21.15.79:0/742810559 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fce2c06a0e0 0x7fce2c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.456+0000 7fce3cff9700 1 -- 172.21.15.79:0/742810559 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fce38089340 con 0x7fce4015ce70 2023-10-19T08:39:38.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.456+0000 7fce3ffff700 1 --2- 172.21.15.79:0/742810559 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fce2c06a0e0 0x7fce2c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.457+0000 7fce3ffff700 1 --2- 172.21.15.79:0/742810559 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fce2c06a0e0 0x7fce2c06c5a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fce34014040 tx=0x7fce34008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:38.472 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.461+0000 7fce3cff9700 1 -- 172.21.15.79:0/742810559 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fce380547c0 con 0x7fce4015ce70 2023-10-19T08:39:38.731 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.727+0000 7fce46797700 1 -- 172.21.15.79:0/742810559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fce4004ee70 con 0x7fce4015ce70 2023-10-19T08:39:38.734 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.730+0000 7fce3cff9700 1 -- 172.21.15.79:0/742810559 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fce380180e0 con 0x7fce4015ce70 2023-10-19T08:39:38.735 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2023-10-19T08:39:38.735 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQCv6jBlFLbeOBAAsiQ+nNFDq+Mc3VC54pqOmw== 2023-10-19T08:39:38.735 INFO:teuthology.orchestra.run.smithi079.stdout: caps mds = "allow" 2023-10-19T08:39:38.735 INFO:teuthology.orchestra.run.smithi079.stdout: caps mon = "allow r" 2023-10-19T08:39:38.736 INFO:teuthology.orchestra.run.smithi079.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-10-19T08:39:38.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.732+0000 7fce46797700 1 -- 172.21.15.79:0/742810559 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fce2c06a0e0 msgr2=0x7fce2c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:38.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.732+0000 7fce46797700 1 --2- 172.21.15.79:0/742810559 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fce2c06a0e0 0x7fce2c06c5a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fce34014040 tx=0x7fce34008030 comp rx=0 tx=0).stop 2023-10-19T08:39:38.737 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.732+0000 7fce46797700 1 -- 172.21.15.79:0/742810559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4015ce70 msgr2=0x7fce4015f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:38.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.732+0000 7fce46797700 1 --2- 172.21.15.79:0/742810559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4015ce70 0x7fce4015f7a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fce3800efc0 tx=0x7fce3800c3a0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.732+0000 7fce46797700 1 -- 172.21.15.79:0/742810559 shutdown_connections 2023-10-19T08:39:38.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.732+0000 7fce46797700 1 --2- 172.21.15.79:0/742810559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce4015ce70 0x7fce4015f7a0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.732+0000 7fce46797700 1 --2- 172.21.15.79:0/742810559 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fce2c06a0e0 0x7fce2c06c5a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.738 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.732+0000 7fce46797700 1 --2- 172.21.15.79:0/742810559 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fce400b27e0 0x7fce4015ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.732+0000 7fce46797700 1 --2- 172.21.15.79:0/742810559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce400cb600 0x7fce4015f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.732+0000 7fce46797700 1 -- 172.21.15.79:0/742810559 >> 172.21.15.79:0/742810559 conn(0x7fce400cd7e0 msgr2=0x7fce4015c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:38.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.733+0000 7fce46797700 1 -- 172.21.15.79:0/742810559 shutdown_connections 2023-10-19T08:39:38.739 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.733+0000 7fce46797700 1 -- 172.21.15.79:0/742810559 wait complete. 2023-10-19T08:39:38.740 INFO:teuthology.orchestra.run.smithi079.stderr:updated caps for client.0 2023-10-19T08:39:38.749 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T08:39:38.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.866+0000 7fe5f0cf9700 1 Processor -- start 2023-10-19T08:39:38.871 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.867+0000 7fe5f0cf9700 1 -- start start 2023-10-19T08:39:38.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.867+0000 7fe5f0cf9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5ec0b1560 0x7fe5ec0b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.875 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.867+0000 7fe5f0cf9700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe5ec0cb390 0x7fe5ec0cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.867+0000 7fe5f0cf9700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ec0b1f00 con 0x7fe5ec15d250 2023-10-19T08:39:38.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.867+0000 7fe5f0cf9700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5ec06b080 con 0x7fe5ec0cb390 2023-10-19T08:39:38.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5f0cf9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec0caf00 con 0x7fe5ec0b1560 2023-10-19T08:39:38.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5ea59c700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe5ec15d250 0x7fe5ec06a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59184/0 (socket says 172.21.15.79:59184) 2023-10-19T08:39:38.876 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5ea59c700 1 -- 172.21.15.79:0/3405601903 learned_addr learned my addr 172.21.15.79:0/3405601903 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:38.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5ead9d700 1 --2- 172.21.15.79:0/3405601903 >> v2:172.21.15.89:3300/0 conn(0x7fe5ec0cb390 0x7fe5ec0cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5e9d9b700 1 --2- 172.21.15.79:0/3405601903 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5ec0b1560 0x7fe5ec0b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5e959a700 1 -- 172.21.15.79:0/3405601903 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055228486 0 0) 0x7fe5ec0b1f00 con 0x7fe5ec15d250 2023-10-19T08:39:38.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5e959a700 1 -- 172.21.15.79:0/3405601903 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5d40035b0 con 0x7fe5ec15d250 2023-10-19T08:39:38.877 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5e959a700 1 -- 172.21.15.79:0/3405601903 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1818191713 0 0) 0x7fe5d40035b0 con 0x7fe5ec15d250 2023-10-19T08:39:38.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5e959a700 1 -- 172.21.15.79:0/3405601903 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5ec0b1560 msgr2=0x7fe5ec0b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:38.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5e959a700 1 --2- 172.21.15.79:0/3405601903 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5ec0b1560 0x7fe5ec0b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5e959a700 1 -- 172.21.15.79:0/3405601903 >> v2:172.21.15.89:3300/0 conn(0x7fe5ec0cb390 msgr2=0x7fe5ec0cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:38.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5e959a700 1 --2- 172.21.15.79:0/3405601903 >> v2:172.21.15.89:3300/0 conn(0x7fe5ec0cb390 0x7fe5ec0cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.878 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5e959a700 1 -- 172.21.15.79:0/3405601903 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec0ce840 con 0x7fe5ec15d250 2023-10-19T08:39:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5e959a700 1 -- 172.21.15.79:0/3405601903 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7fe5e0001670 con 0x7fe5ec15d250 2023-10-19T08:39:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5e959a700 1 -- 172.21.15.79:0/3405601903 >> v1:172.21.15.79:6789/0 conn(0x7fe5ec15d250 legacy=0x7fe5ec06a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5e959a700 1 --2- 172.21.15.79:0/3405601903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d4003a00 0x7fe5d4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5e959a700 1 --2- 172.21.15.79:0/3405601903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5d4004850 0x7fe5d4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.879 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5e959a700 1 --2- 172.21.15.79:0/3405601903 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5d4005210 0x7fe5d400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5e959a700 1 -- 172.21.15.79:0/3405601903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec06b080 con 0x7fe5d4003a00 2023-10-19T08:39:38.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5e959a700 1 -- 172.21.15.79:0/3405601903 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec0caf00 con 0x7fe5d4004850 2023-10-19T08:39:38.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5e959a700 1 -- 172.21.15.79:0/3405601903 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d400bf50 con 0x7fe5d4005210 2023-10-19T08:39:38.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5ead9d700 1 --2- 172.21.15.79:0/3405601903 >> v2:172.21.15.89:3300/0 conn(0x7fe5ec0cb390 0x7fe5ec0cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:39:38.880 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5e9d9b700 1 --2- 172.21.15.79:0/3405601903 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5ec0b1560 0x7fe5ec0b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:39:38.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.868+0000 7fe5ea59c700 1 --2- 172.21.15.79:0/3405601903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d4003a00 0x7fe5d4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.869+0000 7fe5e9d9b700 1 --2- 172.21.15.79:0/3405601903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5d4004850 0x7fe5d4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.869+0000 7fe5ead9d700 1 --2- 172.21.15.79:0/3405601903 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5d4005210 0x7fe5d400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.869+0000 7fe5ea59c700 1 -- 172.21.15.79:0/3405601903 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5d4005210 msgr2=0x7fe5d400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:38.881 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.869+0000 7fe5ea59c700 1 --2- 172.21.15.79:0/3405601903 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5d4005210 0x7fe5d400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.869+0000 7fe5ea59c700 1 -- 172.21.15.79:0/3405601903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5d4004850 msgr2=0x7fe5d4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:38.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.869+0000 7fe5ea59c700 1 --2- 172.21.15.79:0/3405601903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5d4004850 0x7fe5d4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.869+0000 7fe5ea59c700 1 -- 172.21.15.79:0/3405601903 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d40035b0 con 0x7fe5d4003a00 2023-10-19T08:39:38.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.869+0000 7fe5ea59c700 1 --2- 172.21.15.79:0/3405601903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d4003a00 0x7fe5d4003e20 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000c350 tx=0x7fe5d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9259cd024218569 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:38.882 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.869+0000 7fe5e959a700 1 -- 172.21.15.79:0/3405601903 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e000ce50 con 0x7fe5d4003a00 2023-10-19T08:39:38.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.869+0000 7fe5e959a700 1 -- 172.21.15.79:0/3405601903 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e0005960 con 0x7fe5d4003a00 2023-10-19T08:39:38.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.869+0000 7fe5e959a700 1 -- 172.21.15.79:0/3405601903 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0005d10 con 0x7fe5d4003a00 2023-10-19T08:39:38.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.870+0000 7fe5f0cf9700 1 -- 172.21.15.79:0/3405601903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d4003a00 msgr2=0x7fe5d4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:38.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.870+0000 7fe5f0cf9700 1 --2- 172.21.15.79:0/3405601903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5d4003a00 0x7fe5d4003e20 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000c350 tx=0x7fe5d4005880 comp rx=0 tx=0).stop 2023-10-19T08:39:38.883 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.870+0000 7fe5ead9d700 1 -- 172.21.15.79:0/3405601903 reap_dead start 2023-10-19T08:39:38.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.870+0000 7fe5f0cf9700 1 -- 172.21.15.79:0/3405601903 shutdown_connections 2023-10-19T08:39:38.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.870+0000 7fe5f0cf9700 1 -- 172.21.15.79:0/3405601903 >> 172.21.15.79:0/3405601903 conn(0x7fe5ec0cc560 msgr2=0x7fe5ec0cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:38.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.870+0000 7fe5f0cf9700 1 -- 172.21.15.79:0/3405601903 shutdown_connections 2023-10-19T08:39:38.884 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.870+0000 7fe5f0cf9700 1 -- 172.21.15.79:0/3405601903 wait complete. 2023-10-19T08:39:38.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.871+0000 7fe5f0cf9700 1 Processor -- start 2023-10-19T08:39:38.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.871+0000 7fe5f0cf9700 1 -- start start 2023-10-19T08:39:38.887 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.872+0000 7fe5f0cf9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5d4003a00 0x7fe5ec0b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.872+0000 7fe5f0cf9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5ec0ab8e0 0x7fe5ec1f2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.872+0000 7fe5f0cf9700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5ec0b0440 0x7fe5ec0b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.872+0000 7fe5f0cf9700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec0b0de0 con 0x7fe5ec0b0440 2023-10-19T08:39:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.872+0000 7fe5f0cf9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec0ad2b0 con 0x7fe5ec0ab8e0 2023-10-19T08:39:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.872+0000 7fe5f0cf9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec0ad530 con 0x7fe5d4003a00 2023-10-19T08:39:38.888 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.872+0000 7fe5ead9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5ec0b0440 0x7fe5ec0b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.872+0000 7fe5ead9d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5ec0b0440 0x7fe5ec0b08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49128/0 (socket says 172.21.15.79:49128) 2023-10-19T08:39:38.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.872+0000 7fe5ead9d700 1 -- 172.21.15.79:0/3448555494 learned_addr learned my addr 172.21.15.79:0/3448555494 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:38.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.873+0000 7fe5ea59c700 1 --2- 172.21.15.79:0/3448555494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5d4003a00 0x7fe5ec0b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.889 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.873+0000 7fe5e9d9b700 1 --2- 172.21.15.79:0/3448555494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5ec0ab8e0 0x7fe5ec1f2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.873+0000 7fe5ead9d700 1 -- 172.21.15.79:0/3448555494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5d4003a00 msgr2=0x7fe5ec0b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:38.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.873+0000 7fe5ead9d700 1 --2- 172.21.15.79:0/3448555494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5d4003a00 0x7fe5ec0b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.873+0000 7fe5ead9d700 1 -- 172.21.15.79:0/3448555494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5ec0ab8e0 msgr2=0x7fe5ec1f2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:38.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.873+0000 7fe5ead9d700 1 --2- 172.21.15.79:0/3448555494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5ec0ab8e0 0x7fe5ec1f2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:38.890 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.873+0000 7fe5ead9d700 1 -- 172.21.15.79:0/3448555494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec1f6950 con 0x7fe5ec0b0440 2023-10-19T08:39:38.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.873+0000 7fe5ea59c700 1 --2- 172.21.15.79:0/3448555494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5d4003a00 0x7fe5ec0b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:38.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.873+0000 7fe5e9d9b700 1 --2- 172.21.15.79:0/3448555494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5ec0ab8e0 0x7fe5ec1f2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:38.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.873+0000 7fe5ead9d700 1 --2- 172.21.15.79:0/3448555494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5ec0b0440 0x7fe5ec0b08a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec06a720 tx=0x7fe5e400f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:38.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.873+0000 7fe5daffd700 1 -- 172.21.15.79:0/3448555494 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e400e040 con 0x7fe5ec0b0440 2023-10-19T08:39:38.891 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.873+0000 7fe5daffd700 1 -- 172.21.15.79:0/3448555494 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e400f040 con 0x7fe5ec0b0440 2023-10-19T08:39:38.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.873+0000 7fe5f0cf9700 1 -- 172.21.15.79:0/3448555494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ec1f6c30 con 0x7fe5ec0b0440 2023-10-19T08:39:38.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.873+0000 7fe5daffd700 1 -- 172.21.15.79:0/3448555494 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4003a20 con 0x7fe5ec0b0440 2023-10-19T08:39:38.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.873+0000 7fe5f0cf9700 1 -- 172.21.15.79:0/3448555494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ec1f2660 con 0x7fe5ec0b0440 2023-10-19T08:39:38.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.874+0000 7fe5f0cf9700 1 -- 172.21.15.79:0/3448555494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ec04ee70 con 0x7fe5ec0b0440 2023-10-19T08:39:38.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.874+0000 7fe5daffd700 1 -- 172.21.15.79:0/3448555494 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe5e4015430 con 0x7fe5ec0b0440 2023-10-19T08:39:38.892 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.875+0000 7fe5daffd700 1 --2- 172.21.15.79:0/3448555494 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe5cc06a0e0 0x7fe5cc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:38.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.875+0000 7fe5daffd700 1 -- 172.21.15.79:0/3448555494 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe5e4088da0 con 0x7fe5ec0b0440 2023-10-19T08:39:38.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.875+0000 7fe5ea59c700 1 --2- 172.21.15.79:0/3448555494 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe5cc06a0e0 0x7fe5cc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:38.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.875+0000 7fe5ea59c700 1 --2- 172.21.15.79:0/3448555494 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe5cc06a0e0 0x7fe5cc06c5a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0008fd0 tx=0x7fe5e000a000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:38.893 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:38.879+0000 7fe5daffd700 1 -- 172.21.15.79:0/3448555494 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fe5e4057e70 con 0x7fe5ec0b0440 2023-10-19T08:39:39.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.109+0000 7fe5f0cf9700 1 -- 172.21.15.79:0/3448555494 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5ec06a750 con 0x7fe5ec0b0440 2023-10-19T08:39:39.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.110+0000 7fe5daffd700 1 -- 172.21.15.79:0/3448555494 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4872 (secure 0 0 0) 0x7fe5e4057a00 con 0x7fe5ec0b0440 2023-10-19T08:39:39.115 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:39.115 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/2135698128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2135698128},{"type":"v1","addr":"172.21.15.89:6834","nonce":2135698128}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5299,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3306148048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3306148048},{"type":"v1","addr":"172.21.15.89:6835","nonce":3306148048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3876408658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3876408658},{"type":"v1","addr":"172.21.15.79:6836","nonce":3876408658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-19T08:39:33.202270+0000","modified":"2023-10-19T08:39:36.817728+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/594110949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":594110949},{"type":"v1","addr":"172.21.15.79:6837","nonce":594110949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-19T08:39:39.116 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.112+0000 7fe5f0cf9700 1 -- 172.21.15.79:0/3448555494 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe5cc06a0e0 msgr2=0x7fe5cc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:39.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.112+0000 7fe5f0cf9700 1 --2- 172.21.15.79:0/3448555494 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe5cc06a0e0 0x7fe5cc06c5a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0008fd0 tx=0x7fe5e000a000 comp rx=0 tx=0).stop 2023-10-19T08:39:39.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.112+0000 7fe5f0cf9700 1 -- 172.21.15.79:0/3448555494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5ec0b0440 msgr2=0x7fe5ec0b08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:39.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.112+0000 7fe5f0cf9700 1 --2- 172.21.15.79:0/3448555494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5ec0b0440 0x7fe5ec0b08a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec06a720 tx=0x7fe5e400f490 comp rx=0 tx=0).stop 2023-10-19T08:39:39.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.112+0000 7fe5f0cf9700 1 -- 172.21.15.79:0/3448555494 shutdown_connections 2023-10-19T08:39:39.117 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.112+0000 7fe5f0cf9700 1 --2- 172.21.15.79:0/3448555494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5ec0b0440 0x7fe5ec0b08a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.112+0000 7fe5f0cf9700 1 --2- 172.21.15.79:0/3448555494 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe5cc06a0e0 0x7fe5cc06c5a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.112+0000 7fe5f0cf9700 1 --2- 172.21.15.79:0/3448555494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5d4003a00 0x7fe5ec0b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.112+0000 7fe5f0cf9700 1 --2- 172.21.15.79:0/3448555494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5ec0ab8e0 0x7fe5ec1f2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.112+0000 7fe5f0cf9700 1 -- 172.21.15.79:0/3448555494 >> 172.21.15.79:0/3448555494 conn(0x7fe5ec0cc560 msgr2=0x7fe5ec15ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:39.118 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.112+0000 7fe5f0cf9700 1 -- 172.21.15.79:0/3448555494 shutdown_connections 2023-10-19T08:39:39.119 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.112+0000 7fe5f0cf9700 1 -- 172.21.15.79:0/3448555494 wait complete. 2023-10-19T08:39:39.119 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 18 2023-10-19T08:39:39.531 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-19T08:39:33.202270+0000', 'modified': '2023-10-19T08:39:36.817728+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5736}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5736': {'gid': 5736, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.79:6837/594110949', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 594110949}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 594110949}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-19T08:39:39.531 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-19T08:39:39.532 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-19T08:39:39.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.651+0000 7f79ee918700 1 Processor -- start 2023-10-19T08:39:39.655 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.651+0000 7f79ee918700 1 -- start start 2023-10-19T08:39:39.657 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.651+0000 7f79ee918700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79e80cf710 0x7f79e8164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.651+0000 7f79ee918700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e80cc870 con 0x7f79e80b5610 2023-10-19T08:39:39.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.651+0000 7f79ee918700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e80b5aa0 con 0x7f79e8159f40 2023-10-19T08:39:39.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.651+0000 7f79ee918700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e80cd800 con 0x7f79e80cf710 2023-10-19T08:39:39.658 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.652+0000 7f79e77fe700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f79e80b5610 0x7f79e80cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59204/0 (socket says 172.21.15.79:59204) 2023-10-19T08:39:39.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.652+0000 7f79e77fe700 1 -- 172.21.15.79:0/1757669241 learned_addr learned my addr 172.21.15.79:0/1757669241 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:39.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.652+0000 7f79eceb5700 1 --2- 172.21.15.79:0/1757669241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79e80cf710 0x7f79e8164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.652+0000 7f79e6ffd700 1 -- 172.21.15.79:0/1757669241 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284196754 0 0) 0x7f79dc001110 con 0x7f79e80b5610 2023-10-19T08:39:39.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.652+0000 7f79e6ffd700 1 -- 172.21.15.79:0/1757669241 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79d00035b0 con 0x7f79e80b5610 2023-10-19T08:39:39.659 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.652+0000 7f79eceb5700 1 -- 172.21.15.79:0/1757669241 >> v1:172.21.15.89:6789/0 conn(0x7f79e8159f40 legacy=0x7f79e815e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:39.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.652+0000 7f79e6ffd700 1 -- 172.21.15.79:0/1757669241 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820945081 0 0) 0x7f79e80b5aa0 con 0x7f79e8159f40 2023-10-19T08:39:39.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.652+0000 7f79eceb5700 1 -- 172.21.15.79:0/1757669241 >> v1:172.21.15.79:6789/0 conn(0x7f79e80b5610 legacy=0x7f79e80cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:39.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.652+0000 7f79eceb5700 1 -- 172.21.15.79:0/1757669241 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e80cdae0 con 0x7f79e80cf710 2023-10-19T08:39:39.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.652+0000 7f79eceb5700 1 --2- 172.21.15.79:0/1757669241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79e80cf710 0x7f79e8164cb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009dc0 tx=0x7f79e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f06edd5b3b555610 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:39.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.652+0000 7f79e6ffd700 1 -- 172.21.15.79:0/1757669241 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e000e070 con 0x7f79e80cf710 2023-10-19T08:39:39.660 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.652+0000 7f79e6ffd700 1 -- 172.21.15.79:0/1757669241 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e000bb20 con 0x7f79e80cf710 2023-10-19T08:39:39.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.652+0000 7f79e6ffd700 1 -- 172.21.15.79:0/1757669241 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e000be90 con 0x7f79e80cf710 2023-10-19T08:39:39.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.653+0000 7f79ee918700 1 -- 172.21.15.79:0/1757669241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79e80cf710 msgr2=0x7f79e8164cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:39.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.653+0000 7f79ee918700 1 --2- 172.21.15.79:0/1757669241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79e80cf710 0x7f79e8164cb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009dc0 tx=0x7f79e000b330 comp rx=0 tx=0).stop 2023-10-19T08:39:39.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.653+0000 7f79ee918700 1 -- 172.21.15.79:0/1757669241 shutdown_connections 2023-10-19T08:39:39.661 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.653+0000 7f79ee918700 1 --2- 172.21.15.79:0/1757669241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79e80cf710 0x7f79e8164cb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.653+0000 7f79ee918700 1 -- 172.21.15.79:0/1757669241 >> 172.21.15.79:0/1757669241 conn(0x7f79e806dcc0 msgr2=0x7f79e806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:39.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.653+0000 7f79ee918700 1 -- 172.21.15.79:0/1757669241 shutdown_connections 2023-10-19T08:39:39.662 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.653+0000 7f79ee918700 1 -- 172.21.15.79:0/1757669241 wait complete. 2023-10-19T08:39:39.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.654+0000 7f79ee918700 1 Processor -- start 2023-10-19T08:39:39.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.654+0000 7f79ee918700 1 -- start start 2023-10-19T08:39:39.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.655+0000 7f79ee918700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79e80cf710 0x7f79e80c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.655+0000 7f79ee918700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e8159f40 0x7f79e80c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.667 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.655+0000 7f79ee918700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79e80c6380 0x7f79e814fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.655+0000 7f79ee918700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e81521c0 con 0x7f79e8159f40 2023-10-19T08:39:39.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.655+0000 7f79ee918700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e80c7c60 con 0x7f79e80c6380 2023-10-19T08:39:39.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.655+0000 7f79ee918700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e80c7f40 con 0x7f79e80cf710 2023-10-19T08:39:39.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.655+0000 7f79e77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e8159f40 0x7f79e80c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.668 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.655+0000 7f79e77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e8159f40 0x7f79e80c5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49140/0 (socket says 172.21.15.79:49140) 2023-10-19T08:39:39.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.655+0000 7f79e77fe700 1 -- 172.21.15.79:0/3965212512 learned_addr learned my addr 172.21.15.79:0/3965212512 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:39.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.655+0000 7f79e7fff700 1 --2- 172.21.15.79:0/3965212512 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79e80cf710 0x7f79e80c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.655+0000 7f79e77fe700 1 -- 172.21.15.79:0/3965212512 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79e80cf710 msgr2=0x7f79e80c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:39.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.655+0000 7f79e77fe700 1 --2- 172.21.15.79:0/3965212512 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79e80cf710 0x7f79e80c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.669 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.655+0000 7f79eceb5700 1 --2- 172.21.15.79:0/3965212512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79e80c6380 0x7f79e814fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.655+0000 7f79e77fe700 1 -- 172.21.15.79:0/3965212512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79e80c6380 msgr2=0x7f79e814fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:39.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.655+0000 7f79e77fe700 1 --2- 172.21.15.79:0/3965212512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79e80c6380 0x7f79e814fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.655+0000 7f79e77fe700 1 -- 172.21.15.79:0/3965212512 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e0009a70 con 0x7f79e8159f40 2023-10-19T08:39:39.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.655+0000 7f79e7fff700 1 --2- 172.21.15.79:0/3965212512 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79e80cf710 0x7f79e80c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:39.670 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.656+0000 7f79e77fe700 1 --2- 172.21.15.79:0/3965212512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e8159f40 0x7f79e80c5e40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00c4d0 tx=0x7f79dc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:39.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.656+0000 7f79e4ff9700 1 -- 172.21.15.79:0/3965212512 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc005d70 con 0x7f79e8159f40 2023-10-19T08:39:39.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.656+0000 7f79e4ff9700 1 -- 172.21.15.79:0/3965212512 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc0070d0 con 0x7f79e8159f40 2023-10-19T08:39:39.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.656+0000 7f79e4ff9700 1 -- 172.21.15.79:0/3965212512 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc007480 con 0x7f79e8159f40 2023-10-19T08:39:39.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.656+0000 7f79ee918700 1 -- 172.21.15.79:0/3965212512 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e80c8220 con 0x7f79e8159f40 2023-10-19T08:39:39.671 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.656+0000 7f79ee918700 1 -- 172.21.15.79:0/3965212512 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e80c7710 con 0x7f79e8159f40 2023-10-19T08:39:39.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.657+0000 7f79e4ff9700 1 -- 172.21.15.79:0/3965212512 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f79dc0075e0 con 0x7f79e8159f40 2023-10-19T08:39:39.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.658+0000 7f79e4ff9700 1 --2- 172.21.15.79:0/3965212512 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f79d406a0e0 0x7f79d406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.658+0000 7f79e4ff9700 1 -- 172.21.15.79:0/3965212512 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f79dc08a360 con 0x7f79e8159f40 2023-10-19T08:39:39.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.658+0000 7f79e7fff700 1 --2- 172.21.15.79:0/3965212512 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f79d406a0e0 0x7f79d406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.658+0000 7f79e7fff700 1 --2- 172.21.15.79:0/3965212512 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f79d406a0e0 0x7f79d406c5a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f79d8000f60 tx=0x7f79d8009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:39.672 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.660+0000 7f79faab3b80 1 Processor -- start 2023-10-19T08:39:39.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.660+0000 7f79faab3b80 1 -- start start 2023-10-19T08:39:39.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.660+0000 7f79faab3b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ccce10 0x555aa3ccd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.660+0000 7f79faab3b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555aa3ca7cb0 0x555aa3cd0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.660+0000 7f79faab3b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3cd1220 0x555aa3ca98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.673 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.660+0000 7f79faab3b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa3c025e0 con 0x555aa3ccce10 2023-10-19T08:39:39.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.660+0000 7f79faab3b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa3bfff00 con 0x555aa3cd1220 2023-10-19T08:39:39.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.660+0000 7f79faab3b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x555aa3bfb7f0 con 0x555aa3ca7cb0 2023-10-19T08:39:39.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.661+0000 7f79e7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ccce10 0x555aa3ccd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.661+0000 7f79e7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ccce10 0x555aa3ccd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49146/0 (socket says 172.21.15.79:49146) 2023-10-19T08:39:39.674 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.661+0000 7f79e7fff700 1 -- 172.21.15.79:0/932200019 learned_addr learned my addr 172.21.15.79:0/932200019 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:39.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.661+0000 7f79e7fff700 1 -- 172.21.15.79:0/932200019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555aa3ca7cb0 msgr2=0x555aa3cd0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:39.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.661+0000 7f79e7fff700 1 --2- 172.21.15.79:0/932200019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555aa3ca7cb0 0x555aa3cd0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.661+0000 7f79e7fff700 1 -- 172.21.15.79:0/932200019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3cd1220 msgr2=0x555aa3ca98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:39.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.661+0000 7f79eceb5700 1 --2- 172.21.15.79:0/932200019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3cd1220 0x555aa3ca98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.661+0000 7f79e7fff700 1 --2- 172.21.15.79:0/932200019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3cd1220 0x555aa3ca98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.675 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.661+0000 7f79e7fff700 1 -- 172.21.15.79:0/932200019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555aa3a7b5e0 con 0x555aa3ccce10 2023-10-19T08:39:39.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.661+0000 7f79e7fff700 1 --2- 172.21.15.79:0/932200019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ccce10 0x555aa3ccd1f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f79d80052b0 tx=0x7f79d8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e437f34c99b4504 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:39.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.661+0000 7f79cdffb700 1 -- 172.21.15.79:0/932200019 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d800d620 con 0x555aa3ccce10 2023-10-19T08:39:39.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.661+0000 7f79cdffb700 1 -- 172.21.15.79:0/932200019 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d800d780 con 0x555aa3ccce10 2023-10-19T08:39:39.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.661+0000 7f79cdffb700 1 -- 172.21.15.79:0/932200019 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d800db10 con 0x555aa3ccce10 2023-10-19T08:39:39.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.662+0000 7f79faab3b80 1 -- 172.21.15.79:0/932200019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ccce10 msgr2=0x555aa3ccd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:39.676 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.662+0000 7f79faab3b80 1 --2- 172.21.15.79:0/932200019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ccce10 0x555aa3ccd1f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f79d80052b0 tx=0x7f79d8010000 comp rx=0 tx=0).stop 2023-10-19T08:39:39.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.662+0000 7f79faab3b80 1 -- 172.21.15.79:0/932200019 shutdown_connections 2023-10-19T08:39:39.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.662+0000 7f79faab3b80 1 --2- 172.21.15.79:0/932200019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3cd1220 0x555aa3ca98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.662+0000 7f79faab3b80 1 --2- 172.21.15.79:0/932200019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ccce10 0x555aa3ccd1f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.662+0000 7f79faab3b80 1 --2- 172.21.15.79:0/932200019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555aa3ca7cb0 0x555aa3cd0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.677 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.662+0000 7f79faab3b80 1 -- 172.21.15.79:0/932200019 >> 172.21.15.79:0/932200019 conn(0x555aa3bd6900 msgr2=0x555aa3cef590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:39.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.662+0000 7f79faab3b80 1 -- 172.21.15.79:0/932200019 shutdown_connections 2023-10-19T08:39:39.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.662+0000 7f79faab3b80 1 -- 172.21.15.79:0/932200019 wait complete. 2023-10-19T08:39:39.678 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.662+0000 7f79faab3b80 1 -- start start 2023-10-19T08:39:39.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.663+0000 7f79faab3b80 1 Processor -- start 2023-10-19T08:39:39.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.663+0000 7f79faab3b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3ca7cb0 0x555aa3cc6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.663+0000 7f79faab3b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ccce10 0x555aa3cc5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.682 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.663+0000 7f79faab3b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555aa3cc2b90 0x555aa3cc3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.663+0000 7f79faab3b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa3b99a70 con 0x555aa3ccce10 2023-10-19T08:39:39.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.663+0000 7f79faab3b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa3b99770 con 0x555aa3ca7cb0 2023-10-19T08:39:39.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79faab3b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x555aa3a7d8d0 con 0x555aa3cc2b90 2023-10-19T08:39:39.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79faab3b80 10 client.0 _ll_register_callbacks cb 0x555aa3ae3a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T08:39:39.683 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79e77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ccce10 0x555aa3cc5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79e77fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ccce10 0x555aa3cc5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49154/0 (socket says 172.21.15.79:49154) 2023-10-19T08:39:39.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79e77fe700 1 -- 172.21.15.79:0/323535330 learned_addr learned my addr 172.21.15.79:0/323535330 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:39.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79eceb5700 1 --2- 172.21.15.79:0/323535330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555aa3cc2b90 0x555aa3cc3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79e7fff700 1 --2- 172.21.15.79:0/323535330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3ca7cb0 0x555aa3cc6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.684 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79e77fe700 1 -- 172.21.15.79:0/323535330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555aa3cc2b90 msgr2=0x555aa3cc3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:39.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79e77fe700 1 --2- 172.21.15.79:0/323535330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555aa3cc2b90 0x555aa3cc3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79e77fe700 1 -- 172.21.15.79:0/323535330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3ca7cb0 msgr2=0x555aa3cc6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:39.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79e77fe700 1 --2- 172.21.15.79:0/323535330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3ca7cb0 0x555aa3cc6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79e77fe700 1 -- 172.21.15.79:0/323535330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d80050d0 con 0x555aa3ccce10 2023-10-19T08:39:39.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79e7fff700 1 --2- 172.21.15.79:0/323535330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3ca7cb0 0x555aa3cc6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:39.685 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79e77fe700 1 --2- 172.21.15.79:0/323535330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ccce10 0x555aa3cc5140 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0070a0 tx=0x7f79dc058e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89bb653eb537104 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:39.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-19T08:39:39.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79c6ffd700 1 -- 172.21.15.79:0/323535330 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc057a00 con 0x555aa3ccce10 2023-10-19T08:39:39.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79c6ffd700 1 -- 172.21.15.79:0/323535330 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f79dc08a070 con 0x555aa3ccce10 2023-10-19T08:39:39.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79faab3b80 1 -- 172.21.15.79:0/323535330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555aa3c9ccb0 con 0x555aa3ccce10 2023-10-19T08:39:39.686 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79c6ffd700 1 -- 172.21.15.79:0/323535330 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79dc05f0d0 con 0x555aa3ccce10 2023-10-19T08:39:39.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79faab3b80 10 client.5931 fetch_fsmap learned FSMap version 18 2023-10-19T08:39:39.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79faab3b80 1 -- 172.21.15.79:0/323535330 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x555aa3a27d90 con 0x555aa3ccce10 2023-10-19T08:39:39.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79c6ffd700 1 -- 172.21.15.79:0/323535330 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555aa3c9ccb0 con 0x555aa3ccce10 2023-10-19T08:39:39.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.664+0000 7f79c6ffd700 1 -- 172.21.15.79:0/323535330 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f79dc0881a0 con 0x555aa3ccce10 2023-10-19T08:39:39.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.665+0000 7f79faab3b80 10 client.5931 fetch_fsmap finished waiting for FSMap version 18 2023-10-19T08:39:39.687 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.665+0000 7f79faab3b80 10 client.5931 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-19T08:39:39.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.665+0000 7f79faab3b80 20 client.5931 populate_metadata read hostname 'smithi079' 2023-10-19T08:39:39.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.665+0000 7f79faab3b80 1 --2- 172.21.15.79:0/323535330 >> [v2:172.21.15.79:6834/594110949,v1:172.21.15.79:6837/594110949] conn(0x555aa3cc90e0 0x555aa3ccb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.665+0000 7f79faab3b80 4 client.5931 mds_command: new command op to 5736 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-19T08:39:39.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.665+0000 7f79faab3b80 1 -- 172.21.15.79:0/323535330 --> [v2:172.21.15.79:6834/594110949,v1:172.21.15.79:6837/594110949] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555aa3bf47d0 con 0x555aa3cc90e0 2023-10-19T08:39:39.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.665+0000 7f79e7fff700 1 --2- 172.21.15.79:0/323535330 >> [v2:172.21.15.79:6834/594110949,v1:172.21.15.79:6837/594110949] conn(0x555aa3cc90e0 0x555aa3ccb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.688 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.665+0000 7f79c6ffd700 10 client.5931 ms_handle_connect on v2:172.21.15.79:6834/594110949 2023-10-19T08:39:39.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.665+0000 7f79e7fff700 1 --2- 172.21.15.79:0/323535330 >> [v2:172.21.15.79:6834/594110949,v1:172.21.15.79:6837/594110949] conn(0x555aa3cc90e0 0x555aa3ccb020 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=834f7a202079ff7c server_cookie=d0f6ea804162f17b in_seq=0 out_seq=0 2023-10-19T08:39:39.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.666+0000 7f79c6ffd700 1 -- 172.21.15.79:0/323535330 <== mds.0 v2:172.21.15.79:6834/594110949 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555aa3bf47d0 con 0x555aa3cc90e0 2023-10-19T08:39:39.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.666+0000 7f79c6ffd700 10 client.5931 handle_command_reply: tid=0 2023-10-19T08:39:39.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.666+0000 7f79faab3b80 1 client.5931 shutdown 2023-10-19T08:39:39.689 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.666+0000 7f79faab3b80 1 -- 172.21.15.79:0/323535330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ccce10 msgr2=0x555aa3cc5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:39.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.666+0000 7f79faab3b80 1 --2- 172.21.15.79:0/323535330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ccce10 0x555aa3cc5140 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0070a0 tx=0x7f79dc058e30 comp rx=0 tx=0).stop 2023-10-19T08:39:39.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.666+0000 7f79faab3b80 1 -- 172.21.15.79:0/323535330 shutdown_connections 2023-10-19T08:39:39.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.666+0000 7f79faab3b80 1 --2- 172.21.15.79:0/323535330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555aa3cc2b90 0x555aa3cc3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.666+0000 7f79faab3b80 1 --2- 172.21.15.79:0/323535330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3ca7cb0 0x555aa3cc6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.690 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.666+0000 7f79faab3b80 1 --2- 172.21.15.79:0/323535330 >> [v2:172.21.15.79:6834/594110949,v1:172.21.15.79:6837/594110949] conn(0x555aa3cc90e0 0x555aa3ccb020 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.666+0000 7f79faab3b80 1 --2- 172.21.15.79:0/323535330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ccce10 0x555aa3cc5140 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.666+0000 7f79c6ffd700 0 client.5931 ms_handle_reset on v2:172.21.15.79:6834/594110949 2023-10-19T08:39:39.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.666+0000 7f79faab3b80 1 -- 172.21.15.79:0/323535330 >> 172.21.15.79:0/323535330 conn(0x555aa3bd6900 msgr2=0x555aa3ca4430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:39.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.666+0000 7f79faab3b80 1 -- 172.21.15.79:0/323535330 shutdown_connections 2023-10-19T08:39:39.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.666+0000 7f79faab3b80 1 -- 172.21.15.79:0/323535330 wait complete. 2023-10-19T08:39:39.691 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.666+0000 7f79faab3b80 20 client.5931 trim_cache size 0 max 16384 2023-10-19T08:39:39.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.683+0000 7f79faab3b80 1 Processor -- start 2023-10-19T08:39:39.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.683+0000 7f79faab3b80 1 -- start start 2023-10-19T08:39:39.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.684+0000 7f79faab3b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ca7cb0 0x555aa3cc6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.697 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.684+0000 7f79faab3b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555aa3cc2b90 0x555aa3cd0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.684+0000 7f79faab3b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3ccce10 0x555aa3cd0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.684+0000 7f79faab3b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa3cc6480 con 0x555aa3ca7cb0 2023-10-19T08:39:39.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.684+0000 7f79faab3b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa3ca4ed0 con 0x555aa3ccce10 2023-10-19T08:39:39.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.684+0000 7f79faab3b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x555aa3ceeba0 con 0x555aa3cc2b90 2023-10-19T08:39:39.698 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.684+0000 7f79e7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ca7cb0 0x555aa3cc6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.684+0000 7f79e7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ca7cb0 0x555aa3cc6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49160/0 (socket says 172.21.15.79:49160) 2023-10-19T08:39:39.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.684+0000 7f79e7fff700 1 -- 172.21.15.79:0/3147520613 learned_addr learned my addr 172.21.15.79:0/3147520613 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:39.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.684+0000 7f79e7fff700 1 -- 172.21.15.79:0/3147520613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555aa3cc2b90 msgr2=0x555aa3cd0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:39.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.684+0000 7f79e7fff700 1 --2- 172.21.15.79:0/3147520613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555aa3cc2b90 0x555aa3cd0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.684+0000 7f79e7fff700 1 -- 172.21.15.79:0/3147520613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3ccce10 msgr2=0x555aa3cd0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:39.699 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.684+0000 7f79e7fff700 1 --2- 172.21.15.79:0/3147520613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3ccce10 0x555aa3cd0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.684+0000 7f79e7fff700 1 -- 172.21.15.79:0/3147520613 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555aa3a10c10 con 0x555aa3ca7cb0 2023-10-19T08:39:39.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.685+0000 7f79e7fff700 1 --2- 172.21.15.79:0/3147520613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ca7cb0 0x555aa3cc6ba0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x555aa3ce65e0 tx=0x7f79d8005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5faf119b3e9f1232 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:39.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.685+0000 7f79ce7fc700 1 -- 172.21.15.79:0/3147520613 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d802e3b0 con 0x555aa3ca7cb0 2023-10-19T08:39:39.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.685+0000 7f79ce7fc700 1 -- 172.21.15.79:0/3147520613 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d8018070 con 0x555aa3ca7cb0 2023-10-19T08:39:39.700 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.685+0000 7f79ce7fc700 1 -- 172.21.15.79:0/3147520613 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d802e530 con 0x555aa3ca7cb0 2023-10-19T08:39:39.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.685+0000 7f79faab3b80 1 -- 172.21.15.79:0/3147520613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ca7cb0 msgr2=0x555aa3cc6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:39.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.685+0000 7f79faab3b80 1 --2- 172.21.15.79:0/3147520613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ca7cb0 0x555aa3cc6ba0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x555aa3ce65e0 tx=0x7f79d8005000 comp rx=0 tx=0).stop 2023-10-19T08:39:39.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.685+0000 7f79faab3b80 1 -- 172.21.15.79:0/3147520613 shutdown_connections 2023-10-19T08:39:39.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.685+0000 7f79faab3b80 1 --2- 172.21.15.79:0/3147520613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3ccce10 0x555aa3cd0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.685+0000 7f79faab3b80 1 --2- 172.21.15.79:0/3147520613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ca7cb0 0x555aa3cc6ba0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.701 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.685+0000 7f79faab3b80 1 --2- 172.21.15.79:0/3147520613 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555aa3cc2b90 0x555aa3cd0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.685+0000 7f79faab3b80 1 -- 172.21.15.79:0/3147520613 >> 172.21.15.79:0/3147520613 conn(0x555aa3bd6900 msgr2=0x555aa3ca34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:39.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.685+0000 7f79faab3b80 1 -- 172.21.15.79:0/3147520613 shutdown_connections 2023-10-19T08:39:39.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.685+0000 7f79faab3b80 1 -- 172.21.15.79:0/3147520613 wait complete. 2023-10-19T08:39:39.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.686+0000 7f79faab3b80 1 -- start start 2023-10-19T08:39:39.702 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.686+0000 7f79faab3b80 1 Processor -- start 2023-10-19T08:39:39.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.687+0000 7f79faab3b80 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ca7cb0 0x555aa3d10e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.687+0000 7f79faab3b80 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555aa3cc2b90 0x555aa3cc4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.687+0000 7f79faab3b80 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3ccce10 0x555aa3cee230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.687+0000 7f79faab3b80 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa3cc4c60 con 0x555aa3ca7cb0 2023-10-19T08:39:39.703 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.687+0000 7f79faab3b80 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aa3cebbd0 con 0x555aa3ccce10 2023-10-19T08:39:39.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.687+0000 7f79faab3b80 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x555aa3cc47d0 con 0x555aa3cc2b90 2023-10-19T08:39:39.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.687+0000 7f79faab3b80 10 client.0 _ll_register_callbacks cb 0x7f79dc058fc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-19T08:39:39.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.687+0000 7f79e7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ca7cb0 0x555aa3d10e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.687+0000 7f79e7fff700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ca7cb0 0x555aa3d10e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49166/0 (socket says 172.21.15.79:49166) 2023-10-19T08:39:39.704 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.687+0000 7f79e7fff700 1 -- 172.21.15.79:0/3510185559 learned_addr learned my addr 172.21.15.79:0/3510185559 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:39.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.687+0000 7f79e77fe700 1 --2- 172.21.15.79:0/3510185559 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555aa3cc2b90 0x555aa3cc4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.687+0000 7f79eceb5700 1 --2- 172.21.15.79:0/3510185559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3ccce10 0x555aa3cee230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.687+0000 7f79e7fff700 1 -- 172.21.15.79:0/3510185559 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555aa3cc2b90 msgr2=0x555aa3cc4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:39.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.687+0000 7f79e7fff700 1 --2- 172.21.15.79:0/3510185559 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555aa3cc2b90 0x555aa3cc4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.687+0000 7f79e7fff700 1 -- 172.21.15.79:0/3510185559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3ccce10 msgr2=0x555aa3cee230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:39.705 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.687+0000 7f79e7fff700 1 --2- 172.21.15.79:0/3510185559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3ccce10 0x555aa3cee230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.687+0000 7f79e7fff700 1 -- 172.21.15.79:0/3510185559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d8028040 con 0x555aa3ca7cb0 2023-10-19T08:39:39.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.687+0000 7f79e7fff700 1 --2- 172.21.15.79:0/3510185559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ca7cb0 0x555aa3d10e00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f79d8005040 tx=0x7f79d8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6a4da29076f619 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:39.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.687+0000 7f79c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2023-10-19T08:39:39.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.688+0000 7f79c6ffd700 1 -- 172.21.15.79:0/3510185559 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d802e570 con 0x555aa3ca7cb0 2023-10-19T08:39:39.706 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.688+0000 7f79c6ffd700 1 -- 172.21.15.79:0/3510185559 <== mon.0 v2:172.21.15.79:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f79d803b070 con 0x555aa3ca7cb0 2023-10-19T08:39:39.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.688+0000 7f79faab3b80 1 -- 172.21.15.79:0/3510185559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f79d800d780 con 0x555aa3ca7cb0 2023-10-19T08:39:39.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.688+0000 7f79c6ffd700 1 -- 172.21.15.79:0/3510185559 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79d802ebb0 con 0x555aa3ca7cb0 2023-10-19T08:39:39.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.688+0000 7f79faab3b80 10 client.5937 fetch_fsmap learned FSMap version 18 2023-10-19T08:39:39.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.688+0000 7f79faab3b80 1 -- 172.21.15.79:0/3510185559 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x555aa3a4e200 con 0x555aa3ca7cb0 2023-10-19T08:39:39.707 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.688+0000 7f79c6ffd700 1 -- 172.21.15.79:0/3510185559 <== mon.0 v2:172.21.15.79:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d800d780 con 0x555aa3ca7cb0 2023-10-19T08:39:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.688+0000 7f79c6ffd700 1 -- 172.21.15.79:0/3510185559 <== mon.0 v2:172.21.15.79:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f79d802ed10 con 0x555aa3ca7cb0 2023-10-19T08:39:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.688+0000 7f79faab3b80 10 client.5937 fetch_fsmap finished waiting for FSMap version 18 2023-10-19T08:39:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.688+0000 7f79faab3b80 10 client.5937 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-19T08:39:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.688+0000 7f79faab3b80 20 client.5937 populate_metadata read hostname 'smithi079' 2023-10-19T08:39:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.688+0000 7f79faab3b80 1 --2- 172.21.15.79:0/3510185559 >> [v2:172.21.15.79:6834/594110949,v1:172.21.15.79:6837/594110949] conn(0x555aa3cd5250 0x555aa3cd3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.708 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.688+0000 7f79faab3b80 4 client.5937 mds_command: new command op to 5736 tid=0[{"prefix": "status"}] 2023-10-19T08:39:39.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.688+0000 7f79faab3b80 1 -- 172.21.15.79:0/3510185559 --> [v2:172.21.15.79:6834/594110949,v1:172.21.15.79:6837/594110949] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555aa3bb5000 con 0x555aa3cd5250 2023-10-19T08:39:39.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.688+0000 7f79e77fe700 1 --2- 172.21.15.79:0/3510185559 >> [v2:172.21.15.79:6834/594110949,v1:172.21.15.79:6837/594110949] conn(0x555aa3cd5250 0x555aa3cd3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.688+0000 7f79c6ffd700 10 client.5937 ms_handle_connect on v2:172.21.15.79:6834/594110949 2023-10-19T08:39:39.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.688+0000 7f79e77fe700 1 --2- 172.21.15.79:0/3510185559 >> [v2:172.21.15.79:6834/594110949,v1:172.21.15.79:6837/594110949] conn(0x555aa3cd5250 0x555aa3cd3b00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e43ec555192345d4 server_cookie=da3208392caf3d6d in_seq=0 out_seq=0 2023-10-19T08:39:39.709 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.689+0000 7f79c6ffd700 1 -- 172.21.15.79:0/3510185559 <== mds.0 v2:172.21.15.79:6834/594110949 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x555aa3bb5000 con 0x555aa3cd5250 2023-10-19T08:39:39.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.689+0000 7f79c6ffd700 10 client.5937 handle_command_reply: tid=0 2023-10-19T08:39:39.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.689+0000 7f79faab3b80 1 client.5937 shutdown 2023-10-19T08:39:39.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.689+0000 7f79faab3b80 1 -- 172.21.15.79:0/3510185559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ca7cb0 msgr2=0x555aa3d10e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:39.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.689+0000 7f79faab3b80 1 --2- 172.21.15.79:0/3510185559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ca7cb0 0x555aa3d10e00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f79d8005040 tx=0x7f79d8000ed0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.710 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.689+0000 7f79faab3b80 1 -- 172.21.15.79:0/3510185559 shutdown_connections 2023-10-19T08:39:39.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.689+0000 7f79faab3b80 1 --2- 172.21.15.79:0/3510185559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x555aa3ccce10 0x555aa3cee230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.689+0000 7f79faab3b80 1 --2- 172.21.15.79:0/3510185559 >> [v2:172.21.15.79:6834/594110949,v1:172.21.15.79:6837/594110949] conn(0x555aa3cd5250 0x555aa3cd3b00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.689+0000 7f79faab3b80 1 --2- 172.21.15.79:0/3510185559 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555aa3ca7cb0 0x555aa3d10e00 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.689+0000 7f79c6ffd700 0 client.5937 ms_handle_reset on v2:172.21.15.79:6834/594110949 2023-10-19T08:39:39.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.689+0000 7f79faab3b80 1 --2- 172.21.15.79:0/3510185559 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x555aa3cc2b90 0x555aa3cc4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.711 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.689+0000 7f79faab3b80 1 -- 172.21.15.79:0/3510185559 >> 172.21.15.79:0/3510185559 conn(0x555aa3bd6900 msgr2=0x555aa3cc6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:39.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.689+0000 7f79faab3b80 1 -- 172.21.15.79:0/3510185559 shutdown_connections 2023-10-19T08:39:39.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.689+0000 7f79faab3b80 1 -- 172.21.15.79:0/3510185559 wait complete. 2023-10-19T08:39:39.712 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.689+0000 7f79faab3b80 20 client.5937 trim_cache size 0 max 16384 2023-10-19T08:39:39.712 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-19T08:39:39.713 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_fsid": "98eaa3c1-94c8-49a6-8b8d-caae2bee3a98", 2023-10-19T08:39:39.713 INFO:teuthology.orchestra.run.smithi079.stdout: "whoami": 0, 2023-10-19T08:39:39.713 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 5736, 2023-10-19T08:39:39.713 INFO:teuthology.orchestra.run.smithi079.stdout: "want_state": "up:active", 2023-10-19T08:39:39.713 INFO:teuthology.orchestra.run.smithi079.stdout: "state": "up:active", 2023-10-19T08:39:39.714 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs", 2023-10-19T08:39:39.714 INFO:teuthology.orchestra.run.smithi079.stdout: "rank_uptime": 5.8822438410000002, 2023-10-19T08:39:39.714 INFO:teuthology.orchestra.run.smithi079.stdout: "mdsmap_epoch": 18, 2023-10-19T08:39:39.714 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch": 39, 2023-10-19T08:39:39.714 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_epoch_barrier": 39, 2023-10-19T08:39:39.715 INFO:teuthology.orchestra.run.smithi079.stdout: "uptime": 13.892778676000001 2023-10-19T08:39:39.715 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-19T08:39:39.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.689+0000 7f79ee918700 1 -- 172.21.15.79:0/3965212512 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f79d406a0e0 msgr2=0x7f79d406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:39.716 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.689+0000 7f79ee918700 1 --2- 172.21.15.79:0/3965212512 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f79d406a0e0 0x7f79d406c5a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f79d8000f60 tx=0x7f79d8009040 comp rx=0 tx=0).stop 2023-10-19T08:39:39.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.689+0000 7f79ee918700 1 -- 172.21.15.79:0/3965212512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e8159f40 msgr2=0x7f79e80c5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:39.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.689+0000 7f79ee918700 1 --2- 172.21.15.79:0/3965212512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e8159f40 0x7f79e80c5e40 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00c4d0 tx=0x7f79dc00c890 comp rx=0 tx=0).stop 2023-10-19T08:39:39.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.690+0000 7f79ee918700 1 -- 172.21.15.79:0/3965212512 shutdown_connections 2023-10-19T08:39:39.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.690+0000 7f79ee918700 1 --2- 172.21.15.79:0/3965212512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79e80c6380 0x7f79e814fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.717 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.690+0000 7f79ee918700 1 --2- 172.21.15.79:0/3965212512 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f79d406a0e0 0x7f79d406c5a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.690+0000 7f79ee918700 1 --2- 172.21.15.79:0/3965212512 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f79e80cf710 0x7f79e80c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.690+0000 7f79ee918700 1 --2- 172.21.15.79:0/3965212512 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79e8159f40 0x7f79e80c5e40 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.690+0000 7f79ee918700 1 -- 172.21.15.79:0/3965212512 >> 172.21.15.79:0/3965212512 conn(0x7f79e806dcc0 msgr2=0x7f79e80cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:39.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.690+0000 7f79ee918700 1 -- 172.21.15.79:0/3965212512 shutdown_connections 2023-10-19T08:39:39.718 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.690+0000 7f79ee918700 1 -- 172.21.15.79:0/3965212512 wait complete. 2023-10-19T08:39:39.719 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-19T08:39:39.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.834+0000 7ff6d15ef700 1 Processor -- start 2023-10-19T08:39:39.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.834+0000 7ff6d15ef700 1 -- start start 2023-10-19T08:39:39.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.835+0000 7ff6d15ef700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff6cc0cfcf0 0x7ff6cc0d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.835+0000 7ff6d15ef700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff6cc0b5f20 0x7ff6cc0b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.835+0000 7ff6d15ef700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6cc0d0610 con 0x7ff6cc0b2180 2023-10-19T08:39:39.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.835+0000 7ff6d15ef700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6cc0d2b20 con 0x7ff6cc0cfcf0 2023-10-19T08:39:39.841 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.835+0000 7ff6d15ef700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6cc0d1120 con 0x7ff6cc0b5f20 2023-10-19T08:39:39.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.835+0000 7ff6caffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff6cc0cfcf0 0x7ff6cc0d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.835+0000 7ff6caffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff6cc0cfcf0 0x7ff6cc0d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49174/0 (socket says 172.21.15.79:49174) 2023-10-19T08:39:39.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.835+0000 7ff6caffd700 1 -- 172.21.15.79:0/1980131555 learned_addr learned my addr 172.21.15.79:0/1980131555 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:39.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.835+0000 7ff6cb7fe700 1 --2- 172.21.15.79:0/1980131555 >> v2:172.21.15.89:3300/0 conn(0x7ff6cc0b5f20 0x7ff6cc0b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.842 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.835+0000 7ff6caffd700 1 -- 172.21.15.79:0/1980131555 >> v2:172.21.15.89:3300/0 conn(0x7ff6cc0b5f20 msgr2=0x7ff6cc0b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:39.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.835+0000 7ff6caffd700 1 --2- 172.21.15.79:0/1980131555 >> v2:172.21.15.89:3300/0 conn(0x7ff6cc0b5f20 0x7ff6cc0b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.835+0000 7ff6caffd700 1 -- 172.21.15.79:0/1980131555 >> v1:172.21.15.89:6789/0 conn(0x7ff6cc0b2180 legacy=0x7ff6cc0d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:39.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.835+0000 7ff6caffd700 1 -- 172.21.15.79:0/1980131555 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc0d1400 con 0x7ff6cc0cfcf0 2023-10-19T08:39:39.843 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.836+0000 7ff6caffd700 1 --2- 172.21.15.79:0/1980131555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6cc0cfcf0 0x7ff6cc0d00d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0d0dd0 tx=0x7ff6c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51e5484e007446b server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:39.844 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.838+0000 7ff6c9ffb700 1 -- 172.21.15.79:0/1980131555 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0011830 con 0x7ff6cc0cfcf0 2023-10-19T08:39:39.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.838+0000 7ff6c9ffb700 1 -- 172.21.15.79:0/1980131555 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c0011990 con 0x7ff6cc0cfcf0 2023-10-19T08:39:39.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.838+0000 7ff6c9ffb700 1 -- 172.21.15.79:0/1980131555 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0011d20 con 0x7ff6cc0cfcf0 2023-10-19T08:39:39.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.839+0000 7ff6d15ef700 1 -- 172.21.15.79:0/1980131555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6cc0cfcf0 msgr2=0x7ff6cc0d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:39.845 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.839+0000 7ff6d15ef700 1 --2- 172.21.15.79:0/1980131555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6cc0cfcf0 0x7ff6cc0d00d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0d0dd0 tx=0x7ff6c0009bd0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.839+0000 7ff6d15ef700 1 -- 172.21.15.79:0/1980131555 shutdown_connections 2023-10-19T08:39:39.846 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.839+0000 7ff6d15ef700 1 --2- 172.21.15.79:0/1980131555 >> v2:172.21.15.89:3300/0 conn(0x7ff6cc0b5f20 0x7ff6cc0b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.839+0000 7ff6d15ef700 1 --2- 172.21.15.79:0/1980131555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6cc0cfcf0 0x7ff6cc0d00d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.839+0000 7ff6d15ef700 1 -- 172.21.15.79:0/1980131555 >> 172.21.15.79:0/1980131555 conn(0x7ff6cc071b30 msgr2=0x7ff6cc071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:39.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.839+0000 7ff6d15ef700 1 -- 172.21.15.79:0/1980131555 shutdown_connections 2023-10-19T08:39:39.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.839+0000 7ff6d15ef700 1 -- 172.21.15.79:0/1980131555 wait complete. 2023-10-19T08:39:39.847 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.840+0000 7ff6d15ef700 1 Processor -- start 2023-10-19T08:39:39.848 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.840+0000 7ff6d15ef700 1 -- start start 2023-10-19T08:39:39.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.841+0000 7ff6d15ef700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6cc0b2180 0x7ff6cc1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.850 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.841+0000 7ff6d15ef700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6cc0b5f20 0x7ff6cc15eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.841+0000 7ff6d15ef700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6cc0cfcf0 0x7ff6cc15b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.841+0000 7ff6d15ef700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc15f870 con 0x7ff6cc0cfcf0 2023-10-19T08:39:39.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.841+0000 7ff6d15ef700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc15fb50 con 0x7ff6cc0b5f20 2023-10-19T08:39:39.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.841+0000 7ff6d15ef700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc15fe30 con 0x7ff6cc0b2180 2023-10-19T08:39:39.851 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.841+0000 7ff6cb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6cc0cfcf0 0x7ff6cc15b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.841+0000 7ff6cb7fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6cc0cfcf0 0x7ff6cc15b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49180/0 (socket says 172.21.15.79:49180) 2023-10-19T08:39:39.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.841+0000 7ff6cb7fe700 1 -- 172.21.15.79:0/2872283421 learned_addr learned my addr 172.21.15.79:0/2872283421 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:39.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.841+0000 7ff6caffd700 1 --2- 172.21.15.79:0/2872283421 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6cc0b2180 0x7ff6cc1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.852 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.841+0000 7ff6ca7fc700 1 --2- 172.21.15.79:0/2872283421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6cc0b5f20 0x7ff6cc15eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.842+0000 7ff6cb7fe700 1 -- 172.21.15.79:0/2872283421 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6cc0b2180 msgr2=0x7ff6cc1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:39.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.842+0000 7ff6cb7fe700 1 --2- 172.21.15.79:0/2872283421 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6cc0b2180 0x7ff6cc1514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.842+0000 7ff6cb7fe700 1 -- 172.21.15.79:0/2872283421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6cc0b5f20 msgr2=0x7ff6cc15eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:39.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.842+0000 7ff6cb7fe700 1 --2- 172.21.15.79:0/2872283421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6cc0b5f20 0x7ff6cc15eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:39.853 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.842+0000 7ff6cb7fe700 1 -- 172.21.15.79:0/2872283421 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c0009550 con 0x7ff6cc0cfcf0 2023-10-19T08:39:39.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.842+0000 7ff6ca7fc700 1 --2- 172.21.15.79:0/2872283421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6cc0b5f20 0x7ff6cc15eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:39.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.842+0000 7ff6cb7fe700 1 --2- 172.21.15.79:0/2872283421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6cc0cfcf0 0x7ff6cc15b130 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400efc0 tx=0x7ff6c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:39.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.843+0000 7ff6b37fe700 1 -- 172.21.15.79:0/2872283421 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4009ea0 con 0x7ff6cc0cfcf0 2023-10-19T08:39:39.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.843+0000 7ff6d15ef700 1 -- 172.21.15.79:0/2872283421 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6cc160110 con 0x7ff6cc0cfcf0 2023-10-19T08:39:39.854 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.843+0000 7ff6b37fe700 1 -- 172.21.15.79:0/2872283421 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c400f040 con 0x7ff6cc0cfcf0 2023-10-19T08:39:39.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.843+0000 7ff6b37fe700 1 -- 172.21.15.79:0/2872283421 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4014480 con 0x7ff6cc0cfcf0 2023-10-19T08:39:39.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.843+0000 7ff6d15ef700 1 -- 172.21.15.79:0/2872283421 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6cc151bc0 con 0x7ff6cc0cfcf0 2023-10-19T08:39:39.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.844+0000 7ff6d15ef700 1 -- 172.21.15.79:0/2872283421 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6cc04ee70 con 0x7ff6cc0cfcf0 2023-10-19T08:39:39.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.845+0000 7ff6b37fe700 1 -- 172.21.15.79:0/2872283421 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff6c40145e0 con 0x7ff6cc0cfcf0 2023-10-19T08:39:39.855 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.845+0000 7ff6b37fe700 1 --2- 172.21.15.79:0/2872283421 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff6b806a0e0 0x7ff6b806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:39.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.845+0000 7ff6b37fe700 1 -- 172.21.15.79:0/2872283421 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff6c4089230 con 0x7ff6cc0cfcf0 2023-10-19T08:39:39.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.845+0000 7ff6caffd700 1 --2- 172.21.15.79:0/2872283421 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff6b806a0e0 0x7ff6b806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:39.856 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.845+0000 7ff6caffd700 1 --2- 172.21.15.79:0/2872283421 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff6b806a0e0 0x7ff6b806c5a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0014040 tx=0x7ff6c0008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:39.857 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:39.850+0000 7ff6b37fe700 1 -- 172.21.15.79:0/2872283421 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ff6c4054760 con 0x7ff6cc0cfcf0 2023-10-19T08:39:40.084 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:40.080+0000 7ff6d15ef700 1 -- 172.21.15.79:0/2872283421 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff6cc0b37e0 con 0x7ff6cc0cfcf0 2023-10-19T08:39:40.085 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:40.080+0000 7ff6b37fe700 1 -- 172.21.15.79:0/2872283421 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff6c4057d80 con 0x7ff6cc0cfcf0 2023-10-19T08:39:40.085 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-19T08:39:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:40.082+0000 7ff6d15ef700 1 -- 172.21.15.79:0/2872283421 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff6b806a0e0 msgr2=0x7ff6b806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:40.082+0000 7ff6d15ef700 1 --2- 172.21.15.79:0/2872283421 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff6b806a0e0 0x7ff6b806c5a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0014040 tx=0x7ff6c0008030 comp rx=0 tx=0).stop 2023-10-19T08:39:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:40.082+0000 7ff6d15ef700 1 -- 172.21.15.79:0/2872283421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6cc0cfcf0 msgr2=0x7ff6cc15b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:40.082+0000 7ff6d15ef700 1 --2- 172.21.15.79:0/2872283421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6cc0cfcf0 0x7ff6cc15b130 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400efc0 tx=0x7ff6c400c3a0 comp rx=0 tx=0).stop 2023-10-19T08:39:40.087 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:40.082+0000 7ff6d15ef700 1 -- 172.21.15.79:0/2872283421 shutdown_connections 2023-10-19T08:39:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:40.082+0000 7ff6d15ef700 1 --2- 172.21.15.79:0/2872283421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff6cc0cfcf0 0x7ff6cc15b130 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:40.082+0000 7ff6d15ef700 1 --2- 172.21.15.79:0/2872283421 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff6b806a0e0 0x7ff6b806c5a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:40.082+0000 7ff6d15ef700 1 --2- 172.21.15.79:0/2872283421 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff6cc0b2180 0x7ff6cc1514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:40.088 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:40.082+0000 7ff6d15ef700 1 --2- 172.21.15.79:0/2872283421 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff6cc0b5f20 0x7ff6cc15eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:40.082+0000 7ff6d15ef700 1 -- 172.21.15.79:0/2872283421 >> 172.21.15.79:0/2872283421 conn(0x7ff6cc071b30 msgr2=0x7ff6cc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:40.082+0000 7ff6d15ef700 1 -- 172.21.15.79:0/2872283421 shutdown_connections 2023-10-19T08:39:40.089 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:40.082+0000 7ff6d15ef700 1 -- 172.21.15.79:0/2872283421 wait complete. 2023-10-19T08:39:40.098 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-19T08:39:40.099 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-19T08:39:40.099 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2023-10-19T08:39:40.100 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-19T08:39:40.100 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-19T08:39:40.100 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-19T08:39:40.101 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-19T08:39:40.101 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-19T08:39:40.101 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-19T08:39:40.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:40.102 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2023-10-19T08:39:40.119 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-19T08:39:40.119 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-19T08:39:40.120 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2023-10-19T08:39:40.120 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:39:40.120 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2023-10-19T08:39:40.120 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:39:40.120 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:39:40.121 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2023-10-19T08:39:40.121 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:39:40.121 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2023-10-19T08:39:40.121 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:39:40.121 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:39:40.122 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-19T08:39:40.122 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:39:40.122 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-19T08:39:40.122 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42327sec preferred_lft 42327sec 2023-10-19T08:39:40.122 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::b457:4012:3867:53f6/64 scope link noprefixroute 2023-10-19T08:39:40.123 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:39:40.123 INFO:teuthology.orchestra.run.smithi079.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-19T08:39:40.123 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 6e:3a:af:29:74:06 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:39:40.123 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-19T08:39:40.123 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:39:40.124 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::5c75:7aff:fe79:bf81/64 scope link 2023-10-19T08:39:40.124 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:39:40.124 INFO:teuthology.orchestra.run.smithi079.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-19T08:39:40.124 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 6e:3a:af:29:74:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-19T08:39:40.124 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::6c3a:afff:fe29:7406/64 scope link 2023-10-19T08:39:40.124 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:39:40.125 INFO:teuthology.orchestra.run.smithi079.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-19T08:39:40.125 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether fa:77:93:00:db:9f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-19T08:39:40.125 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::f877:93ff:fe00:db9f/64 scope link 2023-10-19T08:39:40.125 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:39:40.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:40.126 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-19T08:39:40.184 INFO:teuthology.orchestra.run.smithi079.stdout:1 2023-10-19T08:39:40.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:40.185 DEBUG:teuthology.orchestra.run.smithi079:> route 2023-10-19T08:39:40.245 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2023-10-19T08:39:40.246 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-19T08:39:40.246 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-19T08:39:40.246 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-19T08:39:40.246 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-19T08:39:40.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:40.247 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec bash -c ' 2023-10-19T08:39:40.248 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2023-10-19T08:39:40.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-19T08:39:40.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-19T08:39:40.249 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-19T08:39:40.249 DEBUG:teuthology.orchestra.run.smithi079:> ') 2023-10-19T08:39:40.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:40.351 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-19T08:39:40.368 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-19T08:39:40.368 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-19T08:39:40.368 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-19T08:39:40.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:40.369 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2023-10-19T08:39:40.434 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-19T08:39:40.435 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-19T08:39:40.435 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-19T08:39:40.491 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-19T08:39:40.491 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-19T08:39:40.492 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-19T08:39:40.547 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2023-10-19T08:39:40.613 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-19T08:39:40.614 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-19T08:39:40.680 INFO:teuthology.orchestra.run.smithi079.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-19T08:39:40.680 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-19T08:39:40.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:40.682 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2023-10-19T08:39:40.739 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-19T08:39:40.739 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-19T08:39:40.781 DEBUG:teuthology.orchestra.run.smithi079:> sudo modprobe fuse 2023-10-19T08:39:40.807 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-19T08:39:40.808 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-19T08:39:40.869 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:2023-10-19T08:39:40.866+0000 7f42528b65c0 -1 init, newargv = 0x557208f99f40 newargc=15 2023-10-19T08:39:40.870 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[124427]: starting ceph client 2023-10-19T08:39:40.874 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi079.stderr:ceph-fuse[124427]: starting fuse 2023-10-19T08:39:40.876 INFO:teuthology.orchestra.run.smithi079.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-19T08:39:40.877 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-19T08:39:40.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:40.879 DEBUG:teuthology.orchestra.run.smithi079:> ls /sys/fs/fuse/connections 2023-10-19T08:39:40.934 INFO:teuthology.orchestra.run.smithi079.stdout:46 2023-10-19T08:39:40.935 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-19T08:39:40.935 DEBUG:teuthology.orchestra.run.smithi079:> sudo stdin-killer -- python3 -c ' 2023-10-19T08:39:40.936 DEBUG:teuthology.orchestra.run.smithi079:> import glob 2023-10-19T08:39:40.936 DEBUG:teuthology.orchestra.run.smithi079:> import re 2023-10-19T08:39:40.937 DEBUG:teuthology.orchestra.run.smithi079:> import os 2023-10-19T08:39:40.937 DEBUG:teuthology.orchestra.run.smithi079:> import subprocess 2023-10-19T08:39:40.937 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-19T08:39:40.938 DEBUG:teuthology.orchestra.run.smithi079:> def _find_admin_socket(client_name): 2023-10-19T08:39:40.938 DEBUG:teuthology.orchestra.run.smithi079:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-19T08:39:40.939 DEBUG:teuthology.orchestra.run.smithi079:> files = glob.glob(asok_path) 2023-10-19T08:39:40.939 DEBUG:teuthology.orchestra.run.smithi079:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-19T08:39:40.939 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-19T08:39:40.940 DEBUG:teuthology.orchestra.run.smithi079:> # Given a non-glob path, it better be there 2023-10-19T08:39:40.940 DEBUG:teuthology.orchestra.run.smithi079:> if "*" not in asok_path: 2023-10-19T08:39:40.940 DEBUG:teuthology.orchestra.run.smithi079:> assert(len(files) == 1) 2023-10-19T08:39:40.941 DEBUG:teuthology.orchestra.run.smithi079:> return files[0] 2023-10-19T08:39:40.941 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-19T08:39:40.942 DEBUG:teuthology.orchestra.run.smithi079:> for f in files: 2023-10-19T08:39:40.942 DEBUG:teuthology.orchestra.run.smithi079:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-19T08:39:40.942 DEBUG:teuthology.orchestra.run.smithi079:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-19T08:39:40.943 DEBUG:teuthology.orchestra.run.smithi079:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-19T08:39:40.943 DEBUG:teuthology.orchestra.run.smithi079:> contents = proc_f.read() 2023-10-19T08:39:40.943 DEBUG:teuthology.orchestra.run.smithi079:> if mountpoint in contents: 2023-10-19T08:39:40.944 DEBUG:teuthology.orchestra.run.smithi079:> return f 2023-10-19T08:39:40.944 DEBUG:teuthology.orchestra.run.smithi079:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-19T08:39:40.945 DEBUG:teuthology.orchestra.run.smithi079:> 2023-10-19T08:39:40.946 DEBUG:teuthology.orchestra.run.smithi079:> print(_find_admin_socket("client.0")) 2023-10-19T08:39:40.947 DEBUG:teuthology.orchestra.run.smithi079:> ' 2023-10-19T08:39:41.057 INFO:teuthology.orchestra.run.smithi079.stdout:/var/run/ceph/ceph-client.0.124427.asok 2023-10-19T08:39:41.060 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-19T08:39:41.067 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.124427.asok 2023-10-19T08:39:41.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:41.068 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.124427.asok status 2023-10-19T08:39:41.222 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2023-10-19T08:39:41.223 INFO:teuthology.orchestra.run.smithi079.stdout: "metadata": { 2023-10-19T08:39:41.223 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_sha1": "6f3e6b48891b9b50415c0822b6b870797fcda16d", 2023-10-19T08:39:41.223 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 18.0.0-5610-g6f3e6b48 (6f3e6b48891b9b50415c0822b6b870797fcda16d) reef (dev)", 2023-10-19T08:39:41.223 INFO:teuthology.orchestra.run.smithi079.stdout: "entity_id": "0", 2023-10-19T08:39:41.224 INFO:teuthology.orchestra.run.smithi079.stdout: "hostname": "smithi079", 2023-10-19T08:39:41.224 INFO:teuthology.orchestra.run.smithi079.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-19T08:39:41.224 INFO:teuthology.orchestra.run.smithi079.stdout: "pid": "124427", 2023-10-19T08:39:41.224 INFO:teuthology.orchestra.run.smithi079.stdout: "root": "/" 2023-10-19T08:39:41.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:41.225 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_count": 0, 2023-10-19T08:39:41.225 INFO:teuthology.orchestra.run.smithi079.stdout: "dentry_pinned_count": 0, 2023-10-19T08:39:41.225 INFO:teuthology.orchestra.run.smithi079.stdout: "id": 5946, 2023-10-19T08:39:41.225 INFO:teuthology.orchestra.run.smithi079.stdout: "inst": { 2023-10-19T08:39:41.225 INFO:teuthology.orchestra.run.smithi079.stdout: "name": { 2023-10-19T08:39:41.226 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "client", 2023-10-19T08:39:41.226 INFO:teuthology.orchestra.run.smithi079.stdout: "num": 5946 2023-10-19T08:39:41.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:41.226 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2023-10-19T08:39:41.226 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-19T08:39:41.227 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2023-10-19T08:39:41.227 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1564072164 2023-10-19T08:39:41.227 INFO:teuthology.orchestra.run.smithi079.stdout: } 2023-10-19T08:39:41.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:41.227 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": { 2023-10-19T08:39:41.228 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2023-10-19T08:39:41.228 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "192.168.0.1:0", 2023-10-19T08:39:41.228 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1564072164 2023-10-19T08:39:41.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2023-10-19T08:39:41.228 INFO:teuthology.orchestra.run.smithi079.stdout: "inst_str": "client.5946 192.168.0.1:0/1564072164", 2023-10-19T08:39:41.229 INFO:teuthology.orchestra.run.smithi079.stdout: "addr_str": "192.168.0.1:0/1564072164", 2023-10-19T08:39:41.229 INFO:teuthology.orchestra.run.smithi079.stdout: "inode_count": 1, 2023-10-19T08:39:41.229 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_epoch": 18, 2023-10-19T08:39:41.229 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch": 39, 2023-10-19T08:39:41.229 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_epoch_barrier": 0, 2023-10-19T08:39:41.229 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklisted": false, 2023-10-19T08:39:41.230 INFO:teuthology.orchestra.run.smithi079.stdout: "fs_name": "cephfs" 2023-10-19T08:39:41.230 INFO:teuthology.orchestra.run.smithi079.stdout:} 2023-10-19T08:39:41.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:41.232 DEBUG:teuthology.orchestra.run.smithi079:> stat --file-system '--printf=%T 2023-10-19T08:39:41.233 DEBUG:teuthology.orchestra.run.smithi079:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-19T08:39:41.249 INFO:teuthology.orchestra.run.smithi079.stdout:fuseblk 2023-10-19T08:39:41.250 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-19T08:39:41.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:41.250 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-19T08:39:41.318 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-19T08:39:41.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.474+0000 7f120016e700 1 Processor -- start 2023-10-19T08:39:41.478 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.474+0000 7f120016e700 1 -- start start 2023-10-19T08:39:41.480 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.475+0000 7f120016e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f11f8159f40 0x7f11f815e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:41.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.475+0000 7f120016e700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f815e870 con 0x7f11f80b5610 2023-10-19T08:39:41.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.475+0000 7f120016e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f80b5aa0 con 0x7f11f80cf710 2023-10-19T08:39:41.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.475+0000 7f120016e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f80cd800 con 0x7f11f8159f40 2023-10-19T08:39:41.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.475+0000 7f11fd709700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f11f80b5610 0x7f11f80cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59270/0 (socket says 172.21.15.79:59270) 2023-10-19T08:39:41.481 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.475+0000 7f11fd709700 1 -- 172.21.15.79:0/454659202 learned_addr learned my addr 172.21.15.79:0/454659202 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:41.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.475+0000 7f11fdf0a700 1 --2- 172.21.15.79:0/454659202 >> v2:172.21.15.89:3300/0 conn(0x7f11f8159f40 0x7f11f815e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:41.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.476+0000 7f11fcf08700 1 -- 172.21.15.79:0/454659202 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059967827 0 0) 0x7f11f815e870 con 0x7f11f80b5610 2023-10-19T08:39:41.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.476+0000 7f11fcf08700 1 -- 172.21.15.79:0/454659202 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11e40035b0 con 0x7f11f80b5610 2023-10-19T08:39:41.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.476+0000 7f11fdf0a700 1 -- 172.21.15.79:0/454659202 >> v1:172.21.15.89:6789/0 conn(0x7f11f80cf710 legacy=0x7f11f80cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:41.482 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.476+0000 7f11fcf08700 1 -- 172.21.15.79:0/454659202 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730570714 0 0) 0x7f11f80b5aa0 con 0x7f11f80cf710 2023-10-19T08:39:41.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.476+0000 7f11fdf0a700 1 -- 172.21.15.79:0/454659202 >> v1:172.21.15.79:6789/0 conn(0x7f11f80b5610 legacy=0x7f11f80cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:41.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.476+0000 7f11fdf0a700 1 -- 172.21.15.79:0/454659202 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f80cdae0 con 0x7f11f8159f40 2023-10-19T08:39:41.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.476+0000 7f11fdf0a700 1 --2- 172.21.15.79:0/454659202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11f8159f40 0x7f11f815e330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009840 tx=0x7f11e8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ca688ee6037fc42 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:41.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.476+0000 7f11fcf08700 1 -- 172.21.15.79:0/454659202 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8004230 con 0x7f11f8159f40 2023-10-19T08:39:41.483 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.476+0000 7f11fcf08700 1 -- 172.21.15.79:0/454659202 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e8004390 con 0x7f11f8159f40 2023-10-19T08:39:41.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.476+0000 7f11fcf08700 1 -- 172.21.15.79:0/454659202 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e80036a0 con 0x7f11f8159f40 2023-10-19T08:39:41.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.477+0000 7f120016e700 1 -- 172.21.15.79:0/454659202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11f8159f40 msgr2=0x7f11f815e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:41.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.477+0000 7f120016e700 1 --2- 172.21.15.79:0/454659202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11f8159f40 0x7f11f815e330 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009840 tx=0x7f11e8009b50 comp rx=0 tx=0).stop 2023-10-19T08:39:41.484 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.477+0000 7f120016e700 1 -- 172.21.15.79:0/454659202 shutdown_connections 2023-10-19T08:39:41.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.477+0000 7f120016e700 1 --2- 172.21.15.79:0/454659202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11f8159f40 0x7f11f815e330 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:41.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.477+0000 7f120016e700 1 -- 172.21.15.79:0/454659202 >> 172.21.15.79:0/454659202 conn(0x7f11f806dcc0 msgr2=0x7f11f806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:41.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.477+0000 7f120016e700 1 -- 172.21.15.79:0/454659202 shutdown_connections 2023-10-19T08:39:41.485 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.477+0000 7f120016e700 1 -- 172.21.15.79:0/454659202 wait complete. 2023-10-19T08:39:41.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.478+0000 7f120016e700 1 Processor -- start 2023-10-19T08:39:41.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.478+0000 7f120016e700 1 -- start start 2023-10-19T08:39:41.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f120016e700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f80cf710 0x7f11f814d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:41.488 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f120016e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11f8159f40 0x7f11f80cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:41.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f120016e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11f814dba0 0x7f11f80cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:41.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f120016e700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f815a3c0 con 0x7f11f80cf710 2023-10-19T08:39:41.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f120016e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f8153d10 con 0x7f11f8159f40 2023-10-19T08:39:41.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f120016e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f8153ff0 con 0x7f11f814dba0 2023-10-19T08:39:41.489 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f11fdf0a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f80cf710 0x7f11f814d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:41.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f11fdf0a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f80cf710 0x7f11f814d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49204/0 (socket says 172.21.15.79:49204) 2023-10-19T08:39:41.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f11fdf0a700 1 -- 172.21.15.79:0/2706030139 learned_addr learned my addr 172.21.15.79:0/2706030139 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:41.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f11fd709700 1 --2- 172.21.15.79:0/2706030139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11f8159f40 0x7f11f80cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:41.490 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f11fe70b700 1 --2- 172.21.15.79:0/2706030139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11f814dba0 0x7f11f80cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:41.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f11fdf0a700 1 -- 172.21.15.79:0/2706030139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11f814dba0 msgr2=0x7f11f80cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:41.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f11fdf0a700 1 --2- 172.21.15.79:0/2706030139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11f814dba0 0x7f11f80cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:41.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f11fdf0a700 1 -- 172.21.15.79:0/2706030139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11f8159f40 msgr2=0x7f11f80cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:41.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f11fdf0a700 1 --2- 172.21.15.79:0/2706030139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11f8159f40 0x7f11f80cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:41.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f11fdf0a700 1 -- 172.21.15.79:0/2706030139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e80094a0 con 0x7f11f80cf710 2023-10-19T08:39:41.491 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f11fe70b700 1 --2- 172.21.15.79:0/2706030139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11f814dba0 0x7f11f80cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:41.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f11fd709700 1 --2- 172.21.15.79:0/2706030139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11f8159f40 0x7f11f80cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-19T08:39:41.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f11fdf0a700 1 --2- 172.21.15.79:0/2706030139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f80cf710 0x7f11f814d3c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009b90 tx=0x7f11e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:41.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f11ee7fc700 1 -- 172.21.15.79:0/2706030139 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8003d50 con 0x7f11f80cf710 2023-10-19T08:39:41.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f11ee7fc700 1 -- 172.21.15.79:0/2706030139 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e801f070 con 0x7f11f80cf710 2023-10-19T08:39:41.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f11ee7fc700 1 -- 172.21.15.79:0/2706030139 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8011870 con 0x7f11f80cf710 2023-10-19T08:39:41.492 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f120016e700 1 -- 172.21.15.79:0/2706030139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f81542d0 con 0x7f11f80cf710 2023-10-19T08:39:41.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.479+0000 7f120016e700 1 -- 172.21.15.79:0/2706030139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f814d900 con 0x7f11f80cf710 2023-10-19T08:39:41.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.480+0000 7f120016e700 1 -- 172.21.15.79:0/2706030139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f815a870 con 0x7f11f80cf710 2023-10-19T08:39:41.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.481+0000 7f11ee7fc700 1 -- 172.21.15.79:0/2706030139 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f11e8021030 con 0x7f11f80cf710 2023-10-19T08:39:41.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.481+0000 7f11ee7fc700 1 --2- 172.21.15.79:0/2706030139 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f11dc06a0e0 0x7f11dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:41.493 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.481+0000 7f11ee7fc700 1 -- 172.21.15.79:0/2706030139 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f11e80899e0 con 0x7f11f80cf710 2023-10-19T08:39:41.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.481+0000 7f11fd709700 1 --2- 172.21.15.79:0/2706030139 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f11dc06a0e0 0x7f11dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:41.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.482+0000 7f11fd709700 1 --2- 172.21.15.79:0/2706030139 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f11dc06a0e0 0x7f11dc06c5a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f11f814e760 tx=0x7f11f4009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:41.494 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.486+0000 7f11ee7fc700 1 -- 172.21.15.79:0/2706030139 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f11f815a870 con 0x7f11f80cf710 2023-10-19T08:39:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.717+0000 7f120016e700 1 -- 172.21.15.79:0/2706030139 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f11f804ee70 con 0x7f11f80cf710 2023-10-19T08:39:41.721 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.717+0000 7f11ee7fc700 1 -- 172.21.15.79:0/2706030139 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f11e8055020 con 0x7f11f80cf710 2023-10-19T08:39:41.721 INFO:teuthology.orchestra.run.smithi079.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-19T08:39:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.719+0000 7f120016e700 1 -- 172.21.15.79:0/2706030139 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f11dc06a0e0 msgr2=0x7f11dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.719+0000 7f120016e700 1 --2- 172.21.15.79:0/2706030139 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f11dc06a0e0 0x7f11dc06c5a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f11f814e760 tx=0x7f11f4009040 comp rx=0 tx=0).stop 2023-10-19T08:39:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.719+0000 7f120016e700 1 -- 172.21.15.79:0/2706030139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f80cf710 msgr2=0x7f11f814d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:41.723 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.719+0000 7f120016e700 1 --2- 172.21.15.79:0/2706030139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f80cf710 0x7f11f814d3c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009b90 tx=0x7f11e8004750 comp rx=0 tx=0).stop 2023-10-19T08:39:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.719+0000 7f120016e700 1 -- 172.21.15.79:0/2706030139 shutdown_connections 2023-10-19T08:39:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.719+0000 7f120016e700 1 --2- 172.21.15.79:0/2706030139 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f11dc06a0e0 0x7f11dc06c5a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:41.724 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.719+0000 7f120016e700 1 --2- 172.21.15.79:0/2706030139 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11f814dba0 0x7f11f80cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.719+0000 7f120016e700 1 --2- 172.21.15.79:0/2706030139 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11f80cf710 0x7f11f814d3c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.719+0000 7f120016e700 1 --2- 172.21.15.79:0/2706030139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11f8159f40 0x7f11f80cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.719+0000 7f120016e700 1 -- 172.21.15.79:0/2706030139 >> 172.21.15.79:0/2706030139 conn(0x7f11f806dcc0 msgr2=0x7f11f80b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.719+0000 7f120016e700 1 -- 172.21.15.79:0/2706030139 shutdown_connections 2023-10-19T08:39:41.725 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:41.719+0000 7f120016e700 1 -- 172.21.15.79:0/2706030139 wait complete. 2023-10-19T08:39:41.734 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-19T08:39:41.735 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-19T08:39:41.735 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-10-19T08:39:41.735 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-19T08:39:41.736 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-19T08:39:41.736 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-19T08:39:41.736 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-19T08:39:41.737 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-19T08:39:41.738 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-19T08:39:41.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:41.739 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-10-19T08:39:41.760 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-19T08:39:41.760 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-19T08:39:41.760 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-10-19T08:39:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:39:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-10-19T08:39:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:39:41.761 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:39:41.761 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:39:41.762 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:39:41.762 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:39:41.762 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-19T08:39:41.762 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:39:41.762 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-19T08:39:41.763 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:39:41.763 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-19T08:39:41.763 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42330sec preferred_lft 42330sec 2023-10-19T08:39:41.763 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::6fbe:3bb2:e4b5:be20/64 scope link noprefixroute 2023-10-19T08:39:41.763 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:39:41.764 INFO:teuthology.orchestra.run.smithi089.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-19T08:39:41.764 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 02:7b:03:b2:55:52 brd ff:ff:ff:ff:ff:ff 2023-10-19T08:39:41.764 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-19T08:39:41.764 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:39:41.764 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::640f:23ff:fee3:c734/64 scope link 2023-10-19T08:39:41.764 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:39:41.765 INFO:teuthology.orchestra.run.smithi089.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-19T08:39:41.765 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether d6:70:c0:be:56:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-19T08:39:41.765 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::d470:c0ff:febe:5694/64 scope link 2023-10-19T08:39:41.765 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:39:41.765 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-19T08:39:41.766 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 02:7b:03:b2:55:52 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-19T08:39:41.766 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::7b:3ff:feb2:5552/64 scope link 2023-10-19T08:39:41.766 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-10-19T08:39:41.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:41.767 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-19T08:39:41.831 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-10-19T08:39:41.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:41.833 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-10-19T08:39:41.894 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-10-19T08:39:41.894 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-19T08:39:41.894 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-19T08:39:41.895 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-19T08:39:41.895 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-19T08:39:41.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:41.896 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-10-19T08:39:41.897 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-10-19T08:39:41.897 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-19T08:39:41.897 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-19T08:39:41.898 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-19T08:39:41.898 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-10-19T08:39:42.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:42.010 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-19T08:39:42.027 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-19T08:39:42.027 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-19T08:39:42.028 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-19T08:39:42.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:42.029 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-10-19T08:39:42.095 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-19T08:39:42.096 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-19T08:39:42.096 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-19T08:39:42.152 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-19T08:39:42.152 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-19T08:39:42.152 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-19T08:39:42.208 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-19T08:39:42.274 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-19T08:39:42.275 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-19T08:39:42.340 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-19T08:39:42.341 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-19T08:39:42.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:42.343 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-19T08:39:42.400 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-19T08:39:42.400 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-19T08:39:42.442 DEBUG:teuthology.orchestra.run.smithi089:> sudo modprobe fuse 2023-10-19T08:39:42.468 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-19T08:39:42.468 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-19T08:39:42.527 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi089.stderr:2023-10-19T08:39:42.523+0000 7f08bb7885c0 -1 init, newargv = 0x5618a42db970 newargc=15 2023-10-19T08:39:42.527 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi089.stderr:ceph-fuse[112322]: starting ceph client 2023-10-19T08:39:42.532 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi089.stderr:ceph-fuse[112322]: starting fuse 2023-10-19T08:39:42.534 INFO:teuthology.orchestra.run.smithi089.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-19T08:39:42.536 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-19T08:39:42.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:42.537 DEBUG:teuthology.orchestra.run.smithi089:> ls /sys/fs/fuse/connections 2023-10-19T08:39:42.593 INFO:teuthology.orchestra.run.smithi089.stdout:46 2023-10-19T08:39:42.594 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-19T08:39:42.594 DEBUG:teuthology.orchestra.run.smithi089:> sudo stdin-killer -- python3 -c ' 2023-10-19T08:39:42.595 DEBUG:teuthology.orchestra.run.smithi089:> import glob 2023-10-19T08:39:42.596 DEBUG:teuthology.orchestra.run.smithi089:> import re 2023-10-19T08:39:42.596 DEBUG:teuthology.orchestra.run.smithi089:> import os 2023-10-19T08:39:42.596 DEBUG:teuthology.orchestra.run.smithi089:> import subprocess 2023-10-19T08:39:42.597 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-19T08:39:42.598 DEBUG:teuthology.orchestra.run.smithi089:> def _find_admin_socket(client_name): 2023-10-19T08:39:42.598 DEBUG:teuthology.orchestra.run.smithi089:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-19T08:39:42.599 DEBUG:teuthology.orchestra.run.smithi089:> files = glob.glob(asok_path) 2023-10-19T08:39:42.599 DEBUG:teuthology.orchestra.run.smithi089:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-19T08:39:42.600 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-19T08:39:42.600 DEBUG:teuthology.orchestra.run.smithi089:> # Given a non-glob path, it better be there 2023-10-19T08:39:42.600 DEBUG:teuthology.orchestra.run.smithi089:> if "*" not in asok_path: 2023-10-19T08:39:42.601 DEBUG:teuthology.orchestra.run.smithi089:> assert(len(files) == 1) 2023-10-19T08:39:42.601 DEBUG:teuthology.orchestra.run.smithi089:> return files[0] 2023-10-19T08:39:42.602 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-19T08:39:42.602 DEBUG:teuthology.orchestra.run.smithi089:> for f in files: 2023-10-19T08:39:42.602 DEBUG:teuthology.orchestra.run.smithi089:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-19T08:39:42.603 DEBUG:teuthology.orchestra.run.smithi089:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-19T08:39:42.603 DEBUG:teuthology.orchestra.run.smithi089:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-19T08:39:42.603 DEBUG:teuthology.orchestra.run.smithi089:> contents = proc_f.read() 2023-10-19T08:39:42.604 DEBUG:teuthology.orchestra.run.smithi089:> if mountpoint in contents: 2023-10-19T08:39:42.604 DEBUG:teuthology.orchestra.run.smithi089:> return f 2023-10-19T08:39:42.604 DEBUG:teuthology.orchestra.run.smithi089:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-19T08:39:42.605 DEBUG:teuthology.orchestra.run.smithi089:> 2023-10-19T08:39:42.605 DEBUG:teuthology.orchestra.run.smithi089:> print(_find_admin_socket("client.1")) 2023-10-19T08:39:42.606 DEBUG:teuthology.orchestra.run.smithi089:> ' 2023-10-19T08:39:42.715 INFO:teuthology.orchestra.run.smithi089.stdout:/var/run/ceph/ceph-client.1.112322.asok 2023-10-19T08:39:42.718 INFO:teuthology.orchestra.run.smithi089.stderr:2023-10-19T08:39:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-19T08:39:42.725 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.112322.asok 2023-10-19T08:39:42.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:42.726 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.112322.asok status 2023-10-19T08:39:42.880 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2023-10-19T08:39:42.880 INFO:teuthology.orchestra.run.smithi089.stdout: "metadata": { 2023-10-19T08:39:42.881 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_sha1": "6f3e6b48891b9b50415c0822b6b870797fcda16d", 2023-10-19T08:39:42.881 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_version": "ceph version 18.0.0-5610-g6f3e6b48 (6f3e6b48891b9b50415c0822b6b870797fcda16d) reef (dev)", 2023-10-19T08:39:42.881 INFO:teuthology.orchestra.run.smithi089.stdout: "entity_id": "1", 2023-10-19T08:39:42.881 INFO:teuthology.orchestra.run.smithi089.stdout: "hostname": "smithi089", 2023-10-19T08:39:42.881 INFO:teuthology.orchestra.run.smithi089.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-19T08:39:42.882 INFO:teuthology.orchestra.run.smithi089.stdout: "pid": "112322", 2023-10-19T08:39:42.882 INFO:teuthology.orchestra.run.smithi089.stdout: "root": "/" 2023-10-19T08:39:42.882 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-19T08:39:42.882 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_count": 0, 2023-10-19T08:39:42.882 INFO:teuthology.orchestra.run.smithi089.stdout: "dentry_pinned_count": 0, 2023-10-19T08:39:42.882 INFO:teuthology.orchestra.run.smithi089.stdout: "id": 5096, 2023-10-19T08:39:42.883 INFO:teuthology.orchestra.run.smithi089.stdout: "inst": { 2023-10-19T08:39:42.883 INFO:teuthology.orchestra.run.smithi089.stdout: "name": { 2023-10-19T08:39:42.883 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "client", 2023-10-19T08:39:42.883 INFO:teuthology.orchestra.run.smithi089.stdout: "num": 5096 2023-10-19T08:39:42.883 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-19T08:39:42.884 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2023-10-19T08:39:42.884 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2023-10-19T08:39:42.884 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "192.168.0.1:0", 2023-10-19T08:39:42.884 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2754645149 2023-10-19T08:39:42.884 INFO:teuthology.orchestra.run.smithi089.stdout: } 2023-10-19T08:39:42.884 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-19T08:39:42.885 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": { 2023-10-19T08:39:42.885 INFO:teuthology.orchestra.run.smithi089.stdout: "type": "v1", 2023-10-19T08:39:42.885 INFO:teuthology.orchestra.run.smithi089.stdout: "addr": "192.168.0.1:0", 2023-10-19T08:39:42.885 INFO:teuthology.orchestra.run.smithi089.stdout: "nonce": 2754645149 2023-10-19T08:39:42.885 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2023-10-19T08:39:42.885 INFO:teuthology.orchestra.run.smithi089.stdout: "inst_str": "client.5096 192.168.0.1:0/2754645149", 2023-10-19T08:39:42.886 INFO:teuthology.orchestra.run.smithi089.stdout: "addr_str": "192.168.0.1:0/2754645149", 2023-10-19T08:39:42.886 INFO:teuthology.orchestra.run.smithi089.stdout: "inode_count": 1, 2023-10-19T08:39:42.886 INFO:teuthology.orchestra.run.smithi089.stdout: "mds_epoch": 18, 2023-10-19T08:39:42.886 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch": 39, 2023-10-19T08:39:42.886 INFO:teuthology.orchestra.run.smithi089.stdout: "osd_epoch_barrier": 0, 2023-10-19T08:39:42.887 INFO:teuthology.orchestra.run.smithi089.stdout: "blocklisted": false, 2023-10-19T08:39:42.887 INFO:teuthology.orchestra.run.smithi089.stdout: "fs_name": "cephfs" 2023-10-19T08:39:42.887 INFO:teuthology.orchestra.run.smithi089.stdout:} 2023-10-19T08:39:42.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:42.890 DEBUG:teuthology.orchestra.run.smithi089:> stat --file-system '--printf=%T 2023-10-19T08:39:42.891 DEBUG:teuthology.orchestra.run.smithi089:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-19T08:39:42.910 INFO:teuthology.orchestra.run.smithi089.stdout:fuseblk 2023-10-19T08:39:42.910 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-19T08:39:42.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:39:42.911 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-19T08:39:42.976 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-19T08:39:43.109 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.106+0000 7fe799349700 1 Processor -- start 2023-10-19T08:39:43.110 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.106+0000 7fe799349700 1 -- start start 2023-10-19T08:39:43.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe799349700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe7940b2180 0x7fe7940d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.111 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe799349700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7940b5f20 0x7fe7940b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe799349700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7940d1120 con 0x7fe7940cfcf0 2023-10-19T08:39:43.113 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe799349700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7940d1400 con 0x7fe7940b2180 2023-10-19T08:39:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe799349700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7940d16e0 con 0x7fe7940b5f20 2023-10-19T08:39:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe792ffd700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe7940cfcf0 0x7fe7940d00d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59284/0 (socket says 172.21.15.79:59284) 2023-10-19T08:39:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe792ffd700 1 -- 172.21.15.79:0/2623345709 learned_addr learned my addr 172.21.15.79:0/2623345709 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe7937fe700 1 --2- 172.21.15.79:0/2623345709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7940b5f20 0x7fe7940b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe7927fc700 1 --2- 172.21.15.79:0/2623345709 >> v2:172.21.15.89:3300/0 conn(0x7fe7940b2180 0x7fe7940d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.114 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe791ffb700 1 -- 172.21.15.79:0/2623345709 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614339281 0 0) 0x7fe7940d1120 con 0x7fe7940cfcf0 2023-10-19T08:39:43.115 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe791ffb700 1 -- 172.21.15.79:0/2623345709 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe77c0035b0 con 0x7fe7940cfcf0 2023-10-19T08:39:43.120 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe791ffb700 1 -- 172.21.15.79:0/2623345709 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 26858407 0 0) 0x7fe77c0035b0 con 0x7fe7940cfcf0 2023-10-19T08:39:43.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe791ffb700 1 -- 172.21.15.79:0/2623345709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7940b5f20 msgr2=0x7fe7940b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:43.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe791ffb700 1 --2- 172.21.15.79:0/2623345709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7940b5f20 0x7fe7940b63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe791ffb700 1 -- 172.21.15.79:0/2623345709 >> v2:172.21.15.89:3300/0 conn(0x7fe7940b2180 msgr2=0x7fe7940d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:43.121 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe791ffb700 1 --2- 172.21.15.79:0/2623345709 >> v2:172.21.15.89:3300/0 conn(0x7fe7940b2180 0x7fe7940d2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe791ffb700 1 -- 172.21.15.79:0/2623345709 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7940d19c0 con 0x7fe7940cfcf0 2023-10-19T08:39:43.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe791ffb700 1 -- 172.21.15.79:0/2623345709 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7fe788001670 con 0x7fe7940cfcf0 2023-10-19T08:39:43.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe791ffb700 1 -- 172.21.15.79:0/2623345709 >> v1:172.21.15.79:6789/0 conn(0x7fe7940cfcf0 legacy=0x7fe7940d00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:43.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe791ffb700 1 --2- 172.21.15.79:0/2623345709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe77c003a00 0x7fe77c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.122 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe791ffb700 1 --2- 172.21.15.79:0/2623345709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe77c0043f0 0x7fe77c0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe791ffb700 1 --2- 172.21.15.79:0/2623345709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe77c004f40 0x7fe77c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe791ffb700 1 -- 172.21.15.79:0/2623345709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7940d1400 con 0x7fe77c0043f0 2023-10-19T08:39:43.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe791ffb700 1 -- 172.21.15.79:0/2623345709 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7940d16e0 con 0x7fe77c004f40 2023-10-19T08:39:43.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.107+0000 7fe791ffb700 1 -- 172.21.15.79:0/2623345709 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c00bf50 con 0x7fe77c003a00 2023-10-19T08:39:43.123 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.108+0000 7fe7927fc700 1 --2- 172.21.15.79:0/2623345709 >> v2:172.21.15.89:3300/0 conn(0x7fe7940b2180 0x7fe7940d2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:39:43.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.108+0000 7fe7937fe700 1 --2- 172.21.15.79:0/2623345709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe7940b5f20 0x7fe7940b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:39:43.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.108+0000 7fe7927fc700 1 --2- 172.21.15.79:0/2623345709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe77c0043f0 0x7fe77c0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.108+0000 7fe792ffd700 1 --2- 172.21.15.79:0/2623345709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe77c003a00 0x7fe77c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.108+0000 7fe7937fe700 1 --2- 172.21.15.79:0/2623345709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe77c004f40 0x7fe77c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.124 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.108+0000 7fe7927fc700 1 -- 172.21.15.79:0/2623345709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe77c003a00 msgr2=0x7fe77c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:43.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.108+0000 7fe7927fc700 1 --2- 172.21.15.79:0/2623345709 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe77c003a00 0x7fe77c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.108+0000 7fe7927fc700 1 -- 172.21.15.79:0/2623345709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe77c004f40 msgr2=0x7fe77c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:43.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.108+0000 7fe7927fc700 1 --2- 172.21.15.79:0/2623345709 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe77c004f40 0x7fe77c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.108+0000 7fe7927fc700 1 -- 172.21.15.79:0/2623345709 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c0035b0 con 0x7fe77c0043f0 2023-10-19T08:39:43.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.108+0000 7fe7927fc700 1 --2- 172.21.15.79:0/2623345709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe77c0043f0 0x7fe77c0048d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe784009d40 tx=0x7fe77c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7a0df65c6dec09 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:43.125 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.108+0000 7fe791ffb700 1 -- 172.21.15.79:0/2623345709 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe784009e90 con 0x7fe77c0043f0 2023-10-19T08:39:43.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.108+0000 7fe791ffb700 1 -- 172.21.15.79:0/2623345709 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78400e9a0 con 0x7fe77c0043f0 2023-10-19T08:39:43.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.108+0000 7fe791ffb700 1 -- 172.21.15.79:0/2623345709 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78400ed10 con 0x7fe77c0043f0 2023-10-19T08:39:43.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.109+0000 7fe799349700 1 -- 172.21.15.79:0/2623345709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe77c0043f0 msgr2=0x7fe77c0048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:43.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.109+0000 7fe799349700 1 --2- 172.21.15.79:0/2623345709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe77c0043f0 0x7fe77c0048d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe784009d40 tx=0x7fe77c005880 comp rx=0 tx=0).stop 2023-10-19T08:39:43.126 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.109+0000 7fe7937fe700 1 -- 172.21.15.79:0/2623345709 reap_dead start 2023-10-19T08:39:43.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.109+0000 7fe799349700 1 -- 172.21.15.79:0/2623345709 shutdown_connections 2023-10-19T08:39:43.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.109+0000 7fe799349700 1 -- 172.21.15.79:0/2623345709 >> 172.21.15.79:0/2623345709 conn(0x7fe794071b30 msgr2=0x7fe794071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:43.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.109+0000 7fe799349700 1 -- 172.21.15.79:0/2623345709 shutdown_connections 2023-10-19T08:39:43.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.109+0000 7fe799349700 1 -- 172.21.15.79:0/2623345709 wait complete. 2023-10-19T08:39:43.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.110+0000 7fe799349700 1 Processor -- start 2023-10-19T08:39:43.127 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.110+0000 7fe799349700 1 -- start start 2023-10-19T08:39:43.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.111+0000 7fe799349700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe77c0043f0 0x7fe79415a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.111+0000 7fe799349700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe79415a570 0x7fe794156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.111+0000 7fe799349700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe794157280 0x7fe7940a9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.111+0000 7fe799349700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79415f040 con 0x7fe794157280 2023-10-19T08:39:43.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.111+0000 7fe799349700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7941576e0 con 0x7fe77c0043f0 2023-10-19T08:39:43.128 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.111+0000 7fe799349700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79415e4c0 con 0x7fe79415a570 2023-10-19T08:39:43.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.111+0000 7fe7937fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe794157280 0x7fe7940a9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.111+0000 7fe7937fe700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe794157280 0x7fe7940a9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49228/0 (socket says 172.21.15.79:49228) 2023-10-19T08:39:43.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.111+0000 7fe7937fe700 1 -- 172.21.15.79:0/2352490857 learned_addr learned my addr 172.21.15.79:0/2352490857 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:43.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.111+0000 7fe7927fc700 1 --2- 172.21.15.79:0/2352490857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe79415a570 0x7fe794156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.129 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.111+0000 7fe792ffd700 1 --2- 172.21.15.79:0/2352490857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe77c0043f0 0x7fe79415a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.111+0000 7fe7937fe700 1 -- 172.21.15.79:0/2352490857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe79415a570 msgr2=0x7fe794156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:43.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.111+0000 7fe7937fe700 1 --2- 172.21.15.79:0/2352490857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe79415a570 0x7fe794156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.111+0000 7fe7937fe700 1 -- 172.21.15.79:0/2352490857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe77c0043f0 msgr2=0x7fe79415a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:43.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.111+0000 7fe7937fe700 1 --2- 172.21.15.79:0/2352490857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe77c0043f0 0x7fe79415a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.130 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.111+0000 7fe7937fe700 1 -- 172.21.15.79:0/2352490857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79415e7a0 con 0x7fe794157280 2023-10-19T08:39:43.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.111+0000 7fe792ffd700 1 --2- 172.21.15.79:0/2352490857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe77c0043f0 0x7fe79415a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:43.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.111+0000 7fe7937fe700 1 --2- 172.21.15.79:0/2352490857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe794157280 0x7fe7940a9c70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe7940d09f0 tx=0x7fe78c00f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:43.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.112+0000 7fe77b7fe700 1 -- 172.21.15.79:0/2352490857 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00e040 con 0x7fe794157280 2023-10-19T08:39:43.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.112+0000 7fe77b7fe700 1 -- 172.21.15.79:0/2352490857 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c00f040 con 0x7fe794157280 2023-10-19T08:39:43.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.112+0000 7fe799349700 1 -- 172.21.15.79:0/2352490857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79415ea80 con 0x7fe794157280 2023-10-19T08:39:43.131 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.112+0000 7fe77b7fe700 1 -- 172.21.15.79:0/2352490857 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c003c60 con 0x7fe794157280 2023-10-19T08:39:43.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.112+0000 7fe799349700 1 -- 172.21.15.79:0/2352490857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe794160560 con 0x7fe794157280 2023-10-19T08:39:43.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.112+0000 7fe799349700 1 -- 172.21.15.79:0/2352490857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79404ee70 con 0x7fe794157280 2023-10-19T08:39:43.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.113+0000 7fe77b7fe700 1 -- 172.21.15.79:0/2352490857 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe78c004030 con 0x7fe794157280 2023-10-19T08:39:43.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.113+0000 7fe77b7fe700 1 --2- 172.21.15.79:0/2352490857 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe78006a0e0 0x7fe78006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.132 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.114+0000 7fe77b7fe700 1 -- 172.21.15.79:0/2352490857 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe78c088580 con 0x7fe794157280 2023-10-19T08:39:43.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.114+0000 7fe792ffd700 1 --2- 172.21.15.79:0/2352490857 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe78006a0e0 0x7fe78006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.114+0000 7fe792ffd700 1 --2- 172.21.15.79:0/2352490857 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe78006a0e0 0x7fe78006c5a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe788000c00 tx=0x7fe788009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:43.133 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.118+0000 7fe77b7fe700 1 -- 172.21.15.79:0/2352490857 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fe78c053a90 con 0x7fe794157280 2023-10-19T08:39:43.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.350+0000 7fe799349700 1 -- 172.21.15.79:0/2352490857 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7940b2660 con 0x7fe794157280 2023-10-19T08:39:43.354 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.351+0000 7fe77b7fe700 1 -- 172.21.15.79:0/2352490857 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4872 (secure 0 0 0) 0x7fe78c0570b0 con 0x7fe794157280 2023-10-19T08:39:43.355 INFO:teuthology.orchestra.run.smithi079.stdout: 2023-10-19T08:39:43.355 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5296,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6834/2135698128","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":2135698128},{"type":"v1","addr":"172.21.15.89:6834","nonce":2135698128}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5299,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/3306148048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6833","nonce":3306148048},{"type":"v1","addr":"172.21.15.89:6835","nonce":3306148048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6836/3876408658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6835","nonce":3876408658},{"type":"v1","addr":"172.21.15.79:6836","nonce":3876408658}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-19T08:39:33.202270+0000","modified":"2023-10-19T08:39:36.817728+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5736},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5736":{"gid":5736,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6837/594110949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":594110949},{"type":"v1","addr":"172.21.15.79:6837","nonce":594110949}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-19T08:39:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.353+0000 7fe799349700 1 -- 172.21.15.79:0/2352490857 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe78006a0e0 msgr2=0x7fe78006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:43.356 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.353+0000 7fe799349700 1 --2- 172.21.15.79:0/2352490857 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe78006a0e0 0x7fe78006c5a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe788000c00 tx=0x7fe788009040 comp rx=0 tx=0).stop 2023-10-19T08:39:43.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.353+0000 7fe799349700 1 -- 172.21.15.79:0/2352490857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe794157280 msgr2=0x7fe7940a9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:43.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.353+0000 7fe799349700 1 --2- 172.21.15.79:0/2352490857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe794157280 0x7fe7940a9c70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe7940d09f0 tx=0x7fe78c00f770 comp rx=0 tx=0).stop 2023-10-19T08:39:43.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.353+0000 7fe799349700 1 -- 172.21.15.79:0/2352490857 shutdown_connections 2023-10-19T08:39:43.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.353+0000 7fe799349700 1 --2- 172.21.15.79:0/2352490857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe794157280 0x7fe7940a9c70 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.357 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.353+0000 7fe799349700 1 --2- 172.21.15.79:0/2352490857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe77c0043f0 0x7fe79415a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.353+0000 7fe799349700 1 --2- 172.21.15.79:0/2352490857 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fe78006a0e0 0x7fe78006c5a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.353+0000 7fe799349700 1 --2- 172.21.15.79:0/2352490857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe79415a570 0x7fe794156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.353+0000 7fe799349700 1 -- 172.21.15.79:0/2352490857 >> 172.21.15.79:0/2352490857 conn(0x7fe794071b30 msgr2=0x7fe7940d2010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:43.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.353+0000 7fe799349700 1 -- 172.21.15.79:0/2352490857 shutdown_connections 2023-10-19T08:39:43.358 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.353+0000 7fe799349700 1 -- 172.21.15.79:0/2352490857 wait complete. 2023-10-19T08:39:43.359 INFO:teuthology.orchestra.run.smithi079.stderr:dumped fsmap epoch 18 2023-10-19T08:39:43.368 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_defer_session_stale false 2023-10-19T08:39:43.507 INFO:teuthology.orchestra.run.smithi079.stdout:{"success":"mds_defer_session_stale = 'false' (not observed, change may require restart) "} 2023-10-19T08:39:43.508 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_defer_session_stale = 'false' (not observed, change may require restart) " } 2023-10-19T08:39:43.508 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds defer_client_eviction_on_laggy_osds true 2023-10-19T08:39:43.632 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.629+0000 7f6693824700 1 Processor -- start 2023-10-19T08:39:43.633 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.629+0000 7f6693824700 1 -- start start 2023-10-19T08:39:43.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.630+0000 7f6693824700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f668c0cd270 0x7f668c06a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.636 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.630+0000 7f6693824700 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668c161a90 con 0x7f668c0703b0 2023-10-19T08:39:43.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.630+0000 7f6693824700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668c0b1fe0 con 0x7f668c0cc2a0 2023-10-19T08:39:43.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.630+0000 7f6693824700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668c160a80 con 0x7f668c0cd270 2023-10-19T08:39:43.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.630+0000 7f6690dbf700 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f668c0703b0 0x7f668c160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:59306/0 (socket says 172.21.15.79:59306) 2023-10-19T08:39:43.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.630+0000 7f6690dbf700 1 -- 172.21.15.79:0/4008316606 learned_addr learned my addr 172.21.15.79:0/4008316606 (peer_addr_for_me v1:172.21.15.79:0/0) 2023-10-19T08:39:43.637 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.630+0000 7f66915c0700 1 --2- 172.21.15.79:0/4008316606 >> v2:172.21.15.89:3300/0 conn(0x7f668c0cd270 0x7f668c06a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.630+0000 7f6683fff700 1 -- 172.21.15.79:0/4008316606 <== mon.0 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256254015 0 0) 0x7f668c161a90 con 0x7f668c0703b0 2023-10-19T08:39:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.630+0000 7f6683fff700 1 -- 172.21.15.79:0/4008316606 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66780035b0 con 0x7f668c0703b0 2023-10-19T08:39:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.630+0000 7f6683fff700 1 -- 172.21.15.79:0/4008316606 <== mon.0 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2828776953 0 0) 0x7f66780035b0 con 0x7f668c0703b0 2023-10-19T08:39:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.630+0000 7f6683fff700 1 -- 172.21.15.79:0/4008316606 >> v2:172.21.15.89:3300/0 conn(0x7f668c0cd270 msgr2=0x7f668c06a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:43.638 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.630+0000 7f6683fff700 1 --2- 172.21.15.79:0/4008316606 >> v2:172.21.15.89:3300/0 conn(0x7f668c0cd270 0x7f668c06a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.630+0000 7f6683fff700 1 -- 172.21.15.79:0/4008316606 >> v1:172.21.15.89:6789/0 conn(0x7f668c0cc2a0 legacy=0x7f668c161380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.630+0000 7f6683fff700 1 -- 172.21.15.79:0/4008316606 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c0ce2b0 con 0x7f668c0703b0 2023-10-19T08:39:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.630+0000 7f6683fff700 1 -- 172.21.15.79:0/4008316606 <== mon.0 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1862692248 0 0) 0x7f667c001670 con 0x7f668c0703b0 2023-10-19T08:39:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.630+0000 7f6683fff700 1 -- 172.21.15.79:0/4008316606 >> v1:172.21.15.79:6789/0 conn(0x7f668c0703b0 legacy=0x7f668c160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:43.639 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.630+0000 7f6683fff700 1 --2- 172.21.15.79:0/4008316606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6678003a70 0x7f6678003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.630+0000 7f6683fff700 1 --2- 172.21.15.79:0/4008316606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6678004850 0x7f6678004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.631+0000 7f6683fff700 1 --2- 172.21.15.79:0/4008316606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6678005210 0x7f667800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.631+0000 7f6683fff700 1 -- 172.21.15.79:0/4008316606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c160a80 con 0x7f6678005210 2023-10-19T08:39:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.631+0000 7f6683fff700 1 -- 172.21.15.79:0/4008316606 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667800c140 con 0x7f6678004850 2023-10-19T08:39:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.631+0000 7f6683fff700 1 -- 172.21.15.79:0/4008316606 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667800c300 con 0x7f6678003a70 2023-10-19T08:39:43.640 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.631+0000 7f6691dc1700 1 --2- 172.21.15.79:0/4008316606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6678005210 0x7f667800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.631+0000 7f6690dbf700 1 --2- 172.21.15.79:0/4008316606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6678004850 0x7f6678004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.631+0000 7f66915c0700 1 --2- 172.21.15.79:0/4008316606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6678003a70 0x7f6678003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.631+0000 7f6691dc1700 1 -- 172.21.15.79:0/4008316606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6678003a70 msgr2=0x7f6678003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:43.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.631+0000 7f6691dc1700 1 --2- 172.21.15.79:0/4008316606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6678003a70 0x7f6678003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.631+0000 7f6691dc1700 1 -- 172.21.15.79:0/4008316606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6678004850 msgr2=0x7f6678004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:43.641 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.631+0000 7f6691dc1700 1 --2- 172.21.15.79:0/4008316606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6678004850 0x7f6678004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.631+0000 7f6691dc1700 1 -- 172.21.15.79:0/4008316606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66780035b0 con 0x7f6678005210 2023-10-19T08:39:43.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.631+0000 7f6690dbf700 1 --2- 172.21.15.79:0/4008316606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6678004850 0x7f6678004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-19T08:39:43.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.631+0000 7f66915c0700 1 --2- 172.21.15.79:0/4008316606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6678003a70 0x7f6678003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:43.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.631+0000 7f6691dc1700 1 -- 172.21.15.79:0/4008316606 reap_dead start 2023-10-19T08:39:43.642 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.631+0000 7f6691dc1700 1 --2- 172.21.15.79:0/4008316606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6678005210 0x7f667800ba10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f668400c190 tx=0x7f6678005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35ec14a365078c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:43.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.631+0000 7f6683fff700 1 -- 172.21.15.79:0/4008316606 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684001db0 con 0x7f6678005210 2023-10-19T08:39:43.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.631+0000 7f6683fff700 1 -- 172.21.15.79:0/4008316606 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668400ccf0 con 0x7f6678005210 2023-10-19T08:39:43.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.631+0000 7f6683fff700 1 -- 172.21.15.79:0/4008316606 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684003c40 con 0x7f6678005210 2023-10-19T08:39:43.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.632+0000 7f6693824700 1 -- 172.21.15.79:0/4008316606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6678005210 msgr2=0x7f667800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:43.643 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.632+0000 7f6693824700 1 --2- 172.21.15.79:0/4008316606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6678005210 0x7f667800ba10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f668400c190 tx=0x7f6678005880 comp rx=0 tx=0).stop 2023-10-19T08:39:43.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.632+0000 7f6693824700 1 -- 172.21.15.79:0/4008316606 shutdown_connections 2023-10-19T08:39:43.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.632+0000 7f6693824700 1 --2- 172.21.15.79:0/4008316606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6678005210 0x7f667800ba10 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.632+0000 7f6693824700 1 -- 172.21.15.79:0/4008316606 >> 172.21.15.79:0/4008316606 conn(0x7f668c06dcc0 msgr2=0x7f668c06e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:43.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.632+0000 7f6693824700 1 -- 172.21.15.79:0/4008316606 shutdown_connections 2023-10-19T08:39:43.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.632+0000 7f6693824700 1 -- 172.21.15.79:0/4008316606 wait complete. 2023-10-19T08:39:43.644 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.633+0000 7f6693824700 1 Processor -- start 2023-10-19T08:39:43.645 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.633+0000 7f6693824700 1 -- start start 2023-10-19T08:39:43.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6693824700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6678005210 0x7f668c0c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.647 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6693824700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f668c0c6d00 0x7f668c0c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6693824700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f668c15d9a0 0x7f668c0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6693824700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c0c8770 con 0x7f668c0c6d00 2023-10-19T08:39:43.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6693824700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668c0c7190 con 0x7f668c15d9a0 2023-10-19T08:39:43.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6693824700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668c0c7470 con 0x7f6678005210 2023-10-19T08:39:43.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6690dbf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f668c0c6d00 0x7f668c0c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.648 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6690dbf700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f668c0c6d00 0x7f668c0c9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49246/0 (socket says 172.21.15.79:49246) 2023-10-19T08:39:43.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6690dbf700 1 -- 172.21.15.79:0/3106650572 learned_addr learned my addr 172.21.15.79:0/3106650572 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:43.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f66915c0700 1 --2- 172.21.15.79:0/3106650572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6678005210 0x7f668c0c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6691dc1700 1 --2- 172.21.15.79:0/3106650572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f668c15d9a0 0x7f668c0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6690dbf700 1 -- 172.21.15.79:0/3106650572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6678005210 msgr2=0x7f668c0c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:43.649 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6690dbf700 1 --2- 172.21.15.79:0/3106650572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6678005210 0x7f668c0c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6690dbf700 1 -- 172.21.15.79:0/3106650572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f668c15d9a0 msgr2=0x7f668c0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:43.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6690dbf700 1 --2- 172.21.15.79:0/3106650572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f668c15d9a0 0x7f668c0ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6690dbf700 1 -- 172.21.15.79:0/3106650572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c0c7750 con 0x7f668c0c6d00 2023-10-19T08:39:43.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6690dbf700 1 --2- 172.21.15.79:0/3106650572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f668c0c6d00 0x7f668c0c9400 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f667c007fd0 tx=0x7f667c007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:43.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6681ffb700 1 -- 172.21.15.79:0/3106650572 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c00f820 con 0x7f668c0c6d00 2023-10-19T08:39:43.650 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6681ffb700 1 -- 172.21.15.79:0/3106650572 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c00f980 con 0x7f668c0c6d00 2023-10-19T08:39:43.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6693824700 1 -- 172.21.15.79:0/3106650572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f668c0c7a30 con 0x7f668c0c6d00 2023-10-19T08:39:43.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.634+0000 7f6681ffb700 1 -- 172.21.15.79:0/3106650572 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c00fd30 con 0x7f668c0c6d00 2023-10-19T08:39:43.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.635+0000 7f6693824700 1 -- 172.21.15.79:0/3106650572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668c0c9940 con 0x7f668c0c6d00 2023-10-19T08:39:43.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.636+0000 7f6693824700 1 -- 172.21.15.79:0/3106650572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668c0c7f50 con 0x7f668c0c6d00 2023-10-19T08:39:43.651 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.636+0000 7f6681ffb700 1 -- 172.21.15.79:0/3106650572 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f667c01d460 con 0x7f668c0c6d00 2023-10-19T08:39:43.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.636+0000 7f6681ffb700 1 --2- 172.21.15.79:0/3106650572 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f667006a0e0 0x7f667006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.636+0000 7f6681ffb700 1 -- 172.21.15.79:0/3106650572 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f667c088840 con 0x7f668c0c6d00 2023-10-19T08:39:43.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.636+0000 7f66915c0700 1 --2- 172.21.15.79:0/3106650572 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f667006a0e0 0x7f667006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.637+0000 7f66915c0700 1 --2- 172.21.15.79:0/3106650572 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f667006a0e0 0x7f667006c5a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6688009a90 tx=0x7f6688008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:43.652 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.641+0000 7f6681ffb700 1 -- 172.21.15.79:0/3106650572 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7f668c0c7f50 con 0x7f668c0c6d00 2023-10-19T08:39:43.832 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.829+0000 7f6693824700 1 -- 172.21.15.79:0/3106650572 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=defer_client_eviction_on_laggy_osds}] v 0) v1 -- 0x7f668c0c7f50 con 0x7f668c0c6d00 2023-10-19T08:39:43.836 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.832+0000 7f6681ffb700 1 -- 172.21.15.79:0/3106650572 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=defer_client_eviction_on_laggy_osds}]=0 v11)=0 v11) v1 ==== 136+0+0 (secure 0 0 0) 0x7f668c0c7f50 con 0x7f668c0c6d00 2023-10-19T08:39:43.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.835+0000 7f6693824700 1 -- 172.21.15.79:0/3106650572 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f667006a0e0 msgr2=0x7f667006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:43.838 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.835+0000 7f6693824700 1 --2- 172.21.15.79:0/3106650572 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f667006a0e0 0x7f667006c5a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6688009a90 tx=0x7f6688008040 comp rx=0 tx=0).stop 2023-10-19T08:39:43.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.835+0000 7f6693824700 1 -- 172.21.15.79:0/3106650572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f668c0c6d00 msgr2=0x7f668c0c9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:43.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.835+0000 7f6693824700 1 --2- 172.21.15.79:0/3106650572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f668c0c6d00 0x7f668c0c9400 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f667c007fd0 tx=0x7f667c007c50 comp rx=0 tx=0).stop 2023-10-19T08:39:43.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.835+0000 7f6693824700 1 -- 172.21.15.79:0/3106650572 shutdown_connections 2023-10-19T08:39:43.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.835+0000 7f6693824700 1 --2- 172.21.15.79:0/3106650572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f668c15d9a0 0x7f668c0ad0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.839 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.835+0000 7f6693824700 1 --2- 172.21.15.79:0/3106650572 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7f667006a0e0 0x7f667006c5a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.835+0000 7f6693824700 1 --2- 172.21.15.79:0/3106650572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6678005210 0x7f668c0c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.835+0000 7f6693824700 1 --2- 172.21.15.79:0/3106650572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f668c0c6d00 0x7f668c0c9400 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.835+0000 7f6693824700 1 -- 172.21.15.79:0/3106650572 >> 172.21.15.79:0/3106650572 conn(0x7f668c06dcc0 msgr2=0x7f668c0ca5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:43.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.835+0000 7f6693824700 1 -- 172.21.15.79:0/3106650572 shutdown_connections 2023-10-19T08:39:43.840 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.835+0000 7f6693824700 1 -- 172.21.15.79:0/3106650572 wait complete. 2023-10-19T08:39:43.850 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds defer_client_eviction_on_laggy_osds 2023-10-19T08:39:43.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.968+0000 7fc26bfad700 1 Processor -- start 2023-10-19T08:39:43.971 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.968+0000 7fc26bfad700 1 -- start start 2023-10-19T08:39:43.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.969+0000 7fc26bfad700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc26415ce90 0x7fc26415df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.974 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.969+0000 7fc26bfad700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc26406a220 0x7fc26406a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.969+0000 7fc26bfad700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2640cc870 0x7fc2640ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.969+0000 7fc26bfad700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26406abf0 con 0x7fc26406a220 2023-10-19T08:39:43.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.969+0000 7fc26bfad700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc264070670 con 0x7fc26415ce90 2023-10-19T08:39:43.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.969+0000 7fc26bfad700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26406faf0 con 0x7fc2640cc870 2023-10-19T08:39:43.975 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.969+0000 7fc269548700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc26406a220 0x7fc26406a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.969+0000 7fc269548700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc26406a220 0x7fc26406a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49256/0 (socket says 172.21.15.79:49256) 2023-10-19T08:39:43.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.969+0000 7fc269548700 1 -- 172.21.15.79:0/3180317024 learned_addr learned my addr 172.21.15.79:0/3180317024 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:43.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.969+0000 7fc26a54a700 1 --2- 172.21.15.79:0/3180317024 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2640cc870 0x7fc2640ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.969+0000 7fc269d49700 1 --2- 172.21.15.79:0/3180317024 >> v2:172.21.15.89:3300/0 conn(0x7fc26415ce90 0x7fc26415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.976 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.969+0000 7fc269548700 1 -- 172.21.15.79:0/3180317024 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2640cc870 msgr2=0x7fc2640ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:43.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.969+0000 7fc269548700 1 --2- 172.21.15.79:0/3180317024 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2640cc870 0x7fc2640ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.969+0000 7fc269548700 1 -- 172.21.15.79:0/3180317024 >> v2:172.21.15.89:3300/0 conn(0x7fc26415ce90 msgr2=0x7fc26415df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:43.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.969+0000 7fc269548700 1 --2- 172.21.15.79:0/3180317024 >> v2:172.21.15.89:3300/0 conn(0x7fc26415ce90 0x7fc26415df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.969+0000 7fc269548700 1 -- 172.21.15.79:0/3180317024 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26406fdd0 con 0x7fc26406a220 2023-10-19T08:39:43.977 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.969+0000 7fc269548700 1 --2- 172.21.15.79:0/3180317024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26406a220 0x7fc26406a6b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fc2640cd770 tx=0x7fc254009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890a445a5df469c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:43.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.969+0000 7fc268d47700 1 -- 172.21.15.79:0/3180317024 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25400b870 con 0x7fc26406a220 2023-10-19T08:39:43.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.969+0000 7fc268d47700 1 -- 172.21.15.79:0/3180317024 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25400b9d0 con 0x7fc26406a220 2023-10-19T08:39:43.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.970+0000 7fc268d47700 1 -- 172.21.15.79:0/3180317024 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25400bd60 con 0x7fc26406a220 2023-10-19T08:39:43.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.970+0000 7fc26bfad700 1 -- 172.21.15.79:0/3180317024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26406a220 msgr2=0x7fc26406a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:43.978 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.970+0000 7fc26bfad700 1 --2- 172.21.15.79:0/3180317024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26406a220 0x7fc26406a6b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fc2640cd770 tx=0x7fc254009bd0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.970+0000 7fc26bfad700 1 -- 172.21.15.79:0/3180317024 shutdown_connections 2023-10-19T08:39:43.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.970+0000 7fc26bfad700 1 --2- 172.21.15.79:0/3180317024 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2640cc870 0x7fc2640ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.970+0000 7fc26bfad700 1 --2- 172.21.15.79:0/3180317024 >> v2:172.21.15.89:3300/0 conn(0x7fc26415ce90 0x7fc26415df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.970+0000 7fc26bfad700 1 --2- 172.21.15.79:0/3180317024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26406a220 0x7fc26406a6b0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.979 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.970+0000 7fc26bfad700 1 -- 172.21.15.79:0/3180317024 >> 172.21.15.79:0/3180317024 conn(0x7fc26406dce0 msgr2=0x7fc26406e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:43.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.970+0000 7fc26bfad700 1 -- 172.21.15.79:0/3180317024 shutdown_connections 2023-10-19T08:39:43.980 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.970+0000 7fc26bfad700 1 -- 172.21.15.79:0/3180317024 wait complete. 2023-10-19T08:39:43.982 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.971+0000 7fc26bfad700 1 Processor -- start 2023-10-19T08:39:43.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.971+0000 7fc26bfad700 1 -- start start 2023-10-19T08:39:43.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.972+0000 7fc26bfad700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc26406a220 0x7fc2640b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.972+0000 7fc26bfad700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2640cc870 0x7fc2641f6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.972+0000 7fc26bfad700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26415ce90 0x7fc26414ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.983 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.972+0000 7fc26bfad700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2641f5e30 con 0x7fc26415ce90 2023-10-19T08:39:43.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.972+0000 7fc26bfad700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc26414b7e0 con 0x7fc26406a220 2023-10-19T08:39:43.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.972+0000 7fc26bfad700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc26414bac0 con 0x7fc2640cc870 2023-10-19T08:39:43.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.972+0000 7fc26a54a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26415ce90 0x7fc26414ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.972+0000 7fc26a54a700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26415ce90 0x7fc26414ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49260/0 (socket says 172.21.15.79:49260) 2023-10-19T08:39:43.984 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.972+0000 7fc26a54a700 1 -- 172.21.15.79:0/719521398 learned_addr learned my addr 172.21.15.79:0/719521398 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:43.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.972+0000 7fc269d49700 1 --2- 172.21.15.79:0/719521398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc26406a220 0x7fc2640b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.972+0000 7fc269548700 1 --2- 172.21.15.79:0/719521398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2640cc870 0x7fc2641f6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.972+0000 7fc26a54a700 1 -- 172.21.15.79:0/719521398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2640cc870 msgr2=0x7fc2641f6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:43.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.972+0000 7fc26a54a700 1 --2- 172.21.15.79:0/719521398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2640cc870 0x7fc2641f6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.985 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.972+0000 7fc26a54a700 1 -- 172.21.15.79:0/719521398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc26406a220 msgr2=0x7fc2640b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:43.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.972+0000 7fc26a54a700 1 --2- 172.21.15.79:0/719521398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc26406a220 0x7fc2640b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:43.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.972+0000 7fc26a54a700 1 -- 172.21.15.79:0/719521398 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc254009550 con 0x7fc26415ce90 2023-10-19T08:39:43.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.973+0000 7fc26a54a700 1 --2- 172.21.15.79:0/719521398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26415ce90 0x7fc26414ad50 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc25c007e40 tx=0x7fc25c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:43.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.973+0000 7fc25a7fc700 1 -- 172.21.15.79:0/719521398 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c00ed30 con 0x7fc26415ce90 2023-10-19T08:39:43.986 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.973+0000 7fc25a7fc700 1 -- 172.21.15.79:0/719521398 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25c014420 con 0x7fc26415ce90 2023-10-19T08:39:43.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.973+0000 7fc26bfad700 1 -- 172.21.15.79:0/719521398 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2641f60f0 con 0x7fc26415ce90 2023-10-19T08:39:43.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.973+0000 7fc25a7fc700 1 -- 172.21.15.79:0/719521398 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc25c0147d0 con 0x7fc26415ce90 2023-10-19T08:39:43.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.973+0000 7fc26bfad700 1 -- 172.21.15.79:0/719521398 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc26414ef30 con 0x7fc26415ce90 2023-10-19T08:39:43.987 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.974+0000 7fc26bfad700 1 -- 172.21.15.79:0/719521398 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2641f6330 con 0x7fc26415ce90 2023-10-19T08:39:43.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.974+0000 7fc25a7fc700 1 -- 172.21.15.79:0/719521398 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc25c014930 con 0x7fc26415ce90 2023-10-19T08:39:43.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.974+0000 7fc25a7fc700 1 --2- 172.21.15.79:0/719521398 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc24806a0e0 0x7fc24806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:43.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.975+0000 7fc25a7fc700 1 -- 172.21.15.79:0/719521398 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc25c088cb0 con 0x7fc26415ce90 2023-10-19T08:39:43.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.975+0000 7fc269d49700 1 --2- 172.21.15.79:0/719521398 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc24806a0e0 0x7fc24806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:43.988 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.975+0000 7fc269d49700 1 --2- 172.21.15.79:0/719521398 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc24806a0e0 0x7fc24806c5a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc260006b20 tx=0x7fc260008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:43.989 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:43.979+0000 7fc25a7fc700 1 -- 172.21.15.79:0/719521398 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7fc2641f6330 con 0x7fc26415ce90 2023-10-19T08:39:44.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.171+0000 7fc26bfad700 1 -- 172.21.15.79:0/719521398 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "defer_client_eviction_on_laggy_osds"} v 0) v1 -- 0x7fc2641f6330 con 0x7fc26415ce90 2023-10-19T08:39:44.175 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.171+0000 7fc25a7fc700 1 -- 172.21.15.79:0/719521398 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "defer_client_eviction_on_laggy_osds"}]=0 v11) v1 ==== 118+0+5 (secure 0 0 0) 0x7fc2641f6330 con 0x7fc26415ce90 2023-10-19T08:39:44.175 INFO:teuthology.orchestra.run.smithi079.stdout:true 2023-10-19T08:39:44.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.173+0000 7fc26bfad700 1 -- 172.21.15.79:0/719521398 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc24806a0e0 msgr2=0x7fc24806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:44.177 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.173+0000 7fc26bfad700 1 --2- 172.21.15.79:0/719521398 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc24806a0e0 0x7fc24806c5a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc260006b20 tx=0x7fc260008040 comp rx=0 tx=0).stop 2023-10-19T08:39:44.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.173+0000 7fc26bfad700 1 -- 172.21.15.79:0/719521398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26415ce90 msgr2=0x7fc26414ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:44.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.173+0000 7fc26bfad700 1 --2- 172.21.15.79:0/719521398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26415ce90 0x7fc26414ad50 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fc25c007e40 tx=0x7fc25c00e3c0 comp rx=0 tx=0).stop 2023-10-19T08:39:44.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.173+0000 7fc26bfad700 1 -- 172.21.15.79:0/719521398 shutdown_connections 2023-10-19T08:39:44.178 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.173+0000 7fc26bfad700 1 --2- 172.21.15.79:0/719521398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc26415ce90 0x7fc26414ad50 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:44.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.173+0000 7fc26bfad700 1 --2- 172.21.15.79:0/719521398 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc26406a220 0x7fc2640b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:44.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.173+0000 7fc26bfad700 1 --2- 172.21.15.79:0/719521398 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7fc24806a0e0 0x7fc24806c5a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:44.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.173+0000 7fc26bfad700 1 --2- 172.21.15.79:0/719521398 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc2640cc870 0x7fc2641f6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:44.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.173+0000 7fc26bfad700 1 -- 172.21.15.79:0/719521398 >> 172.21.15.79:0/719521398 conn(0x7fc26406dce0 msgr2=0x7fc2640ce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:44.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.174+0000 7fc26bfad700 1 -- 172.21.15.79:0/719521398 shutdown_connections 2023-10-19T08:39:44.179 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.174+0000 7fc26bfad700 1 -- 172.21.15.79:0/719521398 wait complete. 2023-10-19T08:39:44.189 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2023-10-19T08:39:44.308 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.305+0000 7ff81d83d700 1 Processor -- start 2023-10-19T08:39:44.309 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.305+0000 7ff81d83d700 1 -- start start 2023-10-19T08:39:44.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.306+0000 7ff81d83d700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff8180cfcf0 0x7ff8180d00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:44.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.306+0000 7ff81d83d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff8180b2180 0x7ff8180d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:44.311 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.306+0000 7ff81d83d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8180d0610 con 0x7ff8180d2eb0 2023-10-19T08:39:44.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.306+0000 7ff81d83d700 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8180d1120 con 0x7ff8180cfcf0 2023-10-19T08:39:44.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.306+0000 7ff81d83d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8180d1400 con 0x7ff8180b2180 2023-10-19T08:39:44.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.306+0000 7ff816ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff8180cfcf0 0x7ff8180d00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:44.312 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.306+0000 7ff816ffd700 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff8180cfcf0 0x7ff8180d00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49266/0 (socket says 172.21.15.79:49266) 2023-10-19T08:39:44.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.306+0000 7ff816ffd700 1 -- 172.21.15.79:0/2172867104 learned_addr learned my addr 172.21.15.79:0/2172867104 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:44.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.306+0000 7ff8167fc700 1 --2- 172.21.15.79:0/2172867104 >> v2:172.21.15.89:3300/0 conn(0x7ff8180b2180 0x7ff8180d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:44.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.306+0000 7ff816ffd700 1 -- 172.21.15.79:0/2172867104 >> v2:172.21.15.89:3300/0 conn(0x7ff8180b2180 msgr2=0x7ff8180d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-19T08:39:44.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.306+0000 7ff816ffd700 1 --2- 172.21.15.79:0/2172867104 >> v2:172.21.15.89:3300/0 conn(0x7ff8180b2180 0x7ff8180d2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:44.313 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.306+0000 7ff816ffd700 1 -- 172.21.15.79:0/2172867104 >> v1:172.21.15.89:6789/0 conn(0x7ff8180d2eb0 legacy=0x7ff8180d3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:44.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.306+0000 7ff816ffd700 1 -- 172.21.15.79:0/2172867104 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8180d16e0 con 0x7ff8180cfcf0 2023-10-19T08:39:44.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.306+0000 7ff816ffd700 1 --2- 172.21.15.79:0/2172867104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8180cfcf0 0x7ff8180d00d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff8180d09d0 tx=0x7ff80c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b156d81533aff82a server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:44.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.307+0000 7ff815ffb700 1 -- 172.21.15.79:0/2172867104 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c011830 con 0x7ff8180cfcf0 2023-10-19T08:39:44.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.307+0000 7ff815ffb700 1 -- 172.21.15.79:0/2172867104 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80c011990 con 0x7ff8180cfcf0 2023-10-19T08:39:44.314 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.307+0000 7ff815ffb700 1 -- 172.21.15.79:0/2172867104 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80c011d20 con 0x7ff8180cfcf0 2023-10-19T08:39:44.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.307+0000 7ff81d83d700 1 -- 172.21.15.79:0/2172867104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8180cfcf0 msgr2=0x7ff8180d00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:44.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.307+0000 7ff81d83d700 1 --2- 172.21.15.79:0/2172867104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8180cfcf0 0x7ff8180d00d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff8180d09d0 tx=0x7ff80c009bd0 comp rx=0 tx=0).stop 2023-10-19T08:39:44.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.307+0000 7ff81d83d700 1 -- 172.21.15.79:0/2172867104 shutdown_connections 2023-10-19T08:39:44.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.307+0000 7ff81d83d700 1 --2- 172.21.15.79:0/2172867104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8180cfcf0 0x7ff8180d00d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:44.315 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.307+0000 7ff81d83d700 1 --2- 172.21.15.79:0/2172867104 >> v2:172.21.15.89:3300/0 conn(0x7ff8180b2180 0x7ff8180d2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:44.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.307+0000 7ff81d83d700 1 -- 172.21.15.79:0/2172867104 >> 172.21.15.79:0/2172867104 conn(0x7ff818071b30 msgr2=0x7ff818071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:44.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.307+0000 7ff81d83d700 1 -- 172.21.15.79:0/2172867104 shutdown_connections 2023-10-19T08:39:44.316 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.307+0000 7ff81d83d700 1 -- 172.21.15.79:0/2172867104 wait complete. 2023-10-19T08:39:44.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.308+0000 7ff81d83d700 1 Processor -- start 2023-10-19T08:39:44.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.308+0000 7ff81d83d700 1 -- start start 2023-10-19T08:39:44.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.309+0000 7ff81d83d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8180b2180 0x7ff8181f48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:44.319 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.309+0000 7ff81d83d700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8180cfcf0 0x7ff81815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:44.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.309+0000 7ff81d83d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8180d2eb0 0x7ff8180aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:44.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.309+0000 7ff81d83d700 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8181f4e10 con 0x7ff8180cfcf0 2023-10-19T08:39:44.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.309+0000 7ff81d83d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8181f50e0 con 0x7ff8180d2eb0 2023-10-19T08:39:44.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.309+0000 7ff81d83d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8181f53c0 con 0x7ff8180b2180 2023-10-19T08:39:44.320 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.309+0000 7ff8167fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8180cfcf0 0x7ff81815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:44.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.309+0000 7ff8167fc700 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8180cfcf0 0x7ff81815a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:49272/0 (socket says 172.21.15.79:49272) 2023-10-19T08:39:44.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.309+0000 7ff8167fc700 1 -- 172.21.15.79:0/4113873257 learned_addr learned my addr 172.21.15.79:0/4113873257 (peer_addr_for_me v2:172.21.15.79:0/0) 2023-10-19T08:39:44.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.309+0000 7ff8177fe700 1 --2- 172.21.15.79:0/4113873257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8180d2eb0 0x7ff8180aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:44.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.309+0000 7ff816ffd700 1 --2- 172.21.15.79:0/4113873257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8180b2180 0x7ff8181f48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:44.321 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.309+0000 7ff8167fc700 1 -- 172.21.15.79:0/4113873257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8180b2180 msgr2=0x7ff8181f48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:44.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.309+0000 7ff8167fc700 1 --2- 172.21.15.79:0/4113873257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8180b2180 0x7ff8181f48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:44.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.309+0000 7ff8167fc700 1 -- 172.21.15.79:0/4113873257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8180d2eb0 msgr2=0x7ff8180aa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:44.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.309+0000 7ff8167fc700 1 --2- 172.21.15.79:0/4113873257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8180d2eb0 0x7ff8180aa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:44.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.310+0000 7ff8167fc700 1 -- 172.21.15.79:0/4113873257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c009550 con 0x7ff8180cfcf0 2023-10-19T08:39:44.322 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.310+0000 7ff816ffd700 1 --2- 172.21.15.79:0/4113873257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8180b2180 0x7ff8181f48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-19T08:39:44.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.310+0000 7ff8167fc700 1 --2- 172.21.15.79:0/4113873257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8180cfcf0 0x7ff81815a5c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff80800e9b0 tx=0x7ff80800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:44.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.310+0000 7ff7fffff700 1 -- 172.21.15.79:0/4113873257 <== mon.0 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff808009710 con 0x7ff8180cfcf0 2023-10-19T08:39:44.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.310+0000 7ff7fffff700 1 -- 172.21.15.79:0/4113873257 <== mon.0 v2:172.21.15.79:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80800c850 con 0x7ff8180cfcf0 2023-10-19T08:39:44.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.310+0000 7ff7fffff700 1 -- 172.21.15.79:0/4113873257 <== mon.0 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80800cbc0 con 0x7ff8180cfcf0 2023-10-19T08:39:44.323 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.310+0000 7ff81d83d700 1 -- 172.21.15.79:0/4113873257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8181f56a0 con 0x7ff8180cfcf0 2023-10-19T08:39:44.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.310+0000 7ff81d83d700 1 -- 172.21.15.79:0/4113873257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff81815ab00 con 0x7ff8180cfcf0 2023-10-19T08:39:44.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.311+0000 7ff81d83d700 1 -- 172.21.15.79:0/4113873257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff81804ee70 con 0x7ff8180cfcf0 2023-10-19T08:39:44.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.311+0000 7ff7fffff700 1 -- 172.21.15.79:0/4113873257 <== mon.0 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff80800cd20 con 0x7ff8180cfcf0 2023-10-19T08:39:44.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.311+0000 7ff7fffff700 1 --2- 172.21.15.79:0/4113873257 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff80406a0e0 0x7ff80406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-19T08:39:44.324 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.312+0000 7ff7fffff700 1 -- 172.21.15.79:0/4113873257 <== mon.0 v2:172.21.15.79:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff808088a10 con 0x7ff8180cfcf0 2023-10-19T08:39:44.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.312+0000 7ff816ffd700 1 --2- 172.21.15.79:0/4113873257 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff80406a0e0 0x7ff80406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-19T08:39:44.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.312+0000 7ff816ffd700 1 --2- 172.21.15.79:0/4113873257 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff80406a0e0 0x7ff80406c5a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009c10 tx=0x7ff80c008030 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-19T08:39:44.325 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.316+0000 7ff7fffff700 1 -- 172.21.15.79:0/4113873257 <== mon.0 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178480 (secure 0 0 0) 0x7ff808054050 con 0x7ff8180cfcf0 2023-10-19T08:39:44.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.512+0000 7ff81d83d700 1 -- 172.21.15.79:0/4113873257 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7ff818160960 con 0x7ff8180cfcf0 2023-10-19T08:39:44.516 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.513+0000 7ff7fffff700 1 -- 172.21.15.79:0/4113873257 <== mon.0 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v40) v1 ==== 56+0+3482 (secure 0 0 0) 0x7ff808017db0 con 0x7ff8180cfcf0 2023-10-19T08:39:44.517 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 40 2023-10-19T08:39:44.517 INFO:teuthology.orchestra.run.smithi079.stdout:fsid 98eaa3c1-94c8-49a6-8b8d-caae2bee3a98 2023-10-19T08:39:44.517 INFO:teuthology.orchestra.run.smithi079.stdout:created 2023-10-19T08:37:37.523150+0000 2023-10-19T08:39:44.517 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2023-10-19T08:39:44.318362+0000 2023-10-19T08:39:44.518 INFO:teuthology.orchestra.run.smithi079.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-10-19T08:39:44.518 INFO:teuthology.orchestra.run.smithi079.stdout:crush_version 5 2023-10-19T08:39:44.518 INFO:teuthology.orchestra.run.smithi079.stdout:full_ratio 0.95 2023-10-19T08:39:44.518 INFO:teuthology.orchestra.run.smithi079.stdout:backfillfull_ratio 0.9 2023-10-19T08:39:44.518 INFO:teuthology.orchestra.run.smithi079.stdout:nearfull_ratio 0.85 2023-10-19T08:39:44.519 INFO:teuthology.orchestra.run.smithi079.stdout:require_min_compat_client luminous 2023-10-19T08:39:44.519 INFO:teuthology.orchestra.run.smithi079.stdout:min_compat_client luminous 2023-10-19T08:39:44.519 INFO:teuthology.orchestra.run.smithi079.stdout:require_osd_release reef 2023-10-19T08:39:44.519 INFO:teuthology.orchestra.run.smithi079.stdout:stretch_mode_enabled false 2023-10-19T08:39:44.519 INFO:teuthology.orchestra.run.smithi079.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2023-10-19T08:39:44.520 INFO:teuthology.orchestra.run.smithi079.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 application rbd read_balance_score 1.99 2023-10-19T08:39:44.520 INFO:teuthology.orchestra.run.smithi079.stdout:pool 6 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 38 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.75 2023-10-19T08:39:44.520 INFO:teuthology.orchestra.run.smithi079.stdout:pool 7 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 39 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.63 2023-10-19T08:39:44.520 INFO:teuthology.orchestra.run.smithi079.stdout:max_osd 8 2023-10-19T08:39:44.521 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 up in weight 1 up_from 13 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6800/942045489,v1:172.21.15.79:6801/942045489] [v2:172.21.15.79:6803/942045489,v1:172.21.15.79:6805/942045489] exists,up 8fc732cf-6693-47af-b4fa-58f49d64d4b7 2023-10-19T08:39:44.521 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 up in weight 1 up_from 13 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6816/2397905014,v1:172.21.15.79:6818/2397905014] [v2:172.21.15.79:6820/2397905014,v1:172.21.15.79:6822/2397905014] exists,up 3df762c5-6cab-4019-84af-5d38457c64f2 2023-10-19T08:39:44.521 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 up in weight 1 up_from 13 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6802/184279381,v1:172.21.15.79:6804/184279381] [v2:172.21.15.79:6806/184279381,v1:172.21.15.79:6808/184279381] exists,up c263a092-506b-4051-bd17-c7082ab857e5 2023-10-19T08:39:44.521 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 up in weight 1 up_from 13 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6817/3593161836,v1:172.21.15.79:6819/3593161836] [v2:172.21.15.79:6821/3593161836,v1:172.21.15.79:6823/3593161836] exists,up 0e13ba18-f5ea-4162-9665-4bf965b07b49 2023-10-19T08:39:44.521 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 up in weight 1 up_from 13 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6808/1735906914,v1:172.21.15.89:6809/1735906914] [v2:172.21.15.89:6810/1735906914,v1:172.21.15.89:6811/1735906914] exists,up 98bd5f90-96c8-4ab8-9905-892af9c61de3 2023-10-19T08:39:44.522 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 up in weight 1 up_from 13 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6816/4289815223,v1:172.21.15.89:6817/4289815223] [v2:172.21.15.89:6818/4289815223,v1:172.21.15.89:6819/4289815223] exists,up 34a448aa-ee32-4915-9c76-968440526e50 2023-10-19T08:39:44.522 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6 up in weight 1 up_from 13 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6800/1904262341,v1:172.21.15.89:6801/1904262341] [v2:172.21.15.89:6802/1904262341,v1:172.21.15.89:6803/1904262341] exists,up 2f526ed0-57ba-44b2-9d4c-d07c5700b0e4 2023-10-19T08:39:44.522 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7 up in weight 1 up_from 13 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6824/3325999642,v1:172.21.15.89:6825/3325999642] [v2:172.21.15.89:6826/3325999642,v1:172.21.15.89:6827/3325999642] exists,up d0001967-3981-4ebe-8dfb-aa38db091f0d 2023-10-19T08:39:44.522 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 7.16 [0,5] 2023-10-19T08:39:44.522 INFO:teuthology.orchestra.run.smithi079.stdout:pg_upmap_items 7.18 [0,4] 2023-10-19T08:39:44.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.515+0000 7ff81d83d700 1 -- 172.21.15.79:0/4113873257 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff80406a0e0 msgr2=0x7ff80406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:44.523 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.515+0000 7ff81d83d700 1 --2- 172.21.15.79:0/4113873257 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff80406a0e0 0x7ff80406c5a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009c10 tx=0x7ff80c008030 comp rx=0 tx=0).stop 2023-10-19T08:39:44.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.515+0000 7ff81d83d700 1 -- 172.21.15.79:0/4113873257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8180cfcf0 msgr2=0x7ff81815a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-19T08:39:44.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.515+0000 7ff81d83d700 1 --2- 172.21.15.79:0/4113873257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8180cfcf0 0x7ff81815a5c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff80800e9b0 tx=0x7ff80800ecc0 comp rx=0 tx=0).stop 2023-10-19T08:39:44.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.515+0000 7ff81d83d700 1 -- 172.21.15.79:0/4113873257 shutdown_connections 2023-10-19T08:39:44.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.515+0000 7ff81d83d700 1 --2- 172.21.15.79:0/4113873257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8180d2eb0 0x7ff8180aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:44.524 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.515+0000 7ff81d83d700 1 --2- 172.21.15.79:0/4113873257 >> [v2:172.21.15.79:6832/316135984,v1:172.21.15.79:6833/316135984] conn(0x7ff80406a0e0 0x7ff80406c5a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:44.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.515+0000 7ff81d83d700 1 --2- 172.21.15.79:0/4113873257 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8180b2180 0x7ff8181f48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:44.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.515+0000 7ff81d83d700 1 --2- 172.21.15.79:0/4113873257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8180cfcf0 0x7ff81815a5c0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-19T08:39:44.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.515+0000 7ff81d83d700 1 -- 172.21.15.79:0/4113873257 >> 172.21.15.79:0/4113873257 conn(0x7ff818071b30 msgr2=0x7ff8180d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-19T08:39:44.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.516+0000 7ff81d83d700 1 -- 172.21.15.79:0/4113873257 shutdown_connections 2023-10-19T08:39:44.525 INFO:teuthology.orchestra.run.smithi079.stderr:2023-10-19T08:39:44.516+0000 7ff81d83d700 1 -- 172.21.15.79:0/4113873257 wait complete. 2023-10-19T08:39:44.531 INFO:tasks.cephfs.filesystem.ceph_manager:['osd.0 up in weight 1 up_from 13 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6800/942045489,v1:172.21.15.79:6801/942045489] [v2:172.21.15.79:6803/942045489,v1:172.21.15.79:6805/942045489] exists,up 8fc732cf-6693-47af-b4fa-58f49d64d4b7', 'osd.1 up in weight 1 up_from 13 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6816/2397905014,v1:172.21.15.79:6818/2397905014] [v2:172.21.15.79:6820/2397905014,v1:172.21.15.79:6822/2397905014] exists,up 3df762c5-6cab-4019-84af-5d38457c64f2', 'osd.2 up in weight 1 up_from 13 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6802/184279381,v1:172.21.15.79:6804/184279381] [v2:172.21.15.79:6806/184279381,v1:172.21.15.79:6808/184279381] exists,up c263a092-506b-4051-bd17-c7082ab857e5', 'osd.3 up in weight 1 up_from 13 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6817/3593161836,v1:172.21.15.79:6819/3593161836] [v2:172.21.15.79:6821/3593161836,v1:172.21.15.79:6823/3593161836] exists,up 0e13ba18-f5ea-4162-9665-4bf965b07b49', 'osd.4 up in weight 1 up_from 13 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6808/1735906914,v1:172.21.15.89:6809/1735906914] [v2:172.21.15.89:6810/1735906914,v1:172.21.15.89:6811/1735906914] exists,up 98bd5f90-96c8-4ab8-9905-892af9c61de3', 'osd.5 up in weight 1 up_from 13 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6816/4289815223,v1:172.21.15.89:6817/4289815223] [v2:172.21.15.89:6818/4289815223,v1:172.21.15.89:6819/4289815223] exists,up 34a448aa-ee32-4915-9c76-968440526e50', 'osd.6 up in weight 1 up_from 13 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6800/1904262341,v1:172.21.15.89:6801/1904262341] [v2:172.21.15.89:6802/1904262341,v1:172.21.15.89:6803/1904262341] exists,up 2f526ed0-57ba-44b2-9d4c-d07c5700b0e4', 'osd.7 up in weight 1 up_from 13 up_thru 37 down_at 0 last_clean_interval [0,0) [v2:172.21.15.89:6824/3325999642,v1:172.21.15.89:6825/3325999642] [v2:172.21.15.89:6826/3325999642,v1:172.21.15.89:6827/3325999642] exists,up d0001967-3981-4ebe-8dfb-aa38db091f0d'] 2023-10-19T08:39:44.531 INFO:tasks.ceph.osd.0:Sent signal 19 2023-10-19T08:40:01.227 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-19T08:40:01.231 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-19T08:40:05.535 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-10-19T08:40:05.531+0000 7f33fc98c700 -1 osd.4 41 heartbeat_check: no reply from 172.21.15.79:6807 osd.0 since back 2023-10-19T08:39:43.651053+0000 front 2023-10-19T08:39:43.650926+0000 (oldest deadline 2023-10-19T08:40:04.751009+0000) 2023-10-19T08:40:05.926 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-10-19T08:40:05.922+0000 7ff1011f6700 -1 osd.5 41 heartbeat_check: no reply from 172.21.15.79:6807 osd.0 since back 2023-10-19T08:39:41.747525+0000 front 2023-10-19T08:39:41.747553+0000 (oldest deadline 2023-10-19T08:40:05.247241+0000) 2023-10-19T08:40:06.446 INFO:tasks.ceph.osd.3.smithi079.stderr:2023-10-19T08:40:06.444+0000 7feb5238c700 -1 osd.3 41 heartbeat_check: no reply from 172.21.15.79:6807 osd.0 since back 2023-10-19T08:39:40.847166+0000 front 2023-10-19T08:39:40.847238+0000 (oldest deadline 2023-10-19T08:40:05.547313+0000) 2023-10-19T08:40:06.447 INFO:tasks.ceph.osd.2.smithi079.stderr:2023-10-19T08:40:06.444+0000 7f7616b08700 -1 osd.2 41 heartbeat_check: no reply from 172.21.15.79:6807 osd.0 since back 2023-10-19T08:39:42.821707+0000 front 2023-10-19T08:39:42.821720+0000 (oldest deadline 2023-10-19T08:40:06.321748+0000) 2023-10-19T08:40:06.585 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-10-19T08:40:06.581+0000 7f33fc98c700 -1 osd.4 41 heartbeat_check: no reply from 172.21.15.79:6807 osd.0 since back 2023-10-19T08:39:43.651053+0000 front 2023-10-19T08:39:43.650926+0000 (oldest deadline 2023-10-19T08:40:04.751009+0000) 2023-10-19T08:40:06.924 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-10-19T08:40:06.921+0000 7ff1011f6700 -1 osd.5 41 heartbeat_check: no reply from 172.21.15.79:6807 osd.0 since back 2023-10-19T08:39:41.747525+0000 front 2023-10-19T08:39:41.747553+0000 (oldest deadline 2023-10-19T08:40:05.247241+0000) 2023-10-19T08:40:06.969 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-10-19T08:40:06.965+0000 7f1f845d6700 -1 osd.6 41 heartbeat_check: no reply from 172.21.15.79:6807 osd.0 since back 2023-10-19T08:39:44.320838+0000 front 2023-10-19T08:39:44.320855+0000 (oldest deadline 2023-10-19T08:40:06.620907+0000) 2023-10-19T08:40:07.338 INFO:tasks.ceph.osd.1.smithi079.stderr:2023-10-19T08:40:07.335+0000 7fb909ffc700 -1 osd.1 41 heartbeat_check: no reply from 172.21.15.79:6807 osd.0 since back 2023-10-19T08:39:42.232623+0000 front 2023-10-19T08:39:42.232680+0000 (oldest deadline 2023-10-19T08:40:06.332688+0000) 2023-10-19T08:40:07.428 INFO:tasks.ceph.osd.2.smithi079.stderr:2023-10-19T08:40:07.425+0000 7f7616b08700 -1 osd.2 41 heartbeat_check: no reply from 172.21.15.79:6807 osd.0 since back 2023-10-19T08:39:42.821707+0000 front 2023-10-19T08:39:42.821720+0000 (oldest deadline 2023-10-19T08:40:06.321748+0000) 2023-10-19T08:40:07.441 INFO:tasks.ceph.osd.3.smithi079.stderr:2023-10-19T08:40:07.438+0000 7feb5238c700 -1 osd.3 41 heartbeat_check: no reply from 172.21.15.79:6807 osd.0 since back 2023-10-19T08:39:40.847166+0000 front 2023-10-19T08:39:40.847238+0000 (oldest deadline 2023-10-19T08:40:05.547313+0000) 2023-10-19T08:40:07.589 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-10-19T08:40:07.585+0000 7f33fc98c700 -1 osd.4 41 heartbeat_check: no reply from 172.21.15.79:6807 osd.0 since back 2023-10-19T08:39:43.651053+0000 front 2023-10-19T08:39:43.650926+0000 (oldest deadline 2023-10-19T08:40:04.751009+0000) 2023-10-19T08:40:07.880 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-10-19T08:40:07.875+0000 7ff1011f6700 -1 osd.5 41 heartbeat_check: no reply from 172.21.15.79:6807 osd.0 since back 2023-10-19T08:39:41.747525+0000 front 2023-10-19T08:39:41.747553+0000 (oldest deadline 2023-10-19T08:40:05.247241+0000) 2023-10-19T08:40:07.924 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-10-19T08:40:07.920+0000 7f1f845d6700 -1 osd.6 41 heartbeat_check: no reply from 172.21.15.79:6807 osd.0 since back 2023-10-19T08:39:44.320838+0000 front 2023-10-19T08:39:44.320855+0000 (oldest deadline 2023-10-19T08:40:06.620907+0000) 2023-10-19T08:40:08.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2023-10-19T08:40:08.330+0000 7fb909ffc700 -1 osd.1 41 heartbeat_check: no reply from 172.21.15.79:6807 osd.0 since back 2023-10-19T08:39:42.232623+0000 front 2023-10-19T08:39:42.232680+0000 (oldest deadline 2023-10-19T08:40:06.332688+0000) 2023-10-19T08:40:08.397 INFO:tasks.ceph.osd.3.smithi079.stderr:2023-10-19T08:40:08.394+0000 7feb5238c700 -1 osd.3 41 heartbeat_check: no reply from 172.21.15.79:6807 osd.0 since back 2023-10-19T08:39:40.847166+0000 front 2023-10-19T08:39:40.847238+0000 (oldest deadline 2023-10-19T08:40:05.547313+0000) 2023-10-19T08:40:08.473 INFO:tasks.ceph.osd.2.smithi079.stderr:2023-10-19T08:40:08.470+0000 7f7616b08700 -1 osd.2 41 heartbeat_check: no reply from 172.21.15.79:6807 osd.0 since back 2023-10-19T08:39:42.821707+0000 front 2023-10-19T08:39:42.821720+0000 (oldest deadline 2023-10-19T08:40:06.321748+0000) 2023-10-19T08:40:08.612 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-10-19T08:40:08.607+0000 7f33fc98c700 -1 osd.4 41 heartbeat_check: no reply from 172.21.15.79:6807 osd.0 since back 2023-10-19T08:39:43.651053+0000 front 2023-10-19T08:39:43.650926+0000 (oldest deadline 2023-10-19T08:40:04.751009+0000) 2023-10-19T08:40:31.300 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-19T08:40:31.303 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-19T08:41:01.373 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-19T08:41:01.377 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-19T08:41:31.451 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-19T08:41:31.455 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-19T08:41:37.471 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-19T08:41:37.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-10-19T08:41:37.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-10-19T08:41:37.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-10-19T08:41:37.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-19T08:41:37.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-19T08:41:37.473 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-19T08:41:37.473 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-19T08:41:37.473 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-10-19T08:41:37.473 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-10-19T08:41:42.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-10-19T08:41:42.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-10-19T08:41:42.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-10-19T08:41:42.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-19T08:41:42.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-10-19T08:41:42.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-19T08:41:42.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-19T08:41:42.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~6s 2023-10-19T08:41:42.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~6s 2023-10-19T08:41:42.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~6s 2023-10-19T08:41:42.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~6s 2023-10-19T08:41:42.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~6s 2023-10-19T08:41:42.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~6s 2023-10-19T08:41:42.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~6s 2023-10-19T08:41:42.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~6s 2023-10-19T08:41:42.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~6s 2023-10-19T08:41:42.482 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~6s 2023-10-19T08:41:44.534 ERROR:teuthology.orchestra.daemon.state:Failed to send signal 18: None Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 108, in signal self.proc.stdin.write(struct.pack('!b', sig)) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 405, in write self._write_all(data) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 523, in _write_all count = self._write(data) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1364, in _write self.channel.sendall(data) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 846, in sendall sent = self.send(s) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 801, in send return self._send(s, m) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1198, in _send raise socket.error("Socket is closed") OSError: Socket is closed 2023-10-19T08:41:44.535 INFO:tasks.ceph.osd.0:Sent signal 18 2023-10-19T08:41:44.536 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:41:44.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:41:47.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~5s 2023-10-19T08:41:47.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~5s 2023-10-19T08:41:47.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~5s 2023-10-19T08:41:47.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~5s 2023-10-19T08:41:47.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~5s 2023-10-19T08:41:47.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~5s 2023-10-19T08:41:47.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~5s 2023-10-19T08:41:47.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~11s 2023-10-19T08:41:47.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~11s 2023-10-19T08:41:47.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~11s 2023-10-19T08:41:47.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~11s 2023-10-19T08:41:47.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~11s 2023-10-19T08:41:47.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~11s 2023-10-19T08:41:47.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~11s 2023-10-19T08:41:47.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~11s 2023-10-19T08:41:47.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~11s 2023-10-19T08:41:47.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~11s 2023-10-19T08:41:52.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~10s 2023-10-19T08:41:52.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~10s 2023-10-19T08:41:52.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~10s 2023-10-19T08:41:52.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~10s 2023-10-19T08:41:52.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~10s 2023-10-19T08:41:52.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~10s 2023-10-19T08:41:52.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~10s 2023-10-19T08:41:52.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~16s 2023-10-19T08:41:52.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~16s 2023-10-19T08:41:52.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~16s 2023-10-19T08:41:52.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~16s 2023-10-19T08:41:52.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~16s 2023-10-19T08:41:52.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~16s 2023-10-19T08:41:52.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~16s 2023-10-19T08:41:52.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~16s 2023-10-19T08:41:52.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~16s 2023-10-19T08:41:52.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~16s 2023-10-19T08:41:57.502 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~15s 2023-10-19T08:41:57.503 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~15s 2023-10-19T08:41:57.503 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~15s 2023-10-19T08:41:57.503 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~15s 2023-10-19T08:41:57.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~15s 2023-10-19T08:41:57.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~15s 2023-10-19T08:41:57.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~15s 2023-10-19T08:41:57.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~21s 2023-10-19T08:41:57.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~21s 2023-10-19T08:41:57.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~21s 2023-10-19T08:41:57.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~21s 2023-10-19T08:41:57.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~21s 2023-10-19T08:41:57.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~21s 2023-10-19T08:41:57.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~21s 2023-10-19T08:41:57.506 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~21s 2023-10-19T08:41:57.506 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~21s 2023-10-19T08:41:57.506 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~21s 2023-10-19T08:42:01.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:42:01.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:42:02.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~20s 2023-10-19T08:42:02.509 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~20s 2023-10-19T08:42:02.509 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~20s 2023-10-19T08:42:02.509 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~20s 2023-10-19T08:42:02.510 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~20s 2023-10-19T08:42:02.510 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~20s 2023-10-19T08:42:02.510 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~20s 2023-10-19T08:42:02.510 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~26s 2023-10-19T08:42:02.510 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~26s 2023-10-19T08:42:02.511 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~26s 2023-10-19T08:42:02.511 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~26s 2023-10-19T08:42:02.511 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~26s 2023-10-19T08:42:02.511 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~26s 2023-10-19T08:42:02.511 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~26s 2023-10-19T08:42:02.512 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~26s 2023-10-19T08:42:02.512 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~26s 2023-10-19T08:42:02.512 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~26s 2023-10-19T08:42:07.518 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~25s 2023-10-19T08:42:07.518 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~25s 2023-10-19T08:42:07.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~25s 2023-10-19T08:42:07.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~25s 2023-10-19T08:42:07.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~25s 2023-10-19T08:42:07.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~25s 2023-10-19T08:42:07.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~25s 2023-10-19T08:42:07.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~31s 2023-10-19T08:42:07.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~31s 2023-10-19T08:42:07.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~31s 2023-10-19T08:42:07.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~31s 2023-10-19T08:42:07.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~31s 2023-10-19T08:42:07.521 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~31s 2023-10-19T08:42:07.521 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~31s 2023-10-19T08:42:07.521 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~31s 2023-10-19T08:42:07.521 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~31s 2023-10-19T08:42:07.522 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~31s 2023-10-19T08:42:12.527 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~30s 2023-10-19T08:42:12.527 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~30s 2023-10-19T08:42:12.527 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~30s 2023-10-19T08:42:12.527 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~30s 2023-10-19T08:42:12.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~30s 2023-10-19T08:42:12.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~30s 2023-10-19T08:42:12.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~30s 2023-10-19T08:42:12.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~36s 2023-10-19T08:42:12.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~36s 2023-10-19T08:42:12.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~36s 2023-10-19T08:42:12.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~36s 2023-10-19T08:42:12.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~36s 2023-10-19T08:42:12.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~36s 2023-10-19T08:42:12.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~36s 2023-10-19T08:42:12.530 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~36s 2023-10-19T08:42:12.530 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~36s 2023-10-19T08:42:12.530 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~36s 2023-10-19T08:42:17.535 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~35s 2023-10-19T08:42:17.535 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~35s 2023-10-19T08:42:17.535 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~35s 2023-10-19T08:42:17.535 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~35s 2023-10-19T08:42:17.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~35s 2023-10-19T08:42:17.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~35s 2023-10-19T08:42:17.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~35s 2023-10-19T08:42:17.536 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~41s 2023-10-19T08:42:17.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~41s 2023-10-19T08:42:17.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~41s 2023-10-19T08:42:17.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~41s 2023-10-19T08:42:17.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~41s 2023-10-19T08:42:17.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~41s 2023-10-19T08:42:17.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~41s 2023-10-19T08:42:17.538 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~41s 2023-10-19T08:42:17.538 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~41s 2023-10-19T08:42:17.538 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~41s 2023-10-19T08:42:22.544 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~40s 2023-10-19T08:42:22.545 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~40s 2023-10-19T08:42:22.545 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~40s 2023-10-19T08:42:22.545 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~40s 2023-10-19T08:42:22.545 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~40s 2023-10-19T08:42:22.545 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~40s 2023-10-19T08:42:22.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~40s 2023-10-19T08:42:22.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~46s 2023-10-19T08:42:22.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~46s 2023-10-19T08:42:22.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~46s 2023-10-19T08:42:22.546 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~46s 2023-10-19T08:42:22.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~46s 2023-10-19T08:42:22.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~46s 2023-10-19T08:42:22.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~46s 2023-10-19T08:42:22.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~46s 2023-10-19T08:42:22.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~46s 2023-10-19T08:42:22.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~46s 2023-10-19T08:42:27.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~45s 2023-10-19T08:42:27.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~45s 2023-10-19T08:42:27.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~45s 2023-10-19T08:42:27.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~45s 2023-10-19T08:42:27.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~45s 2023-10-19T08:42:27.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~45s 2023-10-19T08:42:27.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~45s 2023-10-19T08:42:27.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~51s 2023-10-19T08:42:27.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~51s 2023-10-19T08:42:27.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~51s 2023-10-19T08:42:27.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~51s 2023-10-19T08:42:27.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~51s 2023-10-19T08:42:27.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~51s 2023-10-19T08:42:27.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~51s 2023-10-19T08:42:27.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~51s 2023-10-19T08:42:27.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~51s 2023-10-19T08:42:27.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~51s 2023-10-19T08:42:32.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~50s 2023-10-19T08:42:32.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~50s 2023-10-19T08:42:32.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~50s 2023-10-19T08:42:32.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~50s 2023-10-19T08:42:32.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~50s 2023-10-19T08:42:32.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~50s 2023-10-19T08:42:32.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~50s 2023-10-19T08:42:32.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~56s 2023-10-19T08:42:32.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~56s 2023-10-19T08:42:32.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~56s 2023-10-19T08:42:32.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~56s 2023-10-19T08:42:32.561 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~56s 2023-10-19T08:42:32.561 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~56s 2023-10-19T08:42:32.561 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~56s 2023-10-19T08:42:32.561 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~56s 2023-10-19T08:42:32.561 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~56s 2023-10-19T08:42:32.562 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~56s 2023-10-19T08:42:36.026 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-19T08:42:37.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~55s 2023-10-19T08:42:37.565 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~55s 2023-10-19T08:42:37.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~55s 2023-10-19T08:42:37.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~55s 2023-10-19T08:42:37.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~55s 2023-10-19T08:42:37.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~55s 2023-10-19T08:42:37.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~55s 2023-10-19T08:42:37.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~61s 2023-10-19T08:42:37.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~61s 2023-10-19T08:42:37.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~61s 2023-10-19T08:42:37.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~61s 2023-10-19T08:42:37.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~61s 2023-10-19T08:42:37.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~61s 2023-10-19T08:42:37.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~61s 2023-10-19T08:42:37.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~61s 2023-10-19T08:42:37.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~61s 2023-10-19T08:42:37.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~61s 2023-10-19T08:42:42.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~60s 2023-10-19T08:42:42.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~60s 2023-10-19T08:42:42.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~60s 2023-10-19T08:42:42.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~60s 2023-10-19T08:42:42.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~60s 2023-10-19T08:42:42.574 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~60s 2023-10-19T08:42:42.574 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~60s 2023-10-19T08:42:42.574 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~66s 2023-10-19T08:42:42.574 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~66s 2023-10-19T08:42:42.574 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~66s 2023-10-19T08:42:42.575 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~66s 2023-10-19T08:42:42.575 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~66s 2023-10-19T08:42:42.575 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~66s 2023-10-19T08:42:42.575 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~66s 2023-10-19T08:42:42.575 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~66s 2023-10-19T08:42:42.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~66s 2023-10-19T08:42:42.576 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~66s 2023-10-19T08:42:44.541 DEBUG:teuthology.orchestra.remote:timed out 2023-10-19T08:42:45.028 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:42:45.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:42:47.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~65s 2023-10-19T08:42:47.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~65s 2023-10-19T08:42:47.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~65s 2023-10-19T08:42:47.579 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~65s 2023-10-19T08:42:47.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~65s 2023-10-19T08:42:47.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~65s 2023-10-19T08:42:47.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~65s 2023-10-19T08:42:47.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~71s 2023-10-19T08:42:47.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~71s 2023-10-19T08:42:47.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~71s 2023-10-19T08:42:47.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~71s 2023-10-19T08:42:47.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~71s 2023-10-19T08:42:47.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~71s 2023-10-19T08:42:47.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~71s 2023-10-19T08:42:47.582 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~71s 2023-10-19T08:42:47.582 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~71s 2023-10-19T08:42:47.582 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~71s 2023-10-19T08:42:48.090 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-19T08:42:52.587 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~70s 2023-10-19T08:42:52.587 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~70s 2023-10-19T08:42:52.587 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~70s 2023-10-19T08:42:52.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~70s 2023-10-19T08:42:52.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~70s 2023-10-19T08:42:52.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~70s 2023-10-19T08:42:52.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~70s 2023-10-19T08:42:52.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~76s 2023-10-19T08:42:52.589 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~76s 2023-10-19T08:42:52.589 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~76s 2023-10-19T08:42:52.589 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~76s 2023-10-19T08:42:52.589 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~76s 2023-10-19T08:42:52.589 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~76s 2023-10-19T08:42:52.590 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~76s 2023-10-19T08:42:52.590 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~76s 2023-10-19T08:42:52.590 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~76s 2023-10-19T08:42:52.590 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~76s 2023-10-19T08:42:53.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:42:53.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:42:56.602 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-19T08:42:57.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~75s 2023-10-19T08:42:57.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~75s 2023-10-19T08:42:57.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~75s 2023-10-19T08:42:57.593 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~75s 2023-10-19T08:42:57.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~75s 2023-10-19T08:42:57.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~75s 2023-10-19T08:42:57.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~75s 2023-10-19T08:42:57.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~81s 2023-10-19T08:42:57.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~81s 2023-10-19T08:42:57.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~81s 2023-10-19T08:42:57.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~81s 2023-10-19T08:42:57.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~81s 2023-10-19T08:42:57.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~81s 2023-10-19T08:42:57.596 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~81s 2023-10-19T08:42:57.596 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~81s 2023-10-19T08:42:57.596 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~81s 2023-10-19T08:42:57.596 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~81s 2023-10-19T08:43:00.094 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:43:00.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:43:02.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~80s 2023-10-19T08:43:02.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~80s 2023-10-19T08:43:02.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~80s 2023-10-19T08:43:02.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~80s 2023-10-19T08:43:02.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~80s 2023-10-19T08:43:02.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~80s 2023-10-19T08:43:02.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~80s 2023-10-19T08:43:02.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~86s 2023-10-19T08:43:02.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~86s 2023-10-19T08:43:02.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~86s 2023-10-19T08:43:02.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~86s 2023-10-19T08:43:02.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~86s 2023-10-19T08:43:02.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~86s 2023-10-19T08:43:02.604 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~86s 2023-10-19T08:43:02.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~86s 2023-10-19T08:43:02.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~86s 2023-10-19T08:43:02.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~86s 2023-10-19T08:43:03.162 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-19T08:43:06.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:43:06.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:43:06.234 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-19T08:43:06.235 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-10-19T08:43:06.299 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 183, in invoke_logrotate procs = ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi079 2023-10-19T08:43:07.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~85s 2023-10-19T08:43:07.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~85s 2023-10-19T08:43:07.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~85s 2023-10-19T08:43:07.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~85s 2023-10-19T08:43:07.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~85s 2023-10-19T08:43:07.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~85s 2023-10-19T08:43:07.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~85s 2023-10-19T08:43:07.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~91s 2023-10-19T08:43:07.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~91s 2023-10-19T08:43:07.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~91s 2023-10-19T08:43:07.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~91s 2023-10-19T08:43:07.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~91s 2023-10-19T08:43:07.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~91s 2023-10-19T08:43:07.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~91s 2023-10-19T08:43:07.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~91s 2023-10-19T08:43:07.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~91s 2023-10-19T08:43:07.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~91s 2023-10-19T08:43:08.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:43:08.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:43:12.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~90s 2023-10-19T08:43:12.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~90s 2023-10-19T08:43:12.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~90s 2023-10-19T08:43:12.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~90s 2023-10-19T08:43:12.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~90s 2023-10-19T08:43:12.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~90s 2023-10-19T08:43:12.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~90s 2023-10-19T08:43:12.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~96s 2023-10-19T08:43:12.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~96s 2023-10-19T08:43:12.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~96s 2023-10-19T08:43:12.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~96s 2023-10-19T08:43:12.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~96s 2023-10-19T08:43:12.619 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~96s 2023-10-19T08:43:12.619 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~96s 2023-10-19T08:43:12.619 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~96s 2023-10-19T08:43:12.619 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~96s 2023-10-19T08:43:12.619 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~96s 2023-10-19T08:43:17.625 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~95s 2023-10-19T08:43:17.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~95s 2023-10-19T08:43:17.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~95s 2023-10-19T08:43:17.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~95s 2023-10-19T08:43:17.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~95s 2023-10-19T08:43:17.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~95s 2023-10-19T08:43:17.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~95s 2023-10-19T08:43:17.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~101s 2023-10-19T08:43:17.627 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~101s 2023-10-19T08:43:17.628 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~101s 2023-10-19T08:43:17.628 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~101s 2023-10-19T08:43:17.628 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~101s 2023-10-19T08:43:17.628 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~101s 2023-10-19T08:43:17.628 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~101s 2023-10-19T08:43:17.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~101s 2023-10-19T08:43:17.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~101s 2023-10-19T08:43:17.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~101s 2023-10-19T08:43:22.635 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~100s 2023-10-19T08:43:22.635 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~100s 2023-10-19T08:43:22.636 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~100s 2023-10-19T08:43:22.636 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~100s 2023-10-19T08:43:22.636 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~100s 2023-10-19T08:43:22.636 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~100s 2023-10-19T08:43:22.637 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~100s 2023-10-19T08:43:22.637 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~106s 2023-10-19T08:43:22.637 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~106s 2023-10-19T08:43:22.637 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~106s 2023-10-19T08:43:22.637 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~106s 2023-10-19T08:43:22.637 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~106s 2023-10-19T08:43:22.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~106s 2023-10-19T08:43:22.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~106s 2023-10-19T08:43:22.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~106s 2023-10-19T08:43:22.638 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~106s 2023-10-19T08:43:22.639 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~106s 2023-10-19T08:43:26.974 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-19T08:43:27.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~105s 2023-10-19T08:43:27.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~105s 2023-10-19T08:43:27.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~105s 2023-10-19T08:43:27.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~105s 2023-10-19T08:43:27.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~105s 2023-10-19T08:43:27.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~105s 2023-10-19T08:43:27.643 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~105s 2023-10-19T08:43:27.643 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~111s 2023-10-19T08:43:27.643 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~111s 2023-10-19T08:43:27.643 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~111s 2023-10-19T08:43:27.643 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~111s 2023-10-19T08:43:27.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~111s 2023-10-19T08:43:27.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~111s 2023-10-19T08:43:27.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~111s 2023-10-19T08:43:27.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~111s 2023-10-19T08:43:27.644 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~111s 2023-10-19T08:43:27.645 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~111s 2023-10-19T08:43:29.978 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:43:29.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:43:32.647 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~110s 2023-10-19T08:43:32.647 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~110s 2023-10-19T08:43:32.647 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~110s 2023-10-19T08:43:32.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~110s 2023-10-19T08:43:32.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~110s 2023-10-19T08:43:32.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~110s 2023-10-19T08:43:32.648 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~110s 2023-10-19T08:43:32.649 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~116s 2023-10-19T08:43:32.649 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~116s 2023-10-19T08:43:32.649 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~116s 2023-10-19T08:43:32.649 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~116s 2023-10-19T08:43:32.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~116s 2023-10-19T08:43:32.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~116s 2023-10-19T08:43:32.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~116s 2023-10-19T08:43:32.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~116s 2023-10-19T08:43:32.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~116s 2023-10-19T08:43:32.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~116s 2023-10-19T08:43:33.050 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-19T08:43:33.051 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-10-19T08:43:33.051 INFO:tasks.cephfs.mount:Cleaning up killed connection on ubuntu@smithi079.front.sepia.ceph.com 2023-10-19T08:43:33.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:43:33.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:43:36.122 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-19T08:43:37.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~115s 2023-10-19T08:43:37.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~115s 2023-10-19T08:43:37.653 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~115s 2023-10-19T08:43:37.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~115s 2023-10-19T08:43:37.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~115s 2023-10-19T08:43:37.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~115s 2023-10-19T08:43:37.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~115s 2023-10-19T08:43:37.655 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~121s 2023-10-19T08:43:37.655 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~121s 2023-10-19T08:43:37.655 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~121s 2023-10-19T08:43:37.655 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~121s 2023-10-19T08:43:37.655 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~121s 2023-10-19T08:43:37.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~121s 2023-10-19T08:43:37.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~121s 2023-10-19T08:43:37.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~121s 2023-10-19T08:43:37.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~121s 2023-10-19T08:43:37.656 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~121s 2023-10-19T08:43:42.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~120s 2023-10-19T08:43:42.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~120s 2023-10-19T08:43:42.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~120s 2023-10-19T08:43:42.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~120s 2023-10-19T08:43:42.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~120s 2023-10-19T08:43:42.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~120s 2023-10-19T08:43:42.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~120s 2023-10-19T08:43:42.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~126s 2023-10-19T08:43:42.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~126s 2023-10-19T08:43:42.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~126s 2023-10-19T08:43:42.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~126s 2023-10-19T08:43:42.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~126s 2023-10-19T08:43:42.663 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~126s 2023-10-19T08:43:42.664 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~126s 2023-10-19T08:43:42.664 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~126s 2023-10-19T08:43:42.664 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~126s 2023-10-19T08:43:42.664 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~126s 2023-10-19T08:43:45.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:43:45.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:43:45.250 ERROR:teuthology.orchestra.connection:Error authenticating with smithi079.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-19T08:43:47.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~125s 2023-10-19T08:43:47.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~125s 2023-10-19T08:43:47.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~125s 2023-10-19T08:43:47.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~125s 2023-10-19T08:43:47.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~125s 2023-10-19T08:43:47.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~125s 2023-10-19T08:43:47.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~125s 2023-10-19T08:43:47.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~131s 2023-10-19T08:43:47.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~131s 2023-10-19T08:43:47.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~131s 2023-10-19T08:43:47.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~131s 2023-10-19T08:43:47.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~131s 2023-10-19T08:43:47.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~131s 2023-10-19T08:43:47.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~131s 2023-10-19T08:43:47.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~131s 2023-10-19T08:43:47.669 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~131s 2023-10-19T08:43:47.669 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~131s 2023-10-19T08:43:49.375 ERROR:teuthology.orchestra.connection:Error authenticating with smithi079.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-19T08:43:52.670 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~130s 2023-10-19T08:43:52.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~130s 2023-10-19T08:43:52.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~130s 2023-10-19T08:43:52.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~130s 2023-10-19T08:43:52.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~130s 2023-10-19T08:43:52.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~130s 2023-10-19T08:43:52.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~130s 2023-10-19T08:43:52.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~136s 2023-10-19T08:43:52.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~136s 2023-10-19T08:43:52.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~136s 2023-10-19T08:43:52.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~136s 2023-10-19T08:43:52.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~136s 2023-10-19T08:43:52.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~136s 2023-10-19T08:43:52.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~136s 2023-10-19T08:43:52.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~136s 2023-10-19T08:43:52.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~136s 2023-10-19T08:43:52.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~136s 2023-10-19T08:43:56.458 ERROR:teuthology.orchestra.connection:Error authenticating with smithi079.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-19T08:43:57.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~135s 2023-10-19T08:43:57.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~135s 2023-10-19T08:43:57.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~135s 2023-10-19T08:43:57.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~135s 2023-10-19T08:43:57.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~135s 2023-10-19T08:43:57.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~135s 2023-10-19T08:43:57.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~135s 2023-10-19T08:43:57.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~141s 2023-10-19T08:43:57.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~141s 2023-10-19T08:43:57.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~141s 2023-10-19T08:43:57.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~141s 2023-10-19T08:43:57.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~141s 2023-10-19T08:43:57.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~141s 2023-10-19T08:43:57.678 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~141s 2023-10-19T08:43:57.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~141s 2023-10-19T08:43:57.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~141s 2023-10-19T08:43:57.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~141s 2023-10-19T08:44:02.680 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~140s 2023-10-19T08:44:02.680 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~140s 2023-10-19T08:44:02.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~140s 2023-10-19T08:44:02.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~140s 2023-10-19T08:44:02.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~140s 2023-10-19T08:44:02.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~140s 2023-10-19T08:44:02.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~140s 2023-10-19T08:44:02.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~146s 2023-10-19T08:44:02.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~146s 2023-10-19T08:44:02.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~146s 2023-10-19T08:44:02.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~146s 2023-10-19T08:44:02.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~146s 2023-10-19T08:44:02.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~146s 2023-10-19T08:44:02.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~146s 2023-10-19T08:44:02.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~146s 2023-10-19T08:44:02.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~146s 2023-10-19T08:44:02.683 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~146s 2023-10-19T08:44:06.544 ERROR:teuthology.orchestra.connection:Error authenticating with smithi079.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-19T08:44:07.685 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~145s 2023-10-19T08:44:07.685 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~145s 2023-10-19T08:44:07.685 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~145s 2023-10-19T08:44:07.685 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~145s 2023-10-19T08:44:07.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~145s 2023-10-19T08:44:07.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~145s 2023-10-19T08:44:07.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~145s 2023-10-19T08:44:07.686 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~151s 2023-10-19T08:44:07.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~151s 2023-10-19T08:44:07.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~151s 2023-10-19T08:44:07.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~151s 2023-10-19T08:44:07.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~151s 2023-10-19T08:44:07.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~151s 2023-10-19T08:44:07.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~151s 2023-10-19T08:44:07.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~151s 2023-10-19T08:44:07.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~151s 2023-10-19T08:44:07.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~151s 2023-10-19T08:44:12.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~150s 2023-10-19T08:44:12.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~150s 2023-10-19T08:44:12.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~150s 2023-10-19T08:44:12.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~150s 2023-10-19T08:44:12.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~150s 2023-10-19T08:44:12.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~150s 2023-10-19T08:44:12.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~150s 2023-10-19T08:44:12.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~156s 2023-10-19T08:44:12.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~156s 2023-10-19T08:44:12.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~156s 2023-10-19T08:44:12.692 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~156s 2023-10-19T08:44:12.692 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~156s 2023-10-19T08:44:12.692 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~156s 2023-10-19T08:44:12.692 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~156s 2023-10-19T08:44:12.692 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~156s 2023-10-19T08:44:12.692 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~156s 2023-10-19T08:44:12.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~156s 2023-10-19T08:44:17.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~155s 2023-10-19T08:44:17.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~155s 2023-10-19T08:44:17.695 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~155s 2023-10-19T08:44:17.695 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~155s 2023-10-19T08:44:17.695 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~155s 2023-10-19T08:44:17.695 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~155s 2023-10-19T08:44:17.696 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~155s 2023-10-19T08:44:17.696 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~161s 2023-10-19T08:44:17.696 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~161s 2023-10-19T08:44:17.696 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~161s 2023-10-19T08:44:17.696 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~161s 2023-10-19T08:44:17.696 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~161s 2023-10-19T08:44:17.697 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~161s 2023-10-19T08:44:17.697 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~161s 2023-10-19T08:44:17.697 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~161s 2023-10-19T08:44:17.697 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~161s 2023-10-19T08:44:17.697 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~161s 2023-10-19T08:44:19.670 ERROR:teuthology.orchestra.connection:Error authenticating with smithi079.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-10-19T08:44:22.699 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~160s 2023-10-19T08:44:22.699 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~160s 2023-10-19T08:44:22.699 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~160s 2023-10-19T08:44:22.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~160s 2023-10-19T08:44:22.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~160s 2023-10-19T08:44:22.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~160s 2023-10-19T08:44:22.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~160s 2023-10-19T08:44:22.700 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~166s 2023-10-19T08:44:22.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~166s 2023-10-19T08:44:22.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~166s 2023-10-19T08:44:22.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~166s 2023-10-19T08:44:22.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~166s 2023-10-19T08:44:22.701 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~166s 2023-10-19T08:44:22.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~166s 2023-10-19T08:44:22.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~166s 2023-10-19T08:44:22.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~166s 2023-10-19T08:44:22.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~166s 2023-10-19T08:44:27.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~165s 2023-10-19T08:44:27.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~165s 2023-10-19T08:44:27.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~165s 2023-10-19T08:44:27.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~165s 2023-10-19T08:44:27.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~165s 2023-10-19T08:44:27.705 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~165s 2023-10-19T08:44:27.705 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~165s 2023-10-19T08:44:27.705 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~171s 2023-10-19T08:44:27.705 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~171s 2023-10-19T08:44:27.705 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~171s 2023-10-19T08:44:27.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~171s 2023-10-19T08:44:27.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~171s 2023-10-19T08:44:27.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~171s 2023-10-19T08:44:27.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~171s 2023-10-19T08:44:27.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~171s 2023-10-19T08:44:27.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~171s 2023-10-19T08:44:27.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~171s 2023-10-19T08:44:32.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~170s 2023-10-19T08:44:32.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~170s 2023-10-19T08:44:32.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~170s 2023-10-19T08:44:32.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~170s 2023-10-19T08:44:32.710 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~170s 2023-10-19T08:44:32.710 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~170s 2023-10-19T08:44:32.710 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~170s 2023-10-19T08:44:32.710 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~176s 2023-10-19T08:44:32.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~176s 2023-10-19T08:44:32.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~176s 2023-10-19T08:44:32.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~176s 2023-10-19T08:44:32.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~176s 2023-10-19T08:44:32.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~176s 2023-10-19T08:44:32.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~176s 2023-10-19T08:44:32.712 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~176s 2023-10-19T08:44:32.712 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~176s 2023-10-19T08:44:32.712 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~176s 2023-10-19T08:44:37.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~175s 2023-10-19T08:44:37.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~175s 2023-10-19T08:44:37.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~175s 2023-10-19T08:44:37.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~175s 2023-10-19T08:44:37.715 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~175s 2023-10-19T08:44:37.715 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~175s 2023-10-19T08:44:37.715 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~175s 2023-10-19T08:44:37.715 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~181s 2023-10-19T08:44:37.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~181s 2023-10-19T08:44:37.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~181s 2023-10-19T08:44:37.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~181s 2023-10-19T08:44:37.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~181s 2023-10-19T08:44:37.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~181s 2023-10-19T08:44:37.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~181s 2023-10-19T08:44:37.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~181s 2023-10-19T08:44:37.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~181s 2023-10-19T08:44:37.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~181s 2023-10-19T08:44:42.718 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~180s 2023-10-19T08:44:42.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~180s 2023-10-19T08:44:42.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~180s 2023-10-19T08:44:42.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~180s 2023-10-19T08:44:42.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~180s 2023-10-19T08:44:42.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~180s 2023-10-19T08:44:42.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~180s 2023-10-19T08:44:42.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~186s 2023-10-19T08:44:42.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~186s 2023-10-19T08:44:42.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~186s 2023-10-19T08:44:42.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~186s 2023-10-19T08:44:42.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~186s 2023-10-19T08:44:42.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~186s 2023-10-19T08:44:42.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~186s 2023-10-19T08:44:42.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~186s 2023-10-19T08:44:42.721 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~186s 2023-10-19T08:44:42.722 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~186s 2023-10-19T08:44:47.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~185s 2023-10-19T08:44:47.724 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~185s 2023-10-19T08:44:47.724 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~185s 2023-10-19T08:44:47.724 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~185s 2023-10-19T08:44:47.724 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~185s 2023-10-19T08:44:47.724 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~185s 2023-10-19T08:44:47.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~185s 2023-10-19T08:44:47.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~191s 2023-10-19T08:44:47.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~191s 2023-10-19T08:44:47.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~191s 2023-10-19T08:44:47.725 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~191s 2023-10-19T08:44:47.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~191s 2023-10-19T08:44:47.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~191s 2023-10-19T08:44:47.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~191s 2023-10-19T08:44:47.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~191s 2023-10-19T08:44:47.726 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~191s 2023-10-19T08:44:47.727 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~191s 2023-10-19T08:44:52.728 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~190s 2023-10-19T08:44:52.728 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~190s 2023-10-19T08:44:52.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~190s 2023-10-19T08:44:52.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~190s 2023-10-19T08:44:52.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~190s 2023-10-19T08:44:52.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~190s 2023-10-19T08:44:52.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~190s 2023-10-19T08:44:52.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~196s 2023-10-19T08:44:52.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~196s 2023-10-19T08:44:52.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~196s 2023-10-19T08:44:52.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~196s 2023-10-19T08:44:52.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~196s 2023-10-19T08:44:52.731 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~196s 2023-10-19T08:44:52.731 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~196s 2023-10-19T08:44:52.731 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~196s 2023-10-19T08:44:52.731 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~196s 2023-10-19T08:44:52.731 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~196s 2023-10-19T08:44:57.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~195s 2023-10-19T08:44:57.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~195s 2023-10-19T08:44:57.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~195s 2023-10-19T08:44:57.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~195s 2023-10-19T08:44:57.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~195s 2023-10-19T08:44:57.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~195s 2023-10-19T08:44:57.734 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~195s 2023-10-19T08:44:57.734 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~201s 2023-10-19T08:44:57.734 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~201s 2023-10-19T08:44:57.734 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~201s 2023-10-19T08:44:57.734 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~201s 2023-10-19T08:44:57.735 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~201s 2023-10-19T08:44:57.735 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~201s 2023-10-19T08:44:57.735 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~201s 2023-10-19T08:44:57.735 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~201s 2023-10-19T08:44:57.735 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~201s 2023-10-19T08:44:57.735 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~201s 2023-10-19T08:45:02.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~200s 2023-10-19T08:45:02.738 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~200s 2023-10-19T08:45:02.738 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~200s 2023-10-19T08:45:02.738 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~200s 2023-10-19T08:45:02.738 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~200s 2023-10-19T08:45:02.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~200s 2023-10-19T08:45:02.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~200s 2023-10-19T08:45:02.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~206s 2023-10-19T08:45:02.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~206s 2023-10-19T08:45:02.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~206s 2023-10-19T08:45:02.740 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~206s 2023-10-19T08:45:02.740 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~206s 2023-10-19T08:45:02.740 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~206s 2023-10-19T08:45:02.740 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~206s 2023-10-19T08:45:02.740 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~206s 2023-10-19T08:45:02.740 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~206s 2023-10-19T08:45:02.741 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~206s 2023-10-19T08:45:07.710 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-19T08:45:07.742 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~205s 2023-10-19T08:45:07.743 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~205s 2023-10-19T08:45:07.743 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~205s 2023-10-19T08:45:07.743 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~205s 2023-10-19T08:45:07.743 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~205s 2023-10-19T08:45:07.743 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~205s 2023-10-19T08:45:07.744 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~205s 2023-10-19T08:45:07.744 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~211s 2023-10-19T08:45:07.744 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~211s 2023-10-19T08:45:07.744 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~211s 2023-10-19T08:45:07.744 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~211s 2023-10-19T08:45:07.745 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~211s 2023-10-19T08:45:07.745 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~211s 2023-10-19T08:45:07.745 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~211s 2023-10-19T08:45:07.745 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~211s 2023-10-19T08:45:07.745 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~211s 2023-10-19T08:45:07.745 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~211s 2023-10-19T08:45:12.747 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~210s 2023-10-19T08:45:12.748 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~210s 2023-10-19T08:45:12.748 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~210s 2023-10-19T08:45:12.748 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~210s 2023-10-19T08:45:12.748 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~210s 2023-10-19T08:45:12.748 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~210s 2023-10-19T08:45:12.749 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~210s 2023-10-19T08:45:12.749 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~216s 2023-10-19T08:45:12.749 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~216s 2023-10-19T08:45:12.749 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~216s 2023-10-19T08:45:12.749 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~216s 2023-10-19T08:45:12.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~216s 2023-10-19T08:45:12.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~216s 2023-10-19T08:45:12.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~216s 2023-10-19T08:45:12.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~216s 2023-10-19T08:45:12.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~216s 2023-10-19T08:45:12.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~216s 2023-10-19T08:45:17.752 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~215s 2023-10-19T08:45:17.753 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~215s 2023-10-19T08:45:17.753 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~215s 2023-10-19T08:45:17.753 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~215s 2023-10-19T08:45:17.753 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~215s 2023-10-19T08:45:17.753 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~215s 2023-10-19T08:45:17.754 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~215s 2023-10-19T08:45:17.754 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~221s 2023-10-19T08:45:17.754 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~221s 2023-10-19T08:45:17.754 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~221s 2023-10-19T08:45:17.754 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~221s 2023-10-19T08:45:17.755 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~221s 2023-10-19T08:45:17.755 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~221s 2023-10-19T08:45:17.755 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~221s 2023-10-19T08:45:17.755 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~221s 2023-10-19T08:45:17.755 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~221s 2023-10-19T08:45:17.756 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~221s 2023-10-19T08:45:19.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:45:19.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:45:22.757 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~220s 2023-10-19T08:45:22.757 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~220s 2023-10-19T08:45:22.757 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~220s 2023-10-19T08:45:22.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~220s 2023-10-19T08:45:22.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~220s 2023-10-19T08:45:22.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~220s 2023-10-19T08:45:22.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~220s 2023-10-19T08:45:22.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~226s 2023-10-19T08:45:22.759 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~226s 2023-10-19T08:45:22.759 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~226s 2023-10-19T08:45:22.759 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~226s 2023-10-19T08:45:22.759 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~226s 2023-10-19T08:45:22.759 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~226s 2023-10-19T08:45:22.759 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~226s 2023-10-19T08:45:22.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~226s 2023-10-19T08:45:22.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~226s 2023-10-19T08:45:22.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~226s 2023-10-19T08:45:22.782 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-19T08:45:25.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:45:25.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:45:25.850 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-19T08:45:25.851 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-10-19T08:45:25.851 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-19T08:45:25.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:45:25.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:45:27.762 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~225s 2023-10-19T08:45:27.762 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~225s 2023-10-19T08:45:27.762 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~225s 2023-10-19T08:45:27.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~225s 2023-10-19T08:45:27.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~225s 2023-10-19T08:45:27.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~225s 2023-10-19T08:45:27.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~225s 2023-10-19T08:45:27.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~231s 2023-10-19T08:45:27.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~231s 2023-10-19T08:45:27.764 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~231s 2023-10-19T08:45:27.764 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~231s 2023-10-19T08:45:27.764 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~231s 2023-10-19T08:45:27.764 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~231s 2023-10-19T08:45:27.764 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~231s 2023-10-19T08:45:27.765 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~231s 2023-10-19T08:45:27.765 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~231s 2023-10-19T08:45:27.765 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~231s 2023-10-19T08:45:28.922 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-19T08:45:32.766 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~230s 2023-10-19T08:45:32.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~230s 2023-10-19T08:45:32.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~230s 2023-10-19T08:45:32.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~230s 2023-10-19T08:45:32.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~230s 2023-10-19T08:45:32.768 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~230s 2023-10-19T08:45:32.768 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~230s 2023-10-19T08:45:32.768 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~236s 2023-10-19T08:45:32.768 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~236s 2023-10-19T08:45:32.768 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~236s 2023-10-19T08:45:32.769 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~236s 2023-10-19T08:45:32.769 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~236s 2023-10-19T08:45:32.769 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~236s 2023-10-19T08:45:32.769 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~236s 2023-10-19T08:45:32.769 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~236s 2023-10-19T08:45:32.770 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~236s 2023-10-19T08:45:32.770 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~236s 2023-10-19T08:45:37.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~235s 2023-10-19T08:45:37.772 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~235s 2023-10-19T08:45:37.772 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~235s 2023-10-19T08:45:37.772 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~235s 2023-10-19T08:45:37.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~235s 2023-10-19T08:45:37.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~235s 2023-10-19T08:45:37.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~235s 2023-10-19T08:45:37.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~241s 2023-10-19T08:45:37.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~241s 2023-10-19T08:45:37.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~241s 2023-10-19T08:45:37.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~241s 2023-10-19T08:45:37.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~241s 2023-10-19T08:45:37.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~241s 2023-10-19T08:45:37.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~241s 2023-10-19T08:45:37.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~241s 2023-10-19T08:45:37.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~241s 2023-10-19T08:45:37.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~241s 2023-10-19T08:45:37.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:45:37.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:45:42.777 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~240s 2023-10-19T08:45:42.777 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~240s 2023-10-19T08:45:42.777 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~240s 2023-10-19T08:45:42.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~240s 2023-10-19T08:45:42.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~240s 2023-10-19T08:45:42.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~240s 2023-10-19T08:45:42.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~240s 2023-10-19T08:45:42.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~246s 2023-10-19T08:45:42.779 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~246s 2023-10-19T08:45:42.779 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~246s 2023-10-19T08:45:42.779 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~246s 2023-10-19T08:45:42.779 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~246s 2023-10-19T08:45:42.779 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~246s 2023-10-19T08:45:42.780 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~246s 2023-10-19T08:45:42.780 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~246s 2023-10-19T08:45:42.780 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~246s 2023-10-19T08:45:42.780 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~246s 2023-10-19T08:45:47.781 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~245s 2023-10-19T08:45:47.782 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~245s 2023-10-19T08:45:47.782 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~245s 2023-10-19T08:45:47.782 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~245s 2023-10-19T08:45:47.782 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~245s 2023-10-19T08:45:47.783 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~245s 2023-10-19T08:45:47.783 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~245s 2023-10-19T08:45:47.783 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~251s 2023-10-19T08:45:47.783 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~251s 2023-10-19T08:45:47.783 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~251s 2023-10-19T08:45:47.783 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~251s 2023-10-19T08:45:47.784 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~251s 2023-10-19T08:45:47.784 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~251s 2023-10-19T08:45:47.784 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~251s 2023-10-19T08:45:47.784 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~251s 2023-10-19T08:45:47.785 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~251s 2023-10-19T08:45:47.785 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~251s 2023-10-19T08:45:48.282 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-19T08:45:52.786 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~250s 2023-10-19T08:45:52.787 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~250s 2023-10-19T08:45:52.787 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~250s 2023-10-19T08:45:52.787 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~250s 2023-10-19T08:45:52.787 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~250s 2023-10-19T08:45:52.787 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~250s 2023-10-19T08:45:52.788 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~250s 2023-10-19T08:45:52.788 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~256s 2023-10-19T08:45:52.788 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~256s 2023-10-19T08:45:52.788 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~256s 2023-10-19T08:45:52.788 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~256s 2023-10-19T08:45:52.788 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~256s 2023-10-19T08:45:52.789 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~256s 2023-10-19T08:45:52.789 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~256s 2023-10-19T08:45:52.789 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~256s 2023-10-19T08:45:52.789 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~256s 2023-10-19T08:45:52.790 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~256s 2023-10-19T08:45:57.791 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~255s 2023-10-19T08:45:57.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~255s 2023-10-19T08:45:57.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~255s 2023-10-19T08:45:57.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~255s 2023-10-19T08:45:57.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~255s 2023-10-19T08:45:57.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~255s 2023-10-19T08:45:57.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~255s 2023-10-19T08:45:57.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~261s 2023-10-19T08:45:57.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~261s 2023-10-19T08:45:57.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~261s 2023-10-19T08:45:57.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~261s 2023-10-19T08:45:57.794 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~261s 2023-10-19T08:45:57.794 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~261s 2023-10-19T08:45:57.794 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~261s 2023-10-19T08:45:57.794 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~261s 2023-10-19T08:45:57.794 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~261s 2023-10-19T08:45:57.795 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~261s 2023-10-19T08:46:00.284 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:46:00.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:46:02.490 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-19T08:46:02.796 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~260s 2023-10-19T08:46:02.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~260s 2023-10-19T08:46:02.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~260s 2023-10-19T08:46:02.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~260s 2023-10-19T08:46:02.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~260s 2023-10-19T08:46:02.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~260s 2023-10-19T08:46:02.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~260s 2023-10-19T08:46:02.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~266s 2023-10-19T08:46:02.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~266s 2023-10-19T08:46:02.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~266s 2023-10-19T08:46:02.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~266s 2023-10-19T08:46:02.799 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~266s 2023-10-19T08:46:02.799 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~266s 2023-10-19T08:46:02.799 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~266s 2023-10-19T08:46:02.799 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~266s 2023-10-19T08:46:02.799 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~266s 2023-10-19T08:46:02.800 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~266s 2023-10-19T08:46:05.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:46:05.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:46:05.562 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-19T08:46:05.563 WARNING:teuthology.contextutil:'reconnect to {self.shortname}' reached maximum tries (5) after waiting for 30 seconds 2023-10-19T08:46:05.564 INFO:tasks.cephfs_test_runner:If any client gets unresponsive/it's session get idle due to lagginess ... ERROR 2023-10-19T08:46:05.565 INFO:tasks.cephfs_test_runner:ERROR 2023-10-19T08:46:05.565 INFO:tasks.cephfs_test_runner: 2023-10-19T08:46:05.566 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-19T08:46:05.566 INFO:tasks.cephfs_test_runner:ERROR: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) 2023-10-19T08:46:05.566 INFO:tasks.cephfs_test_runner:If any client gets unresponsive/it's session get idle due to lagginess 2023-10-19T08:46:05.567 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-19T08:46:05.567 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-19T08:46:05.567 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/test_client_recovery.py", line 797, in test_client_eviction_if_config_is_set 2023-10-19T08:46:05.567 INFO:tasks.cephfs_test_runner: mount_a_gid = self.mount_a.get_global_id() 2023-10-19T08:46:05.568 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/fuse_mount.py", line 494, in get_global_id 2023-10-19T08:46:05.568 INFO:tasks.cephfs_test_runner: return self.admin_socket(['mds_sessions'])['id'] 2023-10-19T08:46:05.568 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/fuse_mount.py", line 471, in admin_socket 2023-10-19T08:46:05.569 INFO:tasks.cephfs_test_runner: asok_path = self.find_admin_socket() 2023-10-19T08:46:05.569 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/fuse_mount.py", line 466, in find_admin_socket 2023-10-19T08:46:05.569 INFO:tasks.cephfs_test_runner: asok_path = self.run_python(pyscript, sudo=True) 2023-10-19T08:46:05.569 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/mount.py", line 770, in run_python 2023-10-19T08:46:05.570 INFO:tasks.cephfs_test_runner: p = self._run_python(pyscript, py_version, sudo=sudo) 2023-10-19T08:46:05.570 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/mount.py", line 766, in _run_python 2023-10-19T08:46:05.570 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, wait=False, stdin=run.PIPE, 2023-10-19T08:46:05.571 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 521, in run 2023-10-19T08:46:05.571 INFO:tasks.cephfs_test_runner: raise ConnectionError(f'Failed to reconnect to {self.shortname}') 2023-10-19T08:46:05.571 INFO:tasks.cephfs_test_runner:ConnectionError: Failed to reconnect to smithi079 2023-10-19T08:46:05.571 INFO:tasks.cephfs_test_runner: 2023-10-19T08:46:05.572 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-19T08:46:05.572 INFO:tasks.cephfs_test_runner: 2023-10-19T08:46:05.572 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-19T08:46:05.572 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/test_client_recovery.py", line 828, in test_client_eviction_if_config_is_set 2023-10-19T08:46:05.573 INFO:tasks.cephfs_test_runner: self.mount_a.kill_cleanup() 2023-10-19T08:46:05.573 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/mount.py", line 616, in kill_cleanup 2023-10-19T08:46:05.573 INFO:tasks.cephfs_test_runner: self.umount_wait(force=True) 2023-10-19T08:46:05.574 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/fuse_mount.py", line 369, in umount_wait 2023-10-19T08:46:05.574 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2023-10-19T08:46:05.574 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/mount.py", line 220, in is_mounted 2023-10-19T08:46:05.575 INFO:tasks.cephfs_test_runner: file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) 2023-10-19T08:46:05.575 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 253, in read_file 2023-10-19T08:46:05.575 INFO:tasks.cephfs_test_runner: proc = self.run(args=args, stdout=stdout, stderr=StringIO(), 2023-10-19T08:46:05.576 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 521, in run 2023-10-19T08:46:05.576 INFO:tasks.cephfs_test_runner: raise ConnectionError(f'Failed to reconnect to {self.shortname}') 2023-10-19T08:46:05.576 INFO:tasks.cephfs_test_runner:ConnectionError: Failed to reconnect to smithi079 2023-10-19T08:46:05.576 INFO:tasks.cephfs_test_runner: 2023-10-19T08:46:05.577 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-19T08:46:05.577 INFO:tasks.cephfs_test_runner:ERROR: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) 2023-10-19T08:46:05.577 INFO:tasks.cephfs_test_runner:If any client gets unresponsive/it's session get idle due to lagginess 2023-10-19T08:46:05.578 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-19T08:46:05.578 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-19T08:46:05.578 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/cephfs_test_case.py", line 242, in tearDown 2023-10-19T08:46:05.578 INFO:tasks.cephfs_test_runner: self.mds_cluster.clear_firewall() 2023-10-19T08:46:05.579 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/filesystem.py", line 476, in clear_firewall 2023-10-19T08:46:05.579 INFO:tasks.cephfs_test_runner: clear_firewall(self._ctx) 2023-10-19T08:46:05.579 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/nuke/actions.py", line 19, in clear_firewall 2023-10-19T08:46:05.579 INFO:tasks.cephfs_test_runner: ctx.cluster.run( 2023-10-19T08:46:05.580 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in run 2023-10-19T08:46:05.580 INFO:tasks.cephfs_test_runner: procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] 2023-10-19T08:46:05.580 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in 2023-10-19T08:46:05.580 INFO:tasks.cephfs_test_runner: procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] 2023-10-19T08:46:05.580 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 521, in run 2023-10-19T08:46:05.581 INFO:tasks.cephfs_test_runner: raise ConnectionError(f'Failed to reconnect to {self.shortname}') 2023-10-19T08:46:05.581 INFO:tasks.cephfs_test_runner:ConnectionError: Failed to reconnect to smithi079 2023-10-19T08:46:05.581 INFO:tasks.cephfs_test_runner: 2023-10-19T08:46:05.581 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-19T08:46:05.582 INFO:tasks.cephfs_test_runner:Ran 2 tests in 435.032s 2023-10-19T08:46:05.582 INFO:tasks.cephfs_test_runner: 2023-10-19T08:46:05.583 INFO:tasks.cephfs_test_runner:FAILED (errors=2, skipped=1) 2023-10-19T08:46:05.583 INFO:tasks.cephfs_test_runner: 2023-10-19T08:46:05.583 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-19T08:46:05.583 INFO:tasks.cephfs_test_runner:ERROR: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) 2023-10-19T08:46:05.584 INFO:tasks.cephfs_test_runner:If any client gets unresponsive/it's session get idle due to lagginess 2023-10-19T08:46:05.584 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-19T08:46:05.584 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-19T08:46:05.585 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/test_client_recovery.py", line 797, in test_client_eviction_if_config_is_set 2023-10-19T08:46:05.585 INFO:tasks.cephfs_test_runner: mount_a_gid = self.mount_a.get_global_id() 2023-10-19T08:46:05.585 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/fuse_mount.py", line 494, in get_global_id 2023-10-19T08:46:05.586 INFO:tasks.cephfs_test_runner: return self.admin_socket(['mds_sessions'])['id'] 2023-10-19T08:46:05.586 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/fuse_mount.py", line 471, in admin_socket 2023-10-19T08:46:05.586 INFO:tasks.cephfs_test_runner: asok_path = self.find_admin_socket() 2023-10-19T08:46:05.586 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/fuse_mount.py", line 466, in find_admin_socket 2023-10-19T08:46:05.587 INFO:tasks.cephfs_test_runner: asok_path = self.run_python(pyscript, sudo=True) 2023-10-19T08:46:05.587 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/mount.py", line 770, in run_python 2023-10-19T08:46:05.587 INFO:tasks.cephfs_test_runner: p = self._run_python(pyscript, py_version, sudo=sudo) 2023-10-19T08:46:05.587 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/mount.py", line 766, in _run_python 2023-10-19T08:46:05.588 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, wait=False, stdin=run.PIPE, 2023-10-19T08:46:05.588 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 521, in run 2023-10-19T08:46:05.588 INFO:tasks.cephfs_test_runner: raise ConnectionError(f'Failed to reconnect to {self.shortname}') 2023-10-19T08:46:05.588 INFO:tasks.cephfs_test_runner:ConnectionError: Failed to reconnect to smithi079 2023-10-19T08:46:05.589 INFO:tasks.cephfs_test_runner: 2023-10-19T08:46:05.589 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-19T08:46:05.589 INFO:tasks.cephfs_test_runner: 2023-10-19T08:46:05.590 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-19T08:46:05.590 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/test_client_recovery.py", line 828, in test_client_eviction_if_config_is_set 2023-10-19T08:46:05.590 INFO:tasks.cephfs_test_runner: self.mount_a.kill_cleanup() 2023-10-19T08:46:05.590 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/mount.py", line 616, in kill_cleanup 2023-10-19T08:46:05.591 INFO:tasks.cephfs_test_runner: self.umount_wait(force=True) 2023-10-19T08:46:05.591 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/fuse_mount.py", line 369, in umount_wait 2023-10-19T08:46:05.591 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2023-10-19T08:46:05.591 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/mount.py", line 220, in is_mounted 2023-10-19T08:46:05.592 INFO:tasks.cephfs_test_runner: file = self.client_remote.read_file('/proc/self/mounts',stdout=StringIO()) 2023-10-19T08:46:05.592 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 253, in read_file 2023-10-19T08:46:05.592 INFO:tasks.cephfs_test_runner: proc = self.run(args=args, stdout=stdout, stderr=StringIO(), 2023-10-19T08:46:05.593 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 521, in run 2023-10-19T08:46:05.593 INFO:tasks.cephfs_test_runner: raise ConnectionError(f'Failed to reconnect to {self.shortname}') 2023-10-19T08:46:05.593 INFO:tasks.cephfs_test_runner:ConnectionError: Failed to reconnect to smithi079 2023-10-19T08:46:05.593 INFO:tasks.cephfs_test_runner: 2023-10-19T08:46:05.594 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-19T08:46:05.594 INFO:tasks.cephfs_test_runner:ERROR: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) 2023-10-19T08:46:05.594 INFO:tasks.cephfs_test_runner:If any client gets unresponsive/it's session get idle due to lagginess 2023-10-19T08:46:05.595 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-19T08:46:05.595 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-19T08:46:05.595 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/cephfs_test_case.py", line 242, in tearDown 2023-10-19T08:46:05.595 INFO:tasks.cephfs_test_runner: self.mds_cluster.clear_firewall() 2023-10-19T08:46:05.596 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs/filesystem.py", line 476, in clear_firewall 2023-10-19T08:46:05.596 INFO:tasks.cephfs_test_runner: clear_firewall(self._ctx) 2023-10-19T08:46:05.596 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/nuke/actions.py", line 19, in clear_firewall 2023-10-19T08:46:05.596 INFO:tasks.cephfs_test_runner: ctx.cluster.run( 2023-10-19T08:46:05.597 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in run 2023-10-19T08:46:05.597 INFO:tasks.cephfs_test_runner: procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] 2023-10-19T08:46:05.597 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in 2023-10-19T08:46:05.597 INFO:tasks.cephfs_test_runner: procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] 2023-10-19T08:46:05.598 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 521, in run 2023-10-19T08:46:05.598 INFO:tasks.cephfs_test_runner: raise ConnectionError(f'Failed to reconnect to {self.shortname}') 2023-10-19T08:46:05.598 INFO:tasks.cephfs_test_runner:ConnectionError: Failed to reconnect to smithi079 2023-10-19T08:46:05.598 INFO:tasks.cephfs_test_runner: 2023-10-19T08:46:05.599 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD), test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) 2023-10-19T08:46:05.665 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=dbe86e5a4b5a4994a822d7ac4e45d89d Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD), test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD) 2023-10-19T08:46:05.667 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-19T08:46:05.678 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-19T08:46:05.700 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-19T08:46:05.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:46:05.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:46:07.801 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~265s 2023-10-19T08:46:07.802 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~265s 2023-10-19T08:46:07.802 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~265s 2023-10-19T08:46:07.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~265s 2023-10-19T08:46:07.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~265s 2023-10-19T08:46:07.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~265s 2023-10-19T08:46:07.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~265s 2023-10-19T08:46:07.804 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~271s 2023-10-19T08:46:07.804 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~271s 2023-10-19T08:46:07.804 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~271s 2023-10-19T08:46:07.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~271s 2023-10-19T08:46:07.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~271s 2023-10-19T08:46:07.805 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~271s 2023-10-19T08:46:07.806 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~271s 2023-10-19T08:46:07.806 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~271s 2023-10-19T08:46:07.806 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~271s 2023-10-19T08:46:07.806 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~271s 2023-10-19T08:46:08.762 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-10-19T08:46:12.808 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~270s 2023-10-19T08:46:12.809 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~270s 2023-10-19T08:46:12.809 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~270s 2023-10-19T08:46:12.810 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~270s 2023-10-19T08:46:12.810 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~270s 2023-10-19T08:46:12.810 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~270s 2023-10-19T08:46:12.810 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~270s 2023-10-19T08:46:12.811 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~276s 2023-10-19T08:46:12.811 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~276s 2023-10-19T08:46:12.811 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~276s 2023-10-19T08:46:12.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~276s 2023-10-19T08:46:12.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~276s 2023-10-19T08:46:12.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~276s 2023-10-19T08:46:12.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~276s 2023-10-19T08:46:12.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~276s 2023-10-19T08:46:12.813 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~276s 2023-10-19T08:46:12.814 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~276s 2023-10-19T08:46:17.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:46:17.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:46:17.815 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~275s 2023-10-19T08:46:17.815 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~275s 2023-10-19T08:46:17.815 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~275s 2023-10-19T08:46:17.816 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~275s 2023-10-19T08:46:17.816 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~275s 2023-10-19T08:46:17.816 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~275s 2023-10-19T08:46:17.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~275s 2023-10-19T08:46:17.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~281s 2023-10-19T08:46:17.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~281s 2023-10-19T08:46:17.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~281s 2023-10-19T08:46:17.818 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~281s 2023-10-19T08:46:17.818 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~281s 2023-10-19T08:46:17.818 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~281s 2023-10-19T08:46:17.819 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~281s 2023-10-19T08:46:17.819 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~281s 2023-10-19T08:46:17.819 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~281s 2023-10-19T08:46:17.819 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~281s 2023-10-19T08:46:17.849 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-10-19T08:46:17.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-10-19T08:46:17.917 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:46:17.917 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T08:46:17.972 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054617,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6495288k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20855 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3247640k,nr_inodes=811910,mode=700,uid=1000,gid=1301,inode64 0 0 2023-10-19T08:46:17.972 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2023-10-19T08:46:17.973 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T08:46:18.027 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054617,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6495288k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20855 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3247640k,nr_inodes=811910,mode=700,uid=1000,gid=1301,inode64 0 0 2023-10-19T08:46:18.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-19T08:46:18.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-19T08:46:21.245 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-10-19T08:46:21.553 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-10-19T08:46:21.554 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:46:21.555 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T08:46:21.587 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054578,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6495224k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18863 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3247608k,nr_inodes=811902,mode=700,uid=1000,gid=1301,inode64 0 0 2023-10-19T08:46:21.587 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-10-19T08:46:21.588 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-19T08:46:21.643 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054578,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6495224k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18863 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3247608k,nr_inodes=811902,mode=700,uid=1000,gid=1301,inode64 0 0 2023-10-19T08:46:21.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:46:21.644 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2023-10-19T08:46:21.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:46:21.691 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2023-10-19T08:46:21.785 INFO:teuthology.orchestra.run.smithi079.stderr:Cannot find device "ceph-brx" 2023-10-19T08:46:21.809 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T08:46:21.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:46:21.810 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-10-19T08:46:21.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-19T08:46:21.849 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2023-10-19T08:46:21.971 INFO:teuthology.orchestra.run.smithi089.stderr:Cannot find device "ceph-brx" 2023-10-19T08:46:21.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T08:46:21.991 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-19T08:46:22.002 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-19T08:46:22.003 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-19T08:46:22.028 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: adjust-ulimits: command not found 2023-10-19T08:46:22.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T08:46:22.029 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-19T08:46:22.038 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-19T08:46:22.039 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-19T08:46:22.039 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:46:22.042 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T08:46:22.042 ERROR:teuthology.misc:Saw exception from ceph.mds.a Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi079 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2023-10-19T08:46:22.053 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-19T08:46:22.053 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:46:22.054 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T08:46:22.054 ERROR:teuthology.misc:Saw exception from ceph.mds.c Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi079 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2023-10-19T08:46:22.064 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-19T08:46:22.064 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:46:22.065 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T08:46:22.065 ERROR:teuthology.misc:Saw exception from ceph.mds.b Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2023-10-19T08:46:22.075 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-19T08:46:22.076 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:46:22.076 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T08:46:22.077 ERROR:teuthology.misc:Saw exception from ceph.mds.d Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2023-10-19T08:46:22.087 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-19T08:46:22.088 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-19T08:46:22.088 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:46:22.089 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T08:46:22.089 ERROR:teuthology.misc:Saw exception from ceph.osd.0 Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi079 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' 2023-10-19T08:46:22.103 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-19T08:46:22.103 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:46:22.104 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T08:46:22.104 ERROR:teuthology.misc:Saw exception from ceph.osd.1 Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi079 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1' 2023-10-19T08:46:22.120 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-19T08:46:22.121 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:46:22.121 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T08:46:22.122 ERROR:teuthology.misc:Saw exception from ceph.osd.2 Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi079 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2' 2023-10-19T08:46:22.174 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-19T08:46:22.175 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:46:22.176 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T08:46:22.176 ERROR:teuthology.misc:Saw exception from ceph.osd.3 Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi079 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3' 2023-10-19T08:46:22.191 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-19T08:46:22.191 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:46:22.192 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T08:46:22.193 ERROR:teuthology.misc:Saw exception from ceph.osd.4 Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4' 2023-10-19T08:46:22.207 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-19T08:46:22.208 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:46:22.208 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T08:46:22.209 ERROR:teuthology.misc:Saw exception from ceph.osd.5 Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5' 2023-10-19T08:46:22.222 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-19T08:46:22.223 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:46:22.224 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T08:46:22.224 ERROR:teuthology.misc:Saw exception from ceph.osd.6 Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6' 2023-10-19T08:46:22.238 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-19T08:46:22.238 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:46:22.239 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T08:46:22.239 ERROR:teuthology.misc:Saw exception from ceph.osd.7 Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' 2023-10-19T08:46:22.253 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-19T08:46:22.254 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-19T08:46:22.255 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:46:22.256 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T08:46:22.257 ERROR:teuthology.misc:Saw exception from ceph.mgr.y Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi079 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y' 2023-10-19T08:46:22.276 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-19T08:46:22.277 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:46:22.278 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T08:46:22.278 ERROR:teuthology.misc:Saw exception from ceph.mgr.x Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-10-19T08:46:22.296 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-19T08:46:22.297 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-19T08:46:22.297 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:46:22.298 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T08:46:22.299 ERROR:teuthology.misc:Saw exception from ceph.mon.a Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi079 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a' 2023-10-19T08:46:22.321 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-19T08:46:22.321 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:46:22.322 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T08:46:22.322 ERROR:teuthology.misc:Saw exception from ceph.mon.b Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b' 2023-10-19T08:46:22.345 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-19T08:46:22.345 INFO:teuthology.orchestra.run:waiting for 300 2023-10-19T08:46:22.346 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-10-19T08:46:22.346 ERROR:teuthology.misc:Saw exception from ceph.mon.c Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1471, in run_daemon teuthology.stop_daemons_of_type(ctx, type_, cluster_name) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1180, in stop_daemons_of_type raise exc File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 1173, in stop_daemons_of_type daemon.stop() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 174, in _raise_for_status raise ConnectionLostError(command=self.command, teuthology.exceptions.ConnectionLostError: SSH connection to smithi089 was lost: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c' 2023-10-19T08:46:22.369 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-19T08:46:22.370 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v 'but it is still running' | egrep -v 'slow request' | egrep -v MDS_CLIENT_LATE_RELEASE | egrep -v 't responding to mclientcaps' | egrep -v 'file system flag refuse_client_session is set' | egrep -v 'Degraded data redundancy' | egrep -v MDS_CLIENTS_LAGGY | egrep -v 'Reduced data availability' | head -n 1 2023-10-19T08:46:22.408 INFO:teuthology.orchestra.run.smithi079.stderr:grep: /var/log/ceph/ceph.log: No such file or directory 2023-10-19T08:46:22.410 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi079.front.sepia.ceph.com 2023-10-19T08:46:22.411 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-19T08:46:22.535 INFO:teuthology.orchestra.run.smithi079.stderr:umount: /var/lib/ceph/osd/ceph-0: no mount point specified. 2023-10-19T08:46:22.537 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-19T08:46:22.538 DEBUG:teuthology.orchestra.run.smithi079:> sudo PATH=/usr/sbin:$PATH lsof ; ps auxf 2023-10-19T08:46:22.676 INFO:teuthology.orchestra.run.smithi079.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-10-19T08:46:22.677 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.677 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.677 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-10-19T08:46:22.677 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 595024 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-19T08:46:22.678 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:22.678 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:22.678 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-19T08:46:22.679 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:22.679 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:22.679 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:22.680 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-10-19T08:46:22.680 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:22.680 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:22.680 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:22.681 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:22.681 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:22.681 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-19T08:46:22.681 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:22.682 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:22.682 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-19T08:46:22.682 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:22.683 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:22.683 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:22.683 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-10-19T08:46:22.683 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:22.684 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-10-19T08:46:22.684 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-10-19T08:46:22.684 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:22.685 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-19T08:46:22.685 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-10-19T08:46:22.685 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-10-19T08:46:22.686 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:22.686 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 21219 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-19T08:46:22.686 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:22.686 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-19T08:46:22.687 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.687 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.687 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.688 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 3w CHR 1,11 0t0 10 /dev/kmsg 2023-10-19T08:46:22.688 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 4u a_inode 0,14 0 11268 [eventpoll:5,6,8,9,11,14,15,16,17,18,19,24,28,29,30,31,40,41,44,45,53,54,57,59,60,69,72,76,77,78,80,82...] 2023-10-19T08:46:22.688 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 5u a_inode 0,14 0 11268 [signalfd] 2023-10-19T08:46:22.688 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 6r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:22.689 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 7r DIR 0,25 0 1 /sys/fs/cgroup 2023-10-19T08:46:22.689 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 8u a_inode 0,14 0 11268 [timerfd] 2023-10-19T08:46:22.689 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 9u a_inode 0,14 0 11268 [eventpoll:10,13] 2023-10-19T08:46:22.689 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 10r REG 0,20 0 15482 /proc/1/mountinfo 2023-10-19T08:46:22.690 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 11r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:22.690 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 12u netlink 0t0 20851 AUDIT 2023-10-19T08:46:22.690 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 13r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:22.690 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 14r REG 0,20 0 4026532076 /proc/swaps 2023-10-19T08:46:22.691 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 15u netlink 0t0 20843 KOBJECT_UEVENT 2023-10-19T08:46:22.691 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 16u unix 0xffff957488412200 0t0 20845 /run/systemd/private type=STREAM (LISTEN) 2023-10-19T08:46:22.691 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 17u a_inode 0,14 0 11268 [timerfd] 2023-10-19T08:46:22.692 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 18r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:22.692 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 19r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:22.692 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 20r FIFO 0,13 0t0 20848 pipe 2023-10-19T08:46:22.692 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 21w FIFO 0,13 0t0 20848 pipe 2023-10-19T08:46:22.693 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 22r FIFO 0,13 0t0 20849 pipe 2023-10-19T08:46:22.693 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 23w FIFO 0,13 0t0 20849 pipe 2023-10-19T08:46:22.693 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 24r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:22.693 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 25u unix 0xffff95748b124c80 0t0 395 type=DGRAM (CONNECTED) 2023-10-19T08:46:22.694 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 26u a_inode 0,14 0 11268 bpf-prog 2023-10-19T08:46:22.694 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 27r CHR 10,235 0t0 111 /dev/autofs 2023-10-19T08:46:22.694 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 28r FIFO 0,13 0t0 20855 pipe 2023-10-19T08:46:22.694 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 29u FIFO 0,24 0t0 412 /run/dmeventd-server 2023-10-19T08:46:22.695 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 30u FIFO 0,24 0t0 413 /run/dmeventd-client 2023-10-19T08:46:22.695 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 31u unix 0xffff957488633b80 0t0 19548 /run/lvm/lvmpolld.socket type=STREAM (LISTEN) 2023-10-19T08:46:22.695 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 32u unix 0xffff957488632a80 0t0 19550 /run/rpcbind.sock type=STREAM (LISTEN) 2023-10-19T08:46:22.695 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 33u unix 0xffff95748803dd80 0t0 19560 /run/systemd/coredump type=SEQPACKET (LISTEN) 2023-10-19T08:46:22.696 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 34u IPv4 14478 0t0 TCP *:sunrpc (LISTEN) 2023-10-19T08:46:22.696 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 35u IPv4 18695 0t0 UDP *:sunrpc 2023-10-19T08:46:22.696 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 36u IPv6 14484 0t0 TCP *:sunrpc (LISTEN) 2023-10-19T08:46:22.696 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 37u IPv6 18701 0t0 UDP *:sunrpc 2023-10-19T08:46:22.697 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 38u FIFO 0,24 0t0 418 /run/initctl 2023-10-19T08:46:22.697 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 39u unix 0xffff95748803e600 0t0 19562 /run/udev/control type=SEQPACKET (LISTEN) 2023-10-19T08:46:22.697 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 40u unix 0xffff957488430cc0 0t0 15484 /run/systemd/notify type=DGRAM (CONNECTED) 2023-10-19T08:46:22.698 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 41u unix 0xffff957488432ec0 0t0 15485 type=DGRAM (CONNECTED) 2023-10-19T08:46:22.698 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 42u unix 0xffff957488437b40 0t0 15486 type=DGRAM (CONNECTED) 2023-10-19T08:46:22.698 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 43u netlink 0t0 19564 KOBJECT_UEVENT 2023-10-19T08:46:22.698 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 44u unix 0xffff957488416a40 0t0 15490 /run/systemd/io.system.ManagedOOM type=STREAM (LISTEN) 2023-10-19T08:46:22.699 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 45u unix 0xffff957488415500 0t0 15489 /run/systemd/userdb/io.systemd.DynamicUser type=STREAM (LISTEN) 2023-10-19T08:46:22.699 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 46u unix 0xffff957488431980 0t0 15497 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2023-10-19T08:46:22.699 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 47u unix 0xffff957488435500 0t0 15499 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2023-10-19T08:46:22.700 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 48u unix 0xffff957488411dc0 0t0 15501 /run/systemd/journal/stdout type=STREAM (LISTEN) 2023-10-19T08:46:22.700 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 49u a_inode 0,14 0 11268 bpf-prog 2023-10-19T08:46:22.700 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 50u a_inode 0,14 0 11268 bpf-prog 2023-10-19T08:46:22.700 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 51u a_inode 0,14 0 11268 bpf-prog 2023-10-19T08:46:22.701 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 52u a_inode 0,14 0 11268 bpf-prog 2023-10-19T08:46:22.701 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 53u unix 0xffff9574884a3300 0t0 19586 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.701 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 54u a_inode 0,14 0 11268 [timerfd] 2023-10-19T08:46:22.701 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 55u unix 0xffff957488414c80 0t0 20988 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-10-19T08:46:22.702 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 56u unix 0xffff957483132a80 0t0 21768 /run/.heim_org.h5l.kcm-socket type=STREAM (LISTEN) 2023-10-19T08:46:22.702 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 57u unix 0xffff9574884a2640 0t0 20934 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.702 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 58u a_inode 0,14 0 11268 bpf-prog 2023-10-19T08:46:22.702 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 59u unix 0xffff9574884a6600 0t0 19648 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.703 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 60u unix 0xffff957483131540 0t0 21775 type=STREAM (CONNECTED) 2023-10-19T08:46:22.703 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 61u a_inode 0,14 0 11268 bpf-prog 2023-10-19T08:46:22.703 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 62u a_inode 0,14 0 11268 bpf-prog 2023-10-19T08:46:22.703 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 63u a_inode 0,14 0 11268 bpf-prog 2023-10-19T08:46:22.704 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 64u a_inode 0,14 0 11268 bpf-prog 2023-10-19T08:46:22.704 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 65u a_inode 0,14 0 11268 bpf-prog 2023-10-19T08:46:22.704 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 68u unix 0xffff957488549980 0t0 20045 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.704 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 69u unix 0xffff9574982bee80 0t0 19649 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.705 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 70u a_inode 0,14 0 11268 bpf-prog 2023-10-19T08:46:22.705 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 71u unix 0xffff957488039dc0 0t0 19700 type=DGRAM (CONNECTED) 2023-10-19T08:46:22.705 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 72u unix 0xffff9574982b8880 0t0 19658 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.705 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 73u unix 0xffff9574884a2200 0t0 22552 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.706 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 74u unix 0xffff9574884a1100 0t0 22553 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.706 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 75u unix 0xffff95748803cc80 0t0 19701 type=DGRAM (CONNECTED) 2023-10-19T08:46:22.706 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 76u unix 0xffff957488411100 0t0 22644 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.707 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 77u CHR 10,242 0t0 159 /dev/rfkill 2023-10-19T08:46:22.707 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 78u unix 0xffff9574982bf700 0t0 22647 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.707 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 80u unix 0xffff9574880b0000 0t0 11977 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.707 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 81u unix 0xffff9574880b7b40 0t0 22560 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.708 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 82u unix 0xffff95749821e1c0 0t0 11978 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.708 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 84u unix 0xffff957483132200 0t0 21117 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.708 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 1 root 86u unix 0xffff957483131100 0t0 21127 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.708 INFO:teuthology.orchestra.run.smithi079.stdout:kthreadd 2 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.709 INFO:teuthology.orchestra.run.smithi079.stdout:kthreadd 2 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.709 INFO:teuthology.orchestra.run.smithi079.stdout:kthreadd 2 root txt unknown /proc/2/exe 2023-10-19T08:46:22.709 INFO:teuthology.orchestra.run.smithi079.stdout:rcu_gp 3 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.710 INFO:teuthology.orchestra.run.smithi079.stdout:rcu_gp 3 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.710 INFO:teuthology.orchestra.run.smithi079.stdout:rcu_gp 3 root txt unknown /proc/3/exe 2023-10-19T08:46:22.710 INFO:teuthology.orchestra.run.smithi079.stdout:rcu_par_g 4 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.710 INFO:teuthology.orchestra.run.smithi079.stdout:rcu_par_g 4 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.711 INFO:teuthology.orchestra.run.smithi079.stdout:rcu_par_g 4 root txt unknown /proc/4/exe 2023-10-19T08:46:22.711 INFO:teuthology.orchestra.run.smithi079.stdout:slub_flus 5 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.711 INFO:teuthology.orchestra.run.smithi079.stdout:slub_flus 5 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.711 INFO:teuthology.orchestra.run.smithi079.stdout:slub_flus 5 root txt unknown /proc/5/exe 2023-10-19T08:46:22.712 INFO:teuthology.orchestra.run.smithi079.stdout:netns 6 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.712 INFO:teuthology.orchestra.run.smithi079.stdout:netns 6 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.712 INFO:teuthology.orchestra.run.smithi079.stdout:netns 6 root txt unknown /proc/6/exe 2023-10-19T08:46:22.713 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/0 7 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.713 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/0 7 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.713 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/0 7 root txt unknown /proc/7/exe 2023-10-19T08:46:22.713 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/0 8 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.714 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/0 8 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.714 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/0 8 root txt unknown /proc/8/exe 2023-10-19T08:46:22.714 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 9 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.714 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 9 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.715 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 9 root txt unknown /proc/9/exe 2023-10-19T08:46:22.715 INFO:teuthology.orchestra.run.smithi079.stdout:mm_percpu 10 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.715 INFO:teuthology.orchestra.run.smithi079.stdout:mm_percpu 10 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.715 INFO:teuthology.orchestra.run.smithi079.stdout:mm_percpu 10 root txt unknown /proc/10/exe 2023-10-19T08:46:22.716 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 11 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.716 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 11 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.716 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 11 root txt unknown /proc/11/exe 2023-10-19T08:46:22.716 INFO:teuthology.orchestra.run.smithi079.stdout:rcu_tasks 12 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.717 INFO:teuthology.orchestra.run.smithi079.stdout:rcu_tasks 12 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.717 INFO:teuthology.orchestra.run.smithi079.stdout:rcu_tasks 12 root txt unknown /proc/12/exe 2023-10-19T08:46:22.717 INFO:teuthology.orchestra.run.smithi079.stdout:rcu_tasks 13 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.717 INFO:teuthology.orchestra.run.smithi079.stdout:rcu_tasks 13 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.718 INFO:teuthology.orchestra.run.smithi079.stdout:rcu_tasks 13 root txt unknown /proc/13/exe 2023-10-19T08:46:22.718 INFO:teuthology.orchestra.run.smithi079.stdout:rcu_tasks 14 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.718 INFO:teuthology.orchestra.run.smithi079.stdout:rcu_tasks 14 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.719 INFO:teuthology.orchestra.run.smithi079.stdout:rcu_tasks 14 root txt unknown /proc/14/exe 2023-10-19T08:46:22.719 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 15 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.719 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 15 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.719 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 15 root txt unknown /proc/15/exe 2023-10-19T08:46:22.720 INFO:teuthology.orchestra.run.smithi079.stdout:pr/ttyS1 16 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.720 INFO:teuthology.orchestra.run.smithi079.stdout:pr/ttyS1 16 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.720 INFO:teuthology.orchestra.run.smithi079.stdout:pr/ttyS1 16 root txt unknown /proc/16/exe 2023-10-19T08:46:22.720 INFO:teuthology.orchestra.run.smithi079.stdout:rcu_preem 17 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.720 INFO:teuthology.orchestra.run.smithi079.stdout:rcu_preem 17 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.721 INFO:teuthology.orchestra.run.smithi079.stdout:rcu_preem 17 root txt unknown /proc/17/exe 2023-10-19T08:46:22.721 INFO:teuthology.orchestra.run.smithi079.stdout:migration 18 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.721 INFO:teuthology.orchestra.run.smithi079.stdout:migration 18 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.721 INFO:teuthology.orchestra.run.smithi079.stdout:migration 18 root txt unknown /proc/18/exe 2023-10-19T08:46:22.722 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 19 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.722 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 19 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.722 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 19 root txt unknown /proc/19/exe 2023-10-19T08:46:22.722 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/0 20 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.723 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/0 20 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.723 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/0 20 root txt unknown /proc/20/exe 2023-10-19T08:46:22.723 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/0 21 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.723 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/0 21 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.724 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/0 21 root txt unknown /proc/21/exe 2023-10-19T08:46:22.724 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/1 22 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.724 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/1 22 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.724 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/1 22 root txt unknown /proc/22/exe 2023-10-19T08:46:22.725 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 23 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.725 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 23 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.725 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 23 root txt unknown /proc/23/exe 2023-10-19T08:46:22.725 INFO:teuthology.orchestra.run.smithi079.stdout:migration 24 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.726 INFO:teuthology.orchestra.run.smithi079.stdout:migration 24 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.726 INFO:teuthology.orchestra.run.smithi079.stdout:migration 24 root txt unknown /proc/24/exe 2023-10-19T08:46:22.726 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 25 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.727 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 25 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.727 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 25 root txt unknown /proc/25/exe 2023-10-19T08:46:22.727 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/1 26 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.727 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/1 26 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.728 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/1 26 root txt unknown /proc/26/exe 2023-10-19T08:46:22.728 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/1 27 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.728 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/1 27 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.728 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/1 27 root txt unknown /proc/27/exe 2023-10-19T08:46:22.729 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/2 28 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.729 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/2 28 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.729 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/2 28 root txt unknown /proc/28/exe 2023-10-19T08:46:22.730 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 29 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.730 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 29 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.730 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 29 root txt unknown /proc/29/exe 2023-10-19T08:46:22.730 INFO:teuthology.orchestra.run.smithi079.stdout:migration 30 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.731 INFO:teuthology.orchestra.run.smithi079.stdout:migration 30 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.731 INFO:teuthology.orchestra.run.smithi079.stdout:migration 30 root txt unknown /proc/30/exe 2023-10-19T08:46:22.731 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 31 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.731 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 31 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.732 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 31 root txt unknown /proc/31/exe 2023-10-19T08:46:22.732 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/2 32 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.732 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/2 32 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.732 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/2 32 root txt unknown /proc/32/exe 2023-10-19T08:46:22.733 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/2 33 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.733 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/2 33 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.733 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/2 33 root txt unknown /proc/33/exe 2023-10-19T08:46:22.733 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/3 34 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.734 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/3 34 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.734 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/3 34 root txt unknown /proc/34/exe 2023-10-19T08:46:22.734 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 35 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.734 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 35 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.735 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 35 root txt unknown /proc/35/exe 2023-10-19T08:46:22.735 INFO:teuthology.orchestra.run.smithi079.stdout:migration 36 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.735 INFO:teuthology.orchestra.run.smithi079.stdout:migration 36 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.736 INFO:teuthology.orchestra.run.smithi079.stdout:migration 36 root txt unknown /proc/36/exe 2023-10-19T08:46:22.736 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 37 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.736 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 37 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.736 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 37 root txt unknown /proc/37/exe 2023-10-19T08:46:22.737 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/3 38 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.737 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/3 38 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.737 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/3 38 root txt unknown /proc/38/exe 2023-10-19T08:46:22.738 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/3 39 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.738 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/3 39 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.738 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/3 39 root txt unknown /proc/39/exe 2023-10-19T08:46:22.738 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/4 40 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.739 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/4 40 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.739 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/4 40 root txt unknown /proc/40/exe 2023-10-19T08:46:22.739 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 41 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.739 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 41 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.740 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 41 root txt unknown /proc/41/exe 2023-10-19T08:46:22.740 INFO:teuthology.orchestra.run.smithi079.stdout:migration 42 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.740 INFO:teuthology.orchestra.run.smithi079.stdout:migration 42 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.740 INFO:teuthology.orchestra.run.smithi079.stdout:migration 42 root txt unknown /proc/42/exe 2023-10-19T08:46:22.741 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 43 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.741 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 43 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.741 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 43 root txt unknown /proc/43/exe 2023-10-19T08:46:22.741 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/4 44 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.742 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/4 44 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.742 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/4 44 root txt unknown /proc/44/exe 2023-10-19T08:46:22.742 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/4 45 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.742 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/4 45 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.743 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/4 45 root txt unknown /proc/45/exe 2023-10-19T08:46:22.743 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/5 46 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.743 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/5 46 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.743 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/5 46 root txt unknown /proc/46/exe 2023-10-19T08:46:22.744 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 47 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.744 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 47 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.744 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 47 root txt unknown /proc/47/exe 2023-10-19T08:46:22.745 INFO:teuthology.orchestra.run.smithi079.stdout:migration 48 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.745 INFO:teuthology.orchestra.run.smithi079.stdout:migration 48 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.745 INFO:teuthology.orchestra.run.smithi079.stdout:migration 48 root txt unknown /proc/48/exe 2023-10-19T08:46:22.745 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 49 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.746 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 49 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.746 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 49 root txt unknown /proc/49/exe 2023-10-19T08:46:22.746 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/5 50 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.747 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/5 50 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.747 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/5 50 root txt unknown /proc/50/exe 2023-10-19T08:46:22.747 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/5 51 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.747 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/5 51 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.748 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/5 51 root txt unknown /proc/51/exe 2023-10-19T08:46:22.748 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/6 52 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.748 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/6 52 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.748 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/6 52 root txt unknown /proc/52/exe 2023-10-19T08:46:22.749 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 53 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.749 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 53 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.749 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 53 root txt unknown /proc/53/exe 2023-10-19T08:46:22.749 INFO:teuthology.orchestra.run.smithi079.stdout:migration 54 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.750 INFO:teuthology.orchestra.run.smithi079.stdout:migration 54 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.750 INFO:teuthology.orchestra.run.smithi079.stdout:migration 54 root txt unknown /proc/54/exe 2023-10-19T08:46:22.750 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 55 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.751 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 55 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.751 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 55 root txt unknown /proc/55/exe 2023-10-19T08:46:22.751 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/6 56 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.751 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/6 56 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.752 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/6 56 root txt unknown /proc/56/exe 2023-10-19T08:46:22.752 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/6 57 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.752 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/6 57 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.752 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/6 57 root txt unknown /proc/57/exe 2023-10-19T08:46:22.753 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/7 58 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.753 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/7 58 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.753 INFO:teuthology.orchestra.run.smithi079.stdout:cpuhp/7 58 root txt unknown /proc/58/exe 2023-10-19T08:46:22.753 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 59 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.754 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 59 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.754 INFO:teuthology.orchestra.run.smithi079.stdout:idle_inje 59 root txt unknown /proc/59/exe 2023-10-19T08:46:22.754 INFO:teuthology.orchestra.run.smithi079.stdout:migration 60 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.755 INFO:teuthology.orchestra.run.smithi079.stdout:migration 60 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.755 INFO:teuthology.orchestra.run.smithi079.stdout:migration 60 root txt unknown /proc/60/exe 2023-10-19T08:46:22.755 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 61 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.755 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 61 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.756 INFO:teuthology.orchestra.run.smithi079.stdout:ksoftirqd 61 root txt unknown /proc/61/exe 2023-10-19T08:46:22.756 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/7 62 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.756 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/7 62 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.756 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/7 62 root txt unknown /proc/62/exe 2023-10-19T08:46:22.757 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/7 63 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.757 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/7 63 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.757 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/7 63 root txt unknown /proc/63/exe 2023-10-19T08:46:22.758 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 65 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.758 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 65 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.758 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 65 root txt unknown /proc/65/exe 2023-10-19T08:46:22.758 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 66 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.759 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 66 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.759 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 66 root txt unknown /proc/66/exe 2023-10-19T08:46:22.759 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 67 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.759 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 67 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.760 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 67 root txt unknown /proc/67/exe 2023-10-19T08:46:22.760 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 68 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.760 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 68 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.761 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 68 root txt unknown /proc/68/exe 2023-10-19T08:46:22.761 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 69 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.761 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 69 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.761 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 69 root txt unknown /proc/69/exe 2023-10-19T08:46:22.762 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 70 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.762 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 70 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.762 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 70 root txt unknown /proc/70/exe 2023-10-19T08:46:22.762 INFO:teuthology.orchestra.run.smithi079.stdout:kdevtmpfs 71 root cwd DIR 0,5 3380 1 / 2023-10-19T08:46:22.763 INFO:teuthology.orchestra.run.smithi079.stdout:kdevtmpfs 71 root rtd DIR 0,5 3380 1 / 2023-10-19T08:46:22.763 INFO:teuthology.orchestra.run.smithi079.stdout:kdevtmpfs 71 root txt unknown /proc/71/exe 2023-10-19T08:46:22.763 INFO:teuthology.orchestra.run.smithi079.stdout:inet_frag 72 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.763 INFO:teuthology.orchestra.run.smithi079.stdout:inet_frag 72 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.764 INFO:teuthology.orchestra.run.smithi079.stdout:inet_frag 72 root txt unknown /proc/72/exe 2023-10-19T08:46:22.764 INFO:teuthology.orchestra.run.smithi079.stdout:kauditd 73 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.764 INFO:teuthology.orchestra.run.smithi079.stdout:kauditd 73 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.764 INFO:teuthology.orchestra.run.smithi079.stdout:kauditd 73 root txt unknown /proc/73/exe 2023-10-19T08:46:22.765 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/4 74 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.765 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/4 74 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.765 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/4 74 root txt unknown /proc/74/exe 2023-10-19T08:46:22.765 INFO:teuthology.orchestra.run.smithi079.stdout:khungtask 75 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.766 INFO:teuthology.orchestra.run.smithi079.stdout:khungtask 75 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.766 INFO:teuthology.orchestra.run.smithi079.stdout:khungtask 75 root txt unknown /proc/75/exe 2023-10-19T08:46:22.766 INFO:teuthology.orchestra.run.smithi079.stdout:oom_reape 76 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.766 INFO:teuthology.orchestra.run.smithi079.stdout:oom_reape 76 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.767 INFO:teuthology.orchestra.run.smithi079.stdout:oom_reape 76 root txt unknown /proc/76/exe 2023-10-19T08:46:22.767 INFO:teuthology.orchestra.run.smithi079.stdout:writeback 77 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.767 INFO:teuthology.orchestra.run.smithi079.stdout:writeback 77 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.767 INFO:teuthology.orchestra.run.smithi079.stdout:writeback 77 root txt unknown /proc/77/exe 2023-10-19T08:46:22.768 INFO:teuthology.orchestra.run.smithi079.stdout:kcompactd 78 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.768 INFO:teuthology.orchestra.run.smithi079.stdout:kcompactd 78 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.768 INFO:teuthology.orchestra.run.smithi079.stdout:kcompactd 78 root txt unknown /proc/78/exe 2023-10-19T08:46:22.769 INFO:teuthology.orchestra.run.smithi079.stdout:ksmd 79 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.769 INFO:teuthology.orchestra.run.smithi079.stdout:ksmd 79 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.769 INFO:teuthology.orchestra.run.smithi079.stdout:ksmd 79 root txt unknown /proc/79/exe 2023-10-19T08:46:22.770 INFO:teuthology.orchestra.run.smithi079.stdout:khugepage 80 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.770 INFO:teuthology.orchestra.run.smithi079.stdout:khugepage 80 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.770 INFO:teuthology.orchestra.run.smithi079.stdout:khugepage 80 root txt unknown /proc/80/exe 2023-10-19T08:46:22.770 INFO:teuthology.orchestra.run.smithi079.stdout:cryptd 81 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.771 INFO:teuthology.orchestra.run.smithi079.stdout:cryptd 81 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.771 INFO:teuthology.orchestra.run.smithi079.stdout:cryptd 81 root txt unknown /proc/81/exe 2023-10-19T08:46:22.771 INFO:teuthology.orchestra.run.smithi079.stdout:kintegrit 82 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.771 INFO:teuthology.orchestra.run.smithi079.stdout:kintegrit 82 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.772 INFO:teuthology.orchestra.run.smithi079.stdout:kintegrit 82 root txt unknown /proc/82/exe 2023-10-19T08:46:22.772 INFO:teuthology.orchestra.run.smithi079.stdout:kblockd 83 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.772 INFO:teuthology.orchestra.run.smithi079.stdout:kblockd 83 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.773 INFO:teuthology.orchestra.run.smithi079.stdout:kblockd 83 root txt unknown /proc/83/exe 2023-10-19T08:46:22.773 INFO:teuthology.orchestra.run.smithi079.stdout:blkcg_pun 84 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.773 INFO:teuthology.orchestra.run.smithi079.stdout:blkcg_pun 84 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.773 INFO:teuthology.orchestra.run.smithi079.stdout:blkcg_pun 84 root txt unknown /proc/84/exe 2023-10-19T08:46:22.774 INFO:teuthology.orchestra.run.smithi079.stdout:tpm_dev_w 85 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.774 INFO:teuthology.orchestra.run.smithi079.stdout:tpm_dev_w 85 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.774 INFO:teuthology.orchestra.run.smithi079.stdout:tpm_dev_w 85 root txt unknown /proc/85/exe 2023-10-19T08:46:22.774 INFO:teuthology.orchestra.run.smithi079.stdout:md 86 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.775 INFO:teuthology.orchestra.run.smithi079.stdout:md 86 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.775 INFO:teuthology.orchestra.run.smithi079.stdout:md 86 root txt unknown /proc/86/exe 2023-10-19T08:46:22.775 INFO:teuthology.orchestra.run.smithi079.stdout:edac-poll 87 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.775 INFO:teuthology.orchestra.run.smithi079.stdout:edac-poll 87 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.776 INFO:teuthology.orchestra.run.smithi079.stdout:edac-poll 87 root txt unknown /proc/87/exe 2023-10-19T08:46:22.776 INFO:teuthology.orchestra.run.smithi079.stdout:watchdogd 88 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.776 INFO:teuthology.orchestra.run.smithi079.stdout:watchdogd 88 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.776 INFO:teuthology.orchestra.run.smithi079.stdout:watchdogd 88 root txt unknown /proc/88/exe 2023-10-19T08:46:22.777 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/6 89 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.777 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/6 89 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.777 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/6 89 root txt unknown /proc/89/exe 2023-10-19T08:46:22.777 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/6 90 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.778 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/6 90 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.778 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/6 90 root txt unknown /proc/90/exe 2023-10-19T08:46:22.778 INFO:teuthology.orchestra.run.smithi079.stdout:kswapd0 91 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.778 INFO:teuthology.orchestra.run.smithi079.stdout:kswapd0 91 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.779 INFO:teuthology.orchestra.run.smithi079.stdout:kswapd0 91 root txt unknown /proc/91/exe 2023-10-19T08:46:22.779 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/5 92 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.779 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/5 92 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.780 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/5 92 root txt unknown /proc/92/exe 2023-10-19T08:46:22.780 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/7 94 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.780 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/7 94 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.780 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/7 94 root txt unknown /proc/94/exe 2023-10-19T08:46:22.781 INFO:teuthology.orchestra.run.smithi079.stdout:kthrotld 98 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.781 INFO:teuthology.orchestra.run.smithi079.stdout:kthrotld 98 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.781 INFO:teuthology.orchestra.run.smithi079.stdout:kthrotld 98 root txt unknown /proc/98/exe 2023-10-19T08:46:22.781 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/3 99 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.782 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/3 99 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.782 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/3 99 root txt unknown /proc/99/exe 2023-10-19T08:46:22.782 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/3 100 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.783 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/3 100 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.783 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/3 100 root txt unknown /proc/100/exe 2023-10-19T08:46:22.783 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/5 103 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.783 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/5 103 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.783 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/5 103 root txt unknown /proc/103/exe 2023-10-19T08:46:22.784 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/5 104 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.784 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/5 104 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.784 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/5 104 root txt unknown /proc/104/exe 2023-10-19T08:46:22.784 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/1 106 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.785 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/1 106 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.785 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/1 106 root txt unknown /proc/106/exe 2023-10-19T08:46:22.785 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/2 107 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.785 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/2 107 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.786 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/2 107 root txt unknown /proc/107/exe 2023-10-19T08:46:22.786 INFO:teuthology.orchestra.run.smithi079.stdout:acpi_ther 108 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.786 INFO:teuthology.orchestra.run.smithi079.stdout:acpi_ther 108 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.786 INFO:teuthology.orchestra.run.smithi079.stdout:acpi_ther 108 root txt unknown /proc/108/exe 2023-10-19T08:46:22.787 INFO:teuthology.orchestra.run.smithi079.stdout:kmpath_rd 109 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.787 INFO:teuthology.orchestra.run.smithi079.stdout:kmpath_rd 109 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.787 INFO:teuthology.orchestra.run.smithi079.stdout:kmpath_rd 109 root txt unknown /proc/109/exe 2023-10-19T08:46:22.787 INFO:teuthology.orchestra.run.smithi079.stdout:kaluad 110 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.788 INFO:teuthology.orchestra.run.smithi079.stdout:kaluad 110 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.788 INFO:teuthology.orchestra.run.smithi079.stdout:kaluad 110 root txt unknown /proc/110/exe 2023-10-19T08:46:22.788 INFO:teuthology.orchestra.run.smithi079.stdout:mld 111 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.789 INFO:teuthology.orchestra.run.smithi079.stdout:mld 111 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.789 INFO:teuthology.orchestra.run.smithi079.stdout:mld 111 root txt unknown /proc/111/exe 2023-10-19T08:46:22.789 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/3 112 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.789 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/3 112 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.790 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/3 112 root txt unknown /proc/112/exe 2023-10-19T08:46:22.790 INFO:teuthology.orchestra.run.smithi079.stdout:ipv6_addr 113 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.790 INFO:teuthology.orchestra.run.smithi079.stdout:ipv6_addr 113 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.790 INFO:teuthology.orchestra.run.smithi079.stdout:ipv6_addr 113 root txt unknown /proc/113/exe 2023-10-19T08:46:22.791 INFO:teuthology.orchestra.run.smithi079.stdout:kstrp 122 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.791 INFO:teuthology.orchestra.run.smithi079.stdout:kstrp 122 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.791 INFO:teuthology.orchestra.run.smithi079.stdout:kstrp 122 root txt unknown /proc/122/exe 2023-10-19T08:46:22.791 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/1 130 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.792 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/1 130 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.792 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/1 130 root txt unknown /proc/130/exe 2023-10-19T08:46:22.792 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/6 131 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.792 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/6 131 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.793 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/6 131 root txt unknown /proc/131/exe 2023-10-19T08:46:22.793 INFO:teuthology.orchestra.run.smithi079.stdout:zswap-shr 136 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.793 INFO:teuthology.orchestra.run.smithi079.stdout:zswap-shr 136 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.793 INFO:teuthology.orchestra.run.smithi079.stdout:zswap-shr 136 root txt unknown /proc/136/exe 2023-10-19T08:46:22.794 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/3 247 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.794 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/3 247 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.794 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/3 247 root txt unknown /proc/247/exe 2023-10-19T08:46:22.795 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 251 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.795 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 251 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.795 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 251 root txt unknown /proc/251/exe 2023-10-19T08:46:22.795 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/2 301 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.796 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/2 301 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.796 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/2 301 root txt unknown /proc/301/exe 2023-10-19T08:46:22.796 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/0 306 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.796 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/0 306 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.797 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/0 306 root txt unknown /proc/306/exe 2023-10-19T08:46:22.797 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/0 384 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.797 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/0 384 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.798 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/0 384 root txt unknown /proc/384/exe 2023-10-19T08:46:22.798 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/4 385 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.798 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/4 385 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.798 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/4 385 root txt unknown /proc/385/exe 2023-10-19T08:46:22.799 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/5 387 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.799 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/5 387 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.799 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/5 387 root txt unknown /proc/387/exe 2023-10-19T08:46:22.799 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/4 388 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.800 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/4 388 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.800 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/4 388 root txt unknown /proc/388/exe 2023-10-19T08:46:22.800 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/1 421 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.800 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/1 421 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.801 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/1 421 root txt unknown /proc/421/exe 2023-10-19T08:46:22.801 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.801 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.801 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root txt REG 0,2 156280 13940 /usr/sbin/plymouthd (deleted) 2023-10-19T08:46:22.802 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-19T08:46:22.802 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:22.802 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-19T08:46:22.803 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-19T08:46:22.803 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-19T08:46:22.803 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-19T08:46:22.803 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-19T08:46:22.803 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-19T08:46:22.804 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-19T08:46:22.804 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:22.804 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root DEL REG 0,2 13775 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:22.804 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root DEL REG 0,2 13896 /usr/lib64/libudev.so.1.7.5 2023-10-19T08:46:22.805 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root DEL REG 0,2 13820 /usr/lib64/libm.so.6 2023-10-19T08:46:22.805 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root DEL REG 0,2 13740 /usr/lib64/libc.so.6 2023-10-19T08:46:22.805 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root DEL REG 0,2 13861 /usr/lib64/libply-splash-core.so.4.0.0 2023-10-19T08:46:22.805 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root DEL REG 0,2 13863 /usr/lib64/libply.so.4.0.0 2023-10-19T08:46:22.806 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-19T08:46:22.806 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-19T08:46:22.806 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root DEL REG 0,2 13724 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:22.806 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-19T08:46:22.807 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.807 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.807 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.807 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root 3u a_inode 0,14 0 11268 [eventpoll:4,6,7,8] 2023-10-19T08:46:22.808 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root 4r FIFO 0,13 0t0 16484 pipe 2023-10-19T08:46:22.808 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root 5w FIFO 0,13 0t0 16484 pipe 2023-10-19T08:46:22.808 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root 6u unix 0xffff957488631dc0 0t0 14137 @/org/freedesktop/plymouthd type=STREAM (LISTEN) 2023-10-19T08:46:22.808 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root 7u CHR 4,65 0t0 114 /dev/ttyS1 2023-10-19T08:46:22.809 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root 8u CHR 5,2 0t0 112 /dev/ptmx 2023-10-19T08:46:22.809 INFO:teuthology.orchestra.run.smithi079.stdout:plymouthd 424 root 10w REG 8,1 178198 1203 /var/log/boot.log 2023-10-19T08:46:22.809 INFO:teuthology.orchestra.run.smithi079.stdout:nvme-wq 449 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.809 INFO:teuthology.orchestra.run.smithi079.stdout:nvme-wq 449 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.810 INFO:teuthology.orchestra.run.smithi079.stdout:nvme-wq 449 root txt unknown /proc/449/exe 2023-10-19T08:46:22.810 INFO:teuthology.orchestra.run.smithi079.stdout:ata_sff 451 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.810 INFO:teuthology.orchestra.run.smithi079.stdout:ata_sff 451 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.811 INFO:teuthology.orchestra.run.smithi079.stdout:ata_sff 451 root txt unknown /proc/451/exe 2023-10-19T08:46:22.811 INFO:teuthology.orchestra.run.smithi079.stdout:nvme-rese 452 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.811 INFO:teuthology.orchestra.run.smithi079.stdout:nvme-rese 452 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.811 INFO:teuthology.orchestra.run.smithi079.stdout:nvme-rese 452 root txt unknown /proc/452/exe 2023-10-19T08:46:22.812 INFO:teuthology.orchestra.run.smithi079.stdout:nvme-dele 453 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.812 INFO:teuthology.orchestra.run.smithi079.stdout:nvme-dele 453 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.812 INFO:teuthology.orchestra.run.smithi079.stdout:nvme-dele 453 root txt unknown /proc/453/exe 2023-10-19T08:46:22.812 INFO:teuthology.orchestra.run.smithi079.stdout:nvme-auth 454 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.813 INFO:teuthology.orchestra.run.smithi079.stdout:nvme-auth 454 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.813 INFO:teuthology.orchestra.run.smithi079.stdout:nvme-auth 454 root txt unknown /proc/454/exe 2023-10-19T08:46:22.813 INFO:teuthology.orchestra.run.smithi079.stdout:ixgbe 457 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.813 INFO:teuthology.orchestra.run.smithi079.stdout:ixgbe 457 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.814 INFO:teuthology.orchestra.run.smithi079.stdout:ixgbe 457 root txt unknown /proc/457/exe 2023-10-19T08:46:22.814 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/7 460 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.814 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/7 460 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.814 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/7 460 root txt unknown /proc/460/exe 2023-10-19T08:46:22.815 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_0 461 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.815 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_0 461 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.815 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_0 461 root txt unknown /proc/461/exe 2023-10-19T08:46:22.815 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 462 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.816 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 462 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.816 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 462 root txt unknown /proc/462/exe 2023-10-19T08:46:22.816 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_1 463 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.817 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_1 463 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.817 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_1 463 root txt unknown /proc/463/exe 2023-10-19T08:46:22.817 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 464 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.817 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 464 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.818 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 464 root txt unknown /proc/464/exe 2023-10-19T08:46:22.818 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_2 465 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.818 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_2 465 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.818 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_2 465 root txt unknown /proc/465/exe 2023-10-19T08:46:22.819 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 466 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.819 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 466 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.819 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 466 root txt unknown /proc/466/exe 2023-10-19T08:46:22.819 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_3 467 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.820 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_3 467 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.820 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_3 467 root txt unknown /proc/467/exe 2023-10-19T08:46:22.820 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 468 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.820 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 468 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.821 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 468 root txt unknown /proc/468/exe 2023-10-19T08:46:22.821 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_4 469 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.821 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_4 469 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.821 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_4 469 root txt unknown /proc/469/exe 2023-10-19T08:46:22.822 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 470 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.822 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 470 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.822 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 470 root txt unknown /proc/470/exe 2023-10-19T08:46:22.822 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_5 471 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.823 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_5 471 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.823 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_5 471 root txt unknown /proc/471/exe 2023-10-19T08:46:22.823 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 472 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.823 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 472 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.824 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 472 root txt unknown /proc/472/exe 2023-10-19T08:46:22.824 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_6 473 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.824 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_6 473 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.824 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_6 473 root txt unknown /proc/473/exe 2023-10-19T08:46:22.825 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 474 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.825 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 474 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.825 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 474 root txt unknown /proc/474/exe 2023-10-19T08:46:22.826 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_7 475 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.826 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_7 475 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.826 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_7 475 root txt unknown /proc/475/exe 2023-10-19T08:46:22.826 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 476 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.827 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 476 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.827 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 476 root txt unknown /proc/476/exe 2023-10-19T08:46:22.827 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_8 477 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.827 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_8 477 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.828 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_8 477 root txt unknown /proc/477/exe 2023-10-19T08:46:22.828 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 478 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.828 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 478 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.828 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 478 root txt unknown /proc/478/exe 2023-10-19T08:46:22.829 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_9 479 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.829 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_9 479 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.829 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_eh_9 479 root txt unknown /proc/479/exe 2023-10-19T08:46:22.830 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 480 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.830 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 480 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.830 INFO:teuthology.orchestra.run.smithi079.stdout:scsi_tmf_ 480 root txt unknown /proc/480/exe 2023-10-19T08:46:22.830 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 481 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.831 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 481 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.831 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 481 root txt unknown /proc/481/exe 2023-10-19T08:46:22.831 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 482 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.831 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 482 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.832 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 482 root txt unknown /proc/482/exe 2023-10-19T08:46:22.832 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 483 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.832 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 483 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.832 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 483 root txt unknown /proc/483/exe 2023-10-19T08:46:22.833 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 484 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.833 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 484 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.833 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/u 484 root txt unknown /proc/484/exe 2023-10-19T08:46:22.833 INFO:teuthology.orchestra.run.smithi079.stdout:jbd2/sda1 503 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.834 INFO:teuthology.orchestra.run.smithi079.stdout:jbd2/sda1 503 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.834 INFO:teuthology.orchestra.run.smithi079.stdout:jbd2/sda1 503 root txt unknown /proc/503/exe 2023-10-19T08:46:22.834 INFO:teuthology.orchestra.run.smithi079.stdout:ext4-rsv- 504 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.835 INFO:teuthology.orchestra.run.smithi079.stdout:ext4-rsv- 504 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.835 INFO:teuthology.orchestra.run.smithi079.stdout:ext4-rsv- 504 root txt unknown /proc/504/exe 2023-10-19T08:46:22.835 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/2 524 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.835 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/2 524 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.836 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/2 524 root txt unknown /proc/524/exe 2023-10-19T08:46:22.836 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/2 536 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.836 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/2 536 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.836 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/2 536 root txt unknown /proc/536/exe 2023-10-19T08:46:22.837 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.837 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.837 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root txt REG 8,1 185496 20360 /usr/lib/systemd/systemd-journald 2023-10-19T08:46:22.837 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-10-19T08:46:22.838 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:22.838 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-19T08:46:22.838 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:22.838 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:22.839 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:22.839 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:22.839 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-10-19T08:46:22.839 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:22.840 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:22.840 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:22.840 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:22.841 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-10-19T08:46:22.841 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:22.841 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-19T08:46:22.841 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-19T08:46:22.842 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:22.842 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:22.842 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-10-19T08:46:22.842 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:22.843 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:22.843 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-19T08:46:22.843 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:22.843 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:22.844 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:22.844 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-10-19T08:46:22.844 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:22.844 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-10-19T08:46:22.845 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:22.845 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root mem REG 0,24 8 55 /run/systemd/journal/kernel-seqnum 2023-10-19T08:46:22.845 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.845 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 1w CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.846 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 2w CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.846 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 3u unix 0xffff957488431980 0t0 15497 /run/systemd/journal/dev-log type=DGRAM (CONNECTED) 2023-10-19T08:46:22.846 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 4u unix 0xffff957488435500 0t0 15499 /run/systemd/journal/socket type=DGRAM (CONNECTED) 2023-10-19T08:46:22.846 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 5u unix 0xffff957488411dc0 0t0 15501 /run/systemd/journal/stdout type=STREAM (LISTEN) 2023-10-19T08:46:22.847 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 6w CHR 1,11 0t0 10 /dev/kmsg 2023-10-19T08:46:22.847 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 7u a_inode 0,14 0 11268 [eventpoll:3,4,5,8,9,10,11,12,13,15,17,18,19,20,21,22,23,24,25,27,28,29,31,32,33] 2023-10-19T08:46:22.847 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 8u CHR 1,11 0t0 10 /dev/kmsg 2023-10-19T08:46:22.847 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 9u unix 0xffff957483130000 0t0 18709 /run/systemd/journal/io.systemd.journal type=STREAM (LISTEN) 2023-10-19T08:46:22.848 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 10r REG 0,20 0 16411 /proc/sys/kernel/hostname 2023-10-19T08:46:22.848 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 11u a_inode 0,14 0 11268 [signalfd] 2023-10-19T08:46:22.848 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 12u a_inode 0,14 0 11268 [signalfd] 2023-10-19T08:46:22.849 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 13u a_inode 0,14 0 11268 [signalfd] 2023-10-19T08:46:22.849 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 14u unix 0xffff957487a76e80 0t0 18710 type=DGRAM (CONNECTED) 2023-10-19T08:46:22.849 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 15u a_inode 0,14 0 11268 [timerfd] 2023-10-19T08:46:22.849 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 16u REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-10-19T08:46:22.850 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 17u unix 0xffff9574884a3300 0t0 19586 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.850 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 18u unix 0xffff9574884a6600 0t0 19648 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.850 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 19u unix 0xffff9574982bee80 0t0 19649 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.850 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 20u unix 0xffff957488411100 0t0 22644 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.850 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 21u unix 0xffff9574884a2640 0t0 20934 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.851 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 22u unix 0xffff9574982bf700 0t0 22647 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.851 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 23u unix 0xffff9574982b8880 0t0 19658 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.851 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 24u unix 0xffff9574884a2200 0t0 22552 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.852 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 25u unix 0xffff9574884a1100 0t0 22553 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.852 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 27u unix 0xffff9574880b0000 0t0 11977 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.852 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 28u unix 0xffff95749821e1c0 0t0 11978 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.852 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 29u unix 0xffff957483132200 0t0 21117 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.853 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 31u unix 0xffff9574880b7b40 0t0 22560 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.853 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 32u unix 0xffff957483131100 0t0 21127 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.853 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-j 581 root 33u unix 0xffff957488549980 0t0 20045 /run/systemd/journal/stdout type=STREAM (CONNECTED) 2023-10-19T08:46:22.853 INFO:teuthology.orchestra.run.smithi079.stdout:ext4lazyi 587 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.854 INFO:teuthology.orchestra.run.smithi079.stdout:ext4lazyi 587 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.854 INFO:teuthology.orchestra.run.smithi079.stdout:ext4lazyi 587 root txt unknown /proc/587/exe 2023-10-19T08:46:22.854 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.855 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.855 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root txt REG 8,1 597744 11595 /usr/bin/udevadm 2023-10-19T08:46:22.855 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2023-10-19T08:46:22.856 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 561841 62217 /usr/lib/modules/5.14.0-361.el9.x86_64/modules.symbols.bin 2023-10-19T08:46:22.856 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 11772 62218 /usr/lib/modules/5.14.0-361.el9.x86_64/modules.builtin.bin 2023-10-19T08:46:22.856 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 815256 59736 /usr/lib/modules/5.14.0-361.el9.x86_64/modules.alias.bin 2023-10-19T08:46:22.856 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 380439 62222 /usr/lib/modules/5.14.0-361.el9.x86_64/modules.dep.bin 2023-10-19T08:46:22.857 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 595024 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-19T08:46:22.857 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:22.857 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:22.858 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-19T08:46:22.858 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:22.858 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:22.858 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:22.859 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:22.859 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:22.859 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:22.860 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:22.860 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-19T08:46:22.860 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:22.860 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:22.861 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-10-19T08:46:22.861 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:22.861 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-10-19T08:46:22.861 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-19T08:46:22.862 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:22.862 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:22.862 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-10-19T08:46:22.862 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:22.863 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-19T08:46:22.863 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:22.863 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-10-19T08:46:22.864 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:22.864 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:22.864 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-10-19T08:46:22.864 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 21219 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-19T08:46:22.865 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:22.865 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-19T08:46:22.865 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.865 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root 1u unix 0xffff9574884a0880 0t0 11778 type=STREAM (CONNECTED) 2023-10-19T08:46:22.866 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root 2u unix 0xffff9574884a0880 0t0 11778 type=STREAM (CONNECTED) 2023-10-19T08:46:22.866 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root 3u unix 0xffff95748803e600 0t0 19562 /run/udev/control type=SEQPACKET (LISTEN) 2023-10-19T08:46:22.866 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root 4u netlink 0t0 19564 KOBJECT_UEVENT 2023-10-19T08:46:22.866 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root 5u unix 0xffff95748849e1c0 0t0 11790 type=DGRAM (CONNECTED) 2023-10-19T08:46:22.867 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root 6u unix 0xffff957488498000 0t0 11794 type=DGRAM (CONNECTED) 2023-10-19T08:46:22.867 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root 7u unix 0xffff95748849c840 0t0 11795 type=DGRAM (CONNECTED) 2023-10-19T08:46:22.867 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root 8r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:22.867 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root 9u a_inode 0,14 0 11268 [eventpoll:3,4,6,8,10,11,14] 2023-10-19T08:46:22.868 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root 10u a_inode 0,14 0 11268 [signalfd] 2023-10-19T08:46:22.868 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root 11u a_inode 0,14 0 11268 [timerfd] 2023-10-19T08:46:22.868 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root 12r REG 8,1 11730661 64128 /etc/udev/hwdb.bin 2023-10-19T08:46:22.869 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-u 599 root 14u a_inode 0,14 0 11268 [timerfd] 2023-10-19T08:46:22.869 INFO:teuthology.orchestra.run.smithi079.stdout:ipmi-msgh 650 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.869 INFO:teuthology.orchestra.run.smithi079.stdout:ipmi-msgh 650 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.869 INFO:teuthology.orchestra.run.smithi079.stdout:ipmi-msgh 650 root txt unknown /proc/650/exe 2023-10-19T08:46:22.870 INFO:teuthology.orchestra.run.smithi079.stdout:kipmi0 657 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.870 INFO:teuthology.orchestra.run.smithi079.stdout:kipmi0 657 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.870 INFO:teuthology.orchestra.run.smithi079.stdout:kipmi0 657 root txt unknown /proc/657/exe 2023-10-19T08:46:22.870 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/7 669 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.871 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/7 669 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.871 INFO:teuthology.orchestra.run.smithi079.stdout:kworker/7 669 root txt unknown /proc/669/exe 2023-10-19T08:46:22.873 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.874 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.874 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc txt REG 8,1 61200 14999 /usr/bin/rpcbind 2023-10-19T08:46:22.874 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:22.874 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:22.875 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:22.875 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:22.875 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:22.875 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:22.876 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:22.876 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:22.876 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:22.876 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:22.877 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:22.877 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:22.877 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:22.878 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:22.878 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:22.878 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:22.879 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:22.879 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:22.879 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:22.880 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:22.880 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-10-19T08:46:22.880 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:22.880 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.881 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc 1u unix 0xffff9574884a5940 0t0 11869 type=STREAM (CONNECTED) 2023-10-19T08:46:22.881 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc 2u unix 0xffff9574884a5940 0t0 11869 type=STREAM (CONNECTED) 2023-10-19T08:46:22.881 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc 3u unix 0xffff957488632a80 0t0 19550 /run/rpcbind.sock type=STREAM (LISTEN) 2023-10-19T08:46:22.881 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc 4u IPv4 14478 0t0 TCP *:sunrpc (LISTEN) 2023-10-19T08:46:22.882 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc 5u IPv4 18695 0t0 UDP *:sunrpc 2023-10-19T08:46:22.882 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc 6u IPv6 14484 0t0 TCP *:sunrpc (LISTEN) 2023-10-19T08:46:22.882 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc 7u IPv6 18701 0t0 UDP *:sunrpc 2023-10-19T08:46:22.883 INFO:teuthology.orchestra.run.smithi079.stdout:rpcbind 673 rpc 8rW REG 0,24 0 1018 /run/rpcbind/rpcbind.lock 2023-10-19T08:46:22.883 INFO:teuthology.orchestra.run.smithi079.stdout:rpciod 678 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.883 INFO:teuthology.orchestra.run.smithi079.stdout:rpciod 678 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.883 INFO:teuthology.orchestra.run.smithi079.stdout:rpciod 678 root txt unknown /proc/678/exe 2023-10-19T08:46:22.884 INFO:teuthology.orchestra.run.smithi079.stdout:xprtiod 679 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.884 INFO:teuthology.orchestra.run.smithi079.stdout:xprtiod 679 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.884 INFO:teuthology.orchestra.run.smithi079.stdout:xprtiod 679 root txt unknown /proc/679/exe 2023-10-19T08:46:22.885 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.885 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.885 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-10-19T08:46:22.885 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:22.885 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:22.886 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:22.886 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:22.886 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:22.886 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:22.887 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:22.887 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:22.887 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:22.887 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:22.888 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:22.888 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:22.888 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:22.888 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-10-19T08:46:22.889 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:22.889 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:22.889 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.889 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.890 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.890 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root 3u netlink 0t0 11890 AUDIT 2023-10-19T08:46:22.890 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root 5w REG 8,1 2845871 1205 /var/log/audit/audit.log 2023-10-19T08:46:22.890 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root 6u unix 0xffff95748849bb80 0t0 11894 type=DGRAM (CONNECTED) 2023-10-19T08:46:22.891 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root 7u unix 0xffff9574884a7b40 0t0 11893 type=STREAM (CONNECTED) 2023-10-19T08:46:22.891 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root 8u unix 0xffff9574884a2ec0 0t0 11895 type=STREAM (CONNECTED) 2023-10-19T08:46:22.891 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root 9u unix 0xffff9574884a50c0 0t0 11896 type=STREAM (CONNECTED) 2023-10-19T08:46:22.891 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 root 10u a_inode 0,14 0 11268 [eventfd:0] 2023-10-19T08:46:22.892 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.892 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.892 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-10-19T08:46:22.892 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:22.893 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:22.893 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:22.893 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:22.893 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:22.894 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:22.894 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:22.894 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:22.895 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:22.895 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:22.895 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:22.895 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:22.896 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:22.896 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-10-19T08:46:22.896 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:22.896 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:22.897 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.897 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.897 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.897 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root 3u netlink 0t0 11890 AUDIT 2023-10-19T08:46:22.898 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root 5w REG 8,1 2845871 1205 /var/log/audit/audit.log 2023-10-19T08:46:22.898 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root 6u unix 0xffff95748849bb80 0t0 11894 type=DGRAM (CONNECTED) 2023-10-19T08:46:22.898 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root 7u unix 0xffff9574884a7b40 0t0 11893 type=STREAM (CONNECTED) 2023-10-19T08:46:22.899 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root 8u unix 0xffff9574884a2ec0 0t0 11895 type=STREAM (CONNECTED) 2023-10-19T08:46:22.899 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root 9u unix 0xffff9574884a50c0 0t0 11896 type=STREAM (CONNECTED) 2023-10-19T08:46:22.899 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 699 auditd root 10u a_inode 0,14 0 11268 [eventfd:0] 2023-10-19T08:46:22.900 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.900 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.900 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root txt REG 8,1 144576 11776 /usr/sbin/auditd 2023-10-19T08:46:22.900 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:22.901 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:22.901 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:22.901 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:22.901 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:22.902 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:22.902 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:22.902 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:22.902 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:22.903 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:22.903 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:22.903 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:22.904 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:22.904 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-10-19T08:46:22.904 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:22.904 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:22.905 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.905 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.905 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.905 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root 3u netlink 0t0 11890 AUDIT 2023-10-19T08:46:22.906 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root 5w REG 8,1 2845871 1205 /var/log/audit/audit.log 2023-10-19T08:46:22.906 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root 6u unix 0xffff95748849bb80 0t0 11894 type=DGRAM (CONNECTED) 2023-10-19T08:46:22.906 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root 7u unix 0xffff9574884a7b40 0t0 11893 type=STREAM (CONNECTED) 2023-10-19T08:46:22.906 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root 8u unix 0xffff9574884a2ec0 0t0 11895 type=STREAM (CONNECTED) 2023-10-19T08:46:22.907 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root 9u unix 0xffff9574884a50c0 0t0 11896 type=STREAM (CONNECTED) 2023-10-19T08:46:22.907 INFO:teuthology.orchestra.run.smithi079.stdout:auditd 698 701 auditd root 10u a_inode 0,14 0 11268 [eventfd:0] 2023-10-19T08:46:22.907 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.907 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.908 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root txt REG 8,1 19624 11914 /usr/sbin/sedispatch 2023-10-19T08:46:22.908 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:22.908 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:22.909 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:22.909 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:22.909 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:22.909 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:22.910 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:22.910 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:22.910 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:22.910 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:22.911 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:22.911 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:22.911 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root mem REG 8,1 143568 9730 /usr/lib64/libauparse.so.0.0.0 2023-10-19T08:46:22.911 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-10-19T08:46:22.912 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:22.912 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:22.912 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root 0u unix 0xffff9574884a0cc0 0t0 11892 type=STREAM (CONNECTED) 2023-10-19T08:46:22.912 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.913 INFO:teuthology.orchestra.run.smithi079.stdout:sedispatc 700 root 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.913 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.913 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.913 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus txt REG 8,1 131896 11213 /usr/bin/dbus-broker-launch 2023-10-19T08:46:22.914 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus DEL REG 0,1 2048 /memfd:dbus-broker-log 2023-10-19T08:46:22.914 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:22.914 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:22.914 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:22.915 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:22.915 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:22.915 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:22.915 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:22.916 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:22.916 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:22.916 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:22.916 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:22.917 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:22.917 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-19T08:46:22.917 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:22.917 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:22.918 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:22.918 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.918 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus 1u unix 0xffff9574884a1980 0t0 11904 type=STREAM (CONNECTED) 2023-10-19T08:46:22.918 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus 2u unix 0xffff9574884a1980 0t0 11904 type=STREAM (CONNECTED) 2023-10-19T08:46:22.919 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus 3u unix 0xffff957488414c80 0t0 20988 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-10-19T08:46:22.919 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus 4u unix 0xffff95748849d0c0 0t0 11914 type=DGRAM (CONNECTED) 2023-10-19T08:46:22.919 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus 5u a_inode 0,14 0 11268 [eventpoll:6,7,8,9,10,11] 2023-10-19T08:46:22.919 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus 6u a_inode 0,14 0 11268 [signalfd] 2023-10-19T08:46:22.920 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus 7r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:22.920 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus 8u unix 0xffff9574884a5500 0t0 11916 type=STREAM (CONNECTED) 2023-10-19T08:46:22.920 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus 9u unix 0xffff95749821a200 0t0 22551 type=STREAM (CONNECTED) 2023-10-19T08:46:22.920 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus 10u a_inode 0,14 0 11268 [pidfd:723] 2023-10-19T08:46:22.921 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus 11u a_inode 0,14 0 11268 [timerfd] 2023-10-19T08:46:22.921 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 722 dbus 12u REG 0,1 2097152 2048 /memfd:dbus-broker-log (deleted) 2023-10-19T08:46:22.921 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.922 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.922 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus txt REG 8,1 236336 11212 /usr/bin/dbus-broker 2023-10-19T08:46:22.922 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:22.922 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:22.923 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:22.923 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:22.923 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:22.923 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:22.924 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:22.924 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:22.924 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-19T08:46:22.925 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.925 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus 1u unix 0xffff9574884a1980 0t0 11904 type=STREAM (CONNECTED) 2023-10-19T08:46:22.925 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus 2u unix 0xffff9574884a1980 0t0 11904 type=STREAM (CONNECTED) 2023-10-19T08:46:22.925 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus 3u sock 0,8 0t0 576 protocol: NETLINK 2023-10-19T08:46:22.926 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus 4u unix 0xffff95748849d0c0 0t0 11914 type=DGRAM (CONNECTED) 2023-10-19T08:46:22.926 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus 5u a_inode 0,14 0 11268 [eventpoll:6,7,8,9,10,11,12,13,14,15,16,18,19] 2023-10-19T08:46:22.926 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus 6u a_inode 0,14 0 11268 [signalfd] 2023-10-19T08:46:22.927 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus 7u unix 0xffff957488414c80 0t0 20988 /run/dbus/system_bus_socket type=STREAM (LISTEN) 2023-10-19T08:46:22.927 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus 8u unix 0xffff9574831361c0 0t0 17908 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-10-19T08:46:22.927 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus 9u unix 0xffff9574884a6a40 0t0 11917 type=STREAM (CONNECTED) 2023-10-19T08:46:22.927 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus 10u unix 0xffff95749821f2c0 0t0 17910 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-10-19T08:46:22.928 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus 11u unix 0xffff9574880b3b80 0t0 16796 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-10-19T08:46:22.928 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus 12u unix 0xffff9574884a6e80 0t0 21029 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-10-19T08:46:22.928 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus 13u unix 0xffff957488415d80 0t0 16803 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-10-19T08:46:22.929 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus 14u sock 0,8 0t0 21871 protocol: UNIX-STREAM 2023-10-19T08:46:22.929 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus 15u unix 0xffff9574880b5500 0t0 21873 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-10-19T08:46:22.929 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus 16u unix 0xffff957483137b40 0t0 647 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-10-19T08:46:22.929 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus 18u unix 0xffff957483135d80 0t0 21131 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-10-19T08:46:22.930 INFO:teuthology.orchestra.run.smithi079.stdout:dbus-brok 723 dbus 19u unix 0xffff9574880b3300 0t0 22372 /run/dbus/system_bus_socket type=STREAM (CONNECTED) 2023-10-19T08:46:22.930 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.930 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.930 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2023-10-19T08:46:22.931 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-10-19T08:46:22.931 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-10-19T08:46:22.931 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-10-19T08:46:22.931 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-10-19T08:46:22.932 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-10-19T08:46:22.932 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-19T08:46:22.932 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:22.933 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-19T08:46:22.933 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-19T08:46:22.933 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:22.933 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-19T08:46:22.934 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:22.934 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-10-19T08:46:22.934 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-10-19T08:46:22.934 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-10-19T08:46:22.935 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:22.935 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:22.935 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:22.935 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:22.935 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:22.936 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:22.936 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:22.936 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:22.936 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:22.937 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:22.937 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-10-19T08:46:22.937 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-10-19T08:46:22.937 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-10-19T08:46:22.938 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:22.938 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:22.938 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:22.939 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-10-19T08:46:22.939 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-10-19T08:46:22.939 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-10-19T08:46:22.939 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-10-19T08:46:22.940 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:22.940 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:22.940 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:22.940 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:22.941 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:22.941 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:22.941 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-10-19T08:46:22.942 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-10-19T08:46:22.942 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-10-19T08:46:22.942 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:22.942 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-19T08:46:22.943 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:22.943 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-10-19T08:46:22.943 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-10-19T08:46:22.944 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-19T08:46:22.944 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:22.944 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:22.944 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:22.945 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:22.945 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-10-19T08:46:22.945 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:22.945 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:22.946 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-10-19T08:46:22.946 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:22.946 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-10-19T08:46:22.946 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:22.947 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-10-19T08:46:22.947 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-19T08:46:22.947 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-19T08:46:22.948 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-19T08:46:22.948 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-19T08:46:22.948 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-19T08:46:22.948 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-19T08:46:22.949 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:22.949 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-19T08:46:22.949 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.949 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 1u unix 0xffff9574982b8440 0t0 16772 type=STREAM (CONNECTED) 2023-10-19T08:46:22.950 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 2u unix 0xffff9574982b8440 0t0 16772 type=STREAM (CONNECTED) 2023-10-19T08:46:22.950 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 3u a_inode 0,14 0 11268 [eventfd:6] 2023-10-19T08:46:22.950 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 4u a_inode 0,14 0 11268 [eventfd:7] 2023-10-19T08:46:22.950 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 5u unix 0xffff957488432200 0t0 21031 type=DGRAM (UNCONNECTED) 2023-10-19T08:46:22.951 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 6u unix 0xffff957488412640 0t0 21032 type=STREAM (CONNECTED) 2023-10-19T08:46:22.951 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 7u a_inode 0,14 0 11268 [eventfd:8] 2023-10-19T08:46:22.951 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 8r REG 0,4 0 4026531840 net 2023-10-19T08:46:22.951 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 9r REG 0,4 0 4026532495 mnt 2023-10-19T08:46:22.952 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 10u netlink 0t0 17933 KOBJECT_UEVENT 2023-10-19T08:46:22.952 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 11u netlink 0t0 17934 GENERIC 2023-10-19T08:46:22.952 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 12u netlink 0t0 17935 GENERIC 2023-10-19T08:46:22.952 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 13u netlink 0t0 17936 ROUTE 2023-10-19T08:46:22.953 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 14r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:22.953 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 15r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:22.953 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 16u netlink 0t0 17969 KOBJECT_UEVENT 2023-10-19T08:46:22.953 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 17u a_inode 0,14 0 11268 [eventpoll] 2023-10-19T08:46:22.954 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 18u unix 0xffff9574880b6600 0t0 646 type=STREAM (CONNECTED) 2023-10-19T08:46:22.954 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 19u a_inode 0,14 0 11268 [eventpoll:21,22,27] 2023-10-19T08:46:22.954 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 20w FIFO 0,24 0t0 1152 /run/systemd/inhibit/1.ref 2023-10-19T08:46:22.955 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 21u a_inode 0,14 0 11268 [timerfd] 2023-10-19T08:46:22.955 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 22u pack 21916 0t0 IP type=SOCK_DGRAM 2023-10-19T08:46:22.955 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 23u raw6 0t0 12010 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-10-19T08:46:22.955 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 root 27u IPv4 12076 0t0 UDP smithi079.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-10-19T08:46:22.955 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.956 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.956 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2023-10-19T08:46:22.956 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-10-19T08:46:22.957 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-10-19T08:46:22.957 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-10-19T08:46:22.957 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-10-19T08:46:22.957 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-10-19T08:46:22.958 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-19T08:46:22.958 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:22.958 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-19T08:46:22.959 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-19T08:46:22.959 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:22.959 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-19T08:46:22.959 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:22.960 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-10-19T08:46:22.960 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-10-19T08:46:22.960 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-10-19T08:46:22.960 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:22.961 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:22.961 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:22.961 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:22.961 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:22.962 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:22.962 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:22.962 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:22.963 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:22.963 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:22.963 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-10-19T08:46:22.963 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-10-19T08:46:22.964 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-10-19T08:46:22.964 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:22.964 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:22.964 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:22.965 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-10-19T08:46:22.965 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-10-19T08:46:22.965 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-10-19T08:46:22.966 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-10-19T08:46:22.966 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:22.966 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:22.966 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:22.967 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:22.967 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:22.967 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:22.968 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-10-19T08:46:22.968 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-10-19T08:46:22.968 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-10-19T08:46:22.969 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:22.969 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-19T08:46:22.969 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:22.969 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-10-19T08:46:22.970 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-10-19T08:46:22.970 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-19T08:46:22.970 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:22.970 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:22.971 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:22.971 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:22.971 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-10-19T08:46:22.971 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:22.972 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:22.972 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-10-19T08:46:22.972 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:22.972 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-10-19T08:46:22.973 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:22.973 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-10-19T08:46:22.973 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-19T08:46:22.973 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-19T08:46:22.974 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-19T08:46:22.974 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-19T08:46:22.974 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-19T08:46:22.975 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-19T08:46:22.975 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:22.975 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-19T08:46:22.975 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:22.976 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 1u unix 0xffff9574982b8440 0t0 16772 type=STREAM (CONNECTED) 2023-10-19T08:46:22.976 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 2u unix 0xffff9574982b8440 0t0 16772 type=STREAM (CONNECTED) 2023-10-19T08:46:22.976 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 3u a_inode 0,14 0 11268 [eventfd:6] 2023-10-19T08:46:22.977 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 4u a_inode 0,14 0 11268 [eventfd:7] 2023-10-19T08:46:22.977 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 5u unix 0xffff957488432200 0t0 21031 type=DGRAM (UNCONNECTED) 2023-10-19T08:46:22.977 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 6u unix 0xffff957488412640 0t0 21032 type=STREAM (CONNECTED) 2023-10-19T08:46:22.977 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 7u a_inode 0,14 0 11268 [eventfd:8] 2023-10-19T08:46:22.978 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 8r REG 0,4 0 4026531840 net 2023-10-19T08:46:22.978 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 9r REG 0,4 0 4026532495 mnt 2023-10-19T08:46:22.978 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 10u netlink 0t0 17933 KOBJECT_UEVENT 2023-10-19T08:46:22.978 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 11u netlink 0t0 17934 GENERIC 2023-10-19T08:46:22.979 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 12u netlink 0t0 17935 GENERIC 2023-10-19T08:46:22.979 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 13u netlink 0t0 17936 ROUTE 2023-10-19T08:46:22.979 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 14r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:22.979 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 15r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:22.980 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 16u netlink 0t0 17969 KOBJECT_UEVENT 2023-10-19T08:46:22.980 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 17u a_inode 0,14 0 11268 [eventpoll] 2023-10-19T08:46:22.980 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 18u unix 0xffff9574880b6600 0t0 646 type=STREAM (CONNECTED) 2023-10-19T08:46:22.980 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 19u a_inode 0,14 0 11268 [eventpoll:21,22,27] 2023-10-19T08:46:22.981 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 20w FIFO 0,24 0t0 1152 /run/systemd/inhibit/1.ref 2023-10-19T08:46:22.981 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 21u a_inode 0,14 0 11268 [timerfd] 2023-10-19T08:46:22.981 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 22u pack 21916 0t0 IP type=SOCK_DGRAM 2023-10-19T08:46:22.981 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 23u raw6 0t0 12010 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-10-19T08:46:22.981 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 773 gmain root 27u IPv4 12076 0t0 UDP smithi079.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-10-19T08:46:22.982 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:22.982 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:22.982 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root txt REG 8,1 3644720 11633 /usr/sbin/NetworkManager 2023-10-19T08:46:22.983 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 317552 52828 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-settings-plugin-ifcfg-rh.so 2023-10-19T08:46:22.983 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-10-19T08:46:22.983 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 62456 9782 /usr/lib64/libjansson.so.4.14.0 2023-10-19T08:46:22.983 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 31792 10954 /usr/lib64/libteamdctl.so.0.1.5 2023-10-19T08:46:22.983 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 57016 52811 /usr/lib64/NetworkManager/1.44.0-2.el9/libnm-device-plugin-team.so 2023-10-19T08:46:22.984 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-19T08:46:22.984 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:22.984 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-19T08:46:22.984 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-19T08:46:22.985 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:22.985 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-19T08:46:22.985 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:22.985 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 138712 9890 /usr/lib64/libbrotlicommon.so.1.0.9 2023-10-19T08:46:22.986 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-10-19T08:46:22.986 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-10-19T08:46:22.986 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:22.986 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:22.987 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:22.987 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:22.987 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:22.988 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:22.988 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:22.988 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:22.988 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:22.989 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:22.989 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 53048 9892 /usr/lib64/libbrotlidec.so.1.0.9 2023-10-19T08:46:22.989 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-10-19T08:46:22.990 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-10-19T08:46:22.990 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:22.990 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:22.990 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:22.991 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-10-19T08:46:22.991 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 77488 9888 /usr/lib64/libpsl.so.5.3.3 2023-10-19T08:46:22.991 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 483672 11481 /usr/lib64/libssh.so.4.9.4 2023-10-19T08:46:22.991 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 169704 11377 /usr/lib64/libnghttp2.so.14.20.1 2023-10-19T08:46:22.992 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:22.992 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:22.992 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:22.992 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:22.993 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:22.993 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:22.993 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-10-19T08:46:22.994 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-10-19T08:46:22.994 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-10-19T08:46:22.994 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:22.995 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-19T08:46:22.995 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:22.995 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-10-19T08:46:22.995 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-10-19T08:46:22.996 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-19T08:46:22.996 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:22.996 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:22.996 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:22.997 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:22.997 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 662304 11485 /usr/lib64/libcurl.so.4.7.0 2023-10-19T08:46:22.997 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:22.997 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:22.998 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-10-19T08:46:22.998 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:22.998 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 32408 11334 /usr/lib64/libndp.so.0.2.0 2023-10-19T08:46:22.998 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:22.999 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-10-19T08:46:22.999 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-19T08:46:22.999 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-19T08:46:22.999 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-19T08:46:23.000 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-19T08:46:23.000 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-19T08:46:23.000 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-19T08:46:23.000 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.001 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-19T08:46:23.001 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.001 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 1u unix 0xffff9574982b8440 0t0 16772 type=STREAM (CONNECTED) 2023-10-19T08:46:23.001 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 2u unix 0xffff9574982b8440 0t0 16772 type=STREAM (CONNECTED) 2023-10-19T08:46:23.002 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 3u a_inode 0,14 0 11268 [eventfd:6] 2023-10-19T08:46:23.002 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 4u a_inode 0,14 0 11268 [eventfd:7] 2023-10-19T08:46:23.002 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 5u unix 0xffff957488432200 0t0 21031 type=DGRAM (UNCONNECTED) 2023-10-19T08:46:23.003 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 6u unix 0xffff957488412640 0t0 21032 type=STREAM (CONNECTED) 2023-10-19T08:46:23.003 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 7u a_inode 0,14 0 11268 [eventfd:8] 2023-10-19T08:46:23.003 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 8r REG 0,4 0 4026531840 net 2023-10-19T08:46:23.003 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 9r REG 0,4 0 4026532495 mnt 2023-10-19T08:46:23.004 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 10u netlink 0t0 17933 KOBJECT_UEVENT 2023-10-19T08:46:23.004 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 11u netlink 0t0 17934 GENERIC 2023-10-19T08:46:23.004 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 12u netlink 0t0 17935 GENERIC 2023-10-19T08:46:23.004 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 13u netlink 0t0 17936 ROUTE 2023-10-19T08:46:23.005 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 14r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.005 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 15r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.005 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 16u netlink 0t0 17969 KOBJECT_UEVENT 2023-10-19T08:46:23.005 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 17u a_inode 0,14 0 11268 [eventpoll] 2023-10-19T08:46:23.006 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 18u unix 0xffff9574880b6600 0t0 646 type=STREAM (CONNECTED) 2023-10-19T08:46:23.006 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 19u a_inode 0,14 0 11268 [eventpoll:21,22,27] 2023-10-19T08:46:23.006 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 20w FIFO 0,24 0t0 1152 /run/systemd/inhibit/1.ref 2023-10-19T08:46:23.007 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 21u a_inode 0,14 0 11268 [timerfd] 2023-10-19T08:46:23.007 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 22u pack 21916 0t0 IP type=SOCK_DGRAM 2023-10-19T08:46:23.007 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 23u raw6 0t0 12010 00000000000000000000000000000000:003A->00000000000000000000000000000000:0000 st=07 2023-10-19T08:46:23.007 INFO:teuthology.orchestra.run.smithi079.stdout:NetworkMa 724 782 gdbus root 27u IPv4 12076 0t0 UDP smithi079.front.sepia.ceph.com:bootpc->store01.front.sepia.ceph.com:bootps 2023-10-19T08:46:23.008 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.008 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.008 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2023-10-19T08:46:23.009 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.009 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:23.009 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.009 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 root mem REG 8,1 54392 9998 /usr/lib64/libnuma.so.1.0.0 2023-10-19T08:46:23.010 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:23.010 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:23.010 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.010 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.011 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 root 1u unix 0xffff9574982bb300 0t0 16781 type=STREAM (CONNECTED) 2023-10-19T08:46:23.011 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 root 2u unix 0xffff9574982bb300 0t0 16781 type=STREAM (CONNECTED) 2023-10-19T08:46:23.011 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 root 3u a_inode 0,14 0 11268 [eventfd:1] 2023-10-19T08:46:23.011 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 root 4u a_inode 0,14 0 11268 [eventfd:2] 2023-10-19T08:46:23.012 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 root 5u unix 0xffff9574982bd500 0t0 16795 /run/irqbalance/irqbalance727.sock type=STREAM (LISTEN) 2023-10-19T08:46:23.012 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 root 6u unix 0xffff957487be9980 0t0 17002 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.012 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 739 gmain root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.012 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 739 gmain root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.013 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 739 gmain root txt REG 8,1 61904 10507 /usr/sbin/irqbalance 2023-10-19T08:46:23.013 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 739 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.013 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 739 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:23.013 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 739 gmain root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.014 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 739 gmain root mem REG 8,1 54392 9998 /usr/lib64/libnuma.so.1.0.0 2023-10-19T08:46:23.014 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 739 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:23.014 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 739 gmain root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:23.015 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 739 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.015 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 739 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.015 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 739 gmain root 1u unix 0xffff9574982bb300 0t0 16781 type=STREAM (CONNECTED) 2023-10-19T08:46:23.015 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 739 gmain root 2u unix 0xffff9574982bb300 0t0 16781 type=STREAM (CONNECTED) 2023-10-19T08:46:23.016 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 739 gmain root 3u a_inode 0,14 0 11268 [eventfd:1] 2023-10-19T08:46:23.016 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 739 gmain root 4u a_inode 0,14 0 11268 [eventfd:2] 2023-10-19T08:46:23.016 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 739 gmain root 5u unix 0xffff9574982bd500 0t0 16795 /run/irqbalance/irqbalance727.sock type=STREAM (LISTEN) 2023-10-19T08:46:23.016 INFO:teuthology.orchestra.run.smithi079.stdout:irqbalanc 727 739 gmain root 6u unix 0xffff957487be9980 0t0 17002 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.017 INFO:teuthology.orchestra.run.smithi079.stdout:lsmd 728 libstoragemgmt cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.017 INFO:teuthology.orchestra.run.smithi079.stdout:lsmd 728 libstoragemgmt rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.017 INFO:teuthology.orchestra.run.smithi079.stdout:lsmd 728 libstoragemgmt txt REG 8,1 32280 11292 /usr/bin/lsmd 2023-10-19T08:46:23.017 INFO:teuthology.orchestra.run.smithi079.stdout:lsmd 728 libstoragemgmt mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.018 INFO:teuthology.orchestra.run.smithi079.stdout:lsmd 728 libstoragemgmt mem REG 8,1 56912 10811 /usr/lib64/libconfig.so.11.0.2 2023-10-19T08:46:23.018 INFO:teuthology.orchestra.run.smithi079.stdout:lsmd 728 libstoragemgmt mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.018 INFO:teuthology.orchestra.run.smithi079.stdout:lsmd 728 libstoragemgmt 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.018 INFO:teuthology.orchestra.run.smithi079.stdout:lsmd 728 libstoragemgmt 1u unix 0xffff9574884a4400 0t0 11922 type=STREAM (CONNECTED) 2023-10-19T08:46:23.019 INFO:teuthology.orchestra.run.smithi079.stdout:lsmd 728 libstoragemgmt 2u unix 0xffff9574884a4400 0t0 11922 type=STREAM (CONNECTED) 2023-10-19T08:46:23.019 INFO:teuthology.orchestra.run.smithi079.stdout:lsmd 728 libstoragemgmt 3uW REG 0,24 0 1094 /run/lsm/ipc/.lsmd-ipc-lock 2023-10-19T08:46:23.019 INFO:teuthology.orchestra.run.smithi079.stdout:lsmd 728 libstoragemgmt 5u unix 0xffff957483134c80 0t0 21820 /var/run/lsm/ipc/simc type=STREAM (LISTEN) 2023-10-19T08:46:23.019 INFO:teuthology.orchestra.run.smithi079.stdout:lsmd 728 libstoragemgmt 6u unix 0xffff957483133740 0t0 21821 /var/run/lsm/ipc/sim type=STREAM (LISTEN) 2023-10-19T08:46:23.020 INFO:teuthology.orchestra.run.smithi079.stdout:mcelog 729 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.020 INFO:teuthology.orchestra.run.smithi079.stdout:mcelog 729 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.020 INFO:teuthology.orchestra.run.smithi079.stdout:mcelog 729 root txt REG 8,1 194568 12461 /usr/sbin/mcelog 2023-10-19T08:46:23.020 INFO:teuthology.orchestra.run.smithi079.stdout:mcelog 729 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.021 INFO:teuthology.orchestra.run.smithi079.stdout:mcelog 729 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.021 INFO:teuthology.orchestra.run.smithi079.stdout:mcelog 729 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.021 INFO:teuthology.orchestra.run.smithi079.stdout:mcelog 729 root 1u unix 0xffff9574884a72c0 0t0 11925 type=STREAM (CONNECTED) 2023-10-19T08:46:23.021 INFO:teuthology.orchestra.run.smithi079.stdout:mcelog 729 root 2u unix 0xffff9574884a72c0 0t0 11925 type=STREAM (CONNECTED) 2023-10-19T08:46:23.022 INFO:teuthology.orchestra.run.smithi079.stdout:mcelog 729 root 3r CHR 10,227 0t0 142 /dev/mcelog 2023-10-19T08:46:23.022 INFO:teuthology.orchestra.run.smithi079.stdout:mcelog 729 root 4u unix 0xffff9574982bea40 0t0 16794 /var/run/mcelog-client type=STREAM (LISTEN) 2023-10-19T08:46:23.022 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.022 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.023 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-19T08:46:23.023 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.023 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.023 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.024 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.024 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.024 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.024 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.025 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.025 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-19T08:46:23.025 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.025 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.026 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.026 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:23.026 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.026 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.027 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-19T08:46:23.027 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.027 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.027 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:23.028 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.028 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-19T08:46:23.028 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.028 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:23.029 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:23.029 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:23.029 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-19T08:46:23.029 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.030 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.030 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.030 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.030 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd 3r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.031 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd 4u a_inode 0,14 0 11268 [eventfd:3] 2023-10-19T08:46:23.031 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd 5u a_inode 0,14 0 11268 [eventfd:4] 2023-10-19T08:46:23.031 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd 6u unix 0xffff9574884a0440 0t0 11942 type=STREAM (CONNECTED) 2023-10-19T08:46:23.032 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd 7u a_inode 0,14 0 11268 [eventfd:5] 2023-10-19T08:46:23.032 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd 8r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.032 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd 9u a_inode 0,14 0 11268 [eventfd:10] 2023-10-19T08:46:23.032 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 polkitd 10u unix 0xffff95748849a640 0t0 11943 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.032 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.033 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.033 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-19T08:46:23.033 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.033 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.034 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.034 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.034 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.034 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.035 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.035 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.035 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-19T08:46:23.036 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.036 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.036 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.036 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:23.037 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.037 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.037 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-19T08:46:23.038 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.038 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.038 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:23.038 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.039 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-19T08:46:23.039 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.039 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:23.039 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:23.040 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:23.040 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-19T08:46:23.040 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.040 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.041 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.041 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.041 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd 3r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.042 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd 4u a_inode 0,14 0 11268 [eventfd:3] 2023-10-19T08:46:23.042 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd 5u a_inode 0,14 0 11268 [eventfd:4] 2023-10-19T08:46:23.042 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd 6u unix 0xffff9574884a0440 0t0 11942 type=STREAM (CONNECTED) 2023-10-19T08:46:23.042 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd 7u a_inode 0,14 0 11268 [eventfd:5] 2023-10-19T08:46:23.043 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd 8r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.043 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd 9u a_inode 0,14 0 11268 [eventfd:10] 2023-10-19T08:46:23.043 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 771 gmain polkitd 10u unix 0xffff95748849a640 0t0 11943 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.044 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.044 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.044 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-19T08:46:23.044 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.045 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.045 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.045 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.045 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.046 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.046 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.046 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.046 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-19T08:46:23.047 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.047 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.047 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.047 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:23.048 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.048 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.048 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-19T08:46:23.048 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.049 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.049 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:23.049 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.049 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-19T08:46:23.050 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.050 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:23.050 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:23.050 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:23.051 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-19T08:46:23.051 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.051 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.051 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.052 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.052 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd 3r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.052 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd 4u a_inode 0,14 0 11268 [eventfd:3] 2023-10-19T08:46:23.052 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd 5u a_inode 0,14 0 11268 [eventfd:4] 2023-10-19T08:46:23.053 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd 6u unix 0xffff9574884a0440 0t0 11942 type=STREAM (CONNECTED) 2023-10-19T08:46:23.053 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd 7u a_inode 0,14 0 11268 [eventfd:5] 2023-10-19T08:46:23.053 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd 8r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.053 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd 9u a_inode 0,14 0 11268 [eventfd:10] 2023-10-19T08:46:23.054 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 772 gdbus polkitd 10u unix 0xffff95748849a640 0t0 11943 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.054 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.054 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.054 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-19T08:46:23.055 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.055 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.055 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.055 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.056 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.056 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.056 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.056 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.056 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-19T08:46:23.057 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.057 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.057 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.057 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:23.058 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.058 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.058 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-19T08:46:23.059 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.059 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.059 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:23.059 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.060 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-19T08:46:23.060 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.060 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:23.060 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:23.061 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:23.061 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-19T08:46:23.061 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.062 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.062 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.062 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.062 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd 3r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.063 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd 4u a_inode 0,14 0 11268 [eventfd:3] 2023-10-19T08:46:23.063 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd 5u a_inode 0,14 0 11268 [eventfd:4] 2023-10-19T08:46:23.063 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd 6u unix 0xffff9574884a0440 0t0 11942 type=STREAM (CONNECTED) 2023-10-19T08:46:23.064 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd 7u a_inode 0,14 0 11268 [eventfd:5] 2023-10-19T08:46:23.064 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd 8r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.064 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd 9u a_inode 0,14 0 11268 [eventfd:10] 2023-10-19T08:46:23.064 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 774 JS\x20Hel polkitd 10u unix 0xffff95748849a640 0t0 11943 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.065 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.065 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.065 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-19T08:46:23.066 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.066 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.066 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.066 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.067 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.067 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.067 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.067 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.068 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-19T08:46:23.068 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.068 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.069 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.069 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:23.069 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.069 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.070 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-19T08:46:23.070 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.070 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.070 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:23.071 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.071 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-19T08:46:23.071 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.071 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:23.072 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:23.072 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:23.072 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-19T08:46:23.072 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.073 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.073 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.073 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.074 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd 3r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.074 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd 4u a_inode 0,14 0 11268 [eventfd:3] 2023-10-19T08:46:23.074 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd 5u a_inode 0,14 0 11268 [eventfd:4] 2023-10-19T08:46:23.074 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd 6u unix 0xffff9574884a0440 0t0 11942 type=STREAM (CONNECTED) 2023-10-19T08:46:23.075 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd 7u a_inode 0,14 0 11268 [eventfd:5] 2023-10-19T08:46:23.075 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd 8r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.075 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd 9u a_inode 0,14 0 11268 [eventfd:10] 2023-10-19T08:46:23.075 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 775 JS\x20Hel polkitd 10u unix 0xffff95748849a640 0t0 11943 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.076 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.076 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.076 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-19T08:46:23.076 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.077 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.077 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.077 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.077 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.078 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.078 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.078 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.078 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-19T08:46:23.079 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.079 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.079 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.079 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:23.080 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.080 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.080 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-19T08:46:23.080 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.081 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.081 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:23.081 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.081 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-19T08:46:23.082 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.082 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:23.082 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:23.082 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:23.083 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-19T08:46:23.083 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.083 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.083 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.084 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.084 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd 3r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.084 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd 4u a_inode 0,14 0 11268 [eventfd:3] 2023-10-19T08:46:23.084 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd 5u a_inode 0,14 0 11268 [eventfd:4] 2023-10-19T08:46:23.085 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd 6u unix 0xffff9574884a0440 0t0 11942 type=STREAM (CONNECTED) 2023-10-19T08:46:23.085 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd 7u a_inode 0,14 0 11268 [eventfd:5] 2023-10-19T08:46:23.085 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd 8r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.085 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd 9u a_inode 0,14 0 11268 [eventfd:10] 2023-10-19T08:46:23.086 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 776 JS\x20Hel polkitd 10u unix 0xffff95748849a640 0t0 11943 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.086 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.086 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.086 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-19T08:46:23.087 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.087 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.087 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.087 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.088 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.088 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.088 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.089 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.089 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-19T08:46:23.089 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.089 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.090 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.090 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:23.090 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.091 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.091 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-19T08:46:23.091 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.091 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.092 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:23.092 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.092 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-19T08:46:23.092 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.093 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:23.093 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:23.093 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:23.094 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-19T08:46:23.094 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.094 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.094 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.095 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.095 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd 3r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.095 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd 4u a_inode 0,14 0 11268 [eventfd:3] 2023-10-19T08:46:23.095 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd 5u a_inode 0,14 0 11268 [eventfd:4] 2023-10-19T08:46:23.096 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd 6u unix 0xffff9574884a0440 0t0 11942 type=STREAM (CONNECTED) 2023-10-19T08:46:23.096 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd 7u a_inode 0,14 0 11268 [eventfd:5] 2023-10-19T08:46:23.096 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd 8r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.096 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd 9u a_inode 0,14 0 11268 [eventfd:10] 2023-10-19T08:46:23.097 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 777 JS\x20Hel polkitd 10u unix 0xffff95748849a640 0t0 11943 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.097 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.097 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.097 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-19T08:46:23.098 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.098 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.098 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.099 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.099 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.099 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.099 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.100 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.100 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-19T08:46:23.100 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.100 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.101 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.101 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:23.101 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.102 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.102 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-19T08:46:23.102 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.102 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.103 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:23.103 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.103 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-19T08:46:23.104 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.104 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:23.104 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:23.104 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:23.105 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-19T08:46:23.105 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.105 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.106 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.106 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.106 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd 3r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.106 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd 4u a_inode 0,14 0 11268 [eventfd:3] 2023-10-19T08:46:23.107 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd 5u a_inode 0,14 0 11268 [eventfd:4] 2023-10-19T08:46:23.107 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd 6u unix 0xffff9574884a0440 0t0 11942 type=STREAM (CONNECTED) 2023-10-19T08:46:23.107 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd 7u a_inode 0,14 0 11268 [eventfd:5] 2023-10-19T08:46:23.107 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd 8r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.108 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd 9u a_inode 0,14 0 11268 [eventfd:10] 2023-10-19T08:46:23.108 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 778 JS\x20Hel polkitd 10u unix 0xffff95748849a640 0t0 11943 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.108 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.109 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.109 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-19T08:46:23.109 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.109 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.110 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.110 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.110 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.110 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.111 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.111 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.111 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-19T08:46:23.112 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.112 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.112 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.112 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:23.113 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.113 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.113 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-19T08:46:23.113 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.114 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.114 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:23.114 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.114 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-19T08:46:23.115 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.115 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:23.115 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:23.115 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:23.116 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-19T08:46:23.116 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.116 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.117 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.117 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.117 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd 3r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.117 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd 4u a_inode 0,14 0 11268 [eventfd:3] 2023-10-19T08:46:23.118 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd 5u a_inode 0,14 0 11268 [eventfd:4] 2023-10-19T08:46:23.118 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd 6u unix 0xffff9574884a0440 0t0 11942 type=STREAM (CONNECTED) 2023-10-19T08:46:23.118 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd 7u a_inode 0,14 0 11268 [eventfd:5] 2023-10-19T08:46:23.118 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd 8r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.119 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd 9u a_inode 0,14 0 11268 [eventfd:10] 2023-10-19T08:46:23.119 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 779 JS\x20Hel polkitd 10u unix 0xffff95748849a640 0t0 11943 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.119 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.119 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.120 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-19T08:46:23.120 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.120 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.121 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.121 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.121 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.121 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.122 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.122 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.122 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-19T08:46:23.122 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.123 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.123 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.123 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:23.123 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.124 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.124 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-19T08:46:23.124 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.124 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.125 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:23.125 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.125 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-19T08:46:23.125 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.126 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:23.126 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:23.126 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:23.126 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-19T08:46:23.127 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.127 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.127 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.127 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.128 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd 3r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.128 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd 4u a_inode 0,14 0 11268 [eventfd:3] 2023-10-19T08:46:23.128 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd 5u a_inode 0,14 0 11268 [eventfd:4] 2023-10-19T08:46:23.128 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd 6u unix 0xffff9574884a0440 0t0 11942 type=STREAM (CONNECTED) 2023-10-19T08:46:23.129 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd 7u a_inode 0,14 0 11268 [eventfd:5] 2023-10-19T08:46:23.129 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd 8r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.129 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd 9u a_inode 0,14 0 11268 [eventfd:10] 2023-10-19T08:46:23.129 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 780 JS\x20Hel polkitd 10u unix 0xffff95748849a640 0t0 11943 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.130 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.130 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.130 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-19T08:46:23.130 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.131 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.131 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.131 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.131 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.132 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.132 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.132 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.133 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-19T08:46:23.133 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.133 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.134 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.134 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:23.134 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.134 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.135 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-19T08:46:23.135 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.135 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.135 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:23.136 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.136 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-19T08:46:23.136 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.137 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:23.137 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:23.137 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:23.137 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-19T08:46:23.138 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.138 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.138 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.138 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.139 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd 3r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.139 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd 4u a_inode 0,14 0 11268 [eventfd:3] 2023-10-19T08:46:23.139 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd 5u a_inode 0,14 0 11268 [eventfd:4] 2023-10-19T08:46:23.139 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd 6u unix 0xffff9574884a0440 0t0 11942 type=STREAM (CONNECTED) 2023-10-19T08:46:23.140 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd 7u a_inode 0,14 0 11268 [eventfd:5] 2023-10-19T08:46:23.140 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd 8r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.140 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd 9u a_inode 0,14 0 11268 [eventfd:10] 2023-10-19T08:46:23.140 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 781 JS\x20Hel polkitd 10u unix 0xffff95748849a640 0t0 11943 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.141 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.141 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.141 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd txt REG 8,1 145440 49355 /usr/lib/polkit-1/polkitd 2023-10-19T08:46:23.141 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.142 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.142 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.142 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.143 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.143 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.143 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.143 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.144 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-19T08:46:23.144 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.144 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.144 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.145 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:23.145 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.145 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.146 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 29097776 36983 /usr/lib64/polkit-1/libmozjs-78.so 2023-10-19T08:46:23.146 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.146 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.147 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:23.147 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.147 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-19T08:46:23.147 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.148 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:23.148 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:23.148 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:23.149 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 131296 10178 /usr/lib64/libpolkit-gobject-1.so.0.0.0 2023-10-19T08:46:23.149 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.149 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.149 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.150 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.150 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd 3r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.150 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd 4u a_inode 0,14 0 11268 [eventfd:3] 2023-10-19T08:46:23.151 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd 5u a_inode 0,14 0 11268 [eventfd:4] 2023-10-19T08:46:23.151 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd 6u unix 0xffff9574884a0440 0t0 11942 type=STREAM (CONNECTED) 2023-10-19T08:46:23.151 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd 7u a_inode 0,14 0 11268 [eventfd:5] 2023-10-19T08:46:23.151 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd 8r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.152 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd 9u a_inode 0,14 0 11268 [eventfd:10] 2023-10-19T08:46:23.152 INFO:teuthology.orchestra.run.smithi079.stdout:polkitd 730 785 polkitd polkitd 10u unix 0xffff95748849a640 0t0 11943 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.152 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.152 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.153 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root txt REG 8,1 622048 12498 /usr/sbin/smartd 2023-10-19T08:46:23.153 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.153 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.153 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.154 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.154 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.154 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.154 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.155 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.155 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.155 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root mem REG 8,1 2306456 9691 /usr/lib64/libstdc++.so.6.0.29 2023-10-19T08:46:23.155 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.156 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.156 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.156 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:23.156 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.157 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.157 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.157 INFO:teuthology.orchestra.run.smithi079.stdout:smartd 731 root 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.157 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.158 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.158 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root txt REG 8,1 306896 20362 /usr/lib/systemd/systemd-logind 2023-10-19T08:46:23.158 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-10-19T08:46:23.158 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 595024 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-19T08:46:23.159 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.159 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-19T08:46:23.159 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:23.159 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.160 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.160 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.160 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.160 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.161 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.161 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:23.161 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.161 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-10-19T08:46:23.162 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-19T08:46:23.162 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-19T08:46:23.162 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.162 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.163 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.163 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.163 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-10-19T08:46:23.164 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.164 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-19T08:46:23.164 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.164 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-10-19T08:46:23.165 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-10-19T08:46:23.165 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.165 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-10-19T08:46:23.165 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.166 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 21219 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-19T08:46:23.166 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.166 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-19T08:46:23.167 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.167 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 1u unix 0xffff9574880b2ec0 0t0 597 type=STREAM (CONNECTED) 2023-10-19T08:46:23.167 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 2u unix 0xffff9574880b2ec0 0t0 597 type=STREAM (CONNECTED) 2023-10-19T08:46:23.167 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 3u unix 0xffff95748b1272c0 0t0 626 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.168 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 4u a_inode 0,14 0 11268 [eventpoll:5,6,7,8,9,10,11,12,13,14,15,16,17,18,20,21] 2023-10-19T08:46:23.168 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 5u a_inode 0,14 0 11268 [signalfd] 2023-10-19T08:46:23.168 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 6u a_inode 0,14 0 11268 [timerfd] 2023-10-19T08:46:23.168 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 7r REG 0,21 4096 22887 /sys/devices/virtual/tty/tty0/active 2023-10-19T08:46:23.169 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 8u netlink 0t0 637 KOBJECT_UEVENT 2023-10-19T08:46:23.169 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 9r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.169 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 10r FIFO 0,24 0t0 1152 /run/systemd/inhibit/1.ref 2023-10-19T08:46:23.170 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 11u netlink 0t0 638 KOBJECT_UEVENT 2023-10-19T08:46:23.170 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 12u netlink 0t0 639 KOBJECT_UEVENT 2023-10-19T08:46:23.170 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 13u netlink 0t0 640 KOBJECT_UEVENT 2023-10-19T08:46:23.170 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 14u unix 0xffff9574880b4840 0t0 641 type=STREAM (CONNECTED) 2023-10-19T08:46:23.171 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 15u a_inode 0,14 0 11268 [timerfd] 2023-10-19T08:46:23.171 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 16u CHR 13,65 0t0 138 /dev/input/event1 2023-10-19T08:46:23.171 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 17u CHR 13,64 0t0 137 /dev/input/event0 2023-10-19T08:46:23.171 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 18u CHR 13,66 0t0 347 /dev/input/event2 2023-10-19T08:46:23.172 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 19u CHR 4,6 0t0 25 /dev/tty6 2023-10-19T08:46:23.172 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 20r FIFO 0,24 0t0 1226 /run/systemd/sessions/1.ref 2023-10-19T08:46:23.172 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-l 736 root 21r FIFO 0,24 0t0 1234 /run/systemd/sessions/3.ref 2023-10-19T08:46:23.172 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.173 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.173 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony txt REG 8,1 353408 12490 /usr/sbin/chronyd 2023-10-19T08:46:23.173 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-10-19T08:46:23.174 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.174 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.174 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony mem REG 8,1 157072 13149 /usr/lib64/libnss_myhostname.so.2 2023-10-19T08:46:23.174 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-10-19T08:46:23.175 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-10-19T08:46:23.175 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.175 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-10-19T08:46:23.175 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-10-19T08:46:23.176 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-10-19T08:46:23.176 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-19T08:46:23.176 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-10-19T08:46:23.177 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.177 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.177 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.177 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.178 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony 1w CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.178 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.178 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony 3u unix 0xffff957487a75500 0t0 21855 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.179 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony 5u IPv4 21861 0t0 UDP localhost:323 2023-10-19T08:46:23.179 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony 6u IPv6 21862 0t0 UDP localhost:323 2023-10-19T08:46:23.179 INFO:teuthology.orchestra.run.smithi079.stdout:chronyd 753 chrony 7u unix 0xffff957487a76600 0t0 21863 /run/chrony/chronyd.sock type=DGRAM (CONNECTED) 2023-10-19T08:46:23.179 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.180 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.180 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root txt REG 8,1 53128 20358 /usr/lib/systemd/systemd-hostnamed 2023-10-19T08:46:23.180 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.181 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.181 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.181 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.181 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 595024 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-19T08:46:23.182 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-19T08:46:23.182 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.182 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:23.182 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-19T08:46:23.183 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:23.183 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.183 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.184 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.184 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.184 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-10-19T08:46:23.184 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.185 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-10-19T08:46:23.185 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.185 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-10-19T08:46:23.185 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-19T08:46:23.186 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.186 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.186 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-10-19T08:46:23.186 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-19T08:46:23.187 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.187 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.187 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-10-19T08:46:23.188 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.188 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 21219 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-19T08:46:23.188 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.188 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-19T08:46:23.189 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.189 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root 1u unix 0xffff957488413fc0 0t0 21033 type=STREAM (CONNECTED) 2023-10-19T08:46:23.189 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root 2u unix 0xffff957488413fc0 0t0 21033 type=STREAM (CONNECTED) 2023-10-19T08:46:23.189 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root 3u sock 0,8 0t0 21087 protocol: UNIX 2023-10-19T08:46:23.190 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root 4u a_inode 0,14 0 11268 [eventpoll:5,6,7,8] 2023-10-19T08:46:23.190 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root 5u a_inode 0,14 0 11268 [timerfd] 2023-10-19T08:46:23.190 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root 6u a_inode 0,14 0 11268 [signalfd] 2023-10-19T08:46:23.190 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root 7u sock 0,8 0t0 21091 protocol: UNIX-STREAM 2023-10-19T08:46:23.191 INFO:teuthology.orchestra.run.smithi079.stdout:systemd-h 784 root 8u a_inode 0,14 0 11268 [timerfd] 2023-10-19T08:46:23.191 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.191 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.191 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root txt REG 8,1 61696 20956 /usr/libexec/nm-dispatcher 2023-10-19T08:46:23.192 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.192 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.192 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-10-19T08:46:23.192 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-10-19T08:46:23.193 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-10-19T08:46:23.193 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-10-19T08:46:23.193 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-19T08:46:23.193 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:23.194 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.194 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-10-19T08:46:23.194 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-10-19T08:46:23.194 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.195 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.195 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.195 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.196 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-10-19T08:46:23.196 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:23.196 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.196 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:23.197 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:23.197 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:23.197 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 1550504 10190 /usr/lib64/libnm.so.0.1.0 2023-10-19T08:46:23.198 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.198 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.198 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root 1u unix 0xffff9574982bc840 0t0 16805 type=STREAM (CONNECTED) 2023-10-19T08:46:23.198 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root 2u unix 0xffff9574982bc840 0t0 16805 type=STREAM (CONNECTED) 2023-10-19T08:46:23.199 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root 3u a_inode 0,14 0 11268 [eventfd:9] 2023-10-19T08:46:23.199 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root 4u a_inode 0,14 0 11268 [eventfd:11] 2023-10-19T08:46:23.199 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root 5u unix 0xffff957483130cc0 0t0 21875 type=STREAM (CONNECTED) 2023-10-19T08:46:23.200 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 root 6u a_inode 0,14 0 11268 [eventfd:12] 2023-10-19T08:46:23.200 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.200 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.200 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root txt REG 8,1 61696 20956 /usr/libexec/nm-dispatcher 2023-10-19T08:46:23.201 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.201 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.201 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-10-19T08:46:23.202 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-10-19T08:46:23.202 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-10-19T08:46:23.202 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-10-19T08:46:23.202 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-19T08:46:23.203 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:23.203 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.203 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-10-19T08:46:23.204 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-10-19T08:46:23.204 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.204 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.204 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.205 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.205 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-10-19T08:46:23.205 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:23.205 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.206 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:23.206 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:23.206 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:23.206 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 1550504 10190 /usr/lib64/libnm.so.0.1.0 2023-10-19T08:46:23.207 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.207 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.207 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root 1u unix 0xffff9574982bc840 0t0 16805 type=STREAM (CONNECTED) 2023-10-19T08:46:23.207 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root 2u unix 0xffff9574982bc840 0t0 16805 type=STREAM (CONNECTED) 2023-10-19T08:46:23.208 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root 3u a_inode 0,14 0 11268 [eventfd:9] 2023-10-19T08:46:23.208 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root 4u a_inode 0,14 0 11268 [eventfd:11] 2023-10-19T08:46:23.208 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root 5u unix 0xffff957483130cc0 0t0 21875 type=STREAM (CONNECTED) 2023-10-19T08:46:23.208 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 792 gmain root 6u a_inode 0,14 0 11268 [eventfd:12] 2023-10-19T08:46:23.209 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.209 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.209 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root txt REG 8,1 61696 20956 /usr/libexec/nm-dispatcher 2023-10-19T08:46:23.209 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.210 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.210 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 626152 9989 /usr/lib64/libhogweed.so.6.5 2023-10-19T08:46:23.210 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 340456 9991 /usr/lib64/libnettle.so.8.5 2023-10-19T08:46:23.210 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 1591920 9734 /usr/lib64/libunistring.so.2.1.0 2023-10-19T08:46:23.211 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 2291576 9994 /usr/lib64/libgnutls.so.30.33.1 2023-10-19T08:46:23.211 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-19T08:46:23.211 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:23.211 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.212 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 94112 9901 /usr/lib64/libtasn1.so.6.6.0 2023-10-19T08:46:23.212 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 130952 9772 /usr/lib64/libidn2.so.0.3.7 2023-10-19T08:46:23.212 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.213 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.213 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.213 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.213 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-10-19T08:46:23.214 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:23.214 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.214 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:23.215 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:23.215 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:23.215 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 1550504 10190 /usr/lib64/libnm.so.0.1.0 2023-10-19T08:46:23.215 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.216 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.216 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root 1u unix 0xffff9574982bc840 0t0 16805 type=STREAM (CONNECTED) 2023-10-19T08:46:23.216 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root 2u unix 0xffff9574982bc840 0t0 16805 type=STREAM (CONNECTED) 2023-10-19T08:46:23.216 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root 3u a_inode 0,14 0 11268 [eventfd:9] 2023-10-19T08:46:23.217 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root 4u a_inode 0,14 0 11268 [eventfd:11] 2023-10-19T08:46:23.217 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root 5u unix 0xffff957483130cc0 0t0 21875 type=STREAM (CONNECTED) 2023-10-19T08:46:23.217 INFO:teuthology.orchestra.run.smithi079.stdout:nm-dispat 791 794 gdbus root 6u a_inode 0,14 0 11268 [eventfd:12] 2023-10-19T08:46:23.217 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.218 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.218 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-10-19T08:46:23.218 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.218 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:23.219 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:23.219 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.219 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.219 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.220 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.220 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.220 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.220 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.221 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:23.221 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.221 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.221 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-19T08:46:23.222 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:23.222 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:23.222 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:23.223 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:23.223 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.223 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-19T08:46:23.223 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.224 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:23.224 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.224 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.224 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-19T08:46:23.225 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:23.225 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.225 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.225 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root 1u unix 0xffff95749821ee80 0t0 22658 type=STREAM (CONNECTED) 2023-10-19T08:46:23.226 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root 2u unix 0xffff95749821ee80 0t0 22658 type=STREAM (CONNECTED) 2023-10-19T08:46:23.226 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root 3u IPv4 22670 0t0 TCP *:ssh (LISTEN) 2023-10-19T08:46:23.226 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 831 root 4u IPv6 22672 0t0 TCP *:ssh (LISTEN) 2023-10-19T08:46:23.227 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.227 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.227 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-10-19T08:46:23.227 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-10-19T08:46:23.228 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.228 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.228 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-10-19T08:46:23.228 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.229 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.229 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.229 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.229 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:23.230 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:23.230 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.230 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:23.230 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-10-19T08:46:23.231 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.231 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:23.231 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:23.231 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-19T08:46:23.232 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.232 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.232 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.232 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.233 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.233 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.233 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.233 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.234 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-10-19T08:46:23.234 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2023-10-19T08:46:23.234 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.234 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2023-10-19T08:46:23.235 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.235 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.235 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.235 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-10-19T08:46:23.236 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.236 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.236 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.236 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.237 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.237 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.237 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.238 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.238 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.238 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.238 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.239 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.239 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.239 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.240 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.240 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.240 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.240 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-10-19T08:46:23.241 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.241 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.241 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:23.241 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.242 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.242 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.242 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.243 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root 1u unix 0xffff957483134400 0t0 21899 type=STREAM (CONNECTED) 2023-10-19T08:46:23.243 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root 2u unix 0xffff957483134400 0t0 21899 type=STREAM (CONNECTED) 2023-10-19T08:46:23.243 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root 3w REG 8,1 9346 1216 /var/log/tuned/tuned.log 2023-10-19T08:46:23.243 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root 4u sock 0,8 0t0 19759 protocol: NETLINK 2023-10-19T08:46:23.244 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root 5u unix 0xffff957483133fc0 0t0 21935 type=STREAM (CONNECTED) 2023-10-19T08:46:23.244 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root 6u a_inode 0,14 0 11268 [eventfd:17] 2023-10-19T08:46:23.244 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root 7u unix 0xffff957498219540 0t0 22679 type=STREAM (CONNECTED) 2023-10-19T08:46:23.245 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 root 8u unix 0xffff95749821aa80 0t0 22680 type=STREAM (CONNECTED) 2023-10-19T08:46:23.245 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.245 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.245 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root txt REG 8,1 15448 10498 /usr/bin/python3.9 2023-10-19T08:46:23.246 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 200144 10124 /usr/lib64/libudev.so.1.7.5 2023-10-19T08:46:23.246 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 130464 38212 /usr/lib64/python3.9/lib-dynload/_ctypes.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.246 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 107736 38215 /usr/lib64/python3.9/lib-dynload/_datetime.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.246 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 204696 37013 /usr/lib64/girepository-1.0/GLib-2.0.typelib 2023-10-19T08:46:23.247 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.247 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.247 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.247 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.248 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 1932656 10165 /usr/lib64/libgio-2.0.so.0.6800.4 2023-10-19T08:46:23.248 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 19480 10169 /usr/lib64/libgmodule-2.0.so.0.6800.4 2023-10-19T08:46:23.248 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.249 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 375136 10171 /usr/lib64/libgobject-2.0.so.0.6800.4 2023-10-19T08:46:23.249 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 143200 10195 /usr/lib64/libgirepository-1.0.so.1.0.0 2023-10-19T08:46:23.249 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 357112 39324 /usr/lib64/python3.9/site-packages/gi/_gi.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.249 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 489696 10000 /usr/lib64/libpcre.so.1.2.12 2023-10-19T08:46:23.250 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 1303016 10167 /usr/lib64/libglib-2.0.so.0.6800.4 2023-10-19T08:46:23.250 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 197952 9776 /usr/lib64/libexpat.so.1.8.10 2023-10-19T08:46:23.250 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 71408 38249 /usr/lib64/python3.9/lib-dynload/pyexpat.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.251 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.251 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.251 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.251 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.252 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.252 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.252 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.252 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 343752 10128 /usr/lib64/libdbus-1.so.3.19.13 2023-10-19T08:46:23.253 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 171376 39203 /usr/lib64/python3.9/site-packages/_dbus_bindings.so 2023-10-19T08:46:23.253 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.253 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 24736 39204 /usr/lib64/python3.9/site-packages/_dbus_glib_bindings.so 2023-10-19T08:46:23.254 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 23800 38230 /usr/lib64/python3.9/lib-dynload/_posixsubprocess.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.254 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.254 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 46560 38224 /usr/lib64/python3.9/lib-dynload/_lzma.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.254 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 76792 9701 /usr/lib64/libbz2.so.1.0.8 2023-10-19T08:46:23.255 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 29224 41980 /usr/lib64/python3.9/lib-dynload/_bz2.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.255 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 41752 38253 /usr/lib64/python3.9/lib-dynload/zlib.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.255 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 50232 41979 /usr/lib64/python3.9/lib-dynload/_blake2.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.255 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.256 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 20000 42001 /usr/lib64/python3.9/lib-dynload/grp.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.256 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 69048 38220 /usr/lib64/python3.9/lib-dynload/_hashlib.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.256 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 24160 41992 /usr/lib64/python3.9/lib-dynload/_random.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.256 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 124184 41989 /usr/lib64/python3.9/lib-dynload/_pickle.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.257 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 56424 38237 /usr/lib64/python3.9/lib-dynload/_struct.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.257 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 68000 38241 /usr/lib64/python3.9/lib-dynload/array.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.257 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 67528 42002 /usr/lib64/python3.9/lib-dynload/math.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.257 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 23832 38245 /usr/lib64/python3.9/lib-dynload/fcntl.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.258 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.258 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 15984 38200 /usr/lib64/python3.9/lib-dynload/_bisect.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.258 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 28056 41985 /usr/lib64/python3.9/lib-dynload/_heapq.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.258 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 37592 38251 /usr/lib64/python3.9/lib-dynload/select.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.259 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 101208 41993 /usr/lib64/python3.9/lib-dynload/_socket.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.259 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 3486240 13688 /usr/lib64/libpython3.9.so.1.0 2023-10-19T08:46:23.259 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 15560 38227 /usr/lib64/python3.9/lib-dynload/_opcode.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.259 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.260 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:23.260 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.260 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 20528 41991 /usr/lib64/python3.9/lib-dynload/_queue.cpython-39-x86_64-linux-gnu.so 2023-10-19T08:46:23.260 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.261 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.261 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root 1u unix 0xffff957483134400 0t0 21899 type=STREAM (CONNECTED) 2023-10-19T08:46:23.261 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root 2u unix 0xffff957483134400 0t0 21899 type=STREAM (CONNECTED) 2023-10-19T08:46:23.261 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root 3w REG 8,1 9346 1216 /var/log/tuned/tuned.log 2023-10-19T08:46:23.261 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root 4u sock 0,8 0t0 19759 protocol: NETLINK 2023-10-19T08:46:23.262 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root 5u unix 0xffff957483133fc0 0t0 21935 type=STREAM (CONNECTED) 2023-10-19T08:46:23.262 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root 6u a_inode 0,14 0 11268 [eventfd:17] 2023-10-19T08:46:23.262 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root 7u unix 0xffff957498219540 0t0 22679 type=STREAM (CONNECTED) 2023-10-19T08:46:23.263 INFO:teuthology.orchestra.run.smithi079.stdout:tuned 833 926 tuned root 8u unix 0xffff95749821aa80 0t0 22680 type=STREAM (CONNECTED) 2023-10-19T08:46:23.263 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.263 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.263 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-10-19T08:46:23.264 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-19T08:46:23.264 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.264 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.265 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:23.265 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.265 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-10-19T08:46:23.265 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-10-19T08:46:23.266 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-19T08:46:23.266 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-19T08:46:23.266 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-19T08:46:23.267 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.267 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.267 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.267 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-19T08:46:23.268 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-10-19T08:46:23.268 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-10-19T08:46:23.268 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:23.269 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:23.269 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:23.269 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:23.269 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:23.270 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-10-19T08:46:23.270 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.270 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-10-19T08:46:23.271 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-10-19T08:46:23.271 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-10-19T08:46:23.271 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:23.271 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:23.272 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-10-19T08:46:23.272 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-19T08:46:23.272 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-19T08:46:23.272 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-19T08:46:23.273 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-19T08:46:23.273 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-19T08:46:23.273 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-19T08:46:23.274 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.274 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-19T08:46:23.274 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.274 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root 1u unix 0xffff9574880b6a40 0t0 665 type=STREAM (CONNECTED) 2023-10-19T08:46:23.275 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root 2u unix 0xffff9574880b6a40 0t0 665 type=STREAM (CONNECTED) 2023-10-19T08:46:23.275 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root 3u unix 0xffff95748b123fc0 0t0 682 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.275 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root 4r FIFO 0,13 0t0 687 pipe 2023-10-19T08:46:23.276 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root 5u a_inode 0,14 0 11268 [eventpoll:4,6,7,8] 2023-10-19T08:46:23.276 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root 6u a_inode 0,14 0 11268 [eventfd:16] 2023-10-19T08:46:23.276 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root 7u unix 0xffff9574880b1dc0 0t0 683 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-10-19T08:46:23.276 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root 8u unix 0xffff9574880b7700 0t0 684 /run/gssproxy.sock type=STREAM (LISTEN) 2023-10-19T08:46:23.277 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 root 9w FIFO 0,13 0t0 687 pipe 2023-10-19T08:46:23.277 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.277 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.278 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-10-19T08:46:23.278 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-19T08:46:23.278 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.278 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.279 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:23.279 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.279 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-10-19T08:46:23.279 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-10-19T08:46:23.280 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-19T08:46:23.280 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-19T08:46:23.280 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-19T08:46:23.280 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.281 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.281 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.281 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-19T08:46:23.281 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-10-19T08:46:23.281 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-10-19T08:46:23.282 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:23.282 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:23.282 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:23.282 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:23.283 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:23.283 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-10-19T08:46:23.283 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.283 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-10-19T08:46:23.284 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-10-19T08:46:23.284 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-10-19T08:46:23.284 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:23.284 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:23.285 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-10-19T08:46:23.285 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-19T08:46:23.285 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-19T08:46:23.285 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-19T08:46:23.286 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-19T08:46:23.286 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-19T08:46:23.286 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-19T08:46:23.286 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.287 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-19T08:46:23.287 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.287 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root 1u unix 0xffff9574880b6a40 0t0 665 type=STREAM (CONNECTED) 2023-10-19T08:46:23.287 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root 2u unix 0xffff9574880b6a40 0t0 665 type=STREAM (CONNECTED) 2023-10-19T08:46:23.288 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root 3u unix 0xffff95748b123fc0 0t0 682 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.288 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root 4r FIFO 0,13 0t0 687 pipe 2023-10-19T08:46:23.288 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root 5u a_inode 0,14 0 11268 [eventpoll:4,6,7,8] 2023-10-19T08:46:23.289 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root 6u a_inode 0,14 0 11268 [eventfd:16] 2023-10-19T08:46:23.289 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root 7u unix 0xffff9574880b1dc0 0t0 683 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-10-19T08:46:23.289 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root 8u unix 0xffff9574880b7700 0t0 684 /run/gssproxy.sock type=STREAM (LISTEN) 2023-10-19T08:46:23.289 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 846 gssproxy root 9w FIFO 0,13 0t0 687 pipe 2023-10-19T08:46:23.290 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.290 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.290 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-10-19T08:46:23.290 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-19T08:46:23.291 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.291 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.291 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:23.291 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.292 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-10-19T08:46:23.292 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-10-19T08:46:23.292 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-19T08:46:23.293 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-19T08:46:23.293 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-19T08:46:23.293 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.293 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.294 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.294 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-19T08:46:23.294 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-10-19T08:46:23.295 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-10-19T08:46:23.295 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:23.295 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:23.295 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:23.296 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:23.296 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:23.296 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-10-19T08:46:23.297 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.297 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-10-19T08:46:23.297 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-10-19T08:46:23.297 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-10-19T08:46:23.298 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:23.298 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:23.298 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-10-19T08:46:23.299 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-19T08:46:23.299 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-19T08:46:23.299 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-19T08:46:23.299 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-19T08:46:23.300 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-19T08:46:23.300 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-19T08:46:23.300 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.300 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-19T08:46:23.301 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.301 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root 1u unix 0xffff9574880b6a40 0t0 665 type=STREAM (CONNECTED) 2023-10-19T08:46:23.301 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root 2u unix 0xffff9574880b6a40 0t0 665 type=STREAM (CONNECTED) 2023-10-19T08:46:23.301 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root 3u unix 0xffff95748b123fc0 0t0 682 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.302 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root 4r FIFO 0,13 0t0 687 pipe 2023-10-19T08:46:23.302 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root 5u a_inode 0,14 0 11268 [eventpoll:4,6,7,8] 2023-10-19T08:46:23.302 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root 6u a_inode 0,14 0 11268 [eventfd:16] 2023-10-19T08:46:23.303 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root 7u unix 0xffff9574880b1dc0 0t0 683 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-10-19T08:46:23.303 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root 8u unix 0xffff9574880b7700 0t0 684 /run/gssproxy.sock type=STREAM (LISTEN) 2023-10-19T08:46:23.303 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 847 gssproxy root 9w FIFO 0,13 0t0 687 pipe 2023-10-19T08:46:23.303 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.304 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.304 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-10-19T08:46:23.304 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-19T08:46:23.304 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.305 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.305 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:23.305 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.306 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-10-19T08:46:23.306 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-10-19T08:46:23.306 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-19T08:46:23.306 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-19T08:46:23.307 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-19T08:46:23.307 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.307 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.307 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.308 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-19T08:46:23.308 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-10-19T08:46:23.308 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-10-19T08:46:23.308 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:23.309 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:23.309 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:23.309 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:23.309 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:23.309 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-10-19T08:46:23.310 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.310 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-10-19T08:46:23.310 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-10-19T08:46:23.310 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-10-19T08:46:23.311 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:23.311 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:23.311 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-10-19T08:46:23.312 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-19T08:46:23.312 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-19T08:46:23.312 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-19T08:46:23.312 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-19T08:46:23.313 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-19T08:46:23.313 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-19T08:46:23.313 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.314 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-19T08:46:23.314 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.314 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root 1u unix 0xffff9574880b6a40 0t0 665 type=STREAM (CONNECTED) 2023-10-19T08:46:23.314 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root 2u unix 0xffff9574880b6a40 0t0 665 type=STREAM (CONNECTED) 2023-10-19T08:46:23.315 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root 3u unix 0xffff95748b123fc0 0t0 682 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.315 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root 4r FIFO 0,13 0t0 687 pipe 2023-10-19T08:46:23.315 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root 5u a_inode 0,14 0 11268 [eventpoll:4,6,7,8] 2023-10-19T08:46:23.315 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root 6u a_inode 0,14 0 11268 [eventfd:16] 2023-10-19T08:46:23.316 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root 7u unix 0xffff9574880b1dc0 0t0 683 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-10-19T08:46:23.316 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root 8u unix 0xffff9574880b7700 0t0 684 /run/gssproxy.sock type=STREAM (LISTEN) 2023-10-19T08:46:23.316 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 848 gssproxy root 9w FIFO 0,13 0t0 687 pipe 2023-10-19T08:46:23.316 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.317 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.317 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-10-19T08:46:23.317 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-19T08:46:23.318 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.318 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.318 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:23.318 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.319 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-10-19T08:46:23.319 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-10-19T08:46:23.319 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-19T08:46:23.319 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-19T08:46:23.320 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-19T08:46:23.320 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.320 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.321 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.321 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-19T08:46:23.321 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-10-19T08:46:23.321 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-10-19T08:46:23.322 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:23.322 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:23.322 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:23.322 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:23.323 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:23.323 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-10-19T08:46:23.323 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.323 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-10-19T08:46:23.324 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-10-19T08:46:23.324 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-10-19T08:46:23.324 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:23.324 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:23.325 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-10-19T08:46:23.325 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-19T08:46:23.325 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-19T08:46:23.326 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-19T08:46:23.326 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-19T08:46:23.326 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-19T08:46:23.326 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-19T08:46:23.327 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.327 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-19T08:46:23.327 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.327 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root 1u unix 0xffff9574880b6a40 0t0 665 type=STREAM (CONNECTED) 2023-10-19T08:46:23.328 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root 2u unix 0xffff9574880b6a40 0t0 665 type=STREAM (CONNECTED) 2023-10-19T08:46:23.328 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root 3u unix 0xffff95748b123fc0 0t0 682 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.328 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root 4r FIFO 0,13 0t0 687 pipe 2023-10-19T08:46:23.328 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root 5u a_inode 0,14 0 11268 [eventpoll:4,6,7,8] 2023-10-19T08:46:23.329 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root 6u a_inode 0,14 0 11268 [eventfd:16] 2023-10-19T08:46:23.329 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root 7u unix 0xffff9574880b1dc0 0t0 683 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-10-19T08:46:23.329 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root 8u unix 0xffff9574880b7700 0t0 684 /run/gssproxy.sock type=STREAM (LISTEN) 2023-10-19T08:46:23.329 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 849 gssproxy root 9w FIFO 0,13 0t0 687 pipe 2023-10-19T08:46:23.330 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.330 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.330 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root txt REG 8,1 127680 15021 /usr/sbin/gssproxy 2023-10-19T08:46:23.330 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-19T08:46:23.331 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.331 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.331 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:23.331 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.332 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 70960 15011 /usr/lib64/libev.so.4.0.0 2023-10-19T08:46:23.332 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 16168 15018 /usr/lib64/libverto-libev.so.1.0.0 2023-10-19T08:46:23.332 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-19T08:46:23.332 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-19T08:46:23.333 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-19T08:46:23.333 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.333 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.334 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.334 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 15912 9764 /usr/lib64/libbasicobjects.so.0.1.0 2023-10-19T08:46:23.334 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 20304 9968 /usr/lib64/libpath_utils.so.1.0.1 2023-10-19T08:46:23.334 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 58392 9766 /usr/lib64/libcollection.so.4.1.1 2023-10-19T08:46:23.335 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:23.335 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:23.335 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:23.335 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:23.336 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:23.336 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 142168 11395 /usr/lib64/libgssrpc.so.4.2 2023-10-19T08:46:23.336 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.337 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 16056 9768 /usr/lib64/libref_array.so.1.2.1 2023-10-19T08:46:23.337 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 120640 9970 /usr/lib64/libini_config.so.5.2.1 2023-10-19T08:46:23.337 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 28472 11392 /usr/lib64/libverto.so.1.0.0 2023-10-19T08:46:23.338 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:23.338 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:23.338 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 58368 9689 /usr/lib64/libpopt.so.0.0.1 2023-10-19T08:46:23.339 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-19T08:46:23.339 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-19T08:46:23.339 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-19T08:46:23.339 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-19T08:46:23.340 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-19T08:46:23.340 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-19T08:46:23.340 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.340 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-19T08:46:23.341 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.341 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root 1u unix 0xffff9574880b6a40 0t0 665 type=STREAM (CONNECTED) 2023-10-19T08:46:23.341 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root 2u unix 0xffff9574880b6a40 0t0 665 type=STREAM (CONNECTED) 2023-10-19T08:46:23.342 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root 3u unix 0xffff95748b123fc0 0t0 682 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.342 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root 4r FIFO 0,13 0t0 687 pipe 2023-10-19T08:46:23.342 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root 5u a_inode 0,14 0 11268 [eventpoll:4,6,7,8] 2023-10-19T08:46:23.343 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root 6u a_inode 0,14 0 11268 [eventfd:16] 2023-10-19T08:46:23.343 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root 7u unix 0xffff9574880b1dc0 0t0 683 /var/lib/gssproxy/default.sock type=STREAM (LISTEN) 2023-10-19T08:46:23.343 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root 8u unix 0xffff9574880b7700 0t0 684 /run/gssproxy.sock type=STREAM (LISTEN) 2023-10-19T08:46:23.343 INFO:teuthology.orchestra.run.smithi079.stdout:gssproxy 845 850 gssproxy root 9w FIFO 0,13 0t0 687 pipe 2023-10-19T08:46:23.344 INFO:teuthology.orchestra.run.smithi079.stdout:atd 852 root cwd DIR 8,1 4096 1657 /var/spool/at 2023-10-19T08:46:23.344 INFO:teuthology.orchestra.run.smithi079.stdout:atd 852 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.344 INFO:teuthology.orchestra.run.smithi079.stdout:atd 852 root txt REG 8,1 32680 12473 /usr/sbin/atd 2023-10-19T08:46:23.344 INFO:teuthology.orchestra.run.smithi079.stdout:atd 852 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.345 INFO:teuthology.orchestra.run.smithi079.stdout:atd 852 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.345 INFO:teuthology.orchestra.run.smithi079.stdout:atd 852 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:23.345 INFO:teuthology.orchestra.run.smithi079.stdout:atd 852 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.346 INFO:teuthology.orchestra.run.smithi079.stdout:atd 852 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-19T08:46:23.346 INFO:teuthology.orchestra.run.smithi079.stdout:atd 852 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:23.346 INFO:teuthology.orchestra.run.smithi079.stdout:atd 852 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.347 INFO:teuthology.orchestra.run.smithi079.stdout:atd 852 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-19T08:46:23.347 INFO:teuthology.orchestra.run.smithi079.stdout:atd 852 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.347 INFO:teuthology.orchestra.run.smithi079.stdout:atd 852 root 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.347 INFO:teuthology.orchestra.run.smithi079.stdout:atd 852 root 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.348 INFO:teuthology.orchestra.run.smithi079.stdout:atd 852 root 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.348 INFO:teuthology.orchestra.run.smithi079.stdout:atd 852 root 3uW REG 0,24 4 1176 /run/atd.pid 2023-10-19T08:46:23.348 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.349 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.349 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root txt REG 8,1 74552 11234 /usr/sbin/crond 2023-10-19T08:46:23.349 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:23.349 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-19T08:46:23.350 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.350 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.350 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.350 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-19T08:46:23.351 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-19T08:46:23.351 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-19T08:46:23.351 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.351 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:23.352 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-19T08:46:23.352 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:23.352 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-19T08:46:23.352 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.353 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-19T08:46:23.353 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-19T08:46:23.353 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-19T08:46:23.354 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-19T08:46:23.354 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-19T08:46:23.354 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-19T08:46:23.354 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.355 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-19T08:46:23.355 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.355 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root 1u unix 0xffff9574831372c0 0t0 21906 type=STREAM (CONNECTED) 2023-10-19T08:46:23.355 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root 2u unix 0xffff9574831372c0 0t0 21906 type=STREAM (CONNECTED) 2023-10-19T08:46:23.356 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root 3uW REG 0,24 4 1174 /run/crond.pid 2023-10-19T08:46:23.356 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root 4u unix 0xffff95748b124400 0t0 690 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.356 INFO:teuthology.orchestra.run.smithi079.stdout:crond 853 root 5r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.356 INFO:teuthology.orchestra.run.smithi079.stdout:nrpe 948 nrpe cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.357 INFO:teuthology.orchestra.run.smithi079.stdout:nrpe 948 nrpe rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.357 INFO:teuthology.orchestra.run.smithi079.stdout:nrpe 948 nrpe txt REG 8,1 80984 12959 /usr/sbin/nrpe 2023-10-19T08:46:23.357 INFO:teuthology.orchestra.run.smithi079.stdout:nrpe 948 nrpe mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.358 INFO:teuthology.orchestra.run.smithi079.stdout:nrpe 948 nrpe mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.358 INFO:teuthology.orchestra.run.smithi079.stdout:nrpe 948 nrpe mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.358 INFO:teuthology.orchestra.run.smithi079.stdout:nrpe 948 nrpe mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-10-19T08:46:23.358 INFO:teuthology.orchestra.run.smithi079.stdout:nrpe 948 nrpe mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.359 INFO:teuthology.orchestra.run.smithi079.stdout:nrpe 948 nrpe 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.359 INFO:teuthology.orchestra.run.smithi079.stdout:nrpe 948 nrpe 1w CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.359 INFO:teuthology.orchestra.run.smithi079.stdout:nrpe 948 nrpe 2w CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.360 INFO:teuthology.orchestra.run.smithi079.stdout:nrpe 948 nrpe 3u IPv4 12045 0t0 TCP *:nrpe (LISTEN) 2023-10-19T08:46:23.360 INFO:teuthology.orchestra.run.smithi079.stdout:nrpe 948 nrpe 4u unix 0xffff95748849aa80 0t0 12037 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.360 INFO:teuthology.orchestra.run.smithi079.stdout:nrpe 948 nrpe 5u IPv6 12046 0t0 TCP *:nrpe (LISTEN) 2023-10-19T08:46:23.360 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.361 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.361 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root txt REG 8,1 1388920 9667 /usr/bin/bash 2023-10-19T08:46:23.361 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-19T08:46:23.362 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.362 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:23.362 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-19T08:46:23.362 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-19T08:46:23.363 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-19T08:46:23.363 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.363 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-10-19T08:46:23.364 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-19T08:46:23.364 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-19T08:46:23.364 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-19T08:46:23.364 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-19T08:46:23.365 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-19T08:46:23.365 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-19T08:46:23.365 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.365 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-19T08:46:23.366 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.366 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root 1w CHR 4,65 0t0 114 /dev/ttyS1 2023-10-19T08:46:23.366 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root 2w CHR 4,65 0t0 114 /dev/ttyS1 2023-10-19T08:46:23.367 INFO:teuthology.orchestra.run.smithi079.stdout:rc.local 949 root 255r REG 8,1 4545 63567 /etc/rc.d/rc.local 2023-10-19T08:46:23.367 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.367 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.367 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-10-19T08:46:23.368 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-10-19T08:46:23.368 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.368 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.369 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.369 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-10-19T08:46:23.369 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-10-19T08:46:23.369 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-10-19T08:46:23.370 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.370 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.370 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.370 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.371 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.371 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:23.371 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-10-19T08:46:23.372 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.372 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-10-19T08:46:23.372 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-10-19T08:46:23.372 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.373 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.373 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.373 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root 1w CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.374 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root 2w CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.374 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root 3r CHR 1,9 0t0 9 /dev/urandom 2023-10-19T08:46:23.374 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root 4w REG 8,1 749432 1641 /var/log/messages 2023-10-19T08:46:23.374 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root 5u unix 0xffff957487a74c80 0t0 21966 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.375 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root 6r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.375 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root 7w REG 8,1 324028 1642 /var/log/secure 2023-10-19T08:46:23.375 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root 8w REG 8,1 680 1220 /var/log/cron 2023-10-19T08:46:23.376 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-10-19T08:46:23.376 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.376 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.376 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-10-19T08:46:23.377 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-10-19T08:46:23.377 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.377 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.377 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.378 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-10-19T08:46:23.378 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-10-19T08:46:23.378 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-10-19T08:46:23.379 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.379 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.379 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.379 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.380 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.380 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:23.380 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-10-19T08:46:23.380 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.381 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-10-19T08:46:23.381 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-10-19T08:46:23.381 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.381 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.382 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.382 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root 1w CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.382 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root 2w CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.383 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root 3r CHR 1,9 0t0 9 /dev/urandom 2023-10-19T08:46:23.383 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root 4w REG 8,1 749432 1641 /var/log/messages 2023-10-19T08:46:23.383 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root 5u unix 0xffff957487a74c80 0t0 21966 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.383 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root 6r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.384 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root 7w REG 8,1 324028 1642 /var/log/secure 2023-10-19T08:46:23.384 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root 8w REG 8,1 680 1220 /var/log/cron 2023-10-19T08:46:23.384 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 984 in:imjour root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-10-19T08:46:23.385 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.385 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.385 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root txt REG 8,1 769928 12237 /usr/sbin/rsyslogd 2023-10-19T08:46:23.385 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root mem REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-10-19T08:46:23.386 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.386 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.386 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.386 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root mem REG 8,1 33592 12207 /usr/lib64/rsyslog/imjournal.so 2023-10-19T08:46:23.387 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root mem REG 8,1 42248 12214 /usr/lib64/rsyslog/imuxsock.so 2023-10-19T08:46:23.387 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root mem REG 8,1 32808 12215 /usr/lib64/rsyslog/lmnet.so 2023-10-19T08:46:23.387 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.388 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.388 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.388 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.388 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.389 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:23.389 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root mem REG 8,1 36328 9712 /usr/lib64/libuuid.so.1.3.0 2023-10-19T08:46:23.389 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.390 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root mem REG 8,1 52856 12201 /usr/lib64/libfastjson.so.4.3.0 2023-10-19T08:46:23.390 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root mem REG 8,1 16032 12200 /usr/lib64/libestr.so.0.0.0 2023-10-19T08:46:23.390 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.390 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.391 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.391 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root 1w CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.391 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root 2w CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.391 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root 3r CHR 1,9 0t0 9 /dev/urandom 2023-10-19T08:46:23.392 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root 4w REG 8,1 749432 1641 /var/log/messages 2023-10-19T08:46:23.392 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root 5u unix 0xffff957487a74c80 0t0 21966 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.392 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root 6r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.392 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root 7w REG 8,1 324028 1642 /var/log/secure 2023-10-19T08:46:23.393 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root 8w REG 8,1 680 1220 /var/log/cron 2023-10-19T08:46:23.393 INFO:teuthology.orchestra.run.smithi079.stdout:rsyslogd 956 987 rs:main root 9r REG 0,24 8388608 58 /run/log/journal/15949e3c88704300882482eddfd7baae/system.journal 2023-10-19T08:46:23.393 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.393 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.394 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-10-19T08:46:23.394 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-10-19T08:46:23.394 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-10-19T08:46:23.395 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-10-19T08:46:23.395 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.395 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-19T08:46:23.395 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-10-19T08:46:23.396 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-10-19T08:46:23.396 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-10-19T08:46:23.396 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-10-19T08:46:23.396 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-10-19T08:46:23.397 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-10-19T08:46:23.397 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-10-19T08:46:23.397 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-10-19T08:46:23.397 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-10-19T08:46:23.398 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-10-19T08:46:23.398 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-10-19T08:46:23.398 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-10-19T08:46:23.399 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-10-19T08:46:23.399 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-10-19T08:46:23.399 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-10-19T08:46:23.399 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-10-19T08:46:23.400 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-10-19T08:46:23.400 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.400 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:23.400 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:23.401 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.401 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.401 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.401 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.402 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.402 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:23.402 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.402 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.403 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.403 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.403 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.404 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-19T08:46:23.404 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:23.404 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:23.404 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:23.405 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:23.405 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:23.405 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.405 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-19T08:46:23.406 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.406 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.406 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-19T08:46:23.406 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:23.407 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-10-19T08:46:23.407 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.407 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-19T08:46:23.408 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.408 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.408 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.408 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root 3u unix 0xffff95748ad6c400 0t0 22837 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.409 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root 4u IPv4 22766 0t0 TCP smithi079.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:33448 (ESTABLISHED) 2023-10-19T08:46:23.409 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root 6u unix 0xffff957483130880 0t0 22279 type=STREAM (CONNECTED) 2023-10-19T08:46:23.409 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root 7w FIFO 0,24 0t0 1226 /run/systemd/sessions/1.ref 2023-10-19T08:46:23.410 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2163 root 8u unix 0xffff95749821dd80 0t0 22841 type=STREAM (CONNECTED) 2023-10-19T08:46:23.410 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.410 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.411 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-10-19T08:46:23.411 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 595024 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-19T08:46:23.411 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.411 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.412 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.412 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.412 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.412 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.413 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.413 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-19T08:46:23.413 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.414 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-10-19T08:46:23.414 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.414 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.414 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.415 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-19T08:46:23.415 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.415 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-10-19T08:46:23.415 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:23.416 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-19T08:46:23.416 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.416 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.417 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.417 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-10-19T08:46:23.417 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-10-19T08:46:23.417 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-10-19T08:46:23.418 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:23.418 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-19T08:46:23.418 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-10-19T08:46:23.419 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.419 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 21219 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-19T08:46:23.419 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.419 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-19T08:46:23.420 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.420 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 1u unix 0xffff95748854ea40 0t0 18264 type=STREAM (CONNECTED) 2023-10-19T08:46:23.420 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 2u unix 0xffff95748854ea40 0t0 18264 type=STREAM (CONNECTED) 2023-10-19T08:46:23.420 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 3u unix 0xffff957488554840 0t0 18292 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.421 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 4u a_inode 0,14 0 11268 [eventpoll:5,6,8,9,11,12,14,15,16,17,19,20,21] 2023-10-19T08:46:23.421 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 5u a_inode 0,14 0 11268 [signalfd] 2023-10-19T08:46:23.421 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 6r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.421 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 7r DIR 0,25 0 3403 /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service 2023-10-19T08:46:23.422 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 8u a_inode 0,14 0 11268 [timerfd] 2023-10-19T08:46:23.422 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 9u a_inode 0,14 0 11268 [eventpoll:10,13] 2023-10-19T08:46:23.422 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 10r REG 0,20 0 18281 /proc/2408/mountinfo 2023-10-19T08:46:23.423 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 11r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.423 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 12u unix 0xffff9574880b5d80 0t0 976 /run/user/1000/bus type=STREAM (LISTEN) 2023-10-19T08:46:23.423 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 13r a_inode 0,14 0 11268 inotify 2023-10-19T08:46:23.423 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 14r REG 0,20 0 4026532076 /proc/swaps 2023-10-19T08:46:23.424 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 15u netlink 0t0 18300 KOBJECT_UEVENT 2023-10-19T08:46:23.424 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 16u unix 0xffff95748b126e80 0t0 962 /run/user/1000/systemd/notify type=DGRAM (UNCONNECTED) 2023-10-19T08:46:23.424 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 17u unix 0xffff95748b121540 0t0 963 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.425 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 18u unix 0xffff95748b121100 0t0 964 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.425 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 19u unix 0xffff9574880b0440 0t0 965 /run/user/1000/systemd/private type=STREAM (LISTEN) 2023-10-19T08:46:23.425 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 20u unix 0xffff9574880b0880 0t0 967 type=STREAM (CONNECTED) 2023-10-19T08:46:23.425 INFO:teuthology.orchestra.run.smithi079.stdout:systemd 2408 ubuntu 21u a_inode 0,14 0 11268 [timerfd] 2023-10-19T08:46:23.426 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.426 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.426 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu txt REG 8,1 102120 20353 /usr/lib/systemd/systemd 2023-10-19T08:46:23.426 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-10-19T08:46:23.427 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-10-19T08:46:23.427 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-10-19T08:46:23.427 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-10-19T08:46:23.428 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-10-19T08:46:23.428 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-10-19T08:46:23.428 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-10-19T08:46:23.428 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-10-19T08:46:23.429 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-10-19T08:46:23.429 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-10-19T08:46:23.429 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 595024 63926 /etc/selinux/targeted/contexts/files/file_contexts.bin 2023-10-19T08:46:23.429 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.430 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.430 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-19T08:46:23.430 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.431 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-10-19T08:46:23.431 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-10-19T08:46:23.431 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.431 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.432 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 28552 9804 /usr/lib64/libattr.so.1.1.2501 2023-10-19T08:46:23.432 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.432 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.432 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.433 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.433 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:23.433 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-19T08:46:23.434 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.434 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.434 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-19T08:46:23.434 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 229360 10126 /usr/lib64/libblkid.so.1.1.0 2023-10-19T08:46:23.435 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 283152 10156 /usr/lib64/libmount.so.1.1.0 2023-10-19T08:46:23.435 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.435 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 3645472 49253 /usr/lib64/systemd/libsystemd-shared-252.so 2023-10-19T08:46:23.435 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.436 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 41120 9806 /usr/lib64/libacl.so.1.1.2301 2023-10-19T08:46:23.436 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 107424 10180 /usr/lib64/libkmod.so.2.3.6 2023-10-19T08:46:23.436 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:23.437 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-19T08:46:23.437 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 127680 9972 /usr/lib64/libseccomp.so.2.5.2 2023-10-19T08:46:23.437 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 2174088 49251 /usr/lib64/systemd/libsystemd-core-252.so 2023-10-19T08:46:23.437 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.438 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 21219 63928 /etc/selinux/targeted/contexts/files/file_contexts.homedirs.bin 2023-10-19T08:46:23.438 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.438 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-19T08:46:23.438 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.439 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu 1u unix 0xffff95748854ea40 0t0 18264 type=STREAM (CONNECTED) 2023-10-19T08:46:23.439 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu 2u unix 0xffff95748854ea40 0t0 18264 type=STREAM (CONNECTED) 2023-10-19T08:46:23.439 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu 3u a_inode 0,14 0 11268 [eventfd:13] 2023-10-19T08:46:23.440 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu 4u a_inode 0,14 0 11268 [eventfd:14] 2023-10-19T08:46:23.440 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu 6w FIFO 0,13 0t0 18268 pipe 2023-10-19T08:46:23.440 INFO:teuthology.orchestra.run.smithi079.stdout:(sd-pam) 2411 ubuntu 7u unix 0xffff957488557700 0t0 18284 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.440 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.441 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.441 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-10-19T08:46:23.441 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-10-19T08:46:23.441 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-10-19T08:46:23.442 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-10-19T08:46:23.442 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.442 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-19T08:46:23.443 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-10-19T08:46:23.443 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-10-19T08:46:23.443 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-10-19T08:46:23.443 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-10-19T08:46:23.444 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-10-19T08:46:23.444 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-10-19T08:46:23.444 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-10-19T08:46:23.444 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-10-19T08:46:23.445 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-10-19T08:46:23.445 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-10-19T08:46:23.445 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-10-19T08:46:23.446 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-10-19T08:46:23.446 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-10-19T08:46:23.446 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-10-19T08:46:23.446 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-10-19T08:46:23.447 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-10-19T08:46:23.447 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-10-19T08:46:23.447 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.447 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:23.448 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:23.448 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.448 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.448 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.449 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.449 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.449 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:23.450 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.450 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.450 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.450 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.451 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.451 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-19T08:46:23.451 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:23.451 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:23.452 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:23.452 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:23.452 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:23.452 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.453 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-19T08:46:23.453 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.453 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.454 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-19T08:46:23.454 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:23.454 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-10-19T08:46:23.454 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.455 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-19T08:46:23.455 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.455 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.456 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.456 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu 3u unix 0xffff95748ad6c400 0t0 22837 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.456 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu 4u IPv4 22766 0t0 TCP smithi079.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:33448 (ESTABLISHED) 2023-10-19T08:46:23.456 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu 5u unix 0xffff95749821b300 0t0 22840 type=STREAM (CONNECTED) 2023-10-19T08:46:23.457 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu 6u unix 0xffff957483130880 0t0 22279 type=STREAM (CONNECTED) 2023-10-19T08:46:23.457 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu 7w FIFO 0,24 0t0 1226 /run/systemd/sessions/1.ref 2023-10-19T08:46:23.457 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu 12r FIFO 0,13 0t0 21311 pipe 2023-10-19T08:46:23.457 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 2546 ubuntu 14r FIFO 0,13 0t0 21312 pipe 2023-10-19T08:46:23.458 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2023-10-19T08:46:23.458 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.458 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2023-10-19T08:46:23.459 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-19T08:46:23.459 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.459 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:23.459 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-19T08:46:23.460 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-19T08:46:23.460 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-19T08:46:23.460 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.460 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-10-19T08:46:23.461 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-19T08:46:23.461 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-19T08:46:23.461 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-19T08:46:23.462 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-19T08:46:23.462 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-19T08:46:23.462 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-19T08:46:23.462 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.463 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-19T08:46:23.463 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu 0r FIFO 0,13 0t0 21310 pipe 2023-10-19T08:46:23.463 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu 1w FIFO 0,13 0t0 21311 pipe 2023-10-19T08:46:23.463 INFO:teuthology.orchestra.run.smithi079.stdout:bash 2612 ubuntu 2w FIFO 0,13 0t0 21312 pipe 2023-10-19T08:46:23.464 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.464 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.464 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-10-19T08:46:23.465 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-10-19T08:46:23.465 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-10-19T08:46:23.465 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-10-19T08:46:23.465 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.466 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-19T08:46:23.466 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-10-19T08:46:23.466 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-10-19T08:46:23.466 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-10-19T08:46:23.467 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-10-19T08:46:23.467 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-10-19T08:46:23.467 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-10-19T08:46:23.468 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-10-19T08:46:23.468 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-10-19T08:46:23.468 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-10-19T08:46:23.468 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-10-19T08:46:23.469 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-10-19T08:46:23.469 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-10-19T08:46:23.469 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.470 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.470 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.470 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.470 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.471 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-10-19T08:46:23.471 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-10-19T08:46:23.471 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-10-19T08:46:23.471 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-10-19T08:46:23.472 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-10-19T08:46:23.472 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:23.472 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:23.473 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~281s 2023-10-19T08:46:23.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~281s 2023-10-19T08:46:23.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~281s 2023-10-19T08:46:23.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~281s 2023-10-19T08:46:23.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~281s 2023-10-19T08:46:23.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~281s 2023-10-19T08:46:23.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~281s 2023-10-19T08:46:23.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~287s 2023-10-19T08:46:23.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~287s 2023-10-19T08:46:23.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~287s 2023-10-19T08:46:23.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~287s 2023-10-19T08:46:23.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~287s 2023-10-19T08:46:23.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~287s 2023-10-19T08:46:23.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~287s 2023-10-19T08:46:23.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~287s 2023-10-19T08:46:23.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~287s 2023-10-19T08:46:23.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~287s 2023-10-19T08:46:23.481 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:23.481 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.481 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:23.482 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.482 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.482 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.483 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.483 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-19T08:46:23.483 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:23.483 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:23.484 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:23.484 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:23.484 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.484 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-19T08:46:23.485 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.485 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.485 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-19T08:46:23.486 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:23.486 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-10-19T08:46:23.486 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.487 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-19T08:46:23.487 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.487 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.487 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.488 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root 3u unix 0xffff95748ad69100 0t0 23189 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.488 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root 4u IPv4 20450 0t0 TCP smithi079.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:33450 (ESTABLISHED) 2023-10-19T08:46:23.488 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root 6u unix 0xffff95749821d940 0t0 23163 type=STREAM (CONNECTED) 2023-10-19T08:46:23.488 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root 7w FIFO 0,24 0t0 1234 /run/systemd/sessions/3.ref 2023-10-19T08:46:23.489 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4223 root 8u unix 0xffff957498218000 0t0 23193 type=STREAM (CONNECTED) 2023-10-19T08:46:23.489 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.489 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.489 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu txt REG 8,1 968800 13744 /usr/sbin/sshd 2023-10-19T08:46:23.490 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-10-19T08:46:23.490 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 19520 32283 /usr/lib64/security/pam_lastlog.so 2023-10-19T08:46:23.490 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 15184 32309 /usr/lib64/security/pam_umask.so 2023-10-19T08:46:23.491 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.491 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-19T08:46:23.491 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-10-19T08:46:23.491 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-10-19T08:46:23.492 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-10-19T08:46:23.492 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-10-19T08:46:23.492 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 15264 32290 /usr/lib64/security/pam_motd.so 2023-10-19T08:46:23.493 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-10-19T08:46:23.493 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 44152 32291 /usr/lib64/security/pam_namespace.so 2023-10-19T08:46:23.493 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 27616 32299 /usr/lib64/security/pam_selinux.so 2023-10-19T08:46:23.493 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-10-19T08:46:23.494 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-10-19T08:46:23.494 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 15240 32287 /usr/lib64/security/pam_loginuid.so 2023-10-19T08:46:23.494 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-10-19T08:46:23.495 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 153600 9809 /usr/lib64/libgpg-error.so.0.32.0 2023-10-19T08:46:23.495 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.495 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 882376 9699 /usr/lib64/libzstd.so.1.5.1 2023-10-19T08:46:23.495 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 1288504 9883 /usr/lib64/libgcrypt.so.20.4.0 2023-10-19T08:46:23.496 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.496 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-10-19T08:46:23.496 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 15232 32292 /usr/lib64/security/pam_nologin.so 2023-10-19T08:46:23.496 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 19368 32301 /usr/lib64/security/pam_sepermit.so 2023-10-19T08:46:23.497 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-10-19T08:46:23.497 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-10-19T08:46:23.497 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:23.497 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:23.498 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.498 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:23.498 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.499 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:23.499 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.499 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 144120 9867 /usr/lib64/liblz4.so.1.9.3 2023-10-19T08:46:23.499 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 178728 9694 /usr/lib64/liblzma.so.5.2.5 2023-10-19T08:46:23.500 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.500 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-19T08:46:23.500 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:23.501 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:23.501 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:23.501 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:23.501 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.502 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-19T08:46:23.502 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.502 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 915808 10122 /usr/lib64/libsystemd.so.0.35.0 2023-10-19T08:46:23.503 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-19T08:46:23.503 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:23.503 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-10-19T08:46:23.503 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.504 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu mem REG 0,19 0 19 /sys/fs/selinux/status 2023-10-19T08:46:23.504 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu 0u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.504 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu 1u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.504 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu 2u CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.505 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu 3u unix 0xffff95748ad69100 0t0 23189 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.505 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu 4u IPv4 20450 0t0 TCP smithi079.front.sepia.ceph.com:ssh->teuthology.front.sepia.ceph.com:33450 (ESTABLISHED) 2023-10-19T08:46:23.505 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu 5u unix 0xffff95749821ea40 0t0 23192 type=STREAM (CONNECTED) 2023-10-19T08:46:23.506 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu 6u unix 0xffff95749821d940 0t0 23163 type=STREAM (CONNECTED) 2023-10-19T08:46:23.506 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu 7w FIFO 0,24 0t0 1234 /run/systemd/sessions/3.ref 2023-10-19T08:46:23.506 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu 12r FIFO 0,13 0t0 23337 pipe 2023-10-19T08:46:23.506 INFO:teuthology.orchestra.run.smithi079.stdout:sshd 4287 ubuntu 14r FIFO 0,13 0t0 23338 pipe 2023-10-19T08:46:23.507 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2023-10-19T08:46:23.507 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.507 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu txt REG 8,1 36312 10086 /usr/bin/sleep 2023-10-19T08:46:23.507 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-19T08:46:23.508 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.508 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:23.508 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-19T08:46:23.509 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-19T08:46:23.509 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-19T08:46:23.509 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.509 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-19T08:46:23.510 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-19T08:46:23.510 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-19T08:46:23.510 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-19T08:46:23.510 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-19T08:46:23.511 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-19T08:46:23.511 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.511 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-19T08:46:23.512 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu 0r FIFO 0,13 0t0 21310 pipe 2023-10-19T08:46:23.512 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu 1w FIFO 0,13 0t0 21311 pipe 2023-10-19T08:46:23.512 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 4996 ubuntu 2w FIFO 0,13 0t0 21312 pipe 2023-10-19T08:46:23.512 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu cwd DIR 8,1 4096 1026 /home/ubuntu 2023-10-19T08:46:23.513 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.513 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu txt REG 8,1 1388920 9667 /usr/bin/bash 2023-10-19T08:46:23.513 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-19T08:46:23.514 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.514 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:23.514 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-19T08:46:23.515 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-19T08:46:23.515 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-19T08:46:23.515 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.515 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu mem REG 8,1 195080 9664 /usr/lib64/libtinfo.so.6.2 2023-10-19T08:46:23.516 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-19T08:46:23.516 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-19T08:46:23.516 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-19T08:46:23.517 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-19T08:46:23.517 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-19T08:46:23.517 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-19T08:46:23.517 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.518 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-19T08:46:23.518 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu 0r FIFO 0,13 0t0 23336 pipe 2023-10-19T08:46:23.518 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu 1w FIFO 0,13 0t0 23337 pipe 2023-10-19T08:46:23.519 INFO:teuthology.orchestra.run.smithi079.stdout:bash 5168 ubuntu 2w FIFO 0,13 0t0 23338 pipe 2023-10-19T08:46:23.519 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-10-19T08:46:23.519 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.519 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root txt REG 8,1 185296 11759 /usr/bin/sudo 2023-10-19T08:46:23.520 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 357408 10120 /usr/lib64/libnss_systemd.so.2 2023-10-19T08:46:23.520 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 44784 9785 /usr/lib64/libffi.so.8.1.0 2023-10-19T08:46:23.520 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 108136 13107 /usr/lib64/libgcc_s-11-20230605.so.1 2023-10-19T08:46:23.521 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 1293840 9789 /usr/lib64/libp11-kit.so.0.3.0 2023-10-19T08:46:23.521 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 36296 9702 /usr/lib64/libcap.so.2.48 2023-10-19T08:46:23.521 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 19600 10967 /usr/lib64/libpam_misc.so.0.82.1 2023-10-19T08:46:23.521 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 19400 32305 /usr/lib64/security/pam_succeed_if.so 2023-10-19T08:46:23.522 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 514280 32422 /usr/lib64/security/pam_systemd.so 2023-10-19T08:46:23.522 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 27536 32284 /usr/lib64/security/pam_limits.so 2023-10-19T08:46:23.522 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 48392 10228 /usr/lib64/libcrack.so.2.9.0 2023-10-19T08:46:23.523 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 32608 10961 /usr/lib64/libpwquality.so.1.0.2 2023-10-19T08:46:23.523 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 15352 32282 /usr/lib64/security/pam_keyinit.so 2023-10-19T08:46:23.523 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 15840 32264 /usr/lib64/security/pam_pwquality.so 2023-10-19T08:46:23.523 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 14928 32270 /usr/lib64/security/pam_deny.so 2023-10-19T08:46:23.524 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 56712 32310 /usr/lib64/security/pam_unix.so 2023-10-19T08:46:23.524 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 15184 32274 /usr/lib64/security/pam_faildelay.so 2023-10-19T08:46:23.524 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:23.525 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:23.525 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:23.525 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 201808 9696 /usr/lib64/libcrypt.so.2.0.0 2023-10-19T08:46:23.525 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.526 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:23.526 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:23.526 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:23.526 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 688208 10009 /usr/lib64/libssl.so.3.0.7 2023-10-19T08:46:23.527 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 128416 11415 /usr/lib64/libsasl2.so.3.0.0 2023-10-19T08:46:23.527 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 904672 9627 /usr/lib64/libm.so.6 2023-10-19T08:46:23.527 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-19T08:46:23.528 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:23.528 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 366424 10411 /usr/lib64/libevent-2.1.so.7.0.1 2023-10-19T08:46:23.528 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 40424 10956 /usr/lib64/libeconf.so.0.4.1 2023-10-19T08:46:23.528 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.529 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 70400 11419 /usr/lib64/liblber.so.2.0.200 2023-10-19T08:46:23.529 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 417792 11423 /usr/lib64/libldap_r.so.2.0.200 2023-10-19T08:46:23.529 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 472568 54513 /usr/libexec/sudo/sudoers.so 2023-10-19T08:46:23.530 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.530 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 69472 10965 /usr/lib64/libpam.so.0.85.1 2023-10-19T08:46:23.530 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 19464 32272 /usr/lib64/security/pam_env.so 2023-10-19T08:46:23.531 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:23.531 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-19T08:46:23.531 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-19T08:46:23.531 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-19T08:46:23.532 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.532 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.532 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 32528 9723 /usr/lib64/libcap-ng.so.0.0.0 2023-10-19T08:46:23.533 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 119832 54509 /usr/libexec/sudo/libsudo_util.so.0.0.0 2023-10-19T08:46:23.533 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.533 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 134624 9727 /usr/lib64/libaudit.so.1.0.0 2023-10-19T08:46:23.534 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-19T08:46:23.534 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-19T08:46:23.534 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-19T08:46:23.534 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-19T08:46:23.535 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-19T08:46:23.535 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-19T08:46:23.535 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.536 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-19T08:46:23.536 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root 0r FIFO 0,13 0t0 23336 pipe 2023-10-19T08:46:23.537 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root 1w FIFO 0,13 0t0 23337 pipe 2023-10-19T08:46:23.537 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root 2w FIFO 0,13 0t0 23338 pipe 2023-10-19T08:46:23.537 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root 3r FIFO 0,13 0t0 23822 pipe 2023-10-19T08:46:23.538 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root 4w FIFO 0,13 0t0 23822 pipe 2023-10-19T08:46:23.538 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root 5u netlink 0t0 23828 AUDIT 2023-10-19T08:46:23.538 INFO:teuthology.orchestra.run.smithi079.stdout:sudo 5187 root 6u unix 0xffff957488550880 0t0 23829 type=DGRAM (CONNECTED) 2023-10-19T08:46:23.538 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root cwd DIR 8,1 4096 2 / 2023-10-19T08:46:23.539 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.539 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root txt REG 8,1 36312 10086 /usr/bin/sleep 2023-10-19T08:46:23.539 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root mem REG 8,1 2586930 17848 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-10-19T08:46:23.540 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.540 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:23.540 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root mem REG 8,1 54 17851 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-10-19T08:46:23.540 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root mem REG 8,1 3284 30787 /usr/lib/locale/en_US.utf8/LC_TIME 2023-10-19T08:46:23.541 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root mem REG 8,1 286 30784 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-10-19T08:46:23.541 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.541 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root mem REG 8,1 57 28351 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-10-19T08:46:23.542 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root mem REG 8,1 34 30837 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-10-19T08:46:23.542 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root mem REG 8,1 77 17850 /usr/lib/locale/en_US.utf8/LC_NAME 2023-10-19T08:46:23.542 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root mem REG 8,1 167 30779 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-10-19T08:46:23.542 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root mem REG 8,1 59 30786 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-10-19T08:46:23.543 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root mem REG 8,1 23 30783 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-10-19T08:46:23.543 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.543 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root mem REG 8,1 369 30782 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-10-19T08:46:23.544 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root 0r CHR 1,3 0t0 4 /dev/null 2023-10-19T08:46:23.544 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root 1w CHR 4,65 0t0 114 /dev/ttyS1 2023-10-19T08:46:23.544 INFO:teuthology.orchestra.run.smithi079.stdout:sleep 5191 root 2w CHR 4,65 0t0 114 /dev/ttyS1 2023-10-19T08:46:23.544 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-10-19T08:46:23.545 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.545 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root txt REG 8,1 179232 12343 /usr/bin/lsof 2023-10-19T08:46:23.545 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.546 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.546 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:23.546 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.546 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:23.550 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:23.550 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:23.550 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:23.551 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.551 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:23.551 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:23.551 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:23.552 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.552 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-10-19T08:46:23.553 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.553 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.554 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root 0r FIFO 0,13 0t0 23336 pipe 2023-10-19T08:46:23.554 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root 1w FIFO 0,13 0t0 23337 pipe 2023-10-19T08:46:23.554 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root 2w FIFO 0,13 0t0 23338 pipe 2023-10-19T08:46:23.555 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root 3r DIR 0,20 0 1 /proc 2023-10-19T08:46:23.555 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root 4r DIR 0,20 0 27728 /proc/5193/fd 2023-10-19T08:46:23.555 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root 5w FIFO 0,13 0t0 27733 pipe 2023-10-19T08:46:23.555 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5193 root 6r FIFO 0,13 0t0 27734 pipe 2023-10-19T08:46:23.556 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root cwd DIR 8,1 4096 1026 /home/ubuntu 2023-10-19T08:46:23.556 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root rtd DIR 8,1 4096 2 / 2023-10-19T08:46:23.556 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root txt REG 8,1 179232 12343 /usr/bin/lsof 2023-10-19T08:46:23.556 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root mem REG 8,1 4483280 10007 /usr/lib64/libcrypto.so.3.0.7 2023-10-19T08:46:23.557 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root mem REG 8,1 26988 29960 /usr/lib64/gconv/gconv-modules.cache 2023-10-19T08:46:23.557 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root mem REG 8,1 346132 30861 /usr/lib/locale/C.utf8/LC_CTYPE 2023-10-19T08:46:23.557 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root mem REG 8,1 102552 9686 /usr/lib64/libz.so.1.2.11 2023-10-19T08:46:23.557 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root mem REG 8,1 70512 9633 /usr/lib64/libresolv.so.2 2023-10-19T08:46:23.558 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root mem REG 8,1 23992 9760 /usr/lib64/libkeyutils.so.1.10 2023-10-19T08:46:23.558 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root mem REG 8,1 906256 11403 /usr/lib64/libkrb5.so.3.3 2023-10-19T08:46:23.558 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root mem REG 8,1 358448 11393 /usr/lib64/libgssapi_krb5.so.2.2 2023-10-19T08:46:23.559 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root mem REG 8,1 2387016 9624 /usr/lib64/libc.so.6 2023-10-19T08:46:23.559 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root mem REG 8,1 66192 11405 /usr/lib64/libkrb5support.so.0.1 2023-10-19T08:46:23.559 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root mem REG 8,1 24400 9711 /usr/lib64/libcom_err.so.2.1 2023-10-19T08:46:23.559 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root mem REG 8,1 98992 11397 /usr/lib64/libk5crypto.so.3.1 2023-10-19T08:46:23.560 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root mem REG 8,1 637872 9740 /usr/lib64/libpcre2-8.so.0.11.0 2023-10-19T08:46:23.560 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root mem REG 8,1 196112 11431 /usr/lib64/libtirpc.so.3.0.0 2023-10-19T08:46:23.560 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root mem REG 8,1 175552 9824 /usr/lib64/libselinux.so.1 2023-10-19T08:46:23.560 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root mem REG 8,1 844808 9620 /usr/lib64/ld-linux-x86-64.so.2 2023-10-19T08:46:23.561 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root 4r FIFO 0,13 0t0 27733 pipe 2023-10-19T08:46:23.561 INFO:teuthology.orchestra.run.smithi079.stdout:lsof 5194 root 7w FIFO 0,13 0t0 27734 pipe 2023-10-19T08:46:23.561 INFO:teuthology.orchestra.run.smithi079.stdout:USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND 2023-10-19T08:46:23.561 INFO:teuthology.orchestra.run.smithi079.stdout:root 2 0.0 0.0 0 0 ? S 08:45 0:00 [kthreadd] 2023-10-19T08:46:23.562 INFO:teuthology.orchestra.run.smithi079.stdout:root 3 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [rcu_gp] 2023-10-19T08:46:23.562 INFO:teuthology.orchestra.run.smithi079.stdout:root 4 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [rcu_par_gp] 2023-10-19T08:46:23.562 INFO:teuthology.orchestra.run.smithi079.stdout:root 5 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [slub_flushwq] 2023-10-19T08:46:23.563 INFO:teuthology.orchestra.run.smithi079.stdout:root 6 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [netns] 2023-10-19T08:46:23.563 INFO:teuthology.orchestra.run.smithi079.stdout:root 7 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/0:0-cgroup_destroy] 2023-10-19T08:46:23.563 INFO:teuthology.orchestra.run.smithi079.stdout:root 8 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kworker/0:0H-events_highpri] 2023-10-19T08:46:23.564 INFO:teuthology.orchestra.run.smithi079.stdout:root 9 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/u16:0-writeback] 2023-10-19T08:46:23.564 INFO:teuthology.orchestra.run.smithi079.stdout:root 10 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [mm_percpu_wq] 2023-10-19T08:46:23.564 INFO:teuthology.orchestra.run.smithi079.stdout:root 11 1.1 0.0 0 0 ? I 08:45 0:00 \_ [kworker/u16:1-flush-8:0] 2023-10-19T08:46:23.565 INFO:teuthology.orchestra.run.smithi079.stdout:root 12 0.0 0.0 0 0 ? I 08:45 0:00 \_ [rcu_tasks_kthre] 2023-10-19T08:46:23.565 INFO:teuthology.orchestra.run.smithi079.stdout:root 13 0.0 0.0 0 0 ? I 08:45 0:00 \_ [rcu_tasks_rude_] 2023-10-19T08:46:23.565 INFO:teuthology.orchestra.run.smithi079.stdout:root 14 0.0 0.0 0 0 ? I 08:45 0:00 \_ [rcu_tasks_trace] 2023-10-19T08:46:23.566 INFO:teuthology.orchestra.run.smithi079.stdout:root 15 0.0 0.0 0 0 ? S 08:45 0:00 \_ [ksoftirqd/0] 2023-10-19T08:46:23.566 INFO:teuthology.orchestra.run.smithi079.stdout:root 16 14.6 0.0 0 0 ? S 08:45 0:04 \_ [pr/ttyS1] 2023-10-19T08:46:23.566 INFO:teuthology.orchestra.run.smithi079.stdout:root 17 0.0 0.0 0 0 ? I 08:45 0:00 \_ [rcu_preempt] 2023-10-19T08:46:23.567 INFO:teuthology.orchestra.run.smithi079.stdout:root 18 0.0 0.0 0 0 ? S 08:45 0:00 \_ [migration/0] 2023-10-19T08:46:23.567 INFO:teuthology.orchestra.run.smithi079.stdout:root 19 0.0 0.0 0 0 ? S 08:45 0:00 \_ [idle_inject/0] 2023-10-19T08:46:23.567 INFO:teuthology.orchestra.run.smithi079.stdout:root 20 0.1 0.0 0 0 ? I 08:45 0:00 \_ [kworker/0:1-events] 2023-10-19T08:46:23.567 INFO:teuthology.orchestra.run.smithi079.stdout:root 21 0.0 0.0 0 0 ? S 08:45 0:00 \_ [cpuhp/0] 2023-10-19T08:46:23.568 INFO:teuthology.orchestra.run.smithi079.stdout:root 22 0.0 0.0 0 0 ? S 08:45 0:00 \_ [cpuhp/1] 2023-10-19T08:46:23.568 INFO:teuthology.orchestra.run.smithi079.stdout:root 23 0.0 0.0 0 0 ? S 08:45 0:00 \_ [idle_inject/1] 2023-10-19T08:46:23.568 INFO:teuthology.orchestra.run.smithi079.stdout:root 24 0.7 0.0 0 0 ? S 08:45 0:00 \_ [migration/1] 2023-10-19T08:46:23.569 INFO:teuthology.orchestra.run.smithi079.stdout:root 25 0.0 0.0 0 0 ? S 08:45 0:00 \_ [ksoftirqd/1] 2023-10-19T08:46:23.569 INFO:teuthology.orchestra.run.smithi079.stdout:root 26 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/1:0-events] 2023-10-19T08:46:23.569 INFO:teuthology.orchestra.run.smithi079.stdout:root 27 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kworker/1:0H-events_highpri] 2023-10-19T08:46:23.569 INFO:teuthology.orchestra.run.smithi079.stdout:root 28 0.0 0.0 0 0 ? S 08:45 0:00 \_ [cpuhp/2] 2023-10-19T08:46:23.570 INFO:teuthology.orchestra.run.smithi079.stdout:root 29 0.0 0.0 0 0 ? S 08:45 0:00 \_ [idle_inject/2] 2023-10-19T08:46:23.570 INFO:teuthology.orchestra.run.smithi079.stdout:root 30 0.7 0.0 0 0 ? S 08:45 0:00 \_ [migration/2] 2023-10-19T08:46:23.570 INFO:teuthology.orchestra.run.smithi079.stdout:root 31 0.0 0.0 0 0 ? S 08:45 0:00 \_ [ksoftirqd/2] 2023-10-19T08:46:23.571 INFO:teuthology.orchestra.run.smithi079.stdout:root 32 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/2:0-events] 2023-10-19T08:46:23.571 INFO:teuthology.orchestra.run.smithi079.stdout:root 33 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kworker/2:0H-events_highpri] 2023-10-19T08:46:23.571 INFO:teuthology.orchestra.run.smithi079.stdout:root 34 0.0 0.0 0 0 ? S 08:45 0:00 \_ [cpuhp/3] 2023-10-19T08:46:23.571 INFO:teuthology.orchestra.run.smithi079.stdout:root 35 0.0 0.0 0 0 ? S 08:45 0:00 \_ [idle_inject/3] 2023-10-19T08:46:23.572 INFO:teuthology.orchestra.run.smithi079.stdout:root 36 0.7 0.0 0 0 ? S 08:45 0:00 \_ [migration/3] 2023-10-19T08:46:23.572 INFO:teuthology.orchestra.run.smithi079.stdout:root 37 0.0 0.0 0 0 ? S 08:45 0:00 \_ [ksoftirqd/3] 2023-10-19T08:46:23.572 INFO:teuthology.orchestra.run.smithi079.stdout:root 38 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/3:0-events] 2023-10-19T08:46:23.573 INFO:teuthology.orchestra.run.smithi079.stdout:root 39 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kworker/3:0H-events_highpri] 2023-10-19T08:46:23.573 INFO:teuthology.orchestra.run.smithi079.stdout:root 40 0.0 0.0 0 0 ? S 08:45 0:00 \_ [cpuhp/4] 2023-10-19T08:46:23.573 INFO:teuthology.orchestra.run.smithi079.stdout:root 41 0.0 0.0 0 0 ? S 08:45 0:00 \_ [idle_inject/4] 2023-10-19T08:46:23.573 INFO:teuthology.orchestra.run.smithi079.stdout:root 42 0.7 0.0 0 0 ? S 08:45 0:00 \_ [migration/4] 2023-10-19T08:46:23.574 INFO:teuthology.orchestra.run.smithi079.stdout:root 43 0.0 0.0 0 0 ? S 08:45 0:00 \_ [ksoftirqd/4] 2023-10-19T08:46:23.574 INFO:teuthology.orchestra.run.smithi079.stdout:root 44 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/4:0-events] 2023-10-19T08:46:23.574 INFO:teuthology.orchestra.run.smithi079.stdout:root 45 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kworker/4:0H-events_highpri] 2023-10-19T08:46:23.575 INFO:teuthology.orchestra.run.smithi079.stdout:root 46 0.0 0.0 0 0 ? S 08:45 0:00 \_ [cpuhp/5] 2023-10-19T08:46:23.575 INFO:teuthology.orchestra.run.smithi079.stdout:root 47 0.0 0.0 0 0 ? S 08:45 0:00 \_ [idle_inject/5] 2023-10-19T08:46:23.575 INFO:teuthology.orchestra.run.smithi079.stdout:root 48 0.7 0.0 0 0 ? S 08:45 0:00 \_ [migration/5] 2023-10-19T08:46:23.575 INFO:teuthology.orchestra.run.smithi079.stdout:root 49 0.0 0.0 0 0 ? S 08:45 0:00 \_ [ksoftirqd/5] 2023-10-19T08:46:23.576 INFO:teuthology.orchestra.run.smithi079.stdout:root 50 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/5:0-events] 2023-10-19T08:46:23.576 INFO:teuthology.orchestra.run.smithi079.stdout:root 51 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kworker/5:0H-events_highpri] 2023-10-19T08:46:23.576 INFO:teuthology.orchestra.run.smithi079.stdout:root 52 0.0 0.0 0 0 ? S 08:45 0:00 \_ [cpuhp/6] 2023-10-19T08:46:23.576 INFO:teuthology.orchestra.run.smithi079.stdout:root 53 0.0 0.0 0 0 ? S 08:45 0:00 \_ [idle_inject/6] 2023-10-19T08:46:23.577 INFO:teuthology.orchestra.run.smithi079.stdout:root 54 0.8 0.0 0 0 ? S 08:45 0:00 \_ [migration/6] 2023-10-19T08:46:23.577 INFO:teuthology.orchestra.run.smithi079.stdout:root 55 0.0 0.0 0 0 ? S 08:45 0:00 \_ [ksoftirqd/6] 2023-10-19T08:46:23.577 INFO:teuthology.orchestra.run.smithi079.stdout:root 56 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/6:0-events] 2023-10-19T08:46:23.577 INFO:teuthology.orchestra.run.smithi079.stdout:root 57 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kworker/6:0H-events_highpri] 2023-10-19T08:46:23.578 INFO:teuthology.orchestra.run.smithi079.stdout:root 58 0.0 0.0 0 0 ? S 08:45 0:00 \_ [cpuhp/7] 2023-10-19T08:46:23.578 INFO:teuthology.orchestra.run.smithi079.stdout:root 59 0.0 0.0 0 0 ? S 08:45 0:00 \_ [idle_inject/7] 2023-10-19T08:46:23.578 INFO:teuthology.orchestra.run.smithi079.stdout:root 60 0.8 0.0 0 0 ? S 08:45 0:00 \_ [migration/7] 2023-10-19T08:46:23.579 INFO:teuthology.orchestra.run.smithi079.stdout:root 61 0.0 0.0 0 0 ? S 08:45 0:00 \_ [ksoftirqd/7] 2023-10-19T08:46:23.579 INFO:teuthology.orchestra.run.smithi079.stdout:root 62 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/7:0-cgroup_destroy] 2023-10-19T08:46:23.579 INFO:teuthology.orchestra.run.smithi079.stdout:root 63 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kworker/7:0H-events_highpri] 2023-10-19T08:46:23.579 INFO:teuthology.orchestra.run.smithi079.stdout:root 65 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/u16:2-flush-8:0] 2023-10-19T08:46:23.580 INFO:teuthology.orchestra.run.smithi079.stdout:root 66 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/u16:3-flush-8:0] 2023-10-19T08:46:23.580 INFO:teuthology.orchestra.run.smithi079.stdout:root 67 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/u16:4-flush-8:0] 2023-10-19T08:46:23.581 INFO:teuthology.orchestra.run.smithi079.stdout:root 68 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/u16:5-flush-8:0] 2023-10-19T08:46:23.581 INFO:teuthology.orchestra.run.smithi079.stdout:root 69 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/u16:6-flush-8:0] 2023-10-19T08:46:23.582 INFO:teuthology.orchestra.run.smithi079.stdout:root 70 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/u16:7-ext4-rsv-conversion] 2023-10-19T08:46:23.582 INFO:teuthology.orchestra.run.smithi079.stdout:root 71 0.0 0.0 0 0 ? S 08:45 0:00 \_ [kdevtmpfs] 2023-10-19T08:46:23.583 INFO:teuthology.orchestra.run.smithi079.stdout:root 72 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [inet_frag_wq] 2023-10-19T08:46:23.583 INFO:teuthology.orchestra.run.smithi079.stdout:root 73 0.0 0.0 0 0 ? S 08:45 0:00 \_ [kauditd] 2023-10-19T08:46:23.584 INFO:teuthology.orchestra.run.smithi079.stdout:root 74 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/4:1-cgroup_destroy] 2023-10-19T08:46:23.584 INFO:teuthology.orchestra.run.smithi079.stdout:root 75 0.0 0.0 0 0 ? S 08:45 0:00 \_ [khungtaskd] 2023-10-19T08:46:23.585 INFO:teuthology.orchestra.run.smithi079.stdout:root 76 0.0 0.0 0 0 ? S 08:45 0:00 \_ [oom_reaper] 2023-10-19T08:46:23.585 INFO:teuthology.orchestra.run.smithi079.stdout:root 77 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [writeback] 2023-10-19T08:46:23.585 INFO:teuthology.orchestra.run.smithi079.stdout:root 78 0.0 0.0 0 0 ? S 08:45 0:00 \_ [kcompactd0] 2023-10-19T08:46:23.586 INFO:teuthology.orchestra.run.smithi079.stdout:root 79 0.0 0.0 0 0 ? SN 08:45 0:00 \_ [ksmd] 2023-10-19T08:46:23.586 INFO:teuthology.orchestra.run.smithi079.stdout:root 80 0.0 0.0 0 0 ? SN 08:45 0:00 \_ [khugepaged] 2023-10-19T08:46:23.587 INFO:teuthology.orchestra.run.smithi079.stdout:root 81 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [cryptd] 2023-10-19T08:46:23.587 INFO:teuthology.orchestra.run.smithi079.stdout:root 82 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kintegrityd] 2023-10-19T08:46:23.588 INFO:teuthology.orchestra.run.smithi079.stdout:root 83 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kblockd] 2023-10-19T08:46:23.588 INFO:teuthology.orchestra.run.smithi079.stdout:root 84 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [blkcg_punt_bio] 2023-10-19T08:46:23.589 INFO:teuthology.orchestra.run.smithi079.stdout:root 85 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [tpm_dev_wq] 2023-10-19T08:46:23.589 INFO:teuthology.orchestra.run.smithi079.stdout:root 86 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [md] 2023-10-19T08:46:23.590 INFO:teuthology.orchestra.run.smithi079.stdout:root 87 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [edac-poller] 2023-10-19T08:46:23.590 INFO:teuthology.orchestra.run.smithi079.stdout:root 88 0.0 0.0 0 0 ? S 08:45 0:00 \_ [watchdogd] 2023-10-19T08:46:23.591 INFO:teuthology.orchestra.run.smithi079.stdout:root 89 0.1 0.0 0 0 ? I 08:45 0:00 \_ [kworker/6:1-events] 2023-10-19T08:46:23.591 INFO:teuthology.orchestra.run.smithi079.stdout:root 90 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kworker/6:1H-kblockd] 2023-10-19T08:46:23.591 INFO:teuthology.orchestra.run.smithi079.stdout:root 91 0.0 0.0 0 0 ? S 08:45 0:00 \_ [kswapd0] 2023-10-19T08:46:23.591 INFO:teuthology.orchestra.run.smithi079.stdout:root 92 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/5:1-events] 2023-10-19T08:46:23.592 INFO:teuthology.orchestra.run.smithi079.stdout:root 94 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/7:1-events] 2023-10-19T08:46:23.592 INFO:teuthology.orchestra.run.smithi079.stdout:root 98 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kthrotld] 2023-10-19T08:46:23.592 INFO:teuthology.orchestra.run.smithi079.stdout:root 99 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/3:1-events] 2023-10-19T08:46:23.592 INFO:teuthology.orchestra.run.smithi079.stdout:root 100 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/3:2-events] 2023-10-19T08:46:23.593 INFO:teuthology.orchestra.run.smithi079.stdout:root 103 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/5:2-cgroup_destroy] 2023-10-19T08:46:23.593 INFO:teuthology.orchestra.run.smithi079.stdout:root 104 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/5:3] 2023-10-19T08:46:23.593 INFO:teuthology.orchestra.run.smithi079.stdout:root 106 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/1:1-mm_percpu_wq] 2023-10-19T08:46:23.594 INFO:teuthology.orchestra.run.smithi079.stdout:root 107 0.1 0.0 0 0 ? I 08:45 0:00 \_ [kworker/2:1-events] 2023-10-19T08:46:23.594 INFO:teuthology.orchestra.run.smithi079.stdout:root 108 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [acpi_thermal_pm] 2023-10-19T08:46:23.594 INFO:teuthology.orchestra.run.smithi079.stdout:root 109 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kmpath_rdacd] 2023-10-19T08:46:23.595 INFO:teuthology.orchestra.run.smithi079.stdout:root 110 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kaluad] 2023-10-19T08:46:23.595 INFO:teuthology.orchestra.run.smithi079.stdout:root 111 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [mld] 2023-10-19T08:46:23.595 INFO:teuthology.orchestra.run.smithi079.stdout:root 112 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kworker/3:1H-kblockd] 2023-10-19T08:46:23.596 INFO:teuthology.orchestra.run.smithi079.stdout:root 113 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [ipv6_addrconf] 2023-10-19T08:46:23.596 INFO:teuthology.orchestra.run.smithi079.stdout:root 122 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kstrp] 2023-10-19T08:46:23.596 INFO:teuthology.orchestra.run.smithi079.stdout:root 130 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/1:2-events] 2023-10-19T08:46:23.596 INFO:teuthology.orchestra.run.smithi079.stdout:root 131 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/6:2-cgroup_destroy] 2023-10-19T08:46:23.597 INFO:teuthology.orchestra.run.smithi079.stdout:root 136 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [zswap-shrink] 2023-10-19T08:46:23.597 INFO:teuthology.orchestra.run.smithi079.stdout:root 247 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/3:3-pm] 2023-10-19T08:46:23.597 INFO:teuthology.orchestra.run.smithi079.stdout:root 251 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kworker/u17:0] 2023-10-19T08:46:23.597 INFO:teuthology.orchestra.run.smithi079.stdout:root 301 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kworker/2:1H-kblockd] 2023-10-19T08:46:23.598 INFO:teuthology.orchestra.run.smithi079.stdout:root 306 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kworker/0:1H-kblockd] 2023-10-19T08:46:23.598 INFO:teuthology.orchestra.run.smithi079.stdout:root 384 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/0:2-rcu_gp] 2023-10-19T08:46:23.598 INFO:teuthology.orchestra.run.smithi079.stdout:root 385 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kworker/4:1H-kblockd] 2023-10-19T08:46:23.599 INFO:teuthology.orchestra.run.smithi079.stdout:root 387 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kworker/5:1H-kblockd] 2023-10-19T08:46:23.599 INFO:teuthology.orchestra.run.smithi079.stdout:root 388 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/4:2-cgroup_destroy] 2023-10-19T08:46:23.599 INFO:teuthology.orchestra.run.smithi079.stdout:root 421 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kworker/1:1H-kblockd] 2023-10-19T08:46:23.600 INFO:teuthology.orchestra.run.smithi079.stdout:root 449 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [nvme-wq] 2023-10-19T08:46:23.600 INFO:teuthology.orchestra.run.smithi079.stdout:root 451 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [ata_sff] 2023-10-19T08:46:23.600 INFO:teuthology.orchestra.run.smithi079.stdout:root 452 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [nvme-reset-wq] 2023-10-19T08:46:23.600 INFO:teuthology.orchestra.run.smithi079.stdout:root 453 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [nvme-delete-wq] 2023-10-19T08:46:23.601 INFO:teuthology.orchestra.run.smithi079.stdout:root 454 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [nvme-auth-wq] 2023-10-19T08:46:23.601 INFO:teuthology.orchestra.run.smithi079.stdout:root 457 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [ixgbe] 2023-10-19T08:46:23.601 INFO:teuthology.orchestra.run.smithi079.stdout:root 460 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [kworker/7:1H-kblockd] 2023-10-19T08:46:23.601 INFO:teuthology.orchestra.run.smithi079.stdout:root 461 0.0 0.0 0 0 ? S 08:45 0:00 \_ [scsi_eh_0] 2023-10-19T08:46:23.602 INFO:teuthology.orchestra.run.smithi079.stdout:root 462 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [scsi_tmf_0] 2023-10-19T08:46:23.602 INFO:teuthology.orchestra.run.smithi079.stdout:root 463 0.0 0.0 0 0 ? S 08:45 0:00 \_ [scsi_eh_1] 2023-10-19T08:46:23.602 INFO:teuthology.orchestra.run.smithi079.stdout:root 464 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [scsi_tmf_1] 2023-10-19T08:46:23.603 INFO:teuthology.orchestra.run.smithi079.stdout:root 465 0.0 0.0 0 0 ? S 08:45 0:00 \_ [scsi_eh_2] 2023-10-19T08:46:23.603 INFO:teuthology.orchestra.run.smithi079.stdout:root 466 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [scsi_tmf_2] 2023-10-19T08:46:23.603 INFO:teuthology.orchestra.run.smithi079.stdout:root 467 0.0 0.0 0 0 ? S 08:45 0:00 \_ [scsi_eh_3] 2023-10-19T08:46:23.603 INFO:teuthology.orchestra.run.smithi079.stdout:root 468 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [scsi_tmf_3] 2023-10-19T08:46:23.604 INFO:teuthology.orchestra.run.smithi079.stdout:root 469 0.0 0.0 0 0 ? S 08:45 0:00 \_ [scsi_eh_4] 2023-10-19T08:46:23.604 INFO:teuthology.orchestra.run.smithi079.stdout:root 470 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [scsi_tmf_4] 2023-10-19T08:46:23.604 INFO:teuthology.orchestra.run.smithi079.stdout:root 471 0.0 0.0 0 0 ? S 08:45 0:00 \_ [scsi_eh_5] 2023-10-19T08:46:23.605 INFO:teuthology.orchestra.run.smithi079.stdout:root 472 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [scsi_tmf_5] 2023-10-19T08:46:23.605 INFO:teuthology.orchestra.run.smithi079.stdout:root 473 0.0 0.0 0 0 ? S 08:45 0:00 \_ [scsi_eh_6] 2023-10-19T08:46:23.605 INFO:teuthology.orchestra.run.smithi079.stdout:root 474 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [scsi_tmf_6] 2023-10-19T08:46:23.605 INFO:teuthology.orchestra.run.smithi079.stdout:root 475 0.0 0.0 0 0 ? S 08:45 0:00 \_ [scsi_eh_7] 2023-10-19T08:46:23.606 INFO:teuthology.orchestra.run.smithi079.stdout:root 476 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [scsi_tmf_7] 2023-10-19T08:46:23.606 INFO:teuthology.orchestra.run.smithi079.stdout:root 477 0.0 0.0 0 0 ? S 08:45 0:00 \_ [scsi_eh_8] 2023-10-19T08:46:23.606 INFO:teuthology.orchestra.run.smithi079.stdout:root 478 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [scsi_tmf_8] 2023-10-19T08:46:23.607 INFO:teuthology.orchestra.run.smithi079.stdout:root 479 0.0 0.0 0 0 ? S 08:45 0:00 \_ [scsi_eh_9] 2023-10-19T08:46:23.607 INFO:teuthology.orchestra.run.smithi079.stdout:root 480 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [scsi_tmf_9] 2023-10-19T08:46:23.607 INFO:teuthology.orchestra.run.smithi079.stdout:root 481 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/u16:8-flush-8:0] 2023-10-19T08:46:23.607 INFO:teuthology.orchestra.run.smithi079.stdout:root 482 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/u16:9-flush-8:0] 2023-10-19T08:46:23.608 INFO:teuthology.orchestra.run.smithi079.stdout:root 483 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/u16:10-events_unbound] 2023-10-19T08:46:23.608 INFO:teuthology.orchestra.run.smithi079.stdout:root 484 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/u16:11-events_unbound] 2023-10-19T08:46:23.608 INFO:teuthology.orchestra.run.smithi079.stdout:root 503 0.0 0.0 0 0 ? S 08:45 0:00 \_ [jbd2/sda1-8] 2023-10-19T08:46:23.608 INFO:teuthology.orchestra.run.smithi079.stdout:root 504 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [ext4-rsv-conver] 2023-10-19T08:46:23.609 INFO:teuthology.orchestra.run.smithi079.stdout:root 524 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/2:2-cgroup_destroy] 2023-10-19T08:46:23.609 INFO:teuthology.orchestra.run.smithi079.stdout:root 536 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/2:3] 2023-10-19T08:46:23.609 INFO:teuthology.orchestra.run.smithi079.stdout:root 587 0.0 0.0 0 0 ? S 08:45 0:00 \_ [ext4lazyinit] 2023-10-19T08:46:23.610 INFO:teuthology.orchestra.run.smithi079.stdout:root 650 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [ipmi-msghandler] 2023-10-19T08:46:23.610 INFO:teuthology.orchestra.run.smithi079.stdout:root 657 0.0 0.0 0 0 ? SN 08:45 0:00 \_ [kipmi0] 2023-10-19T08:46:23.610 INFO:teuthology.orchestra.run.smithi079.stdout:root 669 0.0 0.0 0 0 ? I 08:45 0:00 \_ [kworker/7:2-events] 2023-10-19T08:46:23.610 INFO:teuthology.orchestra.run.smithi079.stdout:root 678 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [rpciod] 2023-10-19T08:46:23.611 INFO:teuthology.orchestra.run.smithi079.stdout:root 679 0.0 0.0 0 0 ? I< 08:45 0:00 \_ [xprtiod] 2023-10-19T08:46:23.611 INFO:teuthology.orchestra.run.smithi079.stdout:root 1 5.1 0.0 172616 16824 ? Ss 08:45 0:01 /usr/lib/systemd/systemd --switched-root --system --deserialize 31 2023-10-19T08:46:23.611 INFO:teuthology.orchestra.run.smithi079.stdout:root 424 0.2 0.0 7296 2444 ? S 08:45 0:00 @usr/sbin/plymouthd --mode=boot --pid-file=/run/plymouth/pid --attach-to-session 2023-10-19T08:46:23.612 INFO:teuthology.orchestra.run.smithi079.stdout:root 581 0.2 0.0 26136 11784 ? Ss 08:45 0:00 /usr/lib/systemd/systemd-journald 2023-10-19T08:46:23.612 INFO:teuthology.orchestra.run.smithi079.stdout:root 599 0.5 0.0 34620 12792 ? Ss 08:45 0:00 /usr/lib/systemd/systemd-udevd 2023-10-19T08:46:23.612 INFO:teuthology.orchestra.run.smithi079.stdout:rpc 673 0.0 0.0 13244 5664 ? Ss 08:45 0:00 /usr/bin/rpcbind -w -f 2023-10-19T08:46:23.612 INFO:teuthology.orchestra.run.smithi079.stdout:root 698 0.0 0.0 91824 4508 ? S sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-19T08:46:23.626 DEBUG:teuthology.orchestra.run.smithi089:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-19T08:46:23.656 INFO:teuthology.orchestra.run.smithi089.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-19T08:46:23.659 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-19T08:46:23.664 INFO:tasks.ceph:Archiving crash dumps... 2023-10-19T08:46:23.667 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-10-19_08:18:21-fs:functional-wip-63105-distro-default-smithi/7432255/remote/smithi079/crash 2023-10-19T08:46:23.668 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-19T08:46:23.750 INFO:teuthology.orchestra.run.smithi079.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2023-10-19T08:46:23.750 INFO:teuthology.orchestra.run.smithi079.stderr:tar: Error is not recoverable: exiting now 2023-10-19T08:46:23.752 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-10-19_08:18:21-fs:functional-wip-63105-distro-default-smithi/7432255/remote/smithi089/crash 2023-10-19T08:46:23.754 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-19T08:46:23.828 INFO:teuthology.orchestra.run.smithi089.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2023-10-19T08:46:23.829 INFO:teuthology.orchestra.run.smithi089.stderr:tar: Error is not recoverable: exiting now 2023-10-19T08:46:23.830 INFO:tasks.ceph:Shutting down logrotate 2023-10-19T08:46:23.831 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 183, in invoke_logrotate procs = ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi079 2023-10-19T08:46:23.849 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-19T08:46:23.860 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 183, in invoke_logrotate procs = ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi079 2023-10-19T08:46:23.867 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-19T08:46:23.868 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-19T08:46:23.875 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-19T08:46:23.951 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-19T08:46:23.959 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-19T08:46:23.960 DEBUG:teuthology.orchestra.run.smithi079:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-19T08:46:23.963 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-19T08:46:23.975 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: ntpq: command not found 2023-10-19T08:46:23.976 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2023-10-19T08:46:23.978 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-19T08:46:23.979 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2023-10-19T08:46:23.980 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-19T08:46:23.980 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2023-10-19T08:46:23.981 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-19T08:46:23.990 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-19T08:46:23.991 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-19T08:46:24.021 DEBUG:teuthology.orchestra.run.smithi079:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-19T08:46:24.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T08:46:24.038 INFO:teuthology.orchestra.run.smithi079.stderr:mkdir: cannot create directory ‘/home/ubuntu/cephtest/archive/audit’: No such file or directory 2023-10-19T08:46:24.038 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/task/selinux.py", line 165, in teardown self.archive_log() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/task/selinux.py", line 195, in archive_log self.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log' 2023-10-19T08:46:24.045 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-19T08:46:24.069 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-19T08:46:24.107 INFO:teuthology.task.internal:Duration was 1233.103735 seconds 2023-10-19T08:46:24.108 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-19T08:46:24.192 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-19T08:46:24.192 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-19T08:46:24.198 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-19T08:46:24.245 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-19T08:46:24.259 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-19T08:46:24.749 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-19T08:46:24.749 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi079.front.sepia.ceph.com 2023-10-19T08:46:24.750 DEBUG:teuthology.orchestra.run.smithi079:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-19T08:46:24.768 INFO:teuthology.orchestra.run.smithi079.stderr:grep: /home/ubuntu/cephtest/archive/syslog/kern.log: No such file or directory 2023-10-19T08:46:24.771 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2023-10-19T08:46:24.771 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-19T08:46:24.796 INFO:teuthology.orchestra.run.smithi089.stderr:grep: /home/ubuntu/cephtest/archive/syslog/kern.log: No such file or directory 2023-10-19T08:46:24.797 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-19T08:46:24.798 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-19T08:46:24.814 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-19T08:46:24.826 INFO:teuthology.orchestra.run.smithi079.stderr:find: ‘/home/ubuntu/cephtest/archive/syslog’: No such file or directory 2023-10-19T08:46:24.862 INFO:teuthology.orchestra.run.smithi089.stderr:find: ‘/home/ubuntu/cephtest/archive/syslog’: No such file or directory 2023-10-19T08:46:24.864 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-19T08:46:24.865 DEBUG:teuthology.orchestra.run.smithi079:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-19T08:46:24.883 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-19T08:46:24.895 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz: No such file or directory 2023-10-19T08:46:24.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T08:46:24.912 ERROR:teuthology.run_tasks:Manager failed: internal.syslog Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/task/internal/syslog.py", line 76, in syslog yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 183, in invoke_logrotate procs = ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi079 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/task/internal/syslog.py", line 185, in syslog run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz' 2023-10-19T08:46:24.933 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-19T08:46:24.944 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-19T08:46:24.945 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-19T08:46:24.952 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz: No such file or directory 2023-10-19T08:46:24.978 INFO:teuthology.orchestra.run.smithi079.stderr:mv: cannot stat '/etc/sudoers.orig.teuthology': No such file or directory 2023-10-19T08:46:24.979 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T08:46:24.980 ERROR:teuthology.run_tasks:Manager failed: internal.sudo Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/task/internal/__init__.py", line 452, in sudo yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 183, in invoke_logrotate procs = ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi079 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/task/internal/__init__.py", line 455, in sudo ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers' 2023-10-19T08:46:25.000 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-19T08:46:25.094 DEBUG:teuthology.orchestra.run.smithi079:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-19T08:46:25.103 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-19T08:46:25.133 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2023-10-19T08:46:25.139 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = core 2023-10-19T08:46:25.147 INFO:teuthology.orchestra.run.smithi089.stderr:find: ‘/home/ubuntu/cephtest/archive/coredump’: No such file or directory 2023-10-19T08:46:25.153 INFO:teuthology.orchestra.run.smithi079.stderr:find: ‘/home/ubuntu/cephtest/archive/coredump’: No such file or directory 2023-10-19T08:46:25.159 INFO:teuthology.orchestra.run.smithi089.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/archive/coredump': No such file or directory 2023-10-19T08:46:25.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T08:46:25.162 INFO:teuthology.orchestra.run.smithi079.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/archive/coredump': No such file or directory 2023-10-19T08:46:25.162 ERROR:teuthology.run_tasks:Manager failed: internal.coredump Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/task/internal/__init__.py", line 488, in coredump yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 183, in invoke_logrotate procs = ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi079 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/task/internal/__init__.py", line 491, in coredump run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: "sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump" 2023-10-19T08:46:25.181 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-19T08:46:25.191 INFO:teuthology.task.internal:Transferring archived files... 2023-10-19T08:46:25.192 DEBUG:teuthology.misc:Transferring archived files from smithi079:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2023-10-19_08:18:21-fs:functional-wip-63105-distro-default-smithi/7432255/remote/smithi079 2023-10-19T08:46:25.193 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-19T08:46:25.228 INFO:teuthology.orchestra.run.smithi079.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2023-10-19T08:46:25.228 INFO:teuthology.orchestra.run.smithi079.stderr:tar: Error is not recoverable: exiting now 2023-10-19T08:46:25.229 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 183, in invoke_logrotate procs = ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi079 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3.8/tarfile.py", line 2318, in next tarinfo = self.tarinfo.fromtarfile(self) File "/usr/lib/python3.8/tarfile.py", line 1105, in fromtarfile obj = cls.frombuf(buf, tarfile.encoding, tarfile.errors) File "/usr/lib/python3.8/tarfile.py", line 1041, in frombuf raise EmptyHeaderError("empty header") tarfile.EmptyHeaderError: empty header During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/task/internal/__init__.py", line 418, in archive misc.pull_directory(rem, archive_dir, path, maybe_compress) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/misc.py", line 749, in pull_directory tar = tarfile.open(mode='r|', fileobj=r.stdout) File "/usr/lib/python3.8/tarfile.py", line 1633, in open t = cls(name, filemode, stream, **kwargs) File "/usr/lib/python3.8/tarfile.py", line 1514, in __init__ self.firstmember = self.next() File "/usr/lib/python3.8/tarfile.py", line 2333, in next raise ReadError("empty file") tarfile.ReadError: empty file 2023-10-19T08:46:25.252 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-19T08:46:25.263 INFO:teuthology.task.internal:Not uploading archives. 2023-10-19T08:46:25.264 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-19T08:46:25.298 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-19T08:46:25.299 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-19T08:46:25.308 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-19T08:46:25.319 INFO:teuthology.orchestra.run.smithi079.stderr:find: ‘/home/ubuntu/cephtest’: No such file or directory 2023-10-19T08:46:25.320 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-19T08:46:25.321 INFO:teuthology.orchestra.run.smithi079.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': No such file or directory 2023-10-19T08:46:25.322 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_dparmar18_ceph_3183a022e354f76c22fd51e4469422a5f509200d/qa/tasks/ceph.py", line 183, in invoke_logrotate procs = ctx.cluster.run( File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in run procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/cluster.py", line 85, in procs = [remote.run(**kwargs, wait=_wait) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/remote.py", line 521, in run raise ConnectionError(f'Failed to reconnect to {self.shortname}') ConnectionError: Failed to reconnect to smithi079 During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-19T08:46:25.341 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-19T08:46:25.405 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-19T08:46:25.438 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: ConnectionError: Failed to reconnect to smithi079 2023-10-19T08:46:25.439 INFO:teuthology.nuke:Checking targets against current locks 2023-10-19T08:46:25.450 INFO:teuthology.orchestra.run.smithi089.stderr:find: ‘/home/ubuntu/cephtest’: No such file or directory 2023-10-19T08:46:25.450 INFO:teuthology.orchestra.run.smithi089.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': No such file or directory 2023-10-19T08:46:25.467 INFO:teuthology.nuke:Not nuking smithi079.front.sepia.ceph.com because description doesn't match: dparmar-2023-10-19_08:18:21-fs:functional-wip-63105-distro-default-smithi != /home/teuthworker/archive/vshankar-2023-10-19_01:21:59-fs-wip-vshankar-testing-reef-20231018.163145-testing-default-smithi/7431779 2023-10-19T08:46:25.488 INFO:teuthology.nuke:Not nuking smithi089.front.sepia.ceph.com because description doesn't match: dparmar-2023-10-19_08:18:21-fs:functional-wip-63105-distro-default-smithi != /home/teuthworker/archive/vshankar-2023-10-19_01:21:59-fs-wip-vshankar-testing-reef-20231018.163145-testing-default-smithi/7431778 2023-10-19T08:46:25.489 ERROR:teuthology.nuke:Could not nuke the following targets: targets: smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= 2023-10-19T08:46:25.498 INFO:teuthology.run:Summary data: description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-recovery} duration: 1233.1037352085114 failure_reason: 'Test failure: test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD), test_client_eviction_if_config_is_set (tasks.cephfs.test_client_recovery.TestClientOnLaggyOSD)' flavor: default owner: scheduled_dparmar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=dbe86e5a4b5a4994a822d7ac4e45d89d status: fail success: false 2023-10-19T08:46:25.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-19T08:46:25.568 INFO:teuthology.run:FAIL